Jul 05 13:16:39.226500 ip-10-0-132-227 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 05 13:16:39.226512 ip-10-0-132-227 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 05 13:16:39.226521 ip-10-0-132-227 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 05 13:16:39.226855 ip-10-0-132-227 systemd[1]: Failed to start Kubernetes Kubelet. Jul 05 13:16:49.446982 ip-10-0-132-227 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 05 13:16:49.447000 ip-10-0-132-227 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e54a9deac7164b67920cbffd665f014f -- Jul 05 13:18:43.523955 ip-10-0-132-227 systemd[1]: Starting Kubernetes Kubelet... Jul 05 13:18:43.968017 ip-10-0-132-227 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 13:18:43.968017 ip-10-0-132-227 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 05 13:18:43.968017 ip-10-0-132-227 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 13:18:43.968017 ip-10-0-132-227 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 05 13:18:43.968017 ip-10-0-132-227 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 05 13:18:43.968017 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.901188 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 05 13:18:43.968017 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904650 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 13:18:43.968017 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904663 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 13:18:43.968017 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904667 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 13:18:43.968017 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904670 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 13:18:43.968017 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904674 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 13:18:43.968017 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904677 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 13:18:43.968017 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904679 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 13:18:43.968017 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904684 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 13:18:43.968736 ip-10-0-132-227 systemd[1]: Started Kubernetes Kubelet. Jul 05 13:18:43.970564 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904687 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 13:18:43.970564 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904690 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 13:18:43.970564 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904693 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 13:18:43.970564 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904696 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 13:18:43.970564 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904698 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 13:18:43.970564 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904701 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 13:18:43.970564 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904704 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 13:18:43.970564 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904706 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 13:18:43.970564 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904709 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 13:18:43.970564 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904712 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 13:18:43.970564 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904715 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 13:18:43.970564 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904719 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 13:18:43.970564 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904722 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 13:18:43.970564 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904724 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 13:18:43.970564 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904727 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 13:18:43.970564 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904730 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 13:18:43.970564 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904734 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 13:18:43.970564 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904737 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 13:18:43.970564 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904739 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 13:18:43.970564 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904742 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 13:18:43.971685 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904745 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 13:18:43.971685 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904747 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 13:18:43.971685 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904750 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 13:18:43.971685 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904753 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 13:18:43.971685 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904755 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 13:18:43.971685 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904758 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 13:18:43.971685 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904760 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 13:18:43.971685 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904763 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 13:18:43.971685 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904765 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 13:18:43.971685 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904768 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 13:18:43.971685 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904771 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 13:18:43.971685 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904773 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 13:18:43.971685 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904775 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 13:18:43.971685 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904778 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 13:18:43.971685 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904781 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 13:18:43.971685 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904783 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 13:18:43.971685 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904786 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 13:18:43.971685 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904788 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 13:18:43.971685 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904791 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 13:18:43.971685 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904794 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 05 13:18:43.973145 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904797 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 13:18:43.973145 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904799 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 13:18:43.973145 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904802 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 13:18:43.973145 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904804 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 13:18:43.973145 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904807 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 13:18:43.973145 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904809 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 13:18:43.973145 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904812 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 13:18:43.973145 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904815 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 13:18:43.973145 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904817 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 13:18:43.973145 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904822 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 13:18:43.973145 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904825 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 13:18:43.973145 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904828 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 13:18:43.973145 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904831 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 13:18:43.973145 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904834 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 13:18:43.973145 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904836 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 13:18:43.973145 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904840 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 13:18:43.973145 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904844 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 13:18:43.973145 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904847 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 13:18:43.973145 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904850 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 13:18:43.973973 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904853 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 13:18:43.973973 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904856 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 13:18:43.973973 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904858 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 13:18:43.973973 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904861 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 13:18:43.973973 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904864 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 13:18:43.973973 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904867 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 13:18:43.973973 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904870 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 13:18:43.973973 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904872 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 13:18:43.973973 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904876 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 13:18:43.973973 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904879 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 13:18:43.973973 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904881 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 13:18:43.973973 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904884 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 13:18:43.973973 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904887 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 13:18:43.973973 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904890 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 13:18:43.973973 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904893 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 13:18:43.973973 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904896 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 13:18:43.973973 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904900 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 13:18:43.973973 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904902 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 13:18:43.973973 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904906 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 13:18:43.976089 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904910 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 13:18:43.976089 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904914 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 13:18:43.976089 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904917 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 13:18:43.976089 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904919 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 13:18:43.976089 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904922 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 13:18:43.976089 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904924 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 13:18:43.976089 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904927 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 13:18:43.976089 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904930 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 13:18:43.976089 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904932 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 13:18:43.976089 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904935 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 13:18:43.976089 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904937 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 13:18:43.976089 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904940 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 13:18:43.976089 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.904942 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 13:18:43.976089 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905652 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 13:18:43.976089 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905659 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 13:18:43.976089 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905662 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 13:18:43.976089 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905665 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 13:18:43.976089 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905668 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 13:18:43.976089 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905672 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 13:18:43.976089 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905674 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 13:18:43.977244 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905677 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 13:18:43.977244 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905680 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 13:18:43.977244 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905683 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 13:18:43.977244 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905687 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 13:18:43.977244 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905690 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 13:18:43.977244 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905692 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 13:18:43.977244 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905695 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 13:18:43.977244 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905697 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 13:18:43.977244 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905700 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 13:18:43.977244 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905703 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 13:18:43.977244 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905705 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 13:18:43.977244 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905708 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 13:18:43.977244 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905712 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 13:18:43.977244 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905716 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 13:18:43.977244 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905720 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 13:18:43.977244 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905722 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 13:18:43.977244 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905725 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 13:18:43.977244 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905728 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 13:18:43.977244 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905730 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 13:18:43.979656 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905733 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 13:18:43.979656 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905736 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 13:18:43.979656 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905739 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 13:18:43.979656 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905741 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 13:18:43.979656 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905744 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 13:18:43.979656 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905746 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 13:18:43.979656 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905749 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 13:18:43.979656 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905751 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 13:18:43.979656 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905754 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 05 13:18:43.979656 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905757 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 13:18:43.979656 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905759 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 13:18:43.979656 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905762 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 13:18:43.979656 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905764 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 13:18:43.979656 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905767 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 13:18:43.979656 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905770 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 13:18:43.979656 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905772 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 13:18:43.979656 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905775 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 13:18:43.979656 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905778 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 13:18:43.979656 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905781 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 13:18:43.980472 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905785 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 13:18:43.980472 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905789 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 13:18:43.980472 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905793 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 13:18:43.980472 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905796 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 13:18:43.980472 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905798 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 13:18:43.980472 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905801 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 13:18:43.980472 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905804 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 13:18:43.980472 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905808 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 13:18:43.980472 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905811 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 13:18:43.980472 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905814 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 13:18:43.980472 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905817 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 13:18:43.980472 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905819 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 13:18:43.980472 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905822 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 13:18:43.980472 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905824 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 13:18:43.980472 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905827 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 13:18:43.980472 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905829 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 13:18:43.980472 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905832 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 13:18:43.980472 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905836 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 13:18:43.980472 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905838 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 13:18:43.982686 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905841 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 13:18:43.982686 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905843 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 13:18:43.982686 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905846 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 13:18:43.982686 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905849 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 13:18:43.982686 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905851 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 13:18:43.982686 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905854 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 13:18:43.982686 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905857 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 13:18:43.982686 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905859 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 13:18:43.982686 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905862 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 13:18:43.982686 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905864 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 13:18:43.982686 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905868 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 13:18:43.982686 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905871 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 13:18:43.982686 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905873 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 13:18:43.982686 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905876 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 13:18:43.982686 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905879 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 13:18:43.982686 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905881 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 13:18:43.982686 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905884 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 13:18:43.982686 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905886 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 13:18:43.982686 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905889 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 13:18:43.982686 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905891 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 13:18:43.984034 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905895 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 13:18:43.984034 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905898 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 13:18:43.984034 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905902 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 13:18:43.984034 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905904 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 13:18:43.984034 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905907 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 13:18:43.984034 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905909 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 13:18:43.984034 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905912 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 13:18:43.984034 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905914 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 13:18:43.984034 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905917 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 13:18:43.984034 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905919 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 13:18:43.984034 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905922 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 13:18:43.984034 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905925 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 13:18:43.984034 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905927 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 13:18:43.984034 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905930 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 13:18:43.984034 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.905932 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 13:18:43.984034 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906312 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 13:18:43.984034 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906317 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 13:18:43.984034 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906320 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 13:18:43.984034 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906322 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 13:18:43.986980 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906325 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 13:18:43.986980 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906327 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 13:18:43.986980 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906332 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 13:18:43.986980 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906336 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 13:18:43.986980 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906346 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 13:18:43.986980 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906349 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 13:18:43.986980 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906352 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 13:18:43.986980 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906355 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 13:18:43.986980 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906357 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 13:18:43.986980 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906360 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 13:18:43.986980 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906363 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 13:18:43.986980 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906366 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 13:18:43.986980 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906368 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 13:18:43.986980 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906371 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 13:18:43.986980 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906373 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 13:18:43.986980 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906376 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 13:18:43.986980 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906379 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 13:18:43.986980 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906382 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 13:18:43.986980 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906384 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 13:18:43.988297 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906387 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 13:18:43.988297 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906390 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 13:18:43.988297 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906392 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 13:18:43.988297 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906395 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 13:18:43.988297 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906397 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 13:18:43.988297 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906400 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 13:18:43.988297 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906403 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 13:18:43.988297 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906405 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 13:18:43.988297 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906408 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 13:18:43.988297 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906410 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 13:18:43.988297 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906413 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 13:18:43.988297 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906416 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 13:18:43.988297 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906418 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 13:18:43.988297 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906421 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 13:18:43.988297 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906423 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 13:18:43.988297 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906426 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 13:18:43.988297 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906429 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 13:18:43.988297 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906431 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 13:18:43.988297 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906434 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 13:18:43.988297 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906437 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 13:18:43.991819 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906440 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 13:18:43.991819 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906442 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 13:18:43.991819 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906445 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 13:18:43.991819 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906447 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 13:18:43.991819 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906450 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 13:18:43.991819 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906452 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 13:18:43.991819 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906455 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 13:18:43.991819 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906457 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 13:18:43.991819 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906460 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 13:18:43.991819 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906463 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 13:18:43.991819 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906465 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 13:18:43.991819 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906467 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 13:18:43.991819 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906470 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 13:18:43.991819 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906472 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 13:18:43.991819 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906475 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 13:18:43.991819 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906478 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 13:18:43.991819 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906481 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 13:18:43.991819 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906483 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 13:18:43.991819 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906486 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 05 13:18:43.991819 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906488 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 13:18:43.992881 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906491 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 13:18:43.992881 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906493 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 13:18:43.992881 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906495 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 13:18:43.992881 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906498 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 13:18:43.992881 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906500 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 13:18:43.992881 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906503 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 13:18:43.992881 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906505 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 13:18:43.992881 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906508 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 13:18:43.992881 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906511 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 13:18:43.992881 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906513 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 13:18:43.992881 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906516 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 13:18:43.992881 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906525 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 13:18:43.992881 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906527 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 13:18:43.992881 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906530 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 13:18:43.992881 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906532 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 13:18:43.992881 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906535 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 13:18:43.992881 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906538 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 13:18:43.992881 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906540 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 13:18:43.992881 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906543 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 13:18:43.995428 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906548 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 13:18:43.995428 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906551 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 13:18:43.995428 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906555 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 13:18:43.995428 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906558 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 13:18:43.995428 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906561 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 13:18:43.995428 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906563 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 13:18:43.995428 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906566 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 13:18:43.995428 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906570 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 13:18:43.995428 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906574 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 13:18:43.995428 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906577 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 13:18:43.995428 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906579 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 13:18:43.995428 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906581 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 13:18:43.995428 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906584 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 13:18:43.995428 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906587 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 13:18:43.995428 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906589 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 13:18:43.995428 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906592 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 13:18:43.995428 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.906594 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 13:18:43.995428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906679 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 05 13:18:43.995428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906686 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 05 13:18:43.995428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906694 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906700 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906705 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906710 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906714 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906718 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906734 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906740 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906743 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906746 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906749 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906752 2577 flags.go:64] FLAG: --cgroup-root="" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906755 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906758 2577 flags.go:64] FLAG: --client-ca-file="" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906761 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906764 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906772 2577 flags.go:64] FLAG: --cluster-domain="" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906775 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906778 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906781 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906785 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906788 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906791 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 05 13:18:43.996256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906795 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906798 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906801 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906804 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906808 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906811 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906813 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906817 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906820 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906823 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906826 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906829 2577 flags.go:64] FLAG: --enable-server="true" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906832 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906839 2577 flags.go:64] FLAG: --event-burst="100" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906842 2577 flags.go:64] FLAG: --event-qps="50" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906845 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906850 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906853 2577 flags.go:64] FLAG: --eviction-hard="" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906857 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906860 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906863 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906866 2577 flags.go:64] FLAG: --eviction-soft="" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906869 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906872 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906874 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 05 13:18:43.998329 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906877 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906880 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906883 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906885 2577 flags.go:64] FLAG: --feature-gates="" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906889 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906892 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906895 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906900 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906903 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906906 2577 flags.go:64] FLAG: --help="false" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906909 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-132-227.ec2.internal" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906912 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906915 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906918 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906921 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906924 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906927 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906929 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906932 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906935 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906938 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906941 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906944 2577 flags.go:64] FLAG: --kube-reserved="" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906948 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 05 13:18:43.999415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906951 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906954 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906957 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906960 2577 flags.go:64] FLAG: --lock-file="" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906963 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906965 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906968 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906973 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906976 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906979 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906981 2577 flags.go:64] FLAG: --logging-format="text" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906984 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906987 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906990 2577 flags.go:64] FLAG: --manifest-url="" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906993 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.906998 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907001 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907005 2577 flags.go:64] FLAG: --max-pods="110" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907008 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907010 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907014 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907017 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907020 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907023 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907025 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 05 13:18:44.140277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907032 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907035 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907038 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907041 2577 flags.go:64] FLAG: --pod-cidr="" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907044 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907049 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907054 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907057 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907061 2577 flags.go:64] FLAG: --port="10250" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907064 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907066 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cc268678f1c1193d" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907069 2577 flags.go:64] FLAG: --qos-reserved="" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907072 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907075 2577 flags.go:64] FLAG: --register-node="true" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907078 2577 flags.go:64] FLAG: --register-with-taints="" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907081 2577 flags.go:64] FLAG: --registry-burst="10" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907084 2577 flags.go:64] FLAG: --registry-qps="5" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907087 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907090 2577 flags.go:64] FLAG: --reserved-memory="" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907093 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907096 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907099 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907102 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907107 2577 flags.go:64] FLAG: --runonce="false" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907110 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 05 13:18:44.161957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907113 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907116 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907119 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907121 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907124 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907127 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907131 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907134 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907137 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907139 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907142 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907145 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907148 2577 flags.go:64] FLAG: --system-cgroups="" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907151 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907157 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907160 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907165 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907170 2577 flags.go:64] FLAG: --tls-min-version="" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907172 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907175 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907178 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907181 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907184 2577 flags.go:64] FLAG: --v="2" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907188 2577 flags.go:64] FLAG: --version="false" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907191 2577 flags.go:64] FLAG: --vmodule="" Jul 05 13:18:44.163220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907195 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 05 13:18:44.164125 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.907198 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 05 13:18:44.164125 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907314 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 13:18:44.164125 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907318 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 13:18:44.164125 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907322 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 13:18:44.164125 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907327 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 13:18:44.164125 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907329 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 13:18:44.164125 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907332 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 13:18:44.164125 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907335 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 13:18:44.164125 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907337 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 13:18:44.164125 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907340 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 13:18:44.164125 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907342 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 13:18:44.164125 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907345 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 13:18:44.164125 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907348 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 13:18:44.164125 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907350 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 13:18:44.164125 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907353 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 13:18:44.164125 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907355 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 13:18:44.164125 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907358 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 13:18:44.164125 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907360 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 13:18:44.164125 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907363 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 13:18:44.164125 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907367 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 13:18:44.165053 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907370 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 13:18:44.165053 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907372 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 13:18:44.165053 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907375 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 13:18:44.165053 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907378 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 13:18:44.165053 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907381 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 13:18:44.165053 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907383 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 13:18:44.165053 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907386 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 13:18:44.165053 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907388 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 13:18:44.165053 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907391 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 13:18:44.165053 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907393 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 13:18:44.165053 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907396 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 13:18:44.165053 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907398 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 13:18:44.165053 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907401 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 13:18:44.165053 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907404 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 13:18:44.165053 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907406 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 13:18:44.165053 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907409 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 13:18:44.165053 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907413 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 13:18:44.165053 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907415 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 05 13:18:44.165053 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907418 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 13:18:44.165053 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907420 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 13:18:44.165792 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907423 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 13:18:44.165792 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907425 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 13:18:44.165792 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907428 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 13:18:44.165792 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907430 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 13:18:44.165792 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907433 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 13:18:44.165792 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907436 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 13:18:44.165792 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907438 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 13:18:44.165792 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907441 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 13:18:44.165792 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907443 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 13:18:44.165792 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907446 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 13:18:44.165792 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907448 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 13:18:44.165792 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907452 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 13:18:44.165792 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907454 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 13:18:44.165792 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907457 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 13:18:44.165792 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907460 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 13:18:44.165792 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907464 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 13:18:44.165792 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907469 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 13:18:44.165792 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907472 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 13:18:44.165792 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907475 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 13:18:44.166597 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907478 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 13:18:44.166597 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907480 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 13:18:44.166597 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907483 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 13:18:44.166597 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907485 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 13:18:44.166597 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907488 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 13:18:44.166597 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907491 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 13:18:44.166597 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907493 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 13:18:44.166597 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907496 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 13:18:44.166597 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907498 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 13:18:44.166597 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907502 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 13:18:44.166597 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907505 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 13:18:44.166597 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907508 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 13:18:44.166597 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907510 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 13:18:44.166597 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907512 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 13:18:44.166597 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907515 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 13:18:44.166597 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907517 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 13:18:44.166597 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907520 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 13:18:44.166597 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907522 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 13:18:44.166597 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907525 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 13:18:44.166597 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907528 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 13:18:44.167305 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907530 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 13:18:44.167305 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907533 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 13:18:44.167305 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907535 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 13:18:44.167305 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907538 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 13:18:44.167305 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907541 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 13:18:44.167305 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907544 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 13:18:44.167305 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907546 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 13:18:44.167305 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907549 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 13:18:44.167305 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907552 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 13:18:44.167305 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907554 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 13:18:44.167305 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907557 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 13:18:44.167305 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907560 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 13:18:44.167305 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907562 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 13:18:44.167305 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907565 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 13:18:44.167305 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907567 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 13:18:44.167305 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907570 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 13:18:44.167305 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907572 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 13:18:44.167305 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907575 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 13:18:44.167305 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907577 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 13:18:44.167305 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907579 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 13:18:44.168328 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.907584 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 13:18:44.168328 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.908327 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 13:18:44.168328 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.915043 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 05 13:18:44.168328 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.915058 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 05 13:18:44.168328 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.915072 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 05 13:18:44.168328 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.915077 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 05 13:18:44.168328 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915137 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 13:18:44.168328 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915142 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 13:18:44.168328 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915145 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 13:18:44.168328 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915148 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 13:18:44.168328 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915151 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 13:18:44.168328 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915154 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 13:18:44.168328 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915157 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 13:18:44.168328 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915160 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 13:18:44.169424 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915162 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 13:18:44.169424 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915165 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 13:18:44.169424 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915167 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 13:18:44.169424 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915170 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 13:18:44.169424 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915173 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 13:18:44.169424 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915177 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 13:18:44.169424 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915181 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 13:18:44.169424 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915185 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 13:18:44.169424 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915188 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 13:18:44.169424 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915191 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 13:18:44.169424 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915194 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 13:18:44.169424 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915197 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 13:18:44.169424 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915199 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 13:18:44.169424 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915202 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 13:18:44.169424 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915206 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 13:18:44.169424 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915210 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 13:18:44.169424 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915213 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 13:18:44.169424 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915231 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 13:18:44.169424 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915236 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 13:18:44.173224 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915239 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 13:18:44.173224 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915242 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 13:18:44.173224 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915246 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 13:18:44.173224 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915249 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 13:18:44.173224 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915252 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 13:18:44.173224 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915254 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 13:18:44.173224 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915257 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 13:18:44.173224 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915260 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 13:18:44.173224 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915263 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 13:18:44.173224 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915267 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 13:18:44.173224 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915270 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 13:18:44.173224 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915273 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 13:18:44.173224 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915276 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 13:18:44.173224 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915279 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 13:18:44.173224 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915282 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 13:18:44.173224 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915285 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 13:18:44.173224 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915288 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 13:18:44.173224 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915291 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 13:18:44.173224 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915293 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 13:18:44.173224 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915296 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 13:18:44.174399 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915298 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 13:18:44.174399 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915301 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 13:18:44.174399 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915306 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 13:18:44.174399 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915309 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 13:18:44.174399 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915312 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 13:18:44.174399 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915314 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 13:18:44.174399 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915318 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 13:18:44.174399 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915320 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 13:18:44.174399 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915323 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 13:18:44.174399 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915326 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 13:18:44.174399 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915328 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 13:18:44.174399 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915331 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 13:18:44.174399 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915333 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 13:18:44.174399 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915336 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 13:18:44.174399 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915340 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 13:18:44.174399 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915343 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 13:18:44.174399 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915346 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 13:18:44.174399 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915348 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 13:18:44.174399 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915351 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 13:18:44.174399 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915353 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 13:18:44.174399 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915356 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 13:18:44.175579 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915359 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 13:18:44.175579 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915363 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 13:18:44.175579 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915366 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 13:18:44.175579 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915369 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 13:18:44.175579 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915371 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 13:18:44.175579 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915374 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 13:18:44.175579 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915377 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 13:18:44.175579 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915380 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 13:18:44.175579 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915383 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 13:18:44.175579 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915385 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 13:18:44.175579 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915388 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 13:18:44.175579 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915391 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 13:18:44.175579 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915394 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 13:18:44.175579 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915396 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 13:18:44.175579 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915399 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 13:18:44.175579 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915402 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 05 13:18:44.175579 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915404 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 13:18:44.175579 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915407 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 13:18:44.175579 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915410 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 13:18:44.179307 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915413 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 13:18:44.179307 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915415 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 13:18:44.179307 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915418 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 13:18:44.179307 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915420 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 13:18:44.179307 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915423 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 13:18:44.179307 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915425 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 13:18:44.179307 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915431 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 13:18:44.179307 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915433 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 13:18:44.179307 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915436 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 13:18:44.179307 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915438 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 13:18:44.179307 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915441 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 13:18:44.179307 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915444 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 13:18:44.179307 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.915449 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 13:18:44.179307 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915553 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 05 13:18:44.179307 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915558 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 05 13:18:44.180247 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915561 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 05 13:18:44.180247 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915564 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 05 13:18:44.180247 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915567 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 05 13:18:44.180247 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915569 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 05 13:18:44.180247 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915572 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 05 13:18:44.180247 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915575 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 05 13:18:44.180247 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915578 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 05 13:18:44.180247 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915580 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 05 13:18:44.180247 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915583 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 05 13:18:44.180247 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915586 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 05 13:18:44.180247 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915588 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 05 13:18:44.180247 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915591 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 05 13:18:44.180247 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915593 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 05 13:18:44.180247 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915596 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 05 13:18:44.180247 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915599 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 05 13:18:44.180247 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915602 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 05 13:18:44.180247 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915604 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 05 13:18:44.180247 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915607 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 05 13:18:44.180247 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915610 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 05 13:18:44.180247 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915612 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 05 13:18:44.181204 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915615 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 05 13:18:44.181204 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915617 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 05 13:18:44.181204 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915620 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 05 13:18:44.181204 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915622 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 05 13:18:44.181204 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915626 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 05 13:18:44.181204 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915629 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 05 13:18:44.181204 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915632 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 05 13:18:44.181204 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915648 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 05 13:18:44.181204 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915652 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 05 13:18:44.181204 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915655 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 05 13:18:44.181204 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915657 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 05 13:18:44.181204 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915660 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 05 13:18:44.181204 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915663 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 05 13:18:44.181204 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915665 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 05 13:18:44.181204 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915668 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 05 13:18:44.181204 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915672 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 05 13:18:44.181204 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915675 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 05 13:18:44.181204 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915678 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 05 13:18:44.181204 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915681 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 05 13:18:44.265716 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915684 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 05 13:18:44.265716 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915687 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 05 13:18:44.265716 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915689 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 05 13:18:44.265716 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915692 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 05 13:18:44.265716 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915694 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 05 13:18:44.265716 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915697 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 05 13:18:44.265716 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915699 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 05 13:18:44.265716 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915705 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 05 13:18:44.265716 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915707 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 05 13:18:44.265716 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915710 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 05 13:18:44.265716 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915712 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 05 13:18:44.265716 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915715 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 05 13:18:44.265716 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915718 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 05 13:18:44.265716 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915720 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 05 13:18:44.265716 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915722 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 05 13:18:44.265716 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915725 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 05 13:18:44.265716 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915728 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 05 13:18:44.265716 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915732 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 05 13:18:44.265716 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915736 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 05 13:18:44.265716 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915739 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 05 13:18:44.266989 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915742 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 05 13:18:44.266989 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915745 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 05 13:18:44.266989 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915747 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 05 13:18:44.266989 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915750 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 05 13:18:44.266989 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915753 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 05 13:18:44.266989 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915755 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 05 13:18:44.266989 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915758 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 05 13:18:44.266989 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915761 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 05 13:18:44.266989 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915763 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 05 13:18:44.266989 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915766 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 05 13:18:44.266989 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915769 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 05 13:18:44.266989 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915771 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 05 13:18:44.266989 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915774 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 05 13:18:44.266989 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915776 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 05 13:18:44.266989 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915779 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 05 13:18:44.266989 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915781 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 05 13:18:44.266989 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915784 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 05 13:18:44.266989 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915787 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 05 13:18:44.266989 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915789 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 05 13:18:44.266989 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915793 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 05 13:18:44.269594 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915796 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 05 13:18:44.269594 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915798 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 05 13:18:44.269594 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915801 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 05 13:18:44.269594 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915803 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 05 13:18:44.269594 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915806 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 05 13:18:44.269594 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915808 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 05 13:18:44.269594 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915811 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 05 13:18:44.269594 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915814 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 05 13:18:44.269594 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915817 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 05 13:18:44.269594 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915820 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 05 13:18:44.269594 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915823 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 05 13:18:44.269594 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915825 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 05 13:18:44.269594 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915828 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 05 13:18:44.269594 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915830 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 05 13:18:44.269594 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915833 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 05 13:18:44.269594 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915835 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 05 13:18:44.269594 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915838 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 05 13:18:44.269594 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:43.915842 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 05 13:18:44.270555 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.915847 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 05 13:18:44.270555 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.915938 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 05 13:18:44.270555 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.917769 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 05 13:18:44.270555 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.918796 2577 server.go:1019] "Starting client certificate rotation" Jul 05 13:18:44.270555 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.918906 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 05 13:18:44.270555 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.918954 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 05 13:18:44.270555 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.921082 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 05 13:18:44.270555 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.925754 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 05 13:18:44.270555 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.932331 2577 log.go:25] "Validated CRI v1 runtime API" Jul 05 13:18:44.270555 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.936267 2577 log.go:25] "Validated CRI v1 image API" Jul 05 13:18:44.270555 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.937101 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 05 13:18:44.270555 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.940891 2577 fs.go:135] Filesystem UUIDs: map[353388e1-d3b9-4549-9885-b8783dd67627:/dev/nvme0n1p3 5cae867e-1536-49c6-90dc-a3d6db07cf90:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 05 13:18:44.272642 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.940909 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 05 13:18:44.273108 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.947455 2577 manager.go:216] Machine: {Timestamp:2026-07-05 13:18:43.946079811 +0000 UTC m=+0.319355860 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100128 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24bdbc33c0fb0460e09ac1430f4f89 SystemUUID:ec24bdbc-33c0-fb04-60e0-9ac1430f4f89 BootID:e54a9dea-c716-4b67-920c-bffd665f014f Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f6:6d:4a:92:e1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f6:6d:4a:92:e1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:fd:79:8c:ad:3d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 05 13:18:44.273108 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.947582 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 05 13:18:44.273108 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.947685 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 05 13:18:44.273108 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.950072 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 05 13:18:44.273108 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.950097 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-227.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 05 13:18:44.273108 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.950715 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 05 13:18:44.273108 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.950726 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 05 13:18:44.273108 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.950734 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.951241 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.952242 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.953771 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.954722 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.954828 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.954854 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.954863 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.954876 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.954886 2577 kubelet.go:398] "Adding apiserver pod source" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.954894 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.955235 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.955257 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.956989 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.958414 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.958441 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.959369 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.959382 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.959388 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.959393 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.959402 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.959407 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.959501 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.959507 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.959514 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.959523 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.959545 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.959557 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.960211 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.960222 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.967782 2577 server.go:1268] "Started kubelet" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:43.967949 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:43.967987 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-227.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.968036 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.968097 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.969199 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.967866 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-227.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.972054 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.972427 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 05 13:18:44.352617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.975918 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-swgzr" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.977693 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.977883 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:43.977980 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-227.ec2.internal\" not found" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.978396 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.978412 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.978492 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.979401 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.979413 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:43.980047 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-227.ec2.internal.18bf67451b23e29c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-227.ec2.internal,UID:ip-10-0-132-227.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-227.ec2.internal,},FirstTimestamp:2026-07-05 13:18:43.967746716 +0000 UTC m=+0.341022749,LastTimestamp:2026-07-05 13:18:43.967746716 +0000 UTC m=+0.341022749,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-227.ec2.internal,}" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.981032 2577 factory.go:55] Registering systemd factory Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.981046 2577 factory.go:223] Registration of the systemd container factory successfully Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.981287 2577 factory.go:153] Registering CRI-O factory Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.981298 2577 factory.go:223] Registration of the crio container factory successfully Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.981336 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.981357 2577 factory.go:103] Registering Raw factory Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.981367 2577 manager.go:1196] Started watching for new ooms in manager Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.981872 2577 manager.go:349] Starting recovery of all containers Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.983595 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-swgzr" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.992103 2577 manager.go:354] Recovery completed Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.992793 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:43.995424 2577 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-227.ec2.internal\" not found" node="ip-10-0-132-227.ec2.internal" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.996407 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.998628 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientMemory" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.998664 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.998678 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientPID" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.999301 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.999312 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.999321 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:43.999329 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.000092 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientMemory" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.000114 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.000126 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientPID" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.000667 2577 policy_none.go:49] "None policy: Start" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.000683 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.000697 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.001623 2577 policy_none.go:47] "Start" Jul 05 13:18:44.354750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.046618 2577 manager.go:337] "Starting Device Plugin manager" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:44.046803 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.046818 2577 server.go:87] "Starting device plugin registration server" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.047013 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.047023 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.047121 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.047211 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.047220 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:44.047602 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:44.047697 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-227.ec2.internal\" not found" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.149240 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.150238 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientMemory" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.150265 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.150275 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientPID" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.150302 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-227.ec2.internal" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.156660 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-227.ec2.internal" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:44.156678 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-227.ec2.internal\": node \"ip-10-0-132-227.ec2.internal\" not found" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:44.173933 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-227.ec2.internal\" not found" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.212968 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.228971 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.229017 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.229047 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:44.229087 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.231779 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:44.274030 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-227.ec2.internal\" not found" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.331825 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-227.ec2.internal"] Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.331888 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.332941 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientMemory" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.332970 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.332984 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientPID" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.335408 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.335541 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.335572 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.336364 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientMemory" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.336356 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientMemory" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.336390 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 13:18:44.356428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.336404 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientPID" Jul 05 13:18:44.358530 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.336392 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 13:18:44.358530 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.336476 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientPID" Jul 05 13:18:44.358530 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.338868 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-227.ec2.internal" Jul 05 13:18:44.358530 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.338893 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 05 13:18:44.358530 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.339679 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientMemory" Jul 05 13:18:44.358530 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.339697 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasNoDiskPressure" Jul 05 13:18:44.358530 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.339706 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeHasSufficientPID" Jul 05 13:18:44.374613 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:44.374594 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-227.ec2.internal\" not found" Jul 05 13:18:44.392497 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:44.392474 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-227.ec2.internal\" not found" node="ip-10-0-132-227.ec2.internal" Jul 05 13:18:44.393021 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.393003 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9501a298fc7cfb0131e8a94db23d3d5b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal\" (UID: \"9501a298fc7cfb0131e8a94db23d3d5b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" Jul 05 13:18:44.393080 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.393032 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9501a298fc7cfb0131e8a94db23d3d5b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal\" (UID: \"9501a298fc7cfb0131e8a94db23d3d5b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" Jul 05 13:18:44.393080 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.393053 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4599d8e1fbf9c314f1658bf65accfac0-config\") pod \"kube-apiserver-proxy-ip-10-0-132-227.ec2.internal\" (UID: \"4599d8e1fbf9c314f1658bf65accfac0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-227.ec2.internal" Jul 05 13:18:44.397373 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:44.397355 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-227.ec2.internal\" not found" node="ip-10-0-132-227.ec2.internal" Jul 05 13:18:44.475248 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:44.475220 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-227.ec2.internal\" not found" Jul 05 13:18:44.493771 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.493734 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9501a298fc7cfb0131e8a94db23d3d5b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal\" (UID: \"9501a298fc7cfb0131e8a94db23d3d5b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" Jul 05 13:18:44.493771 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.493776 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9501a298fc7cfb0131e8a94db23d3d5b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal\" (UID: \"9501a298fc7cfb0131e8a94db23d3d5b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" Jul 05 13:18:44.493869 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.493799 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4599d8e1fbf9c314f1658bf65accfac0-config\") pod \"kube-apiserver-proxy-ip-10-0-132-227.ec2.internal\" (UID: \"4599d8e1fbf9c314f1658bf65accfac0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-227.ec2.internal" Jul 05 13:18:44.493869 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.493846 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9501a298fc7cfb0131e8a94db23d3d5b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal\" (UID: \"9501a298fc7cfb0131e8a94db23d3d5b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" Jul 05 13:18:44.493959 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.493863 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9501a298fc7cfb0131e8a94db23d3d5b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal\" (UID: \"9501a298fc7cfb0131e8a94db23d3d5b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" Jul 05 13:18:44.493959 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.493904 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4599d8e1fbf9c314f1658bf65accfac0-config\") pod \"kube-apiserver-proxy-ip-10-0-132-227.ec2.internal\" (UID: \"4599d8e1fbf9c314f1658bf65accfac0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-227.ec2.internal" Jul 05 13:18:44.581605 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:44.581543 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-227.ec2.internal\" not found" Jul 05 13:18:44.682001 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:44.681969 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-227.ec2.internal\" not found" Jul 05 13:18:44.695100 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.695071 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" Jul 05 13:18:44.700481 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.700119 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-227.ec2.internal" Jul 05 13:18:44.782524 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:44.782498 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-227.ec2.internal\" not found" Jul 05 13:18:44.803852 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.803826 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 13:18:44.879381 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.879325 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-227.ec2.internal" Jul 05 13:18:44.890148 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.890124 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 05 13:18:44.892111 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.892098 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" Jul 05 13:18:44.903260 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.903244 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 05 13:18:44.918218 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.918195 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 05 13:18:44.918324 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.918307 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 05 13:18:44.918379 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.918361 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 05 13:18:44.918415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.918362 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 05 13:18:44.933315 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.933294 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 13:18:44.956032 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.956011 2577 apiserver.go:52] "Watching apiserver" Jul 05 13:18:44.964472 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.963584 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 05 13:18:44.965159 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.965128 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-dtfhw","openshift-network-operator/iptables-alerter-4mgvc","kube-system/global-pull-secret-syncer-f76k8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal","openshift-multus/multus-additional-cni-plugins-ksrfp","openshift-multus/multus-sqxbh","openshift-network-diagnostics/network-check-target-mwfmq","openshift-ovn-kubernetes/ovnkube-node-4mxrf","kube-system/konnectivity-agent-xk5gp","kube-system/kube-apiserver-proxy-ip-10-0-132-227.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz","openshift-cluster-node-tuning-operator/tuned-gpdrt","openshift-dns/node-resolver-rpcxs","openshift-image-registry/node-ca-sjwl5"] Jul 05 13:18:44.967816 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.967794 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rpcxs" Jul 05 13:18:44.970109 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.970089 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4mgvc" Jul 05 13:18:44.970633 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.970417 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-smh84\"" Jul 05 13:18:44.970633 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.970432 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 05 13:18:44.970633 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.970493 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 05 13:18:44.972413 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.972393 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:18:44.972502 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:44.972476 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76k8" podUID="e32393bd-7852-45d8-864c-169ed011c28b" Jul 05 13:18:44.972613 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.972597 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cb786\"" Jul 05 13:18:44.972672 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.972604 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 05 13:18:44.973025 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.973006 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 05 13:18:44.973094 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.973023 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 05 13:18:44.974731 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.974717 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:18:44.974802 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:44.974776 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfhw" podUID="de4f4f54-21b1-4371-81c9-eaab1f91b7e2" Jul 05 13:18:44.977045 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.977031 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:44.979199 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.979173 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 05 13:18:44.979307 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.979272 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sqxbh" Jul 05 13:18:44.979379 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.979363 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 05 13:18:44.979443 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.979400 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 05 13:18:44.979769 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.979620 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 05 13:18:44.979769 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.979742 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 05 13:18:44.980295 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.979746 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 05 13:18:44.980295 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.980079 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ckmtn\"" Jul 05 13:18:44.981807 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.981789 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 05 13:18:44.982073 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.982056 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:18:44.982144 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:44.982123 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwfmq" podUID="ab416b96-ab8a-41bf-93b0-b4a83f8c09d9" Jul 05 13:18:44.982222 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.982209 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gkhbr\"" Jul 05 13:18:44.984773 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.984679 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:44.986152 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.986113 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-04 13:13:44 +0000 UTC" deadline="2028-04-06 22:33:39.420851142 +0000 UTC" Jul 05 13:18:44.986152 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.986150 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15393h14m54.434703363s" Jul 05 13:18:44.987072 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.987052 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hgxsb\"" Jul 05 13:18:44.987072 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.987062 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 05 13:18:44.987270 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.987068 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 05 13:18:44.987270 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.987173 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 05 13:18:44.987270 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.987189 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xk5gp" Jul 05 13:18:44.987548 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.987532 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 05 13:18:44.987600 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.987561 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 05 13:18:44.987636 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.987564 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 05 13:18:44.989523 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.989510 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sjwl5" Jul 05 13:18:44.990509 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.990490 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 05 13:18:44.990595 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.990507 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-g9p7x\"" Jul 05 13:18:44.991470 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.991198 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 05 13:18:44.992174 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.991998 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 05 13:18:44.992174 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.992014 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-rngph\"" Jul 05 13:18:44.992174 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.992140 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 05 13:18:44.992564 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.991912 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 05 13:18:44.992714 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.992681 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:44.995061 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.995043 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 05 13:18:44.995223 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.995203 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rw2g6\"" Jul 05 13:18:44.995223 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.995222 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 05 13:18:44.995350 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.995311 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 05 13:18:44.995659 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.995637 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:44.996281 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.996257 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 05 13:18:44.997340 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997322 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29jhf\" (UniqueName: \"kubernetes.io/projected/560be2cd-0ee9-4de3-b235-6c8f6162334c-kube-api-access-29jhf\") pod \"iptables-alerter-4mgvc\" (UID: \"560be2cd-0ee9-4de3-b235-6c8f6162334c\") " pod="openshift-network-operator/iptables-alerter-4mgvc" Jul 05 13:18:44.997437 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997354 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs\") pod \"network-metrics-daemon-dtfhw\" (UID: \"de4f4f54-21b1-4371-81c9-eaab1f91b7e2\") " pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:18:44.997437 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997381 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-system-cni-dir\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:44.997437 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997406 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:44.997437 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997432 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-host-run-netns\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:44.997605 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997470 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/560be2cd-0ee9-4de3-b235-6c8f6162334c-iptables-alerter-script\") pod \"iptables-alerter-4mgvc\" (UID: \"560be2cd-0ee9-4de3-b235-6c8f6162334c\") " pod="openshift-network-operator/iptables-alerter-4mgvc" Jul 05 13:18:44.997605 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997496 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e32393bd-7852-45d8-864c-169ed011c28b-dbus\") pod \"global-pull-secret-syncer-f76k8\" (UID: \"e32393bd-7852-45d8-864c-169ed011c28b\") " pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:18:44.997605 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997519 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-hostroot\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:44.997605 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997554 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-multus-conf-dir\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:44.997605 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997584 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret\") pod \"global-pull-secret-syncer-f76k8\" (UID: \"e32393bd-7852-45d8-864c-169ed011c28b\") " pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:18:44.997805 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997617 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-cnibin\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:44.997805 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997670 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-os-release\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:44.997805 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997688 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b330688-b70c-47e5-b101-2178dae0a0ba-cni-binary-copy\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:44.997805 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997705 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-host-var-lib-cni-multus\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:44.997805 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997721 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt5nb\" (UniqueName: \"kubernetes.io/projected/550ceb2c-2505-4654-802f-4de1c9384663-kube-api-access-vt5nb\") pod \"node-resolver-rpcxs\" (UID: \"550ceb2c-2505-4654-802f-4de1c9384663\") " pod="openshift-dns/node-resolver-rpcxs" Jul 05 13:18:44.997805 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997738 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:44.997805 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997773 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwbgb\" (UniqueName: \"kubernetes.io/projected/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-kube-api-access-hwbgb\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:44.997805 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997794 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-host-run-k8s-cni-cncf-io\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:44.998143 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997809 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-host-var-lib-cni-bin\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:44.998143 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997831 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-os-release\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:44.998143 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997851 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 05 13:18:44.998143 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997855 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvbgs\" (UniqueName: \"kubernetes.io/projected/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-kube-api-access-dvbgs\") pod \"network-metrics-daemon-dtfhw\" (UID: \"de4f4f54-21b1-4371-81c9-eaab1f91b7e2\") " pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:18:44.998143 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997956 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:44.998143 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.997986 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-host-var-lib-kubelet\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:44.998143 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.998012 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-host-run-multus-certs\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:44.998143 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.998037 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-etc-kubernetes\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:44.998143 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.998068 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/550ceb2c-2505-4654-802f-4de1c9384663-hosts-file\") pod \"node-resolver-rpcxs\" (UID: \"550ceb2c-2505-4654-802f-4de1c9384663\") " pod="openshift-dns/node-resolver-rpcxs" Jul 05 13:18:44.998143 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.998094 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/550ceb2c-2505-4654-802f-4de1c9384663-tmp-dir\") pod \"node-resolver-rpcxs\" (UID: \"550ceb2c-2505-4654-802f-4de1c9384663\") " pod="openshift-dns/node-resolver-rpcxs" Jul 05 13:18:44.998143 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.998120 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-cnibin\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:44.998143 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.998128 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m8hgn\"" Jul 05 13:18:44.998143 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.998143 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-system-cni-dir\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:44.998587 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.998161 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 05 13:18:44.998587 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.998166 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-multus-cni-dir\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:44.998587 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.998193 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-multus-socket-dir-parent\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:44.998587 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.998218 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7lr9\" (UniqueName: \"kubernetes.io/projected/6b330688-b70c-47e5-b101-2178dae0a0ba-kube-api-access-s7lr9\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:44.998587 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.998244 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e32393bd-7852-45d8-864c-169ed011c28b-kubelet-config\") pod \"global-pull-secret-syncer-f76k8\" (UID: \"e32393bd-7852-45d8-864c-169ed011c28b\") " pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:18:44.998587 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.998268 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-cni-binary-copy\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:44.998587 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.998293 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b330688-b70c-47e5-b101-2178dae0a0ba-multus-daemon-config\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:44.998587 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:44.998318 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/560be2cd-0ee9-4de3-b235-6c8f6162334c-host-slash\") pod \"iptables-alerter-4mgvc\" (UID: \"560be2cd-0ee9-4de3-b235-6c8f6162334c\") " pod="openshift-network-operator/iptables-alerter-4mgvc" Jul 05 13:18:45.020315 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.020288 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j8r4s" Jul 05 13:18:45.028630 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.028615 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j8r4s" Jul 05 13:18:45.079945 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.079925 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 05 13:18:45.099531 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.099506 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-os-release\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.099633 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.099539 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-host-var-lib-cni-multus\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.099633 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.099560 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-log-socket\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.099633 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.099577 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0bac94b6-2965-4acf-9cd6-1a74309d4254-konnectivity-ca\") pod \"konnectivity-agent-xk5gp\" (UID: \"0bac94b6-2965-4acf-9cd6-1a74309d4254\") " pod="kube-system/konnectivity-agent-xk5gp" Jul 05 13:18:45.099633 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.099598 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5983413e-d98e-416d-a669-aa4c3e21bcbd-registration-dir\") pod \"aws-ebs-csi-driver-node-sqrqz\" (UID: \"5983413e-d98e-416d-a669-aa4c3e21bcbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:45.099633 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.099624 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt5nb\" (UniqueName: \"kubernetes.io/projected/550ceb2c-2505-4654-802f-4de1c9384663-kube-api-access-vt5nb\") pod \"node-resolver-rpcxs\" (UID: \"550ceb2c-2505-4654-802f-4de1c9384663\") " pod="openshift-dns/node-resolver-rpcxs" Jul 05 13:18:45.099848 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.099633 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-host-var-lib-cni-multus\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.099848 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.099645 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwbgb\" (UniqueName: \"kubernetes.io/projected/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-kube-api-access-hwbgb\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:45.099848 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.099681 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-host-run-k8s-cni-cncf-io\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.099848 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.099636 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-os-release\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.099848 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.099723 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-host-run-k8s-cni-cncf-io\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.099848 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.099796 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-host-var-lib-cni-bin\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.099848 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.099823 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-etc-openvswitch\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.099848 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.099844 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-os-release\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:45.100209 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.099859 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-systemd-units\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.100209 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.099900 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-host-run-ovn-kubernetes\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.100209 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.099906 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-host-var-lib-cni-bin\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.100209 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.099916 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-host-cni-netd\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.100209 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.099927 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-os-release\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:45.100209 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.099949 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fb44c8db-1344-4303-adda-626772a8308f-serviceca\") pod \"node-ca-sjwl5\" (UID: \"fb44c8db-1344-4303-adda-626772a8308f\") " pod="openshift-image-registry/node-ca-sjwl5" Jul 05 13:18:45.100209 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.099969 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-etc-sysctl-d\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.100209 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.099984 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-sys\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.100209 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100021 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-host-var-lib-kubelet\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.100209 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100058 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-etc-kubernetes\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.100209 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100077 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-host-kubelet\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.100209 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100083 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-host-var-lib-kubelet\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.100209 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100099 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-host-cni-bin\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.100209 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100117 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5983413e-d98e-416d-a669-aa4c3e21bcbd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sqrqz\" (UID: \"5983413e-d98e-416d-a669-aa4c3e21bcbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:45.100821 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100116 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-etc-kubernetes\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.100821 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100133 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/550ceb2c-2505-4654-802f-4de1c9384663-hosts-file\") pod \"node-resolver-rpcxs\" (UID: \"550ceb2c-2505-4654-802f-4de1c9384663\") " pod="openshift-dns/node-resolver-rpcxs" Jul 05 13:18:45.100821 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100163 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7lr9\" (UniqueName: \"kubernetes.io/projected/6b330688-b70c-47e5-b101-2178dae0a0ba-kube-api-access-s7lr9\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.100821 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100179 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/550ceb2c-2505-4654-802f-4de1c9384663-hosts-file\") pod \"node-resolver-rpcxs\" (UID: \"550ceb2c-2505-4654-802f-4de1c9384663\") " pod="openshift-dns/node-resolver-rpcxs" Jul 05 13:18:45.100821 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100193 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-run-systemd\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.100821 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100219 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-node-log\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.100821 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100256 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0bac94b6-2965-4acf-9cd6-1a74309d4254-agent-certs\") pod \"konnectivity-agent-xk5gp\" (UID: \"0bac94b6-2965-4acf-9cd6-1a74309d4254\") " pod="kube-system/konnectivity-agent-xk5gp" Jul 05 13:18:45.100821 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100295 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fb44c8db-1344-4303-adda-626772a8308f-host\") pod \"node-ca-sjwl5\" (UID: \"fb44c8db-1344-4303-adda-626772a8308f\") " pod="openshift-image-registry/node-ca-sjwl5" Jul 05 13:18:45.100821 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100323 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5983413e-d98e-416d-a669-aa4c3e21bcbd-socket-dir\") pod \"aws-ebs-csi-driver-node-sqrqz\" (UID: \"5983413e-d98e-416d-a669-aa4c3e21bcbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:45.100821 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100349 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-etc-sysconfig\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.100821 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100389 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e32393bd-7852-45d8-864c-169ed011c28b-kubelet-config\") pod \"global-pull-secret-syncer-f76k8\" (UID: \"e32393bd-7852-45d8-864c-169ed011c28b\") " pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:18:45.100821 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100408 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b330688-b70c-47e5-b101-2178dae0a0ba-multus-daemon-config\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.100821 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100424 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-var-lib-openvswitch\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.100821 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100443 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-run-openvswitch\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.101587 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100459 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-etc-systemd\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.101587 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100479 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e32393bd-7852-45d8-864c-169ed011c28b-kubelet-config\") pod \"global-pull-secret-syncer-f76k8\" (UID: \"e32393bd-7852-45d8-864c-169ed011c28b\") " pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:18:45.101587 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100541 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/560be2cd-0ee9-4de3-b235-6c8f6162334c-host-slash\") pod \"iptables-alerter-4mgvc\" (UID: \"560be2cd-0ee9-4de3-b235-6c8f6162334c\") " pod="openshift-network-operator/iptables-alerter-4mgvc" Jul 05 13:18:45.101587 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100560 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs\") pod \"network-metrics-daemon-dtfhw\" (UID: \"de4f4f54-21b1-4371-81c9-eaab1f91b7e2\") " pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:18:45.101587 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100575 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-system-cni-dir\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:45.101587 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100594 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7c4v\" (UniqueName: \"kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v\") pod \"network-check-target-mwfmq\" (UID: \"ab416b96-ab8a-41bf-93b0-b4a83f8c09d9\") " pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:18:45.101587 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100621 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-system-cni-dir\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:45.101587 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100631 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/560be2cd-0ee9-4de3-b235-6c8f6162334c-host-slash\") pod \"iptables-alerter-4mgvc\" (UID: \"560be2cd-0ee9-4de3-b235-6c8f6162334c\") " pod="openshift-network-operator/iptables-alerter-4mgvc" Jul 05 13:18:45.101587 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100671 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7ffc\" (UniqueName: \"kubernetes.io/projected/5983413e-d98e-416d-a669-aa4c3e21bcbd-kube-api-access-f7ffc\") pod \"aws-ebs-csi-driver-node-sqrqz\" (UID: \"5983413e-d98e-416d-a669-aa4c3e21bcbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:45.101587 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:45.100689 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:45.101587 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100691 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-run\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.101587 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:45.100757 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs podName:de4f4f54-21b1-4371-81c9-eaab1f91b7e2 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:45.600726458 +0000 UTC m=+1.974002488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs") pod "network-metrics-daemon-dtfhw" (UID: "de4f4f54-21b1-4371-81c9-eaab1f91b7e2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:45.101587 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100773 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-lib-modules\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.101587 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100794 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/560be2cd-0ee9-4de3-b235-6c8f6162334c-iptables-alerter-script\") pod \"iptables-alerter-4mgvc\" (UID: \"560be2cd-0ee9-4de3-b235-6c8f6162334c\") " pod="openshift-network-operator/iptables-alerter-4mgvc" Jul 05 13:18:45.102290 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100817 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-hostroot\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.102290 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100842 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-run-ovn\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.102290 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100862 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8dn6\" (UniqueName: \"kubernetes.io/projected/de9933df-3daf-403e-ad99-aa326759e3ff-kube-api-access-k8dn6\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.102290 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100879 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-var-lib-kubelet\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.102290 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100903 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acc09a71-606e-4a33-9411-400891546e66-tmp\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.102290 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100953 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret\") pod \"global-pull-secret-syncer-f76k8\" (UID: \"e32393bd-7852-45d8-864c-169ed011c28b\") " pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:18:45.102290 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100984 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-cnibin\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.102290 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.100990 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-hostroot\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.102290 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101009 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b330688-b70c-47e5-b101-2178dae0a0ba-cni-binary-copy\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.102290 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101038 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-host-run-netns\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.102290 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101065 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de9933df-3daf-403e-ad99-aa326759e3ff-ovn-node-metrics-cert\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.102290 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101075 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-cnibin\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.102290 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:45.101084 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:45.102290 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101089 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-host\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.102290 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101088 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6b330688-b70c-47e5-b101-2178dae0a0ba-multus-daemon-config\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.102804 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101116 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:45.102804 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:45.101155 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret podName:e32393bd-7852-45d8-864c-169ed011c28b nodeName:}" failed. No retries permitted until 2026-07-05 13:18:45.601122939 +0000 UTC m=+1.974398957 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret") pod "global-pull-secret-syncer-f76k8" (UID: "e32393bd-7852-45d8-864c-169ed011c28b") : object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:45.102804 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101256 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grvg6\" (UniqueName: \"kubernetes.io/projected/acc09a71-606e-4a33-9411-400891546e66-kube-api-access-grvg6\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.102804 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101296 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-host-slash\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.102804 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101326 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzbzj\" (UniqueName: \"kubernetes.io/projected/fb44c8db-1344-4303-adda-626772a8308f-kube-api-access-gzbzj\") pod \"node-ca-sjwl5\" (UID: \"fb44c8db-1344-4303-adda-626772a8308f\") " pod="openshift-image-registry/node-ca-sjwl5" Jul 05 13:18:45.102804 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101354 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5983413e-d98e-416d-a669-aa4c3e21bcbd-device-dir\") pod \"aws-ebs-csi-driver-node-sqrqz\" (UID: \"5983413e-d98e-416d-a669-aa4c3e21bcbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:45.102804 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101353 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/560be2cd-0ee9-4de3-b235-6c8f6162334c-iptables-alerter-script\") pod \"iptables-alerter-4mgvc\" (UID: \"560be2cd-0ee9-4de3-b235-6c8f6162334c\") " pod="openshift-network-operator/iptables-alerter-4mgvc" Jul 05 13:18:45.102804 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101379 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5983413e-d98e-416d-a669-aa4c3e21bcbd-etc-selinux\") pod \"aws-ebs-csi-driver-node-sqrqz\" (UID: \"5983413e-d98e-416d-a669-aa4c3e21bcbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:45.102804 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101405 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-etc-modprobe-d\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.102804 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101445 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvbgs\" (UniqueName: \"kubernetes.io/projected/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-kube-api-access-dvbgs\") pod \"network-metrics-daemon-dtfhw\" (UID: \"de4f4f54-21b1-4371-81c9-eaab1f91b7e2\") " pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:18:45.102804 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101499 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:45.102804 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101535 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-host-run-multus-certs\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.102804 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101564 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/550ceb2c-2505-4654-802f-4de1c9384663-tmp-dir\") pod \"node-resolver-rpcxs\" (UID: \"550ceb2c-2505-4654-802f-4de1c9384663\") " pod="openshift-dns/node-resolver-rpcxs" Jul 05 13:18:45.103244 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101594 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-cnibin\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:45.103244 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101609 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-host-run-multus-certs\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.103244 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101626 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-system-cni-dir\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.103244 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101656 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-multus-cni-dir\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.103244 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101687 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-multus-socket-dir-parent\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.103244 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101741 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de9933df-3daf-403e-ad99-aa326759e3ff-env-overrides\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.103244 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101760 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-system-cni-dir\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.103244 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101764 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-cnibin\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:45.103244 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101769 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5983413e-d98e-416d-a669-aa4c3e21bcbd-sys-fs\") pod \"aws-ebs-csi-driver-node-sqrqz\" (UID: \"5983413e-d98e-416d-a669-aa4c3e21bcbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:45.103244 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101853 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/550ceb2c-2505-4654-802f-4de1c9384663-tmp-dir\") pod \"node-resolver-rpcxs\" (UID: \"550ceb2c-2505-4654-802f-4de1c9384663\") " pod="openshift-dns/node-resolver-rpcxs" Jul 05 13:18:45.103244 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101888 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-cni-binary-copy\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:45.103244 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101894 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-multus-socket-dir-parent\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.103244 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101939 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/de9933df-3daf-403e-ad99-aa326759e3ff-ovnkube-script-lib\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.103244 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101950 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-multus-cni-dir\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.103244 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101975 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-etc-kubernetes\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.103675 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.101989 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b330688-b70c-47e5-b101-2178dae0a0ba-cni-binary-copy\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.103675 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.102025 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:45.103675 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.102032 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:45.103675 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.102014 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29jhf\" (UniqueName: \"kubernetes.io/projected/560be2cd-0ee9-4de3-b235-6c8f6162334c-kube-api-access-29jhf\") pod \"iptables-alerter-4mgvc\" (UID: \"560be2cd-0ee9-4de3-b235-6c8f6162334c\") " pod="openshift-network-operator/iptables-alerter-4mgvc" Jul 05 13:18:45.103675 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.102086 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:45.103675 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.102102 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-host-run-netns\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.103675 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.102125 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.103675 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.102153 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e32393bd-7852-45d8-864c-169ed011c28b-dbus\") pod \"global-pull-secret-syncer-f76k8\" (UID: \"e32393bd-7852-45d8-864c-169ed011c28b\") " pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:18:45.103675 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.102180 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-multus-conf-dir\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.103675 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.102224 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-multus-conf-dir\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.103675 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.102239 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e32393bd-7852-45d8-864c-169ed011c28b-dbus\") pod \"global-pull-secret-syncer-f76k8\" (UID: \"e32393bd-7852-45d8-864c-169ed011c28b\") " pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:18:45.103675 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.102246 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:45.103675 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.102285 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de9933df-3daf-403e-ad99-aa326759e3ff-ovnkube-config\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.103675 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.102307 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-etc-sysctl-conf\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.104266 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.102318 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b330688-b70c-47e5-b101-2178dae0a0ba-host-run-netns\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.104266 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.102335 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/acc09a71-606e-4a33-9411-400891546e66-etc-tuned\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.104266 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.102377 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-cni-binary-copy\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:45.108600 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.108395 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 05 13:18:45.112574 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.112215 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29jhf\" (UniqueName: \"kubernetes.io/projected/560be2cd-0ee9-4de3-b235-6c8f6162334c-kube-api-access-29jhf\") pod \"iptables-alerter-4mgvc\" (UID: \"560be2cd-0ee9-4de3-b235-6c8f6162334c\") " pod="openshift-network-operator/iptables-alerter-4mgvc" Jul 05 13:18:45.112574 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.112244 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7lr9\" (UniqueName: \"kubernetes.io/projected/6b330688-b70c-47e5-b101-2178dae0a0ba-kube-api-access-s7lr9\") pod \"multus-sqxbh\" (UID: \"6b330688-b70c-47e5-b101-2178dae0a0ba\") " pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.112574 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.112256 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt5nb\" (UniqueName: \"kubernetes.io/projected/550ceb2c-2505-4654-802f-4de1c9384663-kube-api-access-vt5nb\") pod \"node-resolver-rpcxs\" (UID: \"550ceb2c-2505-4654-802f-4de1c9384663\") " pod="openshift-dns/node-resolver-rpcxs" Jul 05 13:18:45.112574 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.112512 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvbgs\" (UniqueName: \"kubernetes.io/projected/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-kube-api-access-dvbgs\") pod \"network-metrics-daemon-dtfhw\" (UID: \"de4f4f54-21b1-4371-81c9-eaab1f91b7e2\") " pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:18:45.112860 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.112798 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwbgb\" (UniqueName: \"kubernetes.io/projected/9494c1a0-c6fb-4812-b8ad-9dd48da15f68-kube-api-access-hwbgb\") pod \"multus-additional-cni-plugins-ksrfp\" (UID: \"9494c1a0-c6fb-4812-b8ad-9dd48da15f68\") " pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:45.203092 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203058 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.203310 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203097 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de9933df-3daf-403e-ad99-aa326759e3ff-ovnkube-config\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.203310 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203125 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-etc-sysctl-conf\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.203310 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203147 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/acc09a71-606e-4a33-9411-400891546e66-etc-tuned\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.203310 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203172 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-log-socket\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.203310 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203178 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.203310 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203195 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0bac94b6-2965-4acf-9cd6-1a74309d4254-konnectivity-ca\") pod \"konnectivity-agent-xk5gp\" (UID: \"0bac94b6-2965-4acf-9cd6-1a74309d4254\") " pod="kube-system/konnectivity-agent-xk5gp" Jul 05 13:18:45.203310 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203219 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5983413e-d98e-416d-a669-aa4c3e21bcbd-registration-dir\") pod \"aws-ebs-csi-driver-node-sqrqz\" (UID: \"5983413e-d98e-416d-a669-aa4c3e21bcbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:45.203310 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203247 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-etc-openvswitch\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.203310 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203273 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-systemd-units\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.203310 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203270 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-etc-sysctl-conf\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.203310 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203286 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-log-socket\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.203928 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203325 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5983413e-d98e-416d-a669-aa4c3e21bcbd-registration-dir\") pod \"aws-ebs-csi-driver-node-sqrqz\" (UID: \"5983413e-d98e-416d-a669-aa4c3e21bcbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:45.203928 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203345 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-etc-openvswitch\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.203928 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203368 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-host-run-ovn-kubernetes\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.203928 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203399 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-host-cni-netd\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.203928 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203418 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-systemd-units\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.203928 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203428 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fb44c8db-1344-4303-adda-626772a8308f-serviceca\") pod \"node-ca-sjwl5\" (UID: \"fb44c8db-1344-4303-adda-626772a8308f\") " pod="openshift-image-registry/node-ca-sjwl5" Jul 05 13:18:45.203928 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203453 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-etc-sysctl-d\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.203928 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203461 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-host-run-ovn-kubernetes\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.203928 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203479 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-sys\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.203928 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203507 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-host-kubelet\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.203928 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203532 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-host-cni-bin\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.203928 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203555 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5983413e-d98e-416d-a669-aa4c3e21bcbd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sqrqz\" (UID: \"5983413e-d98e-416d-a669-aa4c3e21bcbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:45.203928 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203583 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-run-systemd\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.203928 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203608 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-node-log\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.203928 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203633 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0bac94b6-2965-4acf-9cd6-1a74309d4254-agent-certs\") pod \"konnectivity-agent-xk5gp\" (UID: \"0bac94b6-2965-4acf-9cd6-1a74309d4254\") " pod="kube-system/konnectivity-agent-xk5gp" Jul 05 13:18:45.204702 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203629 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-host-cni-netd\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.204702 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203657 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fb44c8db-1344-4303-adda-626772a8308f-host\") pod \"node-ca-sjwl5\" (UID: \"fb44c8db-1344-4303-adda-626772a8308f\") " pod="openshift-image-registry/node-ca-sjwl5" Jul 05 13:18:45.204702 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203699 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-host-cni-bin\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.204702 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5983413e-d98e-416d-a669-aa4c3e21bcbd-socket-dir\") pod \"aws-ebs-csi-driver-node-sqrqz\" (UID: \"5983413e-d98e-416d-a669-aa4c3e21bcbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:45.204702 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203748 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-run-systemd\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.204702 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203752 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-etc-sysconfig\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.204702 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203801 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-node-log\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.204702 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203816 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-etc-sysconfig\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.204702 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203690 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fb44c8db-1344-4303-adda-626772a8308f-host\") pod \"node-ca-sjwl5\" (UID: \"fb44c8db-1344-4303-adda-626772a8308f\") " pod="openshift-image-registry/node-ca-sjwl5" Jul 05 13:18:45.204702 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203864 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-sys\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.204702 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203864 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/de9933df-3daf-403e-ad99-aa326759e3ff-ovnkube-config\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.204702 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203910 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-var-lib-openvswitch\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.204702 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203769 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5983413e-d98e-416d-a669-aa4c3e21bcbd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-sqrqz\" (UID: \"5983413e-d98e-416d-a669-aa4c3e21bcbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:45.204702 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203916 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-host-kubelet\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.204702 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203912 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-etc-sysctl-d\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.205415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203937 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0bac94b6-2965-4acf-9cd6-1a74309d4254-konnectivity-ca\") pod \"konnectivity-agent-xk5gp\" (UID: \"0bac94b6-2965-4acf-9cd6-1a74309d4254\") " pod="kube-system/konnectivity-agent-xk5gp" Jul 05 13:18:45.205415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203954 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fb44c8db-1344-4303-adda-626772a8308f-serviceca\") pod \"node-ca-sjwl5\" (UID: \"fb44c8db-1344-4303-adda-626772a8308f\") " pod="openshift-image-registry/node-ca-sjwl5" Jul 05 13:18:45.205415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.203963 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-var-lib-openvswitch\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.205415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204011 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-run-openvswitch\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.205415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204029 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5983413e-d98e-416d-a669-aa4c3e21bcbd-socket-dir\") pod \"aws-ebs-csi-driver-node-sqrqz\" (UID: \"5983413e-d98e-416d-a669-aa4c3e21bcbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:45.205415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204053 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-run-openvswitch\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.205415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204081 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-etc-systemd\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.205415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204151 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-etc-systemd\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.205415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204204 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7c4v\" (UniqueName: \"kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v\") pod \"network-check-target-mwfmq\" (UID: \"ab416b96-ab8a-41bf-93b0-b4a83f8c09d9\") " pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:18:45.205415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204236 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7ffc\" (UniqueName: \"kubernetes.io/projected/5983413e-d98e-416d-a669-aa4c3e21bcbd-kube-api-access-f7ffc\") pod \"aws-ebs-csi-driver-node-sqrqz\" (UID: \"5983413e-d98e-416d-a669-aa4c3e21bcbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:45.205415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204264 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-run\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.205415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204290 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-lib-modules\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.205415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204319 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-run-ovn\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.205415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204350 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8dn6\" (UniqueName: \"kubernetes.io/projected/de9933df-3daf-403e-ad99-aa326759e3ff-kube-api-access-k8dn6\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.205415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204368 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-run\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.206077 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204377 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-var-lib-kubelet\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.206077 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204412 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acc09a71-606e-4a33-9411-400891546e66-tmp\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.206077 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204424 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-var-lib-kubelet\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.206077 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204427 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-lib-modules\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.206077 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204460 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-run-ovn\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.206077 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204502 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-host-run-netns\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.206077 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204530 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de9933df-3daf-403e-ad99-aa326759e3ff-ovn-node-metrics-cert\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.206077 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204555 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-host\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.206077 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204582 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grvg6\" (UniqueName: \"kubernetes.io/projected/acc09a71-606e-4a33-9411-400891546e66-kube-api-access-grvg6\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.206077 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204605 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-host-slash\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.206077 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204555 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-host-run-netns\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.206077 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204630 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzbzj\" (UniqueName: \"kubernetes.io/projected/fb44c8db-1344-4303-adda-626772a8308f-kube-api-access-gzbzj\") pod \"node-ca-sjwl5\" (UID: \"fb44c8db-1344-4303-adda-626772a8308f\") " pod="openshift-image-registry/node-ca-sjwl5" Jul 05 13:18:45.206077 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204655 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5983413e-d98e-416d-a669-aa4c3e21bcbd-device-dir\") pod \"aws-ebs-csi-driver-node-sqrqz\" (UID: \"5983413e-d98e-416d-a669-aa4c3e21bcbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:45.206077 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204712 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-host\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.206077 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204758 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5983413e-d98e-416d-a669-aa4c3e21bcbd-etc-selinux\") pod \"aws-ebs-csi-driver-node-sqrqz\" (UID: \"5983413e-d98e-416d-a669-aa4c3e21bcbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:45.206794 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204801 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-etc-modprobe-d\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.206794 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204810 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/de9933df-3daf-403e-ad99-aa326759e3ff-host-slash\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.206794 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204821 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5983413e-d98e-416d-a669-aa4c3e21bcbd-device-dir\") pod \"aws-ebs-csi-driver-node-sqrqz\" (UID: \"5983413e-d98e-416d-a669-aa4c3e21bcbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:45.206794 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204838 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de9933df-3daf-403e-ad99-aa326759e3ff-env-overrides\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.206794 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204866 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5983413e-d98e-416d-a669-aa4c3e21bcbd-sys-fs\") pod \"aws-ebs-csi-driver-node-sqrqz\" (UID: \"5983413e-d98e-416d-a669-aa4c3e21bcbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:45.206794 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204892 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/de9933df-3daf-403e-ad99-aa326759e3ff-ovnkube-script-lib\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.206794 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.204922 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-etc-kubernetes\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.206794 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.205004 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-etc-kubernetes\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.206794 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.205060 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5983413e-d98e-416d-a669-aa4c3e21bcbd-sys-fs\") pod \"aws-ebs-csi-driver-node-sqrqz\" (UID: \"5983413e-d98e-416d-a669-aa4c3e21bcbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:45.206794 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.205155 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5983413e-d98e-416d-a669-aa4c3e21bcbd-etc-selinux\") pod \"aws-ebs-csi-driver-node-sqrqz\" (UID: \"5983413e-d98e-416d-a669-aa4c3e21bcbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:45.206794 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.205250 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/acc09a71-606e-4a33-9411-400891546e66-etc-modprobe-d\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.206794 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.205364 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/de9933df-3daf-403e-ad99-aa326759e3ff-env-overrides\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.206794 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.206060 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/de9933df-3daf-403e-ad99-aa326759e3ff-ovnkube-script-lib\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.206794 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.206191 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/acc09a71-606e-4a33-9411-400891546e66-etc-tuned\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.206794 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.206636 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0bac94b6-2965-4acf-9cd6-1a74309d4254-agent-certs\") pod \"konnectivity-agent-xk5gp\" (UID: \"0bac94b6-2965-4acf-9cd6-1a74309d4254\") " pod="kube-system/konnectivity-agent-xk5gp" Jul 05 13:18:45.207244 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.206756 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/acc09a71-606e-4a33-9411-400891546e66-tmp\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.207244 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.207034 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/de9933df-3daf-403e-ad99-aa326759e3ff-ovn-node-metrics-cert\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.212185 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:45.212161 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 13:18:45.212305 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:45.212191 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 13:18:45.212305 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:45.212204 2577 projected.go:196] Error preparing data for projected volume kube-api-access-k7c4v for pod openshift-network-diagnostics/network-check-target-mwfmq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:45.212305 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:45.212277 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v podName:ab416b96-ab8a-41bf-93b0-b4a83f8c09d9 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:45.71225731 +0000 UTC m=+2.085533327 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-k7c4v" (UniqueName: "kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v") pod "network-check-target-mwfmq" (UID: "ab416b96-ab8a-41bf-93b0-b4a83f8c09d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:45.213991 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.213960 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7ffc\" (UniqueName: \"kubernetes.io/projected/5983413e-d98e-416d-a669-aa4c3e21bcbd-kube-api-access-f7ffc\") pod \"aws-ebs-csi-driver-node-sqrqz\" (UID: \"5983413e-d98e-416d-a669-aa4c3e21bcbd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:45.214160 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.214137 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8dn6\" (UniqueName: \"kubernetes.io/projected/de9933df-3daf-403e-ad99-aa326759e3ff-kube-api-access-k8dn6\") pod \"ovnkube-node-4mxrf\" (UID: \"de9933df-3daf-403e-ad99-aa326759e3ff\") " pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.214220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.214206 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzbzj\" (UniqueName: \"kubernetes.io/projected/fb44c8db-1344-4303-adda-626772a8308f-kube-api-access-gzbzj\") pod \"node-ca-sjwl5\" (UID: \"fb44c8db-1344-4303-adda-626772a8308f\") " pod="openshift-image-registry/node-ca-sjwl5" Jul 05 13:18:45.214386 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.214370 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grvg6\" (UniqueName: \"kubernetes.io/projected/acc09a71-606e-4a33-9411-400891546e66-kube-api-access-grvg6\") pod \"tuned-gpdrt\" (UID: \"acc09a71-606e-4a33-9411-400891546e66\") " pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.275706 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:45.275680 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4599d8e1fbf9c314f1658bf65accfac0.slice/crio-f417447a5a751bdc7409d91a3eb54f8d450a85a9cbd4026ee0c9fc1c990ad93b WatchSource:0}: Error finding container f417447a5a751bdc7409d91a3eb54f8d450a85a9cbd4026ee0c9fc1c990ad93b: Status 404 returned error can't find the container with id f417447a5a751bdc7409d91a3eb54f8d450a85a9cbd4026ee0c9fc1c990ad93b Jul 05 13:18:45.277994 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:45.277971 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9501a298fc7cfb0131e8a94db23d3d5b.slice/crio-52f634482ec6218452680c2afec21b07410cc80e1437fae538aa6a9f3b2a2b70 WatchSource:0}: Error finding container 52f634482ec6218452680c2afec21b07410cc80e1437fae538aa6a9f3b2a2b70: Status 404 returned error can't find the container with id 52f634482ec6218452680c2afec21b07410cc80e1437fae538aa6a9f3b2a2b70 Jul 05 13:18:45.280626 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.280611 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 13:18:45.294294 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.294273 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rpcxs" Jul 05 13:18:45.304194 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:45.304169 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod550ceb2c_2505_4654_802f_4de1c9384663.slice/crio-2fda6ed83ed62c560ec91f006c55080342e13dbe47a20a908f52f72d8be8be9d WatchSource:0}: Error finding container 2fda6ed83ed62c560ec91f006c55080342e13dbe47a20a908f52f72d8be8be9d: Status 404 returned error can't find the container with id 2fda6ed83ed62c560ec91f006c55080342e13dbe47a20a908f52f72d8be8be9d Jul 05 13:18:45.309787 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.309771 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4mgvc" Jul 05 13:18:45.319239 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:45.319219 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod560be2cd_0ee9_4de3_b235_6c8f6162334c.slice/crio-a9396509216e6661e0e8dabd5d27aa0f6616089c6e324783287642cb8b54f38b WatchSource:0}: Error finding container a9396509216e6661e0e8dabd5d27aa0f6616089c6e324783287642cb8b54f38b: Status 404 returned error can't find the container with id a9396509216e6661e0e8dabd5d27aa0f6616089c6e324783287642cb8b54f38b Jul 05 13:18:45.326376 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.326359 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ksrfp" Jul 05 13:18:45.334163 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:45.334134 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9494c1a0_c6fb_4812_b8ad_9dd48da15f68.slice/crio-c1d02536e0d1b14bf1a5049ec7af54efa749aeaa895539d931b5d56474b71bd6 WatchSource:0}: Error finding container c1d02536e0d1b14bf1a5049ec7af54efa749aeaa895539d931b5d56474b71bd6: Status 404 returned error can't find the container with id c1d02536e0d1b14bf1a5049ec7af54efa749aeaa895539d931b5d56474b71bd6 Jul 05 13:18:45.337181 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.337164 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sqxbh" Jul 05 13:18:45.344088 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.344065 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:18:45.345451 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:45.345432 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b330688_b70c_47e5_b101_2178dae0a0ba.slice/crio-1fe5b6eab379081bacd6de8594366943e25120def35c747f37d3022e94cb0313 WatchSource:0}: Error finding container 1fe5b6eab379081bacd6de8594366943e25120def35c747f37d3022e94cb0313: Status 404 returned error can't find the container with id 1fe5b6eab379081bacd6de8594366943e25120def35c747f37d3022e94cb0313 Jul 05 13:18:45.352156 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:45.352132 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde9933df_3daf_403e_ad99_aa326759e3ff.slice/crio-647ab6ccfe17ff099a95b5f8ad59004bc39cb499b800f012c96e5b1d2effeeff WatchSource:0}: Error finding container 647ab6ccfe17ff099a95b5f8ad59004bc39cb499b800f012c96e5b1d2effeeff: Status 404 returned error can't find the container with id 647ab6ccfe17ff099a95b5f8ad59004bc39cb499b800f012c96e5b1d2effeeff Jul 05 13:18:45.359631 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.359584 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xk5gp" Jul 05 13:18:45.367730 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:45.367707 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bac94b6_2965_4acf_9cd6_1a74309d4254.slice/crio-d5fb4509dc0166de8b257c20cba28da21ad1c3ccb2f4df579abcb086e49d1e5a WatchSource:0}: Error finding container d5fb4509dc0166de8b257c20cba28da21ad1c3ccb2f4df579abcb086e49d1e5a: Status 404 returned error can't find the container with id d5fb4509dc0166de8b257c20cba28da21ad1c3ccb2f4df579abcb086e49d1e5a Jul 05 13:18:45.393100 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.393082 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sjwl5" Jul 05 13:18:45.401111 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:45.401089 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb44c8db_1344_4303_adda_626772a8308f.slice/crio-3016a83192ac89a25795bda2091005d20787723aa4e5eb5aa8123033c7e078ae WatchSource:0}: Error finding container 3016a83192ac89a25795bda2091005d20787723aa4e5eb5aa8123033c7e078ae: Status 404 returned error can't find the container with id 3016a83192ac89a25795bda2091005d20787723aa4e5eb5aa8123033c7e078ae Jul 05 13:18:45.406118 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.406071 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" Jul 05 13:18:45.412810 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.412790 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" Jul 05 13:18:45.415064 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:45.415044 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5983413e_d98e_416d_a669_aa4c3e21bcbd.slice/crio-0733c19a588870616605549ef060dd062641a11c0e3e50106f90f32abc38c18a WatchSource:0}: Error finding container 0733c19a588870616605549ef060dd062641a11c0e3e50106f90f32abc38c18a: Status 404 returned error can't find the container with id 0733c19a588870616605549ef060dd062641a11c0e3e50106f90f32abc38c18a Jul 05 13:18:45.423915 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:18:45.423891 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc09a71_606e_4a33_9411_400891546e66.slice/crio-b102bf120317be3c6d2badcc99e373a60c87b3c96a0257d6695176692a3e3d60 WatchSource:0}: Error finding container b102bf120317be3c6d2badcc99e373a60c87b3c96a0257d6695176692a3e3d60: Status 404 returned error can't find the container with id b102bf120317be3c6d2badcc99e373a60c87b3c96a0257d6695176692a3e3d60 Jul 05 13:18:45.425469 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:45.425443 2577 kuberuntime_manager.go:1459] "Unhandled Error" err="container tuned start failed in pod tuned-gpdrt_openshift-cluster-node-tuning-operator(acc09a71-606e-4a33-9411-400891546e66): ErrImagePull: pull QPS exceeded" logger="UnhandledError" Jul 05 13:18:45.425552 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:45.425487 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"tuned\" with ErrImagePull: \"pull QPS exceeded\"" pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" podUID="acc09a71-606e-4a33-9411-400891546e66" Jul 05 13:18:45.607345 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.607309 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs\") pod \"network-metrics-daemon-dtfhw\" (UID: \"de4f4f54-21b1-4371-81c9-eaab1f91b7e2\") " pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:18:45.607529 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.607377 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret\") pod \"global-pull-secret-syncer-f76k8\" (UID: \"e32393bd-7852-45d8-864c-169ed011c28b\") " pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:18:45.607529 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:45.607451 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:45.607529 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:45.607505 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:45.607529 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:45.607523 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs podName:de4f4f54-21b1-4371-81c9-eaab1f91b7e2 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:46.607503528 +0000 UTC m=+2.980779552 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs") pod "network-metrics-daemon-dtfhw" (UID: "de4f4f54-21b1-4371-81c9-eaab1f91b7e2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:45.607790 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:45.607558 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret podName:e32393bd-7852-45d8-864c-169ed011c28b nodeName:}" failed. No retries permitted until 2026-07-05 13:18:46.607541779 +0000 UTC m=+2.980817807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret") pod "global-pull-secret-syncer-f76k8" (UID: "e32393bd-7852-45d8-864c-169ed011c28b") : object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:45.811190 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.811077 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7c4v\" (UniqueName: \"kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v\") pod \"network-check-target-mwfmq\" (UID: \"ab416b96-ab8a-41bf-93b0-b4a83f8c09d9\") " pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:18:45.811484 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:45.811279 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 13:18:45.811484 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:45.811307 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 13:18:45.811484 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:45.811320 2577 projected.go:196] Error preparing data for projected volume kube-api-access-k7c4v for pod openshift-network-diagnostics/network-check-target-mwfmq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:45.811484 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:45.811380 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v podName:ab416b96-ab8a-41bf-93b0-b4a83f8c09d9 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:46.811358648 +0000 UTC m=+3.184634679 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7c4v" (UniqueName: "kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v") pod "network-check-target-mwfmq" (UID: "ab416b96-ab8a-41bf-93b0-b4a83f8c09d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:45.955509 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:45.955475 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 13:18:46.031940 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:46.031867 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 13:13:45 +0000 UTC" deadline="2028-02-27 20:07:49.485464899 +0000 UTC" Jul 05 13:18:46.031940 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:46.031937 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14454h49m3.453532077s" Jul 05 13:18:46.081759 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:46.080080 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 13:18:46.246864 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:46.246435 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xk5gp" event={"ID":"0bac94b6-2965-4acf-9cd6-1a74309d4254","Type":"ContainerStarted","Data":"d5fb4509dc0166de8b257c20cba28da21ad1c3ccb2f4df579abcb086e49d1e5a"} Jul 05 13:18:46.251347 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:46.251313 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" event={"ID":"de9933df-3daf-403e-ad99-aa326759e3ff","Type":"ContainerStarted","Data":"647ab6ccfe17ff099a95b5f8ad59004bc39cb499b800f012c96e5b1d2effeeff"} Jul 05 13:18:46.254386 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:46.254353 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sqxbh" event={"ID":"6b330688-b70c-47e5-b101-2178dae0a0ba","Type":"ContainerStarted","Data":"1fe5b6eab379081bacd6de8594366943e25120def35c747f37d3022e94cb0313"} Jul 05 13:18:46.268548 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:46.268429 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksrfp" event={"ID":"9494c1a0-c6fb-4812-b8ad-9dd48da15f68","Type":"ContainerStarted","Data":"c1d02536e0d1b14bf1a5049ec7af54efa749aeaa895539d931b5d56474b71bd6"} Jul 05 13:18:46.276987 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:46.276855 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" event={"ID":"9501a298fc7cfb0131e8a94db23d3d5b","Type":"ContainerStarted","Data":"52f634482ec6218452680c2afec21b07410cc80e1437fae538aa6a9f3b2a2b70"} Jul 05 13:18:46.297125 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:46.297083 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" event={"ID":"acc09a71-606e-4a33-9411-400891546e66","Type":"ContainerStarted","Data":"b102bf120317be3c6d2badcc99e373a60c87b3c96a0257d6695176692a3e3d60"} Jul 05 13:18:46.315881 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:46.315850 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"tuned\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:5be8cdcf34f35a89a70b6bfa49e66897641871237570b3e09766f83a0a473e6a\\\": ErrImagePull: pull QPS exceeded\"" pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" podUID="acc09a71-606e-4a33-9411-400891546e66" Jul 05 13:18:46.318546 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:46.318515 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" event={"ID":"5983413e-d98e-416d-a669-aa4c3e21bcbd","Type":"ContainerStarted","Data":"0733c19a588870616605549ef060dd062641a11c0e3e50106f90f32abc38c18a"} Jul 05 13:18:46.334147 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:46.334077 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sjwl5" event={"ID":"fb44c8db-1344-4303-adda-626772a8308f","Type":"ContainerStarted","Data":"3016a83192ac89a25795bda2091005d20787723aa4e5eb5aa8123033c7e078ae"} Jul 05 13:18:46.343745 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:46.343634 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4mgvc" event={"ID":"560be2cd-0ee9-4de3-b235-6c8f6162334c","Type":"ContainerStarted","Data":"a9396509216e6661e0e8dabd5d27aa0f6616089c6e324783287642cb8b54f38b"} Jul 05 13:18:46.361132 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:46.361072 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rpcxs" event={"ID":"550ceb2c-2505-4654-802f-4de1c9384663","Type":"ContainerStarted","Data":"2fda6ed83ed62c560ec91f006c55080342e13dbe47a20a908f52f72d8be8be9d"} Jul 05 13:18:46.380326 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:46.380123 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-227.ec2.internal" event={"ID":"4599d8e1fbf9c314f1658bf65accfac0","Type":"ContainerStarted","Data":"f417447a5a751bdc7409d91a3eb54f8d450a85a9cbd4026ee0c9fc1c990ad93b"} Jul 05 13:18:46.617873 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:46.617651 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs\") pod \"network-metrics-daemon-dtfhw\" (UID: \"de4f4f54-21b1-4371-81c9-eaab1f91b7e2\") " pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:18:46.617873 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:46.617740 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret\") pod \"global-pull-secret-syncer-f76k8\" (UID: \"e32393bd-7852-45d8-864c-169ed011c28b\") " pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:18:46.618306 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:46.617896 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:46.618306 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:46.617967 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret podName:e32393bd-7852-45d8-864c-169ed011c28b nodeName:}" failed. No retries permitted until 2026-07-05 13:18:48.617942148 +0000 UTC m=+4.991218165 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret") pod "global-pull-secret-syncer-f76k8" (UID: "e32393bd-7852-45d8-864c-169ed011c28b") : object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:46.618306 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:46.618037 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:46.618306 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:46.618070 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs podName:de4f4f54-21b1-4371-81c9-eaab1f91b7e2 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:48.618058948 +0000 UTC m=+4.991334963 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs") pod "network-metrics-daemon-dtfhw" (UID: "de4f4f54-21b1-4371-81c9-eaab1f91b7e2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:46.819324 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:46.818592 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7c4v\" (UniqueName: \"kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v\") pod \"network-check-target-mwfmq\" (UID: \"ab416b96-ab8a-41bf-93b0-b4a83f8c09d9\") " pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:18:46.819324 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:46.818827 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 13:18:46.819324 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:46.818849 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 13:18:46.819324 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:46.818863 2577 projected.go:196] Error preparing data for projected volume kube-api-access-k7c4v for pod openshift-network-diagnostics/network-check-target-mwfmq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:46.819324 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:46.818925 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v podName:ab416b96-ab8a-41bf-93b0-b4a83f8c09d9 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:48.818906299 +0000 UTC m=+5.192182326 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7c4v" (UniqueName: "kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v") pod "network-check-target-mwfmq" (UID: "ab416b96-ab8a-41bf-93b0-b4a83f8c09d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:47.032334 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:47.032239 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-04 13:13:45 +0000 UTC" deadline="2027-12-30 09:29:29.231134436 +0000 UTC" Jul 05 13:18:47.032334 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:47.032281 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13028h10m42.198857477s" Jul 05 13:18:47.229759 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:47.229726 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:18:47.229957 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:47.229852 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwfmq" podUID="ab416b96-ab8a-41bf-93b0-b4a83f8c09d9" Jul 05 13:18:47.229957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:47.229908 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:18:47.229957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:47.229924 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:18:47.230121 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:47.230032 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76k8" podUID="e32393bd-7852-45d8-864c-169ed011c28b" Jul 05 13:18:47.230172 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:47.230133 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfhw" podUID="de4f4f54-21b1-4371-81c9-eaab1f91b7e2" Jul 05 13:18:47.572307 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:47.572239 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 05 13:18:48.633147 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:48.632285 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs\") pod \"network-metrics-daemon-dtfhw\" (UID: \"de4f4f54-21b1-4371-81c9-eaab1f91b7e2\") " pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:18:48.633147 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:48.632356 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret\") pod \"global-pull-secret-syncer-f76k8\" (UID: \"e32393bd-7852-45d8-864c-169ed011c28b\") " pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:18:48.633147 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:48.632495 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:48.633147 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:48.632562 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret podName:e32393bd-7852-45d8-864c-169ed011c28b nodeName:}" failed. No retries permitted until 2026-07-05 13:18:52.632542566 +0000 UTC m=+9.005818603 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret") pod "global-pull-secret-syncer-f76k8" (UID: "e32393bd-7852-45d8-864c-169ed011c28b") : object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:48.633147 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:48.632997 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:48.633147 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:48.633054 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs podName:de4f4f54-21b1-4371-81c9-eaab1f91b7e2 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:52.633037026 +0000 UTC m=+9.006313041 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs") pod "network-metrics-daemon-dtfhw" (UID: "de4f4f54-21b1-4371-81c9-eaab1f91b7e2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:48.834220 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:48.834179 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7c4v\" (UniqueName: \"kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v\") pod \"network-check-target-mwfmq\" (UID: \"ab416b96-ab8a-41bf-93b0-b4a83f8c09d9\") " pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:18:48.834435 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:48.834411 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 13:18:48.834435 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:48.834434 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 13:18:48.834558 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:48.834448 2577 projected.go:196] Error preparing data for projected volume kube-api-access-k7c4v for pod openshift-network-diagnostics/network-check-target-mwfmq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:48.834558 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:48.834510 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v podName:ab416b96-ab8a-41bf-93b0-b4a83f8c09d9 nodeName:}" failed. No retries permitted until 2026-07-05 13:18:52.834491345 +0000 UTC m=+9.207767363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7c4v" (UniqueName: "kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v") pod "network-check-target-mwfmq" (UID: "ab416b96-ab8a-41bf-93b0-b4a83f8c09d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:49.230270 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:49.230227 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:18:49.230452 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:49.230388 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwfmq" podUID="ab416b96-ab8a-41bf-93b0-b4a83f8c09d9" Jul 05 13:18:49.230452 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:49.230227 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:18:49.230452 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:49.230422 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:18:49.230602 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:49.230501 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfhw" podUID="de4f4f54-21b1-4371-81c9-eaab1f91b7e2" Jul 05 13:18:49.230602 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:49.230567 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76k8" podUID="e32393bd-7852-45d8-864c-169ed011c28b" Jul 05 13:18:51.230279 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:51.230238 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:18:51.230834 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:51.230391 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfhw" podUID="de4f4f54-21b1-4371-81c9-eaab1f91b7e2" Jul 05 13:18:51.230834 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:51.230797 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:18:51.230962 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:51.230893 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76k8" podUID="e32393bd-7852-45d8-864c-169ed011c28b" Jul 05 13:18:51.230962 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:51.230947 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:18:51.231074 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:51.231023 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwfmq" podUID="ab416b96-ab8a-41bf-93b0-b4a83f8c09d9" Jul 05 13:18:52.665552 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:52.665514 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs\") pod \"network-metrics-daemon-dtfhw\" (UID: \"de4f4f54-21b1-4371-81c9-eaab1f91b7e2\") " pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:18:52.666002 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:52.665573 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret\") pod \"global-pull-secret-syncer-f76k8\" (UID: \"e32393bd-7852-45d8-864c-169ed011c28b\") " pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:18:52.666002 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:52.665696 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:52.666002 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:52.665725 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:52.666002 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:52.665769 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs podName:de4f4f54-21b1-4371-81c9-eaab1f91b7e2 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:00.665747419 +0000 UTC m=+17.039023436 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs") pod "network-metrics-daemon-dtfhw" (UID: "de4f4f54-21b1-4371-81c9-eaab1f91b7e2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:18:52.666002 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:52.665789 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret podName:e32393bd-7852-45d8-864c-169ed011c28b nodeName:}" failed. No retries permitted until 2026-07-05 13:19:00.665779132 +0000 UTC m=+17.039055149 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret") pod "global-pull-secret-syncer-f76k8" (UID: "e32393bd-7852-45d8-864c-169ed011c28b") : object "kube-system"/"original-pull-secret" not registered Jul 05 13:18:52.866887 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:52.866855 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7c4v\" (UniqueName: \"kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v\") pod \"network-check-target-mwfmq\" (UID: \"ab416b96-ab8a-41bf-93b0-b4a83f8c09d9\") " pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:18:52.867353 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:52.867063 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 13:18:52.867353 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:52.867090 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 13:18:52.867353 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:52.867103 2577 projected.go:196] Error preparing data for projected volume kube-api-access-k7c4v for pod openshift-network-diagnostics/network-check-target-mwfmq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:52.867353 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:52.867164 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v podName:ab416b96-ab8a-41bf-93b0-b4a83f8c09d9 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:00.867144004 +0000 UTC m=+17.240420034 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7c4v" (UniqueName: "kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v") pod "network-check-target-mwfmq" (UID: "ab416b96-ab8a-41bf-93b0-b4a83f8c09d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:18:53.230006 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:53.229946 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:18:53.230006 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:53.229986 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:18:53.230006 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:53.229986 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:18:53.230304 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:53.230080 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwfmq" podUID="ab416b96-ab8a-41bf-93b0-b4a83f8c09d9" Jul 05 13:18:53.230304 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:53.230220 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76k8" podUID="e32393bd-7852-45d8-864c-169ed011c28b" Jul 05 13:18:53.230410 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:53.230317 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfhw" podUID="de4f4f54-21b1-4371-81c9-eaab1f91b7e2" Jul 05 13:18:55.229665 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:55.229618 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:18:55.229665 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:55.229657 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:18:55.230143 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:55.229630 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:18:55.230143 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:55.229767 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76k8" podUID="e32393bd-7852-45d8-864c-169ed011c28b" Jul 05 13:18:55.230143 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:55.229853 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfhw" podUID="de4f4f54-21b1-4371-81c9-eaab1f91b7e2" Jul 05 13:18:55.230143 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:55.229943 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwfmq" podUID="ab416b96-ab8a-41bf-93b0-b4a83f8c09d9" Jul 05 13:18:57.229815 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:57.229786 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:18:57.229815 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:57.229816 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:18:57.230316 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:57.229786 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:18:57.230316 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:57.229908 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwfmq" podUID="ab416b96-ab8a-41bf-93b0-b4a83f8c09d9" Jul 05 13:18:57.230316 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:57.229976 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76k8" podUID="e32393bd-7852-45d8-864c-169ed011c28b" Jul 05 13:18:57.230316 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:57.230110 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfhw" podUID="de4f4f54-21b1-4371-81c9-eaab1f91b7e2" Jul 05 13:18:59.230339 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:59.230141 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:18:59.230813 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:59.230148 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:18:59.230813 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:59.230448 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfhw" podUID="de4f4f54-21b1-4371-81c9-eaab1f91b7e2" Jul 05 13:18:59.230813 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:18:59.230160 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:18:59.230813 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:59.230518 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwfmq" podUID="ab416b96-ab8a-41bf-93b0-b4a83f8c09d9" Jul 05 13:18:59.230813 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:18:59.230573 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76k8" podUID="e32393bd-7852-45d8-864c-169ed011c28b" Jul 05 13:19:00.720171 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:00.720132 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret\") pod \"global-pull-secret-syncer-f76k8\" (UID: \"e32393bd-7852-45d8-864c-169ed011c28b\") " pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:19:00.720623 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:00.720323 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 13:19:00.720623 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:00.720333 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs\") pod \"network-metrics-daemon-dtfhw\" (UID: \"de4f4f54-21b1-4371-81c9-eaab1f91b7e2\") " pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:19:00.720623 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:00.720393 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret podName:e32393bd-7852-45d8-864c-169ed011c28b nodeName:}" failed. No retries permitted until 2026-07-05 13:19:16.720374904 +0000 UTC m=+33.093650918 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret") pod "global-pull-secret-syncer-f76k8" (UID: "e32393bd-7852-45d8-864c-169ed011c28b") : object "kube-system"/"original-pull-secret" not registered Jul 05 13:19:00.720623 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:00.720453 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:19:00.720623 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:00.720493 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs podName:de4f4f54-21b1-4371-81c9-eaab1f91b7e2 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:16.720479773 +0000 UTC m=+33.093755789 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs") pod "network-metrics-daemon-dtfhw" (UID: "de4f4f54-21b1-4371-81c9-eaab1f91b7e2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:19:00.922187 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:00.922149 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7c4v\" (UniqueName: \"kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v\") pod \"network-check-target-mwfmq\" (UID: \"ab416b96-ab8a-41bf-93b0-b4a83f8c09d9\") " pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:19:00.922366 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:00.922257 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 13:19:00.922366 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:00.922278 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 13:19:00.922366 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:00.922290 2577 projected.go:196] Error preparing data for projected volume kube-api-access-k7c4v for pod openshift-network-diagnostics/network-check-target-mwfmq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:19:00.922366 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:00.922348 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v podName:ab416b96-ab8a-41bf-93b0-b4a83f8c09d9 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:16.922334038 +0000 UTC m=+33.295610052 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7c4v" (UniqueName: "kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v") pod "network-check-target-mwfmq" (UID: "ab416b96-ab8a-41bf-93b0-b4a83f8c09d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:19:01.229728 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:01.229691 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:19:01.229901 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:01.229692 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:19:01.229901 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:01.229817 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76k8" podUID="e32393bd-7852-45d8-864c-169ed011c28b" Jul 05 13:19:01.230020 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:01.229908 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfhw" podUID="de4f4f54-21b1-4371-81c9-eaab1f91b7e2" Jul 05 13:19:01.230020 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:01.229691 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:19:01.230115 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:01.230029 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwfmq" podUID="ab416b96-ab8a-41bf-93b0-b4a83f8c09d9" Jul 05 13:19:03.229967 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:03.229938 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:19:03.230335 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:03.229981 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:19:03.230335 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:03.229986 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:19:03.230335 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:03.230056 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfhw" podUID="de4f4f54-21b1-4371-81c9-eaab1f91b7e2" Jul 05 13:19:03.230335 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:03.230124 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwfmq" podUID="ab416b96-ab8a-41bf-93b0-b4a83f8c09d9" Jul 05 13:19:03.230335 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:03.230184 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76k8" podUID="e32393bd-7852-45d8-864c-169ed011c28b" Jul 05 13:19:03.424193 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:03.424157 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-227.ec2.internal" event={"ID":"4599d8e1fbf9c314f1658bf65accfac0","Type":"ContainerStarted","Data":"5d9e9ed0435058289028b39dc6520e16d89e9b32744b086d3b51204ef2c500b6"} Jul 05 13:19:03.425754 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:03.425700 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sqxbh" event={"ID":"6b330688-b70c-47e5-b101-2178dae0a0ba","Type":"ContainerStarted","Data":"02775216def43e424cb231f35af23df5cf1f48211497d7d7d3f705303941466f"} Jul 05 13:19:03.439216 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:03.439163 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-227.ec2.internal" podStartSLOduration=18.439145866 podStartE2EDuration="18.439145866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:03.438974882 +0000 UTC m=+19.812250915" watchObservedRunningTime="2026-07-05 13:19:03.439145866 +0000 UTC m=+19.812421899" Jul 05 13:19:03.458435 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:03.458383 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sqxbh" podStartSLOduration=1.754026701 podStartE2EDuration="19.458365226s" totalImagesPullingTime="17.704338525s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:03.458283551 +0000 UTC m=+19.831559607" watchObservedRunningTime="2026-07-05 13:19:03.458365226 +0000 UTC m=+19.831641261" Jul 05 13:19:04.430309 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:04.430070 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sjwl5" event={"ID":"fb44c8db-1344-4303-adda-626772a8308f","Type":"ContainerStarted","Data":"d091e4031f606bb8c2885aa4aaf4f342434e486c01bbc85d8cd793484e47c33a"} Jul 05 13:19:04.431999 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:04.431969 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rpcxs" event={"ID":"550ceb2c-2505-4654-802f-4de1c9384663","Type":"ContainerStarted","Data":"c51404934f7df44d6171083c54d777146073f80318941357adae44aa334ace4d"} Jul 05 13:19:04.433507 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:04.433479 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xk5gp" event={"ID":"0bac94b6-2965-4acf-9cd6-1a74309d4254","Type":"ContainerStarted","Data":"7374650af6acd0cdb82c75f737b53fca94397351ecf2aa0d8507523faab3ad93"} Jul 05 13:19:04.438104 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:04.438076 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" event={"ID":"de9933df-3daf-403e-ad99-aa326759e3ff","Type":"ContainerStarted","Data":"8423ff4cc3eca769acce26f5ce617457b3006d0a8d003526f541dff325af7fb2"} Jul 05 13:19:04.438226 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:04.438148 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" event={"ID":"de9933df-3daf-403e-ad99-aa326759e3ff","Type":"ContainerStarted","Data":"ec8ae09a5ba7422f1a8bd093b2e64b4cf4c274133aec61c8ac9a31081d253222"} Jul 05 13:19:04.438226 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:04.438181 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" event={"ID":"de9933df-3daf-403e-ad99-aa326759e3ff","Type":"ContainerStarted","Data":"2f8a150332d86616b45c068b1335e9ab322448322ac93b018120bfcdee7fb023"} Jul 05 13:19:04.438327 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:04.438225 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" event={"ID":"de9933df-3daf-403e-ad99-aa326759e3ff","Type":"ContainerStarted","Data":"628724f69858040f1650185ab2908438ff348025edcaaf850bd42a735ff88b14"} Jul 05 13:19:04.438327 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:04.438260 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" event={"ID":"de9933df-3daf-403e-ad99-aa326759e3ff","Type":"ContainerStarted","Data":"3e285a393e1793e698981fb598453b2ddd1abd9a431c6e474facaec52fad33f8"} Jul 05 13:19:04.438327 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:04.438301 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" event={"ID":"de9933df-3daf-403e-ad99-aa326759e3ff","Type":"ContainerStarted","Data":"7e315c4333611f6f3e0ada8ea9dd35960b269657e5c7c630d90c91d043576a4d"} Jul 05 13:19:04.439769 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:04.439746 2577 generic.go:356] "Generic (PLEG): container finished" podID="9494c1a0-c6fb-4812-b8ad-9dd48da15f68" containerID="30c1ab305f9ef5e67b21daaff941424f714a788a7b103533c40648ea0fdb9d29" exitCode=0 Jul 05 13:19:04.439897 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:04.439830 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksrfp" event={"ID":"9494c1a0-c6fb-4812-b8ad-9dd48da15f68","Type":"ContainerDied","Data":"30c1ab305f9ef5e67b21daaff941424f714a788a7b103533c40648ea0fdb9d29"} Jul 05 13:19:04.441789 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:04.441763 2577 generic.go:356] "Generic (PLEG): container finished" podID="9501a298fc7cfb0131e8a94db23d3d5b" containerID="effeb4f2e2c414728975fbce45da37103e951cada74d9913c2e3075376baa550" exitCode=0 Jul 05 13:19:04.442023 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:04.441992 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" event={"ID":"9501a298fc7cfb0131e8a94db23d3d5b","Type":"ContainerDied","Data":"effeb4f2e2c414728975fbce45da37103e951cada74d9913c2e3075376baa550"} Jul 05 13:19:04.444724 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:04.444699 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" event={"ID":"5983413e-d98e-416d-a669-aa4c3e21bcbd","Type":"ContainerStarted","Data":"ded0d3cd12d2b7488c7dfb19b4ff1795d934e03e01908e441e30ee2e5f22570a"} Jul 05 13:19:04.455275 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:04.455238 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sjwl5" podStartSLOduration=2.843017728 podStartE2EDuration="20.455225001s" totalImagesPullingTime="17.612207273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:04.45479755 +0000 UTC m=+20.828073584" watchObservedRunningTime="2026-07-05 13:19:04.455225001 +0000 UTC m=+20.828501033" Jul 05 13:19:04.515171 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:04.515119 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xk5gp" podStartSLOduration=2.86939591 podStartE2EDuration="20.515098109s" totalImagesPullingTime="17.645702199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:04.514611459 +0000 UTC m=+20.887887493" watchObservedRunningTime="2026-07-05 13:19:04.515098109 +0000 UTC m=+20.888374142" Jul 05 13:19:04.529931 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:04.529894 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rpcxs" podStartSLOduration=2.82127234 podStartE2EDuration="20.529878615s" totalImagesPullingTime="17.708606275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:04.529690316 +0000 UTC m=+20.902966371" watchObservedRunningTime="2026-07-05 13:19:04.529878615 +0000 UTC m=+20.903154647" Jul 05 13:19:05.065401 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:05.065347 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 05 13:19:05.229925 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:05.229475 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:19:05.229925 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:05.229488 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:19:05.229925 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:05.229479 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:19:05.229925 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:05.229601 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwfmq" podUID="ab416b96-ab8a-41bf-93b0-b4a83f8c09d9" Jul 05 13:19:05.229925 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:05.229737 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfhw" podUID="de4f4f54-21b1-4371-81c9-eaab1f91b7e2" Jul 05 13:19:05.229925 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:05.229829 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76k8" podUID="e32393bd-7852-45d8-864c-169ed011c28b" Jul 05 13:19:05.450325 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:05.450219 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" event={"ID":"9501a298fc7cfb0131e8a94db23d3d5b","Type":"ContainerStarted","Data":"2cf7ee230a012adb5c90da6a1ef0bf5b2b09bfea0d676077f34ec9e76909a7d1"} Jul 05 13:19:05.452590 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:05.452555 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" event={"ID":"5983413e-d98e-416d-a669-aa4c3e21bcbd","Type":"ContainerStarted","Data":"5827468a35049d7ab3f82476bfa0d64a05b51aa0a5032f51e8fb29559680e516"} Jul 05 13:19:05.454436 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:05.454361 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4mgvc" event={"ID":"560be2cd-0ee9-4de3-b235-6c8f6162334c","Type":"ContainerStarted","Data":"08feee251c88ec592ab3a4e68e618ac2bb38bb23576f731fcb84725c31154569"} Jul 05 13:19:05.467247 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:05.467193 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-227.ec2.internal" podStartSLOduration=20.467175272 podStartE2EDuration="20.467175272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:05.466969861 +0000 UTC m=+21.840245913" watchObservedRunningTime="2026-07-05 13:19:05.467175272 +0000 UTC m=+21.840451308" Jul 05 13:19:05.482586 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:05.482499 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4mgvc" podStartSLOduration=3.788082026 podStartE2EDuration="21.48248216s" totalImagesPullingTime="17.694400134s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:05.482379057 +0000 UTC m=+21.855655112" watchObservedRunningTime="2026-07-05 13:19:05.48248216 +0000 UTC m=+21.855758197" Jul 05 13:19:06.059141 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:06.058997 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-05T13:19:05.065366662Z","UUID":"4552751a-4eaf-4818-8859-29ccb76365c4","Handler":null,"Name":"","Endpoint":""} Jul 05 13:19:06.061268 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:06.061222 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 05 13:19:06.061403 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:06.061362 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 05 13:19:06.584895 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:06.584861 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xk5gp" Jul 05 13:19:07.230094 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:07.230067 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:19:07.230369 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:07.230109 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:19:07.230369 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:07.230059 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:19:07.230369 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:07.230197 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76k8" podUID="e32393bd-7852-45d8-864c-169ed011c28b" Jul 05 13:19:07.230369 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:07.230277 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwfmq" podUID="ab416b96-ab8a-41bf-93b0-b4a83f8c09d9" Jul 05 13:19:07.230369 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:07.230356 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfhw" podUID="de4f4f54-21b1-4371-81c9-eaab1f91b7e2" Jul 05 13:19:07.913380 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:07.913351 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xk5gp" Jul 05 13:19:07.914039 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:07.914024 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xk5gp" Jul 05 13:19:08.460933 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:08.460904 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xk5gp" Jul 05 13:19:09.229818 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:09.229790 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:19:09.230224 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:09.229920 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:19:09.230224 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:09.229923 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfhw" podUID="de4f4f54-21b1-4371-81c9-eaab1f91b7e2" Jul 05 13:19:09.230224 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:09.230051 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76k8" podUID="e32393bd-7852-45d8-864c-169ed011c28b" Jul 05 13:19:09.230224 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:09.230092 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:19:09.230224 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:09.230180 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwfmq" podUID="ab416b96-ab8a-41bf-93b0-b4a83f8c09d9" Jul 05 13:19:10.466323 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:10.466072 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" event={"ID":"acc09a71-606e-4a33-9411-400891546e66","Type":"ContainerStarted","Data":"d67877665a53d190fe82b831dde9174981fac9132a35c80eccdcc685a521c481"} Jul 05 13:19:10.468703 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:10.468673 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" event={"ID":"5983413e-d98e-416d-a669-aa4c3e21bcbd","Type":"ContainerStarted","Data":"4034905a992193a333178fad3317dc1d5d35c66f08d3ef2eeae77c269f60d0fb"} Jul 05 13:19:10.472310 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:10.472272 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" event={"ID":"de9933df-3daf-403e-ad99-aa326759e3ff","Type":"ContainerStarted","Data":"9ccffe9a1e6f3b54b09acf18061c715e474f34b36072aa98aa8163196eb7991b"} Jul 05 13:19:10.474355 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:10.474319 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksrfp" event={"ID":"9494c1a0-c6fb-4812-b8ad-9dd48da15f68","Type":"ContainerStarted","Data":"e4f4a2a09b27d7b67dad29a2a90afea2c410155ee528d60d37fbc4e5f246f2c2"} Jul 05 13:19:10.486656 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:10.486595 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gpdrt" podStartSLOduration=1.737552348 podStartE2EDuration="26.48658199s" totalImagesPullingTime="24.749029642s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-05 13:19:10.48637572 +0000 UTC m=+26.859651753" watchObservedRunningTime="2026-07-05 13:19:10.48658199 +0000 UTC m=+26.859858022" Jul 05 13:19:10.502793 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:10.502757 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-sqrqz" podStartSLOduration=2.91914604 podStartE2EDuration="26.502743827s" totalImagesPullingTime="23.583597787s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:10.50237107 +0000 UTC m=+26.875647103" watchObservedRunningTime="2026-07-05 13:19:10.502743827 +0000 UTC m=+26.876019859" Jul 05 13:19:11.229796 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:11.229760 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:19:11.229959 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:11.229853 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:19:11.229959 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:11.229861 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76k8" podUID="e32393bd-7852-45d8-864c-169ed011c28b" Jul 05 13:19:11.229959 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:11.229865 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:19:11.229959 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:11.229933 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwfmq" podUID="ab416b96-ab8a-41bf-93b0-b4a83f8c09d9" Jul 05 13:19:11.230170 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:11.229999 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfhw" podUID="de4f4f54-21b1-4371-81c9-eaab1f91b7e2" Jul 05 13:19:11.477759 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:11.477723 2577 generic.go:356] "Generic (PLEG): container finished" podID="9494c1a0-c6fb-4812-b8ad-9dd48da15f68" containerID="e4f4a2a09b27d7b67dad29a2a90afea2c410155ee528d60d37fbc4e5f246f2c2" exitCode=0 Jul 05 13:19:11.478316 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:11.477812 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksrfp" event={"ID":"9494c1a0-c6fb-4812-b8ad-9dd48da15f68","Type":"ContainerDied","Data":"e4f4a2a09b27d7b67dad29a2a90afea2c410155ee528d60d37fbc4e5f246f2c2"} Jul 05 13:19:12.483771 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:12.483569 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" event={"ID":"de9933df-3daf-403e-ad99-aa326759e3ff","Type":"ContainerStarted","Data":"a9bb2c6198658ad223c2d7a0ad46756b76bdf1d52827e7a0aeba2720f9695cb5"} Jul 05 13:19:12.484337 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:12.483836 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:19:12.487121 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:12.486424 2577 generic.go:356] "Generic (PLEG): container finished" podID="9494c1a0-c6fb-4812-b8ad-9dd48da15f68" containerID="a1ea91c338ef96bc8c3358a8b001bf1884325c6d4a2c14ed5074c3d106308559" exitCode=0 Jul 05 13:19:12.487121 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:12.486462 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksrfp" event={"ID":"9494c1a0-c6fb-4812-b8ad-9dd48da15f68","Type":"ContainerDied","Data":"a1ea91c338ef96bc8c3358a8b001bf1884325c6d4a2c14ed5074c3d106308559"} Jul 05 13:19:12.502917 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:12.502757 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:19:12.534016 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:12.533971 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" podStartSLOduration=10.086558135 podStartE2EDuration="28.53395596s" totalImagesPullingTime="18.447397825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:12.533387702 +0000 UTC m=+28.906663734" watchObservedRunningTime="2026-07-05 13:19:12.53395596 +0000 UTC m=+28.907231991" Jul 05 13:19:13.229515 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:13.229448 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:19:13.229515 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:13.229512 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:19:13.229728 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:13.229485 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:19:13.229728 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:13.229593 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76k8" podUID="e32393bd-7852-45d8-864c-169ed011c28b" Jul 05 13:19:13.229728 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:13.229680 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwfmq" podUID="ab416b96-ab8a-41bf-93b0-b4a83f8c09d9" Jul 05 13:19:13.229810 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:13.229732 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfhw" podUID="de4f4f54-21b1-4371-81c9-eaab1f91b7e2" Jul 05 13:19:13.491287 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:13.491255 2577 generic.go:356] "Generic (PLEG): container finished" podID="9494c1a0-c6fb-4812-b8ad-9dd48da15f68" containerID="6568c64195dcf5edd6cf0de2ca2094350462845b74430178483899a64943eef5" exitCode=0 Jul 05 13:19:13.491727 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:13.491343 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksrfp" event={"ID":"9494c1a0-c6fb-4812-b8ad-9dd48da15f68","Type":"ContainerDied","Data":"6568c64195dcf5edd6cf0de2ca2094350462845b74430178483899a64943eef5"} Jul 05 13:19:13.491787 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:13.491745 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:19:13.491835 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:13.491810 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:19:13.506533 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:13.506510 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:19:14.482891 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:14.482854 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f76k8"] Jul 05 13:19:14.483049 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:14.482961 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:19:14.483110 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:14.483054 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76k8" podUID="e32393bd-7852-45d8-864c-169ed011c28b" Jul 05 13:19:14.486385 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:14.486352 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dtfhw"] Jul 05 13:19:14.486540 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:14.486517 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:19:14.486688 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:14.486669 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfhw" podUID="de4f4f54-21b1-4371-81c9-eaab1f91b7e2" Jul 05 13:19:14.486758 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:14.486732 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mwfmq"] Jul 05 13:19:14.486847 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:14.486823 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:19:14.486942 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:14.486910 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwfmq" podUID="ab416b96-ab8a-41bf-93b0-b4a83f8c09d9" Jul 05 13:19:16.229661 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:16.229427 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:19:16.230094 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:16.229427 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:19:16.230094 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:16.229767 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76k8" podUID="e32393bd-7852-45d8-864c-169ed011c28b" Jul 05 13:19:16.230094 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:16.229847 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwfmq" podUID="ab416b96-ab8a-41bf-93b0-b4a83f8c09d9" Jul 05 13:19:16.230094 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:16.229494 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:19:16.230094 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:16.229950 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfhw" podUID="de4f4f54-21b1-4371-81c9-eaab1f91b7e2" Jul 05 13:19:16.750000 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:16.749958 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret\") pod \"global-pull-secret-syncer-f76k8\" (UID: \"e32393bd-7852-45d8-864c-169ed011c28b\") " pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:19:16.750197 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:16.750036 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs\") pod \"network-metrics-daemon-dtfhw\" (UID: \"de4f4f54-21b1-4371-81c9-eaab1f91b7e2\") " pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:19:16.750197 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:16.750109 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:19:16.750197 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:16.750166 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs podName:de4f4f54-21b1-4371-81c9-eaab1f91b7e2 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:48.750148118 +0000 UTC m=+65.123424131 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs") pod "network-metrics-daemon-dtfhw" (UID: "de4f4f54-21b1-4371-81c9-eaab1f91b7e2") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 05 13:19:16.750197 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:16.750109 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 05 13:19:16.750393 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:16.750227 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret podName:e32393bd-7852-45d8-864c-169ed011c28b nodeName:}" failed. No retries permitted until 2026-07-05 13:19:48.750213695 +0000 UTC m=+65.123489709 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret") pod "global-pull-secret-syncer-f76k8" (UID: "e32393bd-7852-45d8-864c-169ed011c28b") : object "kube-system"/"original-pull-secret" not registered Jul 05 13:19:16.952317 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:16.952268 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7c4v\" (UniqueName: \"kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v\") pod \"network-check-target-mwfmq\" (UID: \"ab416b96-ab8a-41bf-93b0-b4a83f8c09d9\") " pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:19:16.952532 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:16.952420 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 05 13:19:16.952532 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:16.952447 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 05 13:19:16.952532 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:16.952457 2577 projected.go:196] Error preparing data for projected volume kube-api-access-k7c4v for pod openshift-network-diagnostics/network-check-target-mwfmq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:19:16.952532 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:16.952513 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v podName:ab416b96-ab8a-41bf-93b0-b4a83f8c09d9 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:48.952494619 +0000 UTC m=+65.325770652 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-k7c4v" (UniqueName: "kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v") pod "network-check-target-mwfmq" (UID: "ab416b96-ab8a-41bf-93b0-b4a83f8c09d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 05 13:19:18.230250 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:18.230167 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:19:18.230829 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:18.230170 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:19:18.230829 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:18.230280 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76k8" podUID="e32393bd-7852-45d8-864c-169ed011c28b" Jul 05 13:19:18.230829 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:18.230170 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:19:18.230829 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:18.230441 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfhw" podUID="de4f4f54-21b1-4371-81c9-eaab1f91b7e2" Jul 05 13:19:18.230829 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:18.230347 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwfmq" podUID="ab416b96-ab8a-41bf-93b0-b4a83f8c09d9" Jul 05 13:19:18.505116 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:18.505026 2577 generic.go:356] "Generic (PLEG): container finished" podID="9494c1a0-c6fb-4812-b8ad-9dd48da15f68" containerID="e53693f853992d2012837898db72b6e53e8efcab502c6c7f93dd54ea92498772" exitCode=0 Jul 05 13:19:18.505116 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:18.505071 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksrfp" event={"ID":"9494c1a0-c6fb-4812-b8ad-9dd48da15f68","Type":"ContainerDied","Data":"e53693f853992d2012837898db72b6e53e8efcab502c6c7f93dd54ea92498772"} Jul 05 13:19:19.509812 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:19.509776 2577 generic.go:356] "Generic (PLEG): container finished" podID="9494c1a0-c6fb-4812-b8ad-9dd48da15f68" containerID="e5d2102c160e2af41151a300080c61ed8fa4c6cc8ff46554271e0eae4cd36bd0" exitCode=0 Jul 05 13:19:19.510261 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:19.509820 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksrfp" event={"ID":"9494c1a0-c6fb-4812-b8ad-9dd48da15f68","Type":"ContainerDied","Data":"e5d2102c160e2af41151a300080c61ed8fa4c6cc8ff46554271e0eae4cd36bd0"} Jul 05 13:19:20.230292 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:20.230256 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:19:20.230474 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:20.230256 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:19:20.230474 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:20.230369 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfhw" podUID="de4f4f54-21b1-4371-81c9-eaab1f91b7e2" Jul 05 13:19:20.230474 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:20.230395 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:19:20.230589 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:20.230471 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwfmq" podUID="ab416b96-ab8a-41bf-93b0-b4a83f8c09d9" Jul 05 13:19:20.230589 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:20.230534 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76k8" podUID="e32393bd-7852-45d8-864c-169ed011c28b" Jul 05 13:19:20.515918 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:20.515890 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ksrfp" event={"ID":"9494c1a0-c6fb-4812-b8ad-9dd48da15f68","Type":"ContainerStarted","Data":"63ac35074348bd1a07fe44262169eef3d90d59b8b5e26d31e5e6cefe9eb66226"} Jul 05 13:19:20.551282 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:20.551237 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ksrfp" podStartSLOduration=7.479707688 podStartE2EDuration="36.551222772s" totalImagesPullingTime="29.071515084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:20.549818439 +0000 UTC m=+36.923094495" watchObservedRunningTime="2026-07-05 13:19:20.551222772 +0000 UTC m=+36.924498803" Jul 05 13:19:22.230120 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:22.230092 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:19:22.230667 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:22.230101 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:19:22.230667 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:22.230181 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwfmq" podUID="ab416b96-ab8a-41bf-93b0-b4a83f8c09d9" Jul 05 13:19:22.230667 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:22.230101 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:19:22.230667 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:22.230259 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfhw" podUID="de4f4f54-21b1-4371-81c9-eaab1f91b7e2" Jul 05 13:19:22.230667 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:22.230372 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76k8" podUID="e32393bd-7852-45d8-864c-169ed011c28b" Jul 05 13:19:24.230529 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:24.230362 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:19:24.230962 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:24.230446 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:19:24.230962 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:24.230606 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dtfhw" podUID="de4f4f54-21b1-4371-81c9-eaab1f91b7e2" Jul 05 13:19:24.230962 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:24.230471 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:19:24.230962 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:24.230683 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwfmq" podUID="ab416b96-ab8a-41bf-93b0-b4a83f8c09d9" Jul 05 13:19:24.230962 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:24.230754 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-f76k8" podUID="e32393bd-7852-45d8-864c-169ed011c28b" Jul 05 13:19:25.338041 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.338015 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rpcxs_550ceb2c-2505-4654-802f-4de1c9384663/dns-node-resolver/0.log" Jul 05 13:19:25.453961 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.453931 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-227.ec2.internal" event="NodeReady" Jul 05 13:19:25.454099 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.454030 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 05 13:19:25.554155 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.554127 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2x7hd"] Jul 05 13:19:25.585695 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.585665 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lmrck"] Jul 05 13:19:25.585815 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.585771 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:25.590475 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.590414 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 05 13:19:25.590765 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.590748 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 05 13:19:25.591623 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.591604 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vjf7b\"" Jul 05 13:19:25.593286 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.593268 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 05 13:19:25.593418 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.593400 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 05 13:19:25.609218 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.609194 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lmrck"] Jul 05 13:19:25.609218 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.609223 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2x7hd"] Jul 05 13:19:25.609332 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.609244 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bx6rk"] Jul 05 13:19:25.609332 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.609291 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lmrck" Jul 05 13:19:25.617056 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.617035 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 05 13:19:25.617149 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.617139 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 05 13:19:25.617214 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.617169 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 05 13:19:25.617364 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.617349 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gcgw5\"" Jul 05 13:19:25.629364 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.629342 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bx6rk" Jul 05 13:19:25.634651 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.634620 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 05 13:19:25.634811 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.634790 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dww7h\"" Jul 05 13:19:25.634895 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.634794 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 05 13:19:25.649383 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.649365 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bx6rk"] Jul 05 13:19:25.718986 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.718959 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05aca99d-967b-4612-a4bf-eec008dea6a8-tmp-dir\") pod \"dns-default-bx6rk\" (UID: \"05aca99d-967b-4612-a4bf-eec008dea6a8\") " pod="openshift-dns/dns-default-bx6rk" Jul 05 13:19:25.719111 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.719003 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05aca99d-967b-4612-a4bf-eec008dea6a8-metrics-tls\") pod \"dns-default-bx6rk\" (UID: \"05aca99d-967b-4612-a4bf-eec008dea6a8\") " pod="openshift-dns/dns-default-bx6rk" Jul 05 13:19:25.719111 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.719030 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fxd7\" (UniqueName: \"kubernetes.io/projected/7139a2d1-8d78-4ee6-810e-cadde0d0d131-kube-api-access-4fxd7\") pod \"ingress-canary-lmrck\" (UID: \"7139a2d1-8d78-4ee6-810e-cadde0d0d131\") " pod="openshift-ingress-canary/ingress-canary-lmrck" Jul 05 13:19:25.719111 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.719082 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2jrc\" (UniqueName: \"kubernetes.io/projected/05aca99d-967b-4612-a4bf-eec008dea6a8-kube-api-access-v2jrc\") pod \"dns-default-bx6rk\" (UID: \"05aca99d-967b-4612-a4bf-eec008dea6a8\") " pod="openshift-dns/dns-default-bx6rk" Jul 05 13:19:25.719219 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.719137 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wvkf\" (UniqueName: \"kubernetes.io/projected/9e28539f-e30b-42c4-8dc4-cb7289a76f15-kube-api-access-6wvkf\") pod \"insights-runtime-extractor-2x7hd\" (UID: \"9e28539f-e30b-42c4-8dc4-cb7289a76f15\") " pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:25.719219 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.719163 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e28539f-e30b-42c4-8dc4-cb7289a76f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2x7hd\" (UID: \"9e28539f-e30b-42c4-8dc4-cb7289a76f15\") " pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:25.719219 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.719195 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e28539f-e30b-42c4-8dc4-cb7289a76f15-crio-socket\") pod \"insights-runtime-extractor-2x7hd\" (UID: \"9e28539f-e30b-42c4-8dc4-cb7289a76f15\") " pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:25.719219 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.719212 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7139a2d1-8d78-4ee6-810e-cadde0d0d131-cert\") pod \"ingress-canary-lmrck\" (UID: \"7139a2d1-8d78-4ee6-810e-cadde0d0d131\") " pod="openshift-ingress-canary/ingress-canary-lmrck" Jul 05 13:19:25.719351 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.719236 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e28539f-e30b-42c4-8dc4-cb7289a76f15-data-volume\") pod \"insights-runtime-extractor-2x7hd\" (UID: \"9e28539f-e30b-42c4-8dc4-cb7289a76f15\") " pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:25.719351 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.719252 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e28539f-e30b-42c4-8dc4-cb7289a76f15-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2x7hd\" (UID: \"9e28539f-e30b-42c4-8dc4-cb7289a76f15\") " pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:25.719351 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.719266 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05aca99d-967b-4612-a4bf-eec008dea6a8-config-volume\") pod \"dns-default-bx6rk\" (UID: \"05aca99d-967b-4612-a4bf-eec008dea6a8\") " pod="openshift-dns/dns-default-bx6rk" Jul 05 13:19:25.820087 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.820057 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e28539f-e30b-42c4-8dc4-cb7289a76f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2x7hd\" (UID: \"9e28539f-e30b-42c4-8dc4-cb7289a76f15\") " pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:25.820223 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.820092 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e28539f-e30b-42c4-8dc4-cb7289a76f15-crio-socket\") pod \"insights-runtime-extractor-2x7hd\" (UID: \"9e28539f-e30b-42c4-8dc4-cb7289a76f15\") " pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:25.820223 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.820111 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7139a2d1-8d78-4ee6-810e-cadde0d0d131-cert\") pod \"ingress-canary-lmrck\" (UID: \"7139a2d1-8d78-4ee6-810e-cadde0d0d131\") " pod="openshift-ingress-canary/ingress-canary-lmrck" Jul 05 13:19:25.820223 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.820129 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e28539f-e30b-42c4-8dc4-cb7289a76f15-data-volume\") pod \"insights-runtime-extractor-2x7hd\" (UID: \"9e28539f-e30b-42c4-8dc4-cb7289a76f15\") " pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:25.820223 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:25.820206 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 13:19:25.820406 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.820258 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e28539f-e30b-42c4-8dc4-cb7289a76f15-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2x7hd\" (UID: \"9e28539f-e30b-42c4-8dc4-cb7289a76f15\") " pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:25.820406 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.820279 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9e28539f-e30b-42c4-8dc4-cb7289a76f15-crio-socket\") pod \"insights-runtime-extractor-2x7hd\" (UID: \"9e28539f-e30b-42c4-8dc4-cb7289a76f15\") " pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:25.820406 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:25.820291 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e28539f-e30b-42c4-8dc4-cb7289a76f15-insights-runtime-extractor-tls podName:9e28539f-e30b-42c4-8dc4-cb7289a76f15 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:26.320261922 +0000 UTC m=+42.693537932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e28539f-e30b-42c4-8dc4-cb7289a76f15-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2x7hd" (UID: "9e28539f-e30b-42c4-8dc4-cb7289a76f15") : secret "insights-runtime-extractor-tls" not found Jul 05 13:19:25.820406 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.820321 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05aca99d-967b-4612-a4bf-eec008dea6a8-config-volume\") pod \"dns-default-bx6rk\" (UID: \"05aca99d-967b-4612-a4bf-eec008dea6a8\") " pod="openshift-dns/dns-default-bx6rk" Jul 05 13:19:25.820406 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.820359 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05aca99d-967b-4612-a4bf-eec008dea6a8-tmp-dir\") pod \"dns-default-bx6rk\" (UID: \"05aca99d-967b-4612-a4bf-eec008dea6a8\") " pod="openshift-dns/dns-default-bx6rk" Jul 05 13:19:25.820406 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:25.820324 2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 05 13:19:25.820752 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.820438 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9e28539f-e30b-42c4-8dc4-cb7289a76f15-data-volume\") pod \"insights-runtime-extractor-2x7hd\" (UID: \"9e28539f-e30b-42c4-8dc4-cb7289a76f15\") " pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:25.820752 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:25.820442 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9e28539f-e30b-42c4-8dc4-cb7289a76f15-kube-rbac-proxy-cm podName:9e28539f-e30b-42c4-8dc4-cb7289a76f15 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:26.320424251 +0000 UTC m=+42.693700284 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9e28539f-e30b-42c4-8dc4-cb7289a76f15-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2x7hd" (UID: "9e28539f-e30b-42c4-8dc4-cb7289a76f15") : configmap "kube-rbac-proxy" not found Jul 05 13:19:25.820752 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.820479 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05aca99d-967b-4612-a4bf-eec008dea6a8-metrics-tls\") pod \"dns-default-bx6rk\" (UID: \"05aca99d-967b-4612-a4bf-eec008dea6a8\") " pod="openshift-dns/dns-default-bx6rk" Jul 05 13:19:25.820752 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.820524 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fxd7\" (UniqueName: \"kubernetes.io/projected/7139a2d1-8d78-4ee6-810e-cadde0d0d131-kube-api-access-4fxd7\") pod \"ingress-canary-lmrck\" (UID: \"7139a2d1-8d78-4ee6-810e-cadde0d0d131\") " pod="openshift-ingress-canary/ingress-canary-lmrck" Jul 05 13:19:25.820752 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:25.820577 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 13:19:25.820752 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:25.820626 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05aca99d-967b-4612-a4bf-eec008dea6a8-metrics-tls podName:05aca99d-967b-4612-a4bf-eec008dea6a8 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:26.320609836 +0000 UTC m=+42.693885872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05aca99d-967b-4612-a4bf-eec008dea6a8-metrics-tls") pod "dns-default-bx6rk" (UID: "05aca99d-967b-4612-a4bf-eec008dea6a8") : secret "dns-default-metrics-tls" not found Jul 05 13:19:25.820752 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.820668 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2jrc\" (UniqueName: \"kubernetes.io/projected/05aca99d-967b-4612-a4bf-eec008dea6a8-kube-api-access-v2jrc\") pod \"dns-default-bx6rk\" (UID: \"05aca99d-967b-4612-a4bf-eec008dea6a8\") " pod="openshift-dns/dns-default-bx6rk" Jul 05 13:19:25.820752 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.820722 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wvkf\" (UniqueName: \"kubernetes.io/projected/9e28539f-e30b-42c4-8dc4-cb7289a76f15-kube-api-access-6wvkf\") pod \"insights-runtime-extractor-2x7hd\" (UID: \"9e28539f-e30b-42c4-8dc4-cb7289a76f15\") " pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:25.820752 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.820750 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05aca99d-967b-4612-a4bf-eec008dea6a8-tmp-dir\") pod \"dns-default-bx6rk\" (UID: \"05aca99d-967b-4612-a4bf-eec008dea6a8\") " pod="openshift-dns/dns-default-bx6rk" Jul 05 13:19:25.821142 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.820995 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05aca99d-967b-4612-a4bf-eec008dea6a8-config-volume\") pod \"dns-default-bx6rk\" (UID: \"05aca99d-967b-4612-a4bf-eec008dea6a8\") " pod="openshift-dns/dns-default-bx6rk" Jul 05 13:19:25.824125 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.824104 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7139a2d1-8d78-4ee6-810e-cadde0d0d131-cert\") pod \"ingress-canary-lmrck\" (UID: \"7139a2d1-8d78-4ee6-810e-cadde0d0d131\") " pod="openshift-ingress-canary/ingress-canary-lmrck" Jul 05 13:19:25.842128 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.842066 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2jrc\" (UniqueName: \"kubernetes.io/projected/05aca99d-967b-4612-a4bf-eec008dea6a8-kube-api-access-v2jrc\") pod \"dns-default-bx6rk\" (UID: \"05aca99d-967b-4612-a4bf-eec008dea6a8\") " pod="openshift-dns/dns-default-bx6rk" Jul 05 13:19:25.842827 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.842811 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fxd7\" (UniqueName: \"kubernetes.io/projected/7139a2d1-8d78-4ee6-810e-cadde0d0d131-kube-api-access-4fxd7\") pod \"ingress-canary-lmrck\" (UID: \"7139a2d1-8d78-4ee6-810e-cadde0d0d131\") " pod="openshift-ingress-canary/ingress-canary-lmrck" Jul 05 13:19:25.842983 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.842968 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wvkf\" (UniqueName: \"kubernetes.io/projected/9e28539f-e30b-42c4-8dc4-cb7289a76f15-kube-api-access-6wvkf\") pod \"insights-runtime-extractor-2x7hd\" (UID: \"9e28539f-e30b-42c4-8dc4-cb7289a76f15\") " pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:25.917289 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:25.917243 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lmrck" Jul 05 13:19:26.093776 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.093709 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lmrck"] Jul 05 13:19:26.097323 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:19:26.097300 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7139a2d1_8d78_4ee6_810e_cadde0d0d131.slice/crio-6e8c1f44c561b82fe0887d2fbb4f2f586ad4ef48bfec73e29afd6dff92700bed WatchSource:0}: Error finding container 6e8c1f44c561b82fe0887d2fbb4f2f586ad4ef48bfec73e29afd6dff92700bed: Status 404 returned error can't find the container with id 6e8c1f44c561b82fe0887d2fbb4f2f586ad4ef48bfec73e29afd6dff92700bed Jul 05 13:19:26.183684 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.183628 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-4jvtw"] Jul 05 13:19:26.202239 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.202214 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-4jvtw" Jul 05 13:19:26.212529 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.212504 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 05 13:19:26.212529 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.212528 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 05 13:19:26.212709 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.212531 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 05 13:19:26.212709 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.212565 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 05 13:19:26.212709 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.212556 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-7v9fh\"" Jul 05 13:19:26.215291 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.215272 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-4jvtw"] Jul 05 13:19:26.229275 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.229250 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:19:26.229371 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.229251 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:19:26.229435 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.229413 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:19:26.234668 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.234632 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 05 13:19:26.235622 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.235602 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kn7g2\"" Jul 05 13:19:26.236799 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.236782 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 05 13:19:26.237009 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.236995 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 05 13:19:26.237084 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.237032 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 05 13:19:26.237084 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.237075 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6n5k8\"" Jul 05 13:19:26.283946 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.283922 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sjwl5_fb44c8db-1344-4303-adda-626772a8308f/node-ca/0.log" Jul 05 13:19:26.325267 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.325240 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e28539f-e30b-42c4-8dc4-cb7289a76f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2x7hd\" (UID: \"9e28539f-e30b-42c4-8dc4-cb7289a76f15\") " pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:26.325364 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.325274 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k2sl\" (UniqueName: \"kubernetes.io/projected/d2511a0d-848a-4479-8372-f7359a2a3dfc-kube-api-access-9k2sl\") pod \"service-ca-758f599c5-4jvtw\" (UID: \"d2511a0d-848a-4479-8372-f7359a2a3dfc\") " pod="openshift-service-ca/service-ca-758f599c5-4jvtw" Jul 05 13:19:26.325364 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.325297 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e28539f-e30b-42c4-8dc4-cb7289a76f15-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2x7hd\" (UID: \"9e28539f-e30b-42c4-8dc4-cb7289a76f15\") " pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:26.325364 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.325352 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d2511a0d-848a-4479-8372-f7359a2a3dfc-signing-key\") pod \"service-ca-758f599c5-4jvtw\" (UID: \"d2511a0d-848a-4479-8372-f7359a2a3dfc\") " pod="openshift-service-ca/service-ca-758f599c5-4jvtw" Jul 05 13:19:26.325507 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.325388 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d2511a0d-848a-4479-8372-f7359a2a3dfc-signing-cabundle\") pod \"service-ca-758f599c5-4jvtw\" (UID: \"d2511a0d-848a-4479-8372-f7359a2a3dfc\") " pod="openshift-service-ca/service-ca-758f599c5-4jvtw" Jul 05 13:19:26.325507 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.325465 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05aca99d-967b-4612-a4bf-eec008dea6a8-metrics-tls\") pod \"dns-default-bx6rk\" (UID: \"05aca99d-967b-4612-a4bf-eec008dea6a8\") " pod="openshift-dns/dns-default-bx6rk" Jul 05 13:19:26.325507 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:26.325479 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 13:19:26.325660 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:26.325546 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e28539f-e30b-42c4-8dc4-cb7289a76f15-insights-runtime-extractor-tls podName:9e28539f-e30b-42c4-8dc4-cb7289a76f15 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:27.325528212 +0000 UTC m=+43.698804241 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e28539f-e30b-42c4-8dc4-cb7289a76f15-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2x7hd" (UID: "9e28539f-e30b-42c4-8dc4-cb7289a76f15") : secret "insights-runtime-extractor-tls" not found Jul 05 13:19:26.325660 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:26.325558 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 13:19:26.325660 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:26.325609 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05aca99d-967b-4612-a4bf-eec008dea6a8-metrics-tls podName:05aca99d-967b-4612-a4bf-eec008dea6a8 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:27.325591797 +0000 UTC m=+43.698867808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05aca99d-967b-4612-a4bf-eec008dea6a8-metrics-tls") pod "dns-default-bx6rk" (UID: "05aca99d-967b-4612-a4bf-eec008dea6a8") : secret "dns-default-metrics-tls" not found Jul 05 13:19:26.325981 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.325964 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9e28539f-e30b-42c4-8dc4-cb7289a76f15-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2x7hd\" (UID: \"9e28539f-e30b-42c4-8dc4-cb7289a76f15\") " pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:26.426173 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.426096 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k2sl\" (UniqueName: \"kubernetes.io/projected/d2511a0d-848a-4479-8372-f7359a2a3dfc-kube-api-access-9k2sl\") pod \"service-ca-758f599c5-4jvtw\" (UID: \"d2511a0d-848a-4479-8372-f7359a2a3dfc\") " pod="openshift-service-ca/service-ca-758f599c5-4jvtw" Jul 05 13:19:26.426173 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.426138 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d2511a0d-848a-4479-8372-f7359a2a3dfc-signing-key\") pod \"service-ca-758f599c5-4jvtw\" (UID: \"d2511a0d-848a-4479-8372-f7359a2a3dfc\") " pod="openshift-service-ca/service-ca-758f599c5-4jvtw" Jul 05 13:19:26.426173 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.426154 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d2511a0d-848a-4479-8372-f7359a2a3dfc-signing-cabundle\") pod \"service-ca-758f599c5-4jvtw\" (UID: \"d2511a0d-848a-4479-8372-f7359a2a3dfc\") " pod="openshift-service-ca/service-ca-758f599c5-4jvtw" Jul 05 13:19:26.426794 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.426768 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/d2511a0d-848a-4479-8372-f7359a2a3dfc-signing-cabundle\") pod \"service-ca-758f599c5-4jvtw\" (UID: \"d2511a0d-848a-4479-8372-f7359a2a3dfc\") " pod="openshift-service-ca/service-ca-758f599c5-4jvtw" Jul 05 13:19:26.429330 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.429306 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/d2511a0d-848a-4479-8372-f7359a2a3dfc-signing-key\") pod \"service-ca-758f599c5-4jvtw\" (UID: \"d2511a0d-848a-4479-8372-f7359a2a3dfc\") " pod="openshift-service-ca/service-ca-758f599c5-4jvtw" Jul 05 13:19:26.439386 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.439369 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k2sl\" (UniqueName: \"kubernetes.io/projected/d2511a0d-848a-4479-8372-f7359a2a3dfc-kube-api-access-9k2sl\") pod \"service-ca-758f599c5-4jvtw\" (UID: \"d2511a0d-848a-4479-8372-f7359a2a3dfc\") " pod="openshift-service-ca/service-ca-758f599c5-4jvtw" Jul 05 13:19:26.511323 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.511289 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-4jvtw" Jul 05 13:19:26.530689 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.530470 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lmrck" event={"ID":"7139a2d1-8d78-4ee6-810e-cadde0d0d131","Type":"ContainerStarted","Data":"6e8c1f44c561b82fe0887d2fbb4f2f586ad4ef48bfec73e29afd6dff92700bed"} Jul 05 13:19:26.679769 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:26.679677 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-4jvtw"] Jul 05 13:19:26.685294 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:19:26.685263 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2511a0d_848a_4479_8372_f7359a2a3dfc.slice/crio-275afadf6394ec3502abb11c037e20a668ca2362ff021e6e49247712d227d38e WatchSource:0}: Error finding container 275afadf6394ec3502abb11c037e20a668ca2362ff021e6e49247712d227d38e: Status 404 returned error can't find the container with id 275afadf6394ec3502abb11c037e20a668ca2362ff021e6e49247712d227d38e Jul 05 13:19:27.332924 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:27.332880 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05aca99d-967b-4612-a4bf-eec008dea6a8-metrics-tls\") pod \"dns-default-bx6rk\" (UID: \"05aca99d-967b-4612-a4bf-eec008dea6a8\") " pod="openshift-dns/dns-default-bx6rk" Jul 05 13:19:27.333117 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:27.332975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e28539f-e30b-42c4-8dc4-cb7289a76f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2x7hd\" (UID: \"9e28539f-e30b-42c4-8dc4-cb7289a76f15\") " pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:27.333117 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:27.333097 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 13:19:27.333234 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:27.333171 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05aca99d-967b-4612-a4bf-eec008dea6a8-metrics-tls podName:05aca99d-967b-4612-a4bf-eec008dea6a8 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:29.333149336 +0000 UTC m=+45.706425348 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05aca99d-967b-4612-a4bf-eec008dea6a8-metrics-tls") pod "dns-default-bx6rk" (UID: "05aca99d-967b-4612-a4bf-eec008dea6a8") : secret "dns-default-metrics-tls" not found Jul 05 13:19:27.333234 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:27.333105 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 13:19:27.333341 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:27.333235 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e28539f-e30b-42c4-8dc4-cb7289a76f15-insights-runtime-extractor-tls podName:9e28539f-e30b-42c4-8dc4-cb7289a76f15 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:29.333218189 +0000 UTC m=+45.706494215 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e28539f-e30b-42c4-8dc4-cb7289a76f15-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2x7hd" (UID: "9e28539f-e30b-42c4-8dc4-cb7289a76f15") : secret "insights-runtime-extractor-tls" not found Jul 05 13:19:27.535224 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:27.535184 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-4jvtw" event={"ID":"d2511a0d-848a-4479-8372-f7359a2a3dfc","Type":"ContainerStarted","Data":"275afadf6394ec3502abb11c037e20a668ca2362ff021e6e49247712d227d38e"} Jul 05 13:19:29.351248 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:29.351225 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05aca99d-967b-4612-a4bf-eec008dea6a8-metrics-tls\") pod \"dns-default-bx6rk\" (UID: \"05aca99d-967b-4612-a4bf-eec008dea6a8\") " pod="openshift-dns/dns-default-bx6rk" Jul 05 13:19:29.351544 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:29.351359 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 13:19:29.351544 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:29.351367 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e28539f-e30b-42c4-8dc4-cb7289a76f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2x7hd\" (UID: \"9e28539f-e30b-42c4-8dc4-cb7289a76f15\") " pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:29.351544 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:29.351412 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05aca99d-967b-4612-a4bf-eec008dea6a8-metrics-tls podName:05aca99d-967b-4612-a4bf-eec008dea6a8 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:33.351395385 +0000 UTC m=+49.724671394 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05aca99d-967b-4612-a4bf-eec008dea6a8-metrics-tls") pod "dns-default-bx6rk" (UID: "05aca99d-967b-4612-a4bf-eec008dea6a8") : secret "dns-default-metrics-tls" not found Jul 05 13:19:29.351544 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:29.351451 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 13:19:29.351544 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:29.351490 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e28539f-e30b-42c4-8dc4-cb7289a76f15-insights-runtime-extractor-tls podName:9e28539f-e30b-42c4-8dc4-cb7289a76f15 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:33.351479062 +0000 UTC m=+49.724755073 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e28539f-e30b-42c4-8dc4-cb7289a76f15-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2x7hd" (UID: "9e28539f-e30b-42c4-8dc4-cb7289a76f15") : secret "insights-runtime-extractor-tls" not found Jul 05 13:19:29.542708 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:29.542605 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-4jvtw" event={"ID":"d2511a0d-848a-4479-8372-f7359a2a3dfc","Type":"ContainerStarted","Data":"b1f9f52366b76301db78575ed22364808bf723a6893661f2369055c7ad4af515"} Jul 05 13:19:29.544092 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:29.544069 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lmrck" event={"ID":"7139a2d1-8d78-4ee6-810e-cadde0d0d131","Type":"ContainerStarted","Data":"3f2bbcc29b1c20cdc1bc00296c96eab00a6b053b0d93dcec1441b17a934b8b00"} Jul 05 13:19:29.611332 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:29.611276 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-4jvtw" podStartSLOduration=1.051926544 podStartE2EDuration="3.611253566s" totalImagesPullingTime="2.559327022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:29.578846886 +0000 UTC m=+45.952122918" watchObservedRunningTime="2026-07-05 13:19:29.611253566 +0000 UTC m=+45.984529600" Jul 05 13:19:33.385316 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:33.385280 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05aca99d-967b-4612-a4bf-eec008dea6a8-metrics-tls\") pod \"dns-default-bx6rk\" (UID: \"05aca99d-967b-4612-a4bf-eec008dea6a8\") " pod="openshift-dns/dns-default-bx6rk" Jul 05 13:19:33.385811 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:33.385343 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e28539f-e30b-42c4-8dc4-cb7289a76f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2x7hd\" (UID: \"9e28539f-e30b-42c4-8dc4-cb7289a76f15\") " pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:33.385811 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:33.385448 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 05 13:19:33.385811 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:33.385491 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 05 13:19:33.385811 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:33.385516 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05aca99d-967b-4612-a4bf-eec008dea6a8-metrics-tls podName:05aca99d-967b-4612-a4bf-eec008dea6a8 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:41.385499696 +0000 UTC m=+57.758775710 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05aca99d-967b-4612-a4bf-eec008dea6a8-metrics-tls") pod "dns-default-bx6rk" (UID: "05aca99d-967b-4612-a4bf-eec008dea6a8") : secret "dns-default-metrics-tls" not found Jul 05 13:19:33.385811 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:19:33.385554 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9e28539f-e30b-42c4-8dc4-cb7289a76f15-insights-runtime-extractor-tls podName:9e28539f-e30b-42c4-8dc4-cb7289a76f15 nodeName:}" failed. No retries permitted until 2026-07-05 13:19:41.385535906 +0000 UTC m=+57.758811919 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9e28539f-e30b-42c4-8dc4-cb7289a76f15-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2x7hd" (UID: "9e28539f-e30b-42c4-8dc4-cb7289a76f15") : secret "insights-runtime-extractor-tls" not found Jul 05 13:19:41.440110 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:41.440073 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e28539f-e30b-42c4-8dc4-cb7289a76f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2x7hd\" (UID: \"9e28539f-e30b-42c4-8dc4-cb7289a76f15\") " pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:41.440539 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:41.440137 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05aca99d-967b-4612-a4bf-eec008dea6a8-metrics-tls\") pod \"dns-default-bx6rk\" (UID: \"05aca99d-967b-4612-a4bf-eec008dea6a8\") " pod="openshift-dns/dns-default-bx6rk" Jul 05 13:19:41.442653 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:41.442611 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05aca99d-967b-4612-a4bf-eec008dea6a8-metrics-tls\") pod \"dns-default-bx6rk\" (UID: \"05aca99d-967b-4612-a4bf-eec008dea6a8\") " pod="openshift-dns/dns-default-bx6rk" Jul 05 13:19:41.442758 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:41.442696 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9e28539f-e30b-42c4-8dc4-cb7289a76f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2x7hd\" (UID: \"9e28539f-e30b-42c4-8dc4-cb7289a76f15\") " pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:41.495314 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:41.495288 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2x7hd" Jul 05 13:19:41.537582 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:41.537554 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bx6rk" Jul 05 13:19:41.743843 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:41.743596 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lmrck" podStartSLOduration=13.601941024 podStartE2EDuration="16.743559205s" totalImagesPullingTime="3.141618181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:29.610789013 +0000 UTC m=+45.984065045" watchObservedRunningTime="2026-07-05 13:19:41.743559205 +0000 UTC m=+58.116835231" Jul 05 13:19:41.745022 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:41.744997 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2x7hd"] Jul 05 13:19:41.745988 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:41.745952 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bx6rk"] Jul 05 13:19:41.747996 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:19:41.747971 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e28539f_e30b_42c4_8dc4_cb7289a76f15.slice/crio-74d994ecbb731863a6da024b6fdbd46348c8c3e645785980535c561a4669e6c7 WatchSource:0}: Error finding container 74d994ecbb731863a6da024b6fdbd46348c8c3e645785980535c561a4669e6c7: Status 404 returned error can't find the container with id 74d994ecbb731863a6da024b6fdbd46348c8c3e645785980535c561a4669e6c7 Jul 05 13:19:41.748501 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:19:41.748479 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05aca99d_967b_4612_a4bf_eec008dea6a8.slice/crio-5dc7500363e92ecc1b9e74a8546633ce5989570ba133db36d8ce96601e9b2d50 WatchSource:0}: Error finding container 5dc7500363e92ecc1b9e74a8546633ce5989570ba133db36d8ce96601e9b2d50: Status 404 returned error can't find the container with id 5dc7500363e92ecc1b9e74a8546633ce5989570ba133db36d8ce96601e9b2d50 Jul 05 13:19:42.577881 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:42.577841 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bx6rk" event={"ID":"05aca99d-967b-4612-a4bf-eec008dea6a8","Type":"ContainerStarted","Data":"5dc7500363e92ecc1b9e74a8546633ce5989570ba133db36d8ce96601e9b2d50"} Jul 05 13:19:42.579691 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:42.579660 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2x7hd" event={"ID":"9e28539f-e30b-42c4-8dc4-cb7289a76f15","Type":"ContainerStarted","Data":"74d994ecbb731863a6da024b6fdbd46348c8c3e645785980535c561a4669e6c7"} Jul 05 13:19:45.506675 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:45.506613 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4mxrf" Jul 05 13:19:46.591970 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:46.591936 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bx6rk" event={"ID":"05aca99d-967b-4612-a4bf-eec008dea6a8","Type":"ContainerStarted","Data":"2c34ee102319d3de96ef65a6c0737e25fe62a5182565b79aee05a1a794f40f5c"} Jul 05 13:19:46.592368 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:46.592003 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bx6rk" event={"ID":"05aca99d-967b-4612-a4bf-eec008dea6a8","Type":"ContainerStarted","Data":"f873942dd8b02c0564c90e1201c7ae7cbff077d7fc2d3831dc9253cac345112c"} Jul 05 13:19:46.592368 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:46.592054 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bx6rk" Jul 05 13:19:46.593398 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:46.593377 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2x7hd" event={"ID":"9e28539f-e30b-42c4-8dc4-cb7289a76f15","Type":"ContainerStarted","Data":"77d6e13bef03511e9711ce40e2b87792c05955449c3217a7f09618438e71efea"} Jul 05 13:19:46.619593 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:46.619547 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bx6rk" podStartSLOduration=17.526247272 podStartE2EDuration="21.619527546s" totalImagesPullingTime="4.093280274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:46.618764113 +0000 UTC m=+62.992040158" watchObservedRunningTime="2026-07-05 13:19:46.619527546 +0000 UTC m=+62.992803580" Jul 05 13:19:47.599844 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:47.599804 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2x7hd" event={"ID":"9e28539f-e30b-42c4-8dc4-cb7289a76f15","Type":"ContainerStarted","Data":"03586c9b0ca2ce8dad11e2ee3a62e8ea2b5e35a31aab878ef969a1735ad097ad"} Jul 05 13:19:48.796482 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:48.796440 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret\") pod \"global-pull-secret-syncer-f76k8\" (UID: \"e32393bd-7852-45d8-864c-169ed011c28b\") " pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:19:48.796957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:48.796526 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs\") pod \"network-metrics-daemon-dtfhw\" (UID: \"de4f4f54-21b1-4371-81c9-eaab1f91b7e2\") " pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:19:48.803388 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:48.803365 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 05 13:19:48.804411 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:48.804387 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 05 13:19:48.809544 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:48.809518 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e32393bd-7852-45d8-864c-169ed011c28b-original-pull-secret\") pod \"global-pull-secret-syncer-f76k8\" (UID: \"e32393bd-7852-45d8-864c-169ed011c28b\") " pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:19:48.809544 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:48.809549 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/de4f4f54-21b1-4371-81c9-eaab1f91b7e2-metrics-certs\") pod \"network-metrics-daemon-dtfhw\" (UID: \"de4f4f54-21b1-4371-81c9-eaab1f91b7e2\") " pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:19:48.998356 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:48.998313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7c4v\" (UniqueName: \"kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v\") pod \"network-check-target-mwfmq\" (UID: \"ab416b96-ab8a-41bf-93b0-b4a83f8c09d9\") " pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:19:49.000933 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.000906 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 05 13:19:49.011619 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.011599 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 05 13:19:49.022512 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.022487 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7c4v\" (UniqueName: \"kubernetes.io/projected/ab416b96-ab8a-41bf-93b0-b4a83f8c09d9-kube-api-access-k7c4v\") pod \"network-check-target-mwfmq\" (UID: \"ab416b96-ab8a-41bf-93b0-b4a83f8c09d9\") " pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:19:49.045286 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.045266 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6n5k8\"" Jul 05 13:19:49.048795 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.048753 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-f76k8" Jul 05 13:19:49.053769 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.053716 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:19:49.061468 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.061450 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kn7g2\"" Jul 05 13:19:49.064213 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.064198 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dtfhw" Jul 05 13:19:49.524611 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.524585 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dtfhw"] Jul 05 13:19:49.563178 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:19:49.563154 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde4f4f54_21b1_4371_81c9_eaab1f91b7e2.slice/crio-5f9a8e8106d8c5becb1ce0053d72209a12414762592440874ce8dd5b8d8d84e5 WatchSource:0}: Error finding container 5f9a8e8106d8c5becb1ce0053d72209a12414762592440874ce8dd5b8d8d84e5: Status 404 returned error can't find the container with id 5f9a8e8106d8c5becb1ce0053d72209a12414762592440874ce8dd5b8d8d84e5 Jul 05 13:19:49.607743 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.607720 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dtfhw" event={"ID":"de4f4f54-21b1-4371-81c9-eaab1f91b7e2","Type":"ContainerStarted","Data":"5f9a8e8106d8c5becb1ce0053d72209a12414762592440874ce8dd5b8d8d84e5"} Jul 05 13:19:49.650237 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.650214 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mwfmq"] Jul 05 13:19:49.667209 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:19:49.667186 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab416b96_ab8a_41bf_93b0_b4a83f8c09d9.slice/crio-f17b37ed0ab52e650292ba38f12248f2a8daf3c7982ce5178f13280cbc474a4e WatchSource:0}: Error finding container f17b37ed0ab52e650292ba38f12248f2a8daf3c7982ce5178f13280cbc474a4e: Status 404 returned error can't find the container with id f17b37ed0ab52e650292ba38f12248f2a8daf3c7982ce5178f13280cbc474a4e Jul 05 13:19:49.691367 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.691253 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-f76k8"] Jul 05 13:19:49.693426 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:19:49.693406 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode32393bd_7852_45d8_864c_169ed011c28b.slice/crio-44ce47bb3fc0400d930fabc130cddb0898c03d2193ed5cf681a3f9c2aa5809c7 WatchSource:0}: Error finding container 44ce47bb3fc0400d930fabc130cddb0898c03d2193ed5cf681a3f9c2aa5809c7: Status 404 returned error can't find the container with id 44ce47bb3fc0400d930fabc130cddb0898c03d2193ed5cf681a3f9c2aa5809c7 Jul 05 13:19:49.872087 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.872004 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56dfc77d88-8kzzd"] Jul 05 13:19:49.873899 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.873876 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56dfc77d88-8kzzd" Jul 05 13:19:49.874418 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.874398 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk"] Jul 05 13:19:49.875972 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.875958 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" Jul 05 13:19:49.878458 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.878441 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 05 13:19:49.878700 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.878684 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 05 13:19:49.880421 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.880400 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 05 13:19:49.880506 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.880470 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 05 13:19:49.880843 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.880829 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 05 13:19:49.881003 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.880986 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-27d55\"" Jul 05 13:19:49.881146 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.881131 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 05 13:19:49.881507 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.881351 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 05 13:19:49.883101 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.883084 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 05 13:19:49.893382 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.893363 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56dfc77d88-8kzzd"] Jul 05 13:19:49.905380 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.905360 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56g5f\" (UniqueName: \"kubernetes.io/projected/1665ac54-51c9-4374-b967-404e62ef4b7b-kube-api-access-56g5f\") pod \"cluster-proxy-proxy-agent-5d5c668dd7-8ltdk\" (UID: \"1665ac54-51c9-4374-b967-404e62ef4b7b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" Jul 05 13:19:49.905479 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.905391 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1665ac54-51c9-4374-b967-404e62ef4b7b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d5c668dd7-8ltdk\" (UID: \"1665ac54-51c9-4374-b967-404e62ef4b7b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" Jul 05 13:19:49.905479 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.905418 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nzcz\" (UniqueName: \"kubernetes.io/projected/1ff04c3a-1649-4032-9901-6c0711e79d92-kube-api-access-6nzcz\") pod \"managed-serviceaccount-addon-agent-56dfc77d88-8kzzd\" (UID: \"1ff04c3a-1649-4032-9901-6c0711e79d92\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56dfc77d88-8kzzd" Jul 05 13:19:49.905479 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.905450 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1665ac54-51c9-4374-b967-404e62ef4b7b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d5c668dd7-8ltdk\" (UID: \"1665ac54-51c9-4374-b967-404e62ef4b7b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" Jul 05 13:19:49.905479 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.905472 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1665ac54-51c9-4374-b967-404e62ef4b7b-ca\") pod \"cluster-proxy-proxy-agent-5d5c668dd7-8ltdk\" (UID: \"1665ac54-51c9-4374-b967-404e62ef4b7b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" Jul 05 13:19:49.905631 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.905488 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ff04c3a-1649-4032-9901-6c0711e79d92-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-56dfc77d88-8kzzd\" (UID: \"1ff04c3a-1649-4032-9901-6c0711e79d92\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56dfc77d88-8kzzd" Jul 05 13:19:49.905631 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.905508 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1665ac54-51c9-4374-b967-404e62ef4b7b-hub\") pod \"cluster-proxy-proxy-agent-5d5c668dd7-8ltdk\" (UID: \"1665ac54-51c9-4374-b967-404e62ef4b7b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" Jul 05 13:19:49.905631 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.905543 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1665ac54-51c9-4374-b967-404e62ef4b7b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d5c668dd7-8ltdk\" (UID: \"1665ac54-51c9-4374-b967-404e62ef4b7b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" Jul 05 13:19:49.924356 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:49.924143 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk"] Jul 05 13:19:50.005905 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.005875 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1665ac54-51c9-4374-b967-404e62ef4b7b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d5c668dd7-8ltdk\" (UID: \"1665ac54-51c9-4374-b967-404e62ef4b7b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" Jul 05 13:19:50.006140 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.005915 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1665ac54-51c9-4374-b967-404e62ef4b7b-ca\") pod \"cluster-proxy-proxy-agent-5d5c668dd7-8ltdk\" (UID: \"1665ac54-51c9-4374-b967-404e62ef4b7b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" Jul 05 13:19:50.006140 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.005933 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ff04c3a-1649-4032-9901-6c0711e79d92-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-56dfc77d88-8kzzd\" (UID: \"1ff04c3a-1649-4032-9901-6c0711e79d92\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56dfc77d88-8kzzd" Jul 05 13:19:50.006140 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.005962 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1665ac54-51c9-4374-b967-404e62ef4b7b-hub\") pod \"cluster-proxy-proxy-agent-5d5c668dd7-8ltdk\" (UID: \"1665ac54-51c9-4374-b967-404e62ef4b7b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" Jul 05 13:19:50.006140 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.005992 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1665ac54-51c9-4374-b967-404e62ef4b7b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d5c668dd7-8ltdk\" (UID: \"1665ac54-51c9-4374-b967-404e62ef4b7b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" Jul 05 13:19:50.006140 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.006024 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56g5f\" (UniqueName: \"kubernetes.io/projected/1665ac54-51c9-4374-b967-404e62ef4b7b-kube-api-access-56g5f\") pod \"cluster-proxy-proxy-agent-5d5c668dd7-8ltdk\" (UID: \"1665ac54-51c9-4374-b967-404e62ef4b7b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" Jul 05 13:19:50.006140 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.006058 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1665ac54-51c9-4374-b967-404e62ef4b7b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d5c668dd7-8ltdk\" (UID: \"1665ac54-51c9-4374-b967-404e62ef4b7b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" Jul 05 13:19:50.006140 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.006099 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nzcz\" (UniqueName: \"kubernetes.io/projected/1ff04c3a-1649-4032-9901-6c0711e79d92-kube-api-access-6nzcz\") pod \"managed-serviceaccount-addon-agent-56dfc77d88-8kzzd\" (UID: \"1ff04c3a-1649-4032-9901-6c0711e79d92\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56dfc77d88-8kzzd" Jul 05 13:19:50.006785 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.006743 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1665ac54-51c9-4374-b967-404e62ef4b7b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d5c668dd7-8ltdk\" (UID: \"1665ac54-51c9-4374-b967-404e62ef4b7b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" Jul 05 13:19:50.008894 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.008869 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1665ac54-51c9-4374-b967-404e62ef4b7b-ca\") pod \"cluster-proxy-proxy-agent-5d5c668dd7-8ltdk\" (UID: \"1665ac54-51c9-4374-b967-404e62ef4b7b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" Jul 05 13:19:50.009324 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.009300 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1ff04c3a-1649-4032-9901-6c0711e79d92-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-56dfc77d88-8kzzd\" (UID: \"1ff04c3a-1649-4032-9901-6c0711e79d92\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56dfc77d88-8kzzd" Jul 05 13:19:50.009418 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.009355 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1665ac54-51c9-4374-b967-404e62ef4b7b-hub\") pod \"cluster-proxy-proxy-agent-5d5c668dd7-8ltdk\" (UID: \"1665ac54-51c9-4374-b967-404e62ef4b7b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" Jul 05 13:19:50.009418 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.009405 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1665ac54-51c9-4374-b967-404e62ef4b7b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d5c668dd7-8ltdk\" (UID: \"1665ac54-51c9-4374-b967-404e62ef4b7b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" Jul 05 13:19:50.009615 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.009595 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1665ac54-51c9-4374-b967-404e62ef4b7b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d5c668dd7-8ltdk\" (UID: \"1665ac54-51c9-4374-b967-404e62ef4b7b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" Jul 05 13:19:50.035087 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.035034 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nzcz\" (UniqueName: \"kubernetes.io/projected/1ff04c3a-1649-4032-9901-6c0711e79d92-kube-api-access-6nzcz\") pod \"managed-serviceaccount-addon-agent-56dfc77d88-8kzzd\" (UID: \"1ff04c3a-1649-4032-9901-6c0711e79d92\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56dfc77d88-8kzzd" Jul 05 13:19:50.041491 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.041466 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56g5f\" (UniqueName: \"kubernetes.io/projected/1665ac54-51c9-4374-b967-404e62ef4b7b-kube-api-access-56g5f\") pod \"cluster-proxy-proxy-agent-5d5c668dd7-8ltdk\" (UID: \"1665ac54-51c9-4374-b967-404e62ef4b7b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" Jul 05 13:19:50.205065 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.204983 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56dfc77d88-8kzzd" Jul 05 13:19:50.209399 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.209376 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" Jul 05 13:19:50.388844 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.387958 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56dfc77d88-8kzzd"] Jul 05 13:19:50.413884 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.413681 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk"] Jul 05 13:19:50.587258 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:19:50.587050 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ff04c3a_1649_4032_9901_6c0711e79d92.slice/crio-1e2d049a581a47995e689bf4203902d6dfb179acb46fa23f0d2de0612bc19b0a WatchSource:0}: Error finding container 1e2d049a581a47995e689bf4203902d6dfb179acb46fa23f0d2de0612bc19b0a: Status 404 returned error can't find the container with id 1e2d049a581a47995e689bf4203902d6dfb179acb46fa23f0d2de0612bc19b0a Jul 05 13:19:50.587514 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:19:50.587485 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1665ac54_51c9_4374_b967_404e62ef4b7b.slice/crio-13a5ac3238b5021085a417243bbc3b1641768331c577b514ff15afcf4bf66dc7 WatchSource:0}: Error finding container 13a5ac3238b5021085a417243bbc3b1641768331c577b514ff15afcf4bf66dc7: Status 404 returned error can't find the container with id 13a5ac3238b5021085a417243bbc3b1641768331c577b514ff15afcf4bf66dc7 Jul 05 13:19:50.613025 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.612965 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" event={"ID":"1665ac54-51c9-4374-b967-404e62ef4b7b","Type":"ContainerStarted","Data":"13a5ac3238b5021085a417243bbc3b1641768331c577b514ff15afcf4bf66dc7"} Jul 05 13:19:50.619988 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.619802 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2x7hd" event={"ID":"9e28539f-e30b-42c4-8dc4-cb7289a76f15","Type":"ContainerStarted","Data":"215c9ba567482d841c038e3e02ab45928e33ea8aa9037b3959290587e4bf07d8"} Jul 05 13:19:50.622124 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.622099 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56dfc77d88-8kzzd" event={"ID":"1ff04c3a-1649-4032-9901-6c0711e79d92","Type":"ContainerStarted","Data":"1e2d049a581a47995e689bf4203902d6dfb179acb46fa23f0d2de0612bc19b0a"} Jul 05 13:19:50.623541 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.623514 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mwfmq" event={"ID":"ab416b96-ab8a-41bf-93b0-b4a83f8c09d9","Type":"ContainerStarted","Data":"f17b37ed0ab52e650292ba38f12248f2a8daf3c7982ce5178f13280cbc474a4e"} Jul 05 13:19:50.624992 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:50.624971 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f76k8" event={"ID":"e32393bd-7852-45d8-864c-169ed011c28b","Type":"ContainerStarted","Data":"44ce47bb3fc0400d930fabc130cddb0898c03d2193ed5cf681a3f9c2aa5809c7"} Jul 05 13:19:51.636429 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:51.636327 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dtfhw" event={"ID":"de4f4f54-21b1-4371-81c9-eaab1f91b7e2","Type":"ContainerStarted","Data":"cc42a1522b2fbf43867f17b1527da07fcf69b69c4ba45d0b636af31fea60d3d0"} Jul 05 13:19:51.636429 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:51.636386 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dtfhw" event={"ID":"de4f4f54-21b1-4371-81c9-eaab1f91b7e2","Type":"ContainerStarted","Data":"3030fb42e6bea0357b76d969203f2de9560a7c40c52d896ed9bba52d9933aa69"} Jul 05 13:19:51.661995 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:51.661939 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dtfhw" podStartSLOduration=66.61429472 podStartE2EDuration="1m7.661918586s" totalImagesPullingTime="1.047623866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:51.655440942 +0000 UTC m=+68.028717003" watchObservedRunningTime="2026-07-05 13:19:51.661918586 +0000 UTC m=+68.035194621" Jul 05 13:19:51.662435 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:51.662396 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2x7hd" podStartSLOduration=18.921532797 podStartE2EDuration="26.662381674s" totalImagesPullingTime="7.740848877s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:19:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:50.672891309 +0000 UTC m=+67.046167342" watchObservedRunningTime="2026-07-05 13:19:51.662381674 +0000 UTC m=+68.035657708" Jul 05 13:19:56.602604 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:56.602570 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bx6rk" Jul 05 13:19:57.669179 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:57.669138 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56dfc77d88-8kzzd" event={"ID":"1ff04c3a-1649-4032-9901-6c0711e79d92","Type":"ContainerStarted","Data":"0bb628717d2462232f8505161d6bb956ffee040bf458c07ab1627d8b195dc523"} Jul 05 13:19:57.670732 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:57.670702 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mwfmq" event={"ID":"ab416b96-ab8a-41bf-93b0-b4a83f8c09d9","Type":"ContainerStarted","Data":"554f39c702ce6a1f2507948d286f59b8ce5d423cf2d0cd6ed7a2dc5617a11bbb"} Jul 05 13:19:57.670892 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:57.670756 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:19:57.672091 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:57.672063 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-f76k8" event={"ID":"e32393bd-7852-45d8-864c-169ed011c28b","Type":"ContainerStarted","Data":"a78c5650106386bcffeb650009e76945bfa95b7c067a3881503f71f0c2757e18"} Jul 05 13:19:57.673846 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:57.673826 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" event={"ID":"1665ac54-51c9-4374-b967-404e62ef4b7b","Type":"ContainerStarted","Data":"3d5090f7fe0b2e4f9d2899c1b65336135a50ceb9e1af30b205fc1dc719360715"} Jul 05 13:19:57.673938 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:57.673854 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" event={"ID":"1665ac54-51c9-4374-b967-404e62ef4b7b","Type":"ContainerStarted","Data":"5a9bd652e1da3cbbc8682ef525e1f559584e09af7c52a1023dc40b755a066338"} Jul 05 13:19:57.673938 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:57.673866 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" event={"ID":"1665ac54-51c9-4374-b967-404e62ef4b7b","Type":"ContainerStarted","Data":"4741d7c925ae2668121726f769fae0bd9b21bb6fe032143ab10edfe88e1f1dc2"} Jul 05 13:19:57.707218 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:57.707170 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-56dfc77d88-8kzzd" podStartSLOduration=2.08565466 podStartE2EDuration="8.707151501s" totalImagesPullingTime="6.621496841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:57.706276045 +0000 UTC m=+74.079552077" watchObservedRunningTime="2026-07-05 13:19:57.707151501 +0000 UTC m=+74.080427527" Jul 05 13:19:57.732330 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:57.732276 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d5c668dd7-8ltdk" podStartSLOduration=2.052943974 podStartE2EDuration="8.732262091s" totalImagesPullingTime="6.679318117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:19:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:57.7322029 +0000 UTC m=+74.105478945" watchObservedRunningTime="2026-07-05 13:19:57.732262091 +0000 UTC m=+74.105538128" Jul 05 13:19:57.771747 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:57.771705 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-f76k8" podStartSLOduration=66.254245965 podStartE2EDuration="1m13.771692785s" totalImagesPullingTime="7.51744682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:57.771410553 +0000 UTC m=+74.144686610" watchObservedRunningTime="2026-07-05 13:19:57.771692785 +0000 UTC m=+74.144968817" Jul 05 13:19:57.772207 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:19:57.772177 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mwfmq" podStartSLOduration=66.237922413 podStartE2EDuration="1m13.772165033s" totalImagesPullingTime="7.53424262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:19:57.751413558 +0000 UTC m=+74.124689600" watchObservedRunningTime="2026-07-05 13:19:57.772165033 +0000 UTC m=+74.145441066" Jul 05 13:20:02.246419 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.246383 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6b7x4"] Jul 05 13:20:02.249235 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.249214 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.255600 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:20:02.255388 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-tls\" is forbidden: User \"system:node:ip-10-0-132-227.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-227.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret" Jul 05 13:20:02.255600 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:20:02.255478 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-dockercfg-vrcb7\" is forbidden: User \"system:node:ip-10-0-132-227.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-227.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vrcb7\"" type="*v1.Secret" Jul 05 13:20:02.255600 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.255519 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 05 13:20:02.255600 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.255570 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 05 13:20:02.257179 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.257159 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 05 13:20:02.257347 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:20:02.257328 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"metrics-client-ca\" is forbidden: User \"system:node:ip-10-0-132-227.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-132-227.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap" Jul 05 13:20:02.257491 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.257479 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 05 13:20:02.293982 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.293954 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q464k\" (UniqueName: \"kubernetes.io/projected/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-kube-api-access-q464k\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.294096 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.293990 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-node-exporter-textfile\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.294096 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.294017 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-metrics-client-ca\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.294096 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.294060 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-node-exporter-wtmp\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.294218 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.294108 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.294218 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.294124 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.294218 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.294172 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-root\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.294218 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.294208 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-sys\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.294414 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.294235 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-node-exporter-tls\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.310746 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.310720 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj"] Jul 05 13:20:02.312528 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.312515 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" Jul 05 13:20:02.316464 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.316444 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-fsc98\"" Jul 05 13:20:02.316586 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.316491 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 05 13:20:02.316586 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.316503 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 05 13:20:02.317069 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.317054 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 05 13:20:02.395504 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.395472 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fdf6e11e-1418-4ee5-a10f-fc85fdc7f786-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-8h7lj\" (UID: \"fdf6e11e-1418-4ee5-a10f-fc85fdc7f786\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" Jul 05 13:20:02.395504 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.395510 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-node-exporter-tls\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.395743 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.395531 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fdf6e11e-1418-4ee5-a10f-fc85fdc7f786-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-8h7lj\" (UID: \"fdf6e11e-1418-4ee5-a10f-fc85fdc7f786\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" Jul 05 13:20:02.395743 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.395549 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56486\" (UniqueName: \"kubernetes.io/projected/fdf6e11e-1418-4ee5-a10f-fc85fdc7f786-kube-api-access-56486\") pod \"kube-state-metrics-7c9dbb8b7d-8h7lj\" (UID: \"fdf6e11e-1418-4ee5-a10f-fc85fdc7f786\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" Jul 05 13:20:02.395743 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.395624 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q464k\" (UniqueName: \"kubernetes.io/projected/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-kube-api-access-q464k\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.395743 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.395671 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-node-exporter-textfile\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.395743 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.395702 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdf6e11e-1418-4ee5-a10f-fc85fdc7f786-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-8h7lj\" (UID: \"fdf6e11e-1418-4ee5-a10f-fc85fdc7f786\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" Jul 05 13:20:02.395743 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.395724 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-metrics-client-ca\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.395743 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.395741 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fdf6e11e-1418-4ee5-a10f-fc85fdc7f786-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-8h7lj\" (UID: \"fdf6e11e-1418-4ee5-a10f-fc85fdc7f786\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" Jul 05 13:20:02.396028 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.395770 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-node-exporter-wtmp\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.396028 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.395799 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.396028 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.395816 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.396028 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.395835 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-root\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.396028 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.395860 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fdf6e11e-1418-4ee5-a10f-fc85fdc7f786-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-8h7lj\" (UID: \"fdf6e11e-1418-4ee5-a10f-fc85fdc7f786\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" Jul 05 13:20:02.396028 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.395894 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-sys\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.396028 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.395926 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-node-exporter-wtmp\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.396028 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.395934 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-root\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.396028 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.395964 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-sys\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.396398 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.396078 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-node-exporter-textfile\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.396398 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.396307 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.398077 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.398056 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.405370 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.405345 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj"] Jul 05 13:20:02.428501 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.428469 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q464k\" (UniqueName: \"kubernetes.io/projected/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-kube-api-access-q464k\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:02.496241 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.496212 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fdf6e11e-1418-4ee5-a10f-fc85fdc7f786-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-8h7lj\" (UID: \"fdf6e11e-1418-4ee5-a10f-fc85fdc7f786\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" Jul 05 13:20:02.496400 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.496247 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fdf6e11e-1418-4ee5-a10f-fc85fdc7f786-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-8h7lj\" (UID: \"fdf6e11e-1418-4ee5-a10f-fc85fdc7f786\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" Jul 05 13:20:02.496400 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.496272 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fdf6e11e-1418-4ee5-a10f-fc85fdc7f786-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-8h7lj\" (UID: \"fdf6e11e-1418-4ee5-a10f-fc85fdc7f786\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" Jul 05 13:20:02.496400 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.496299 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56486\" (UniqueName: \"kubernetes.io/projected/fdf6e11e-1418-4ee5-a10f-fc85fdc7f786-kube-api-access-56486\") pod \"kube-state-metrics-7c9dbb8b7d-8h7lj\" (UID: \"fdf6e11e-1418-4ee5-a10f-fc85fdc7f786\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" Jul 05 13:20:02.496400 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.496336 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdf6e11e-1418-4ee5-a10f-fc85fdc7f786-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-8h7lj\" (UID: \"fdf6e11e-1418-4ee5-a10f-fc85fdc7f786\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" Jul 05 13:20:02.496400 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.496362 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fdf6e11e-1418-4ee5-a10f-fc85fdc7f786-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-8h7lj\" (UID: \"fdf6e11e-1418-4ee5-a10f-fc85fdc7f786\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" Jul 05 13:20:02.496743 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.496695 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/fdf6e11e-1418-4ee5-a10f-fc85fdc7f786-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-8h7lj\" (UID: \"fdf6e11e-1418-4ee5-a10f-fc85fdc7f786\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" Jul 05 13:20:02.497006 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.496986 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/fdf6e11e-1418-4ee5-a10f-fc85fdc7f786-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-8h7lj\" (UID: \"fdf6e11e-1418-4ee5-a10f-fc85fdc7f786\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" Jul 05 13:20:02.498623 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.498599 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fdf6e11e-1418-4ee5-a10f-fc85fdc7f786-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-8h7lj\" (UID: \"fdf6e11e-1418-4ee5-a10f-fc85fdc7f786\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" Jul 05 13:20:02.498809 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.498787 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/fdf6e11e-1418-4ee5-a10f-fc85fdc7f786-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-8h7lj\" (UID: \"fdf6e11e-1418-4ee5-a10f-fc85fdc7f786\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" Jul 05 13:20:02.523316 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:02.523285 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56486\" (UniqueName: \"kubernetes.io/projected/fdf6e11e-1418-4ee5-a10f-fc85fdc7f786-kube-api-access-56486\") pod \"kube-state-metrics-7c9dbb8b7d-8h7lj\" (UID: \"fdf6e11e-1418-4ee5-a10f-fc85fdc7f786\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" Jul 05 13:20:03.239432 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:03.239403 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 05 13:20:03.248721 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:03.248696 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-node-exporter-tls\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:03.396805 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:20:03.396775 2577 configmap.go:193] Couldn't get configMap openshift-monitoring/metrics-client-ca: failed to sync configmap cache: timed out waiting for the condition Jul 05 13:20:03.396976 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:20:03.396877 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-metrics-client-ca podName:302c1e68-5cb5-445e-91f8-81bdb6cb89ce nodeName:}" failed. No retries permitted until 2026-07-05 13:20:03.896855932 +0000 UTC m=+80.270131945 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-client-ca" (UniqueName: "kubernetes.io/configmap/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-metrics-client-ca") pod "node-exporter-6b7x4" (UID: "302c1e68-5cb5-445e-91f8-81bdb6cb89ce") : failed to sync configmap cache: timed out waiting for the condition Jul 05 13:20:03.397295 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:03.397277 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 05 13:20:03.407301 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:03.407274 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fdf6e11e-1418-4ee5-a10f-fc85fdc7f786-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-8h7lj\" (UID: \"fdf6e11e-1418-4ee5-a10f-fc85fdc7f786\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" Jul 05 13:20:03.520778 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:03.520710 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" Jul 05 13:20:03.596671 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:03.596606 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vrcb7\"" Jul 05 13:20:03.656835 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:03.656700 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj"] Jul 05 13:20:03.659255 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:20:03.659223 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdf6e11e_1418_4ee5_a10f_fc85fdc7f786.slice/crio-b67e0aa150bdc87fa3cb756822f52084432eb979f4a5d7143159d6a5fa2b0f94 WatchSource:0}: Error finding container b67e0aa150bdc87fa3cb756822f52084432eb979f4a5d7143159d6a5fa2b0f94: Status 404 returned error can't find the container with id b67e0aa150bdc87fa3cb756822f52084432eb979f4a5d7143159d6a5fa2b0f94 Jul 05 13:20:03.693824 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:03.693792 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" event={"ID":"fdf6e11e-1418-4ee5-a10f-fc85fdc7f786","Type":"ContainerStarted","Data":"b67e0aa150bdc87fa3cb756822f52084432eb979f4a5d7143159d6a5fa2b0f94"} Jul 05 13:20:03.908822 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:03.908783 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-metrics-client-ca\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:03.909235 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:03.909219 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/302c1e68-5cb5-445e-91f8-81bdb6cb89ce-metrics-client-ca\") pod \"node-exporter-6b7x4\" (UID: \"302c1e68-5cb5-445e-91f8-81bdb6cb89ce\") " pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:04.058030 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:04.057989 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6b7x4" Jul 05 13:20:04.068048 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:20:04.068019 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod302c1e68_5cb5_445e_91f8_81bdb6cb89ce.slice/crio-268d4e71dfb5f5cf0f18ee4d69a978aa29e2ca34348424890790f4ff645a40df WatchSource:0}: Error finding container 268d4e71dfb5f5cf0f18ee4d69a978aa29e2ca34348424890790f4ff645a40df: Status 404 returned error can't find the container with id 268d4e71dfb5f5cf0f18ee4d69a978aa29e2ca34348424890790f4ff645a40df Jul 05 13:20:04.698780 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:04.698737 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6b7x4" event={"ID":"302c1e68-5cb5-445e-91f8-81bdb6cb89ce","Type":"ContainerStarted","Data":"268d4e71dfb5f5cf0f18ee4d69a978aa29e2ca34348424890790f4ff645a40df"} Jul 05 13:20:05.704893 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:05.704861 2577 generic.go:356] "Generic (PLEG): container finished" podID="302c1e68-5cb5-445e-91f8-81bdb6cb89ce" containerID="2ef9aeef6d51ff2a10cfe983cc8f71469a647cc81e49b04584ca44a1ae276ad1" exitCode=0 Jul 05 13:20:05.705285 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:05.704943 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6b7x4" event={"ID":"302c1e68-5cb5-445e-91f8-81bdb6cb89ce","Type":"ContainerDied","Data":"2ef9aeef6d51ff2a10cfe983cc8f71469a647cc81e49b04584ca44a1ae276ad1"} Jul 05 13:20:05.707293 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:05.707268 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" event={"ID":"fdf6e11e-1418-4ee5-a10f-fc85fdc7f786","Type":"ContainerStarted","Data":"b187f2313d94850930d1677e1c310d00c6b4176b49222a6fc8be3feed4097803"} Jul 05 13:20:05.707394 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:05.707324 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" event={"ID":"fdf6e11e-1418-4ee5-a10f-fc85fdc7f786","Type":"ContainerStarted","Data":"920edf3c916964b0143a61f680e108d336152c8fa570f26e9ab9df9ecd7d51a2"} Jul 05 13:20:05.707394 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:05.707359 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" event={"ID":"fdf6e11e-1418-4ee5-a10f-fc85fdc7f786","Type":"ContainerStarted","Data":"cb706f222a2e7f11b0811b4e6d8fcc67bd8bfd340f786a117db54892d071a2ef"} Jul 05 13:20:05.789030 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:05.788973 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-8h7lj" podStartSLOduration=2.505031822 podStartE2EDuration="3.788951134s" totalImagesPullingTime="1.283919312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:05.787789073 +0000 UTC m=+82.161065119" watchObservedRunningTime="2026-07-05 13:20:05.788951134 +0000 UTC m=+82.162227168" Jul 05 13:20:06.713459 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:06.713406 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6b7x4" event={"ID":"302c1e68-5cb5-445e-91f8-81bdb6cb89ce","Type":"ContainerStarted","Data":"b7d724da57b8425cd3df86fcddae782970f967391570693d67e0f26fa74bc558"} Jul 05 13:20:06.713886 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:06.713476 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6b7x4" event={"ID":"302c1e68-5cb5-445e-91f8-81bdb6cb89ce","Type":"ContainerStarted","Data":"b4f65c7ae2a61027f6373d08a378d0bdf98fe761a678b314b666e63883fc95c4"} Jul 05 13:20:06.761353 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:06.761289 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6b7x4" podStartSLOduration=3.2540932 podStartE2EDuration="4.761273518s" totalImagesPullingTime="1.441998818s" totalInitContainerRuntime="65.1815ms" isStatefulPod=true podCreationTimestamp="2026-07-05 13:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:20:06.759742296 +0000 UTC m=+83.133018355" watchObservedRunningTime="2026-07-05 13:20:06.761273518 +0000 UTC m=+83.134549549" Jul 05 13:20:28.680354 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:20:28.680319 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mwfmq" Jul 05 13:24:21.230746 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:21.230710 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bbzf7"] Jul 05 13:24:21.233874 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:21.233859 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bbzf7" Jul 05 13:24:21.237866 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:21.237841 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 05 13:24:21.237967 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:21.237878 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 05 13:24:21.237967 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:21.237878 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-p6wwx\"" Jul 05 13:24:21.272857 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:21.272829 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bbzf7"] Jul 05 13:24:21.371536 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:21.371509 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbcxv\" (UniqueName: \"kubernetes.io/projected/38c9b17f-93ea-4c9e-a815-7e10ed9563b4-kube-api-access-tbcxv\") pod \"cert-manager-operator-controller-manager-55c444bf86-bbzf7\" (UID: \"38c9b17f-93ea-4c9e-a815-7e10ed9563b4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bbzf7" Jul 05 13:24:21.371717 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:21.371554 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38c9b17f-93ea-4c9e-a815-7e10ed9563b4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bbzf7\" (UID: \"38c9b17f-93ea-4c9e-a815-7e10ed9563b4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bbzf7" Jul 05 13:24:21.472666 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:21.472622 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbcxv\" (UniqueName: \"kubernetes.io/projected/38c9b17f-93ea-4c9e-a815-7e10ed9563b4-kube-api-access-tbcxv\") pod \"cert-manager-operator-controller-manager-55c444bf86-bbzf7\" (UID: \"38c9b17f-93ea-4c9e-a815-7e10ed9563b4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bbzf7" Jul 05 13:24:21.472815 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:21.472676 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38c9b17f-93ea-4c9e-a815-7e10ed9563b4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bbzf7\" (UID: \"38c9b17f-93ea-4c9e-a815-7e10ed9563b4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bbzf7" Jul 05 13:24:21.473001 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:21.472987 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38c9b17f-93ea-4c9e-a815-7e10ed9563b4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-bbzf7\" (UID: \"38c9b17f-93ea-4c9e-a815-7e10ed9563b4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bbzf7" Jul 05 13:24:21.491488 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:21.491421 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbcxv\" (UniqueName: \"kubernetes.io/projected/38c9b17f-93ea-4c9e-a815-7e10ed9563b4-kube-api-access-tbcxv\") pod \"cert-manager-operator-controller-manager-55c444bf86-bbzf7\" (UID: \"38c9b17f-93ea-4c9e-a815-7e10ed9563b4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bbzf7" Jul 05 13:24:21.542685 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:21.542660 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bbzf7" Jul 05 13:24:21.681145 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:21.681111 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bbzf7"] Jul 05 13:24:21.684968 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:24:21.684935 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38c9b17f_93ea_4c9e_a815_7e10ed9563b4.slice/crio-b0eb4c1b7472dfada05725218411353577e5c7a6eebedbf5915c667267d7432f WatchSource:0}: Error finding container b0eb4c1b7472dfada05725218411353577e5c7a6eebedbf5915c667267d7432f: Status 404 returned error can't find the container with id b0eb4c1b7472dfada05725218411353577e5c7a6eebedbf5915c667267d7432f Jul 05 13:24:21.688167 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:21.688145 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 13:24:22.520687 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:22.520656 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bbzf7" event={"ID":"38c9b17f-93ea-4c9e-a815-7e10ed9563b4","Type":"ContainerStarted","Data":"b0eb4c1b7472dfada05725218411353577e5c7a6eebedbf5915c667267d7432f"} Jul 05 13:24:24.529942 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:24.529907 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bbzf7" event={"ID":"38c9b17f-93ea-4c9e-a815-7e10ed9563b4","Type":"ContainerStarted","Data":"8f7004435818581d189ee5a119ec03fbf5b77cec81a96b8d3bb29bc003e54a77"} Jul 05 13:24:24.577190 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:24.577126 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-bbzf7" podStartSLOduration=0.88021776 podStartE2EDuration="3.577106002s" totalImagesPullingTime="2.696888242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:24:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:24:24.575627659 +0000 UTC m=+340.948903692" watchObservedRunningTime="2026-07-05 13:24:24.577106002 +0000 UTC m=+340.950382037" Jul 05 13:24:28.328163 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:28.328131 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gx6v9"] Jul 05 13:24:28.331240 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:28.331220 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gx6v9" Jul 05 13:24:28.335486 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:28.335462 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 05 13:24:28.335666 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:28.335653 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5pj5h\"" Jul 05 13:24:28.336070 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:28.336055 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 05 13:24:28.347334 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:28.347278 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gx6v9"] Jul 05 13:24:28.423205 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:28.423180 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ec33ca3-4b45-46c1-98f1-e9b4432f2861-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gx6v9\" (UID: \"4ec33ca3-4b45-46c1-98f1-e9b4432f2861\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gx6v9" Jul 05 13:24:28.423322 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:28.423224 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr2qv\" (UniqueName: \"kubernetes.io/projected/4ec33ca3-4b45-46c1-98f1-e9b4432f2861-kube-api-access-lr2qv\") pod \"cert-manager-cainjector-559cdd8c87-gx6v9\" (UID: \"4ec33ca3-4b45-46c1-98f1-e9b4432f2861\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gx6v9" Jul 05 13:24:28.524148 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:28.524116 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ec33ca3-4b45-46c1-98f1-e9b4432f2861-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gx6v9\" (UID: \"4ec33ca3-4b45-46c1-98f1-e9b4432f2861\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gx6v9" Jul 05 13:24:28.524287 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:28.524163 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr2qv\" (UniqueName: \"kubernetes.io/projected/4ec33ca3-4b45-46c1-98f1-e9b4432f2861-kube-api-access-lr2qv\") pod \"cert-manager-cainjector-559cdd8c87-gx6v9\" (UID: \"4ec33ca3-4b45-46c1-98f1-e9b4432f2861\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gx6v9" Jul 05 13:24:28.534487 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:28.534460 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4ec33ca3-4b45-46c1-98f1-e9b4432f2861-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-gx6v9\" (UID: \"4ec33ca3-4b45-46c1-98f1-e9b4432f2861\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gx6v9" Jul 05 13:24:28.535466 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:28.535450 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr2qv\" (UniqueName: \"kubernetes.io/projected/4ec33ca3-4b45-46c1-98f1-e9b4432f2861-kube-api-access-lr2qv\") pod \"cert-manager-cainjector-559cdd8c87-gx6v9\" (UID: \"4ec33ca3-4b45-46c1-98f1-e9b4432f2861\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-gx6v9" Jul 05 13:24:28.639696 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:28.639614 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gx6v9" Jul 05 13:24:28.795521 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:28.795491 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-gx6v9"] Jul 05 13:24:28.797962 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:24:28.797935 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ec33ca3_4b45_46c1_98f1_e9b4432f2861.slice/crio-db91bd9b95e0a55972b19f35a1140103bbe2e08719ea39e2e044f6a8e2b80d95 WatchSource:0}: Error finding container db91bd9b95e0a55972b19f35a1140103bbe2e08719ea39e2e044f6a8e2b80d95: Status 404 returned error can't find the container with id db91bd9b95e0a55972b19f35a1140103bbe2e08719ea39e2e044f6a8e2b80d95 Jul 05 13:24:29.550043 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:29.550001 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gx6v9" event={"ID":"4ec33ca3-4b45-46c1-98f1-e9b4432f2861","Type":"ContainerStarted","Data":"db91bd9b95e0a55972b19f35a1140103bbe2e08719ea39e2e044f6a8e2b80d95"} Jul 05 13:24:31.558820 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:31.558733 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gx6v9" event={"ID":"4ec33ca3-4b45-46c1-98f1-e9b4432f2861","Type":"ContainerStarted","Data":"18d2f018ddaea68b83afa766db47cb5701ffa76b7ae593d1e42c2f015d041c67"} Jul 05 13:24:31.597338 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:24:31.597284 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-gx6v9" podStartSLOduration=0.91735584 podStartE2EDuration="3.597267271s" totalImagesPullingTime="2.679911431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:24:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:24:31.596549836 +0000 UTC m=+347.969825868" watchObservedRunningTime="2026-07-05 13:24:31.597267271 +0000 UTC m=+347.970543302" Jul 05 13:25:02.746149 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:02.746070 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f6c4984d4-wv9pw"] Jul 05 13:25:02.752450 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:02.752431 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f6c4984d4-wv9pw" Jul 05 13:25:02.756925 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:02.756903 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 05 13:25:02.758099 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:02.758076 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-r7q8z\"" Jul 05 13:25:02.758190 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:02.758116 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 05 13:25:02.758190 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:02.758140 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 05 13:25:02.758190 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:02.758147 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 05 13:25:02.760128 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:02.760106 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 05 13:25:02.761486 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:02.761465 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f6c4984d4-wv9pw"] Jul 05 13:25:02.775395 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:02.775375 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aaeed32b-6d71-47cd-a134-8357a7b8929b-cert\") pod \"lws-controller-manager-6f6c4984d4-wv9pw\" (UID: \"aaeed32b-6d71-47cd-a134-8357a7b8929b\") " pod="openshift-lws-operator/lws-controller-manager-6f6c4984d4-wv9pw" Jul 05 13:25:02.775482 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:02.775403 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx4gc\" (UniqueName: \"kubernetes.io/projected/aaeed32b-6d71-47cd-a134-8357a7b8929b-kube-api-access-lx4gc\") pod \"lws-controller-manager-6f6c4984d4-wv9pw\" (UID: \"aaeed32b-6d71-47cd-a134-8357a7b8929b\") " pod="openshift-lws-operator/lws-controller-manager-6f6c4984d4-wv9pw" Jul 05 13:25:02.775482 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:02.775424 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aaeed32b-6d71-47cd-a134-8357a7b8929b-metrics-cert\") pod \"lws-controller-manager-6f6c4984d4-wv9pw\" (UID: \"aaeed32b-6d71-47cd-a134-8357a7b8929b\") " pod="openshift-lws-operator/lws-controller-manager-6f6c4984d4-wv9pw" Jul 05 13:25:02.775554 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:02.775484 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/aaeed32b-6d71-47cd-a134-8357a7b8929b-manager-config\") pod \"lws-controller-manager-6f6c4984d4-wv9pw\" (UID: \"aaeed32b-6d71-47cd-a134-8357a7b8929b\") " pod="openshift-lws-operator/lws-controller-manager-6f6c4984d4-wv9pw" Jul 05 13:25:02.876484 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:02.876445 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aaeed32b-6d71-47cd-a134-8357a7b8929b-cert\") pod \"lws-controller-manager-6f6c4984d4-wv9pw\" (UID: \"aaeed32b-6d71-47cd-a134-8357a7b8929b\") " pod="openshift-lws-operator/lws-controller-manager-6f6c4984d4-wv9pw" Jul 05 13:25:02.876671 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:02.876492 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx4gc\" (UniqueName: \"kubernetes.io/projected/aaeed32b-6d71-47cd-a134-8357a7b8929b-kube-api-access-lx4gc\") pod \"lws-controller-manager-6f6c4984d4-wv9pw\" (UID: \"aaeed32b-6d71-47cd-a134-8357a7b8929b\") " pod="openshift-lws-operator/lws-controller-manager-6f6c4984d4-wv9pw" Jul 05 13:25:02.876671 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:02.876521 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aaeed32b-6d71-47cd-a134-8357a7b8929b-metrics-cert\") pod \"lws-controller-manager-6f6c4984d4-wv9pw\" (UID: \"aaeed32b-6d71-47cd-a134-8357a7b8929b\") " pod="openshift-lws-operator/lws-controller-manager-6f6c4984d4-wv9pw" Jul 05 13:25:02.876671 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:02.876568 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/aaeed32b-6d71-47cd-a134-8357a7b8929b-manager-config\") pod \"lws-controller-manager-6f6c4984d4-wv9pw\" (UID: \"aaeed32b-6d71-47cd-a134-8357a7b8929b\") " pod="openshift-lws-operator/lws-controller-manager-6f6c4984d4-wv9pw" Jul 05 13:25:02.877320 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:02.877294 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/aaeed32b-6d71-47cd-a134-8357a7b8929b-manager-config\") pod \"lws-controller-manager-6f6c4984d4-wv9pw\" (UID: \"aaeed32b-6d71-47cd-a134-8357a7b8929b\") " pod="openshift-lws-operator/lws-controller-manager-6f6c4984d4-wv9pw" Jul 05 13:25:02.879064 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:02.879045 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aaeed32b-6d71-47cd-a134-8357a7b8929b-metrics-cert\") pod \"lws-controller-manager-6f6c4984d4-wv9pw\" (UID: \"aaeed32b-6d71-47cd-a134-8357a7b8929b\") " pod="openshift-lws-operator/lws-controller-manager-6f6c4984d4-wv9pw" Jul 05 13:25:02.879194 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:02.879172 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aaeed32b-6d71-47cd-a134-8357a7b8929b-cert\") pod \"lws-controller-manager-6f6c4984d4-wv9pw\" (UID: \"aaeed32b-6d71-47cd-a134-8357a7b8929b\") " pod="openshift-lws-operator/lws-controller-manager-6f6c4984d4-wv9pw" Jul 05 13:25:02.889840 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:02.889814 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx4gc\" (UniqueName: \"kubernetes.io/projected/aaeed32b-6d71-47cd-a134-8357a7b8929b-kube-api-access-lx4gc\") pod \"lws-controller-manager-6f6c4984d4-wv9pw\" (UID: \"aaeed32b-6d71-47cd-a134-8357a7b8929b\") " pod="openshift-lws-operator/lws-controller-manager-6f6c4984d4-wv9pw" Jul 05 13:25:03.062321 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.062228 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6f6c4984d4-wv9pw" Jul 05 13:25:03.194938 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.194911 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6f6c4984d4-wv9pw"] Jul 05 13:25:03.196606 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:25:03.196581 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaeed32b_6d71_47cd_a134_8357a7b8929b.slice/crio-1f8b03274437b368c9ced2481f5e93ba8a34cfea6895c8c72f102226bd42f805 WatchSource:0}: Error finding container 1f8b03274437b368c9ced2481f5e93ba8a34cfea6895c8c72f102226bd42f805: Status 404 returned error can't find the container with id 1f8b03274437b368c9ced2481f5e93ba8a34cfea6895c8c72f102226bd42f805 Jul 05 13:25:03.669794 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.669758 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f6c4984d4-wv9pw" event={"ID":"aaeed32b-6d71-47cd-a134-8357a7b8929b","Type":"ContainerStarted","Data":"1f8b03274437b368c9ced2481f5e93ba8a34cfea6895c8c72f102226bd42f805"} Jul 05 13:25:03.785467 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.785439 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm"] Jul 05 13:25:03.789799 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.789779 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" Jul 05 13:25:03.797430 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.797407 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 05 13:25:03.797542 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.797466 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bmwcw\"" Jul 05 13:25:03.797674 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.797648 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 05 13:25:03.797974 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.797961 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 05 13:25:03.806165 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.806152 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 05 13:25:03.845629 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.845603 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm"] Jul 05 13:25:03.883700 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.883671 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c63c9669-04e9-4a44-bb57-d92b31da6368-webhook-cert\") pod \"opendatahub-operator-controller-manager-b4f468d94-29ndm\" (UID: \"c63c9669-04e9-4a44-bb57-d92b31da6368\") " pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" Jul 05 13:25:03.883836 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.883743 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c63c9669-04e9-4a44-bb57-d92b31da6368-tmp\") pod \"opendatahub-operator-controller-manager-b4f468d94-29ndm\" (UID: \"c63c9669-04e9-4a44-bb57-d92b31da6368\") " pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" Jul 05 13:25:03.883836 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.883792 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c63c9669-04e9-4a44-bb57-d92b31da6368-manifests\") pod \"opendatahub-operator-controller-manager-b4f468d94-29ndm\" (UID: \"c63c9669-04e9-4a44-bb57-d92b31da6368\") " pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" Jul 05 13:25:03.883918 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.883833 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bgkv\" (UniqueName: \"kubernetes.io/projected/c63c9669-04e9-4a44-bb57-d92b31da6368-kube-api-access-4bgkv\") pod \"opendatahub-operator-controller-manager-b4f468d94-29ndm\" (UID: \"c63c9669-04e9-4a44-bb57-d92b31da6368\") " pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" Jul 05 13:25:03.883918 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.883886 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c63c9669-04e9-4a44-bb57-d92b31da6368-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b4f468d94-29ndm\" (UID: \"c63c9669-04e9-4a44-bb57-d92b31da6368\") " pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" Jul 05 13:25:03.985981 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.984548 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c63c9669-04e9-4a44-bb57-d92b31da6368-tmp\") pod \"opendatahub-operator-controller-manager-b4f468d94-29ndm\" (UID: \"c63c9669-04e9-4a44-bb57-d92b31da6368\") " pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" Jul 05 13:25:03.985981 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.984603 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c63c9669-04e9-4a44-bb57-d92b31da6368-manifests\") pod \"opendatahub-operator-controller-manager-b4f468d94-29ndm\" (UID: \"c63c9669-04e9-4a44-bb57-d92b31da6368\") " pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" Jul 05 13:25:03.985981 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.984634 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bgkv\" (UniqueName: \"kubernetes.io/projected/c63c9669-04e9-4a44-bb57-d92b31da6368-kube-api-access-4bgkv\") pod \"opendatahub-operator-controller-manager-b4f468d94-29ndm\" (UID: \"c63c9669-04e9-4a44-bb57-d92b31da6368\") " pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" Jul 05 13:25:03.985981 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.984689 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c63c9669-04e9-4a44-bb57-d92b31da6368-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b4f468d94-29ndm\" (UID: \"c63c9669-04e9-4a44-bb57-d92b31da6368\") " pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" Jul 05 13:25:03.985981 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.984747 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c63c9669-04e9-4a44-bb57-d92b31da6368-webhook-cert\") pod \"opendatahub-operator-controller-manager-b4f468d94-29ndm\" (UID: \"c63c9669-04e9-4a44-bb57-d92b31da6368\") " pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" Jul 05 13:25:03.985981 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.985613 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c63c9669-04e9-4a44-bb57-d92b31da6368-manifests\") pod \"opendatahub-operator-controller-manager-b4f468d94-29ndm\" (UID: \"c63c9669-04e9-4a44-bb57-d92b31da6368\") " pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" Jul 05 13:25:03.988746 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.988699 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c63c9669-04e9-4a44-bb57-d92b31da6368-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b4f468d94-29ndm\" (UID: \"c63c9669-04e9-4a44-bb57-d92b31da6368\") " pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" Jul 05 13:25:03.993492 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.993164 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c63c9669-04e9-4a44-bb57-d92b31da6368-webhook-cert\") pod \"opendatahub-operator-controller-manager-b4f468d94-29ndm\" (UID: \"c63c9669-04e9-4a44-bb57-d92b31da6368\") " pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" Jul 05 13:25:03.993492 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:03.993452 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c63c9669-04e9-4a44-bb57-d92b31da6368-tmp\") pod \"opendatahub-operator-controller-manager-b4f468d94-29ndm\" (UID: \"c63c9669-04e9-4a44-bb57-d92b31da6368\") " pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" Jul 05 13:25:04.015851 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:04.015796 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bgkv\" (UniqueName: \"kubernetes.io/projected/c63c9669-04e9-4a44-bb57-d92b31da6368-kube-api-access-4bgkv\") pod \"opendatahub-operator-controller-manager-b4f468d94-29ndm\" (UID: \"c63c9669-04e9-4a44-bb57-d92b31da6368\") " pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" Jul 05 13:25:04.099873 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:04.099814 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" Jul 05 13:25:04.310693 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:04.310668 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm"] Jul 05 13:25:04.313073 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:25:04.313043 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc63c9669_04e9_4a44_bb57_d92b31da6368.slice/crio-dcb6421be7e54b4dc780ce80dace825459da84b28810e9690df0058624e55c61 WatchSource:0}: Error finding container dcb6421be7e54b4dc780ce80dace825459da84b28810e9690df0058624e55c61: Status 404 returned error can't find the container with id dcb6421be7e54b4dc780ce80dace825459da84b28810e9690df0058624e55c61 Jul 05 13:25:04.677756 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:04.677709 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" event={"ID":"c63c9669-04e9-4a44-bb57-d92b31da6368","Type":"ContainerStarted","Data":"dcb6421be7e54b4dc780ce80dace825459da84b28810e9690df0058624e55c61"} Jul 05 13:25:07.698861 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:07.698820 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" event={"ID":"c63c9669-04e9-4a44-bb57-d92b31da6368","Type":"ContainerStarted","Data":"e5967c9652ce2971278ea48b781668c67aa34c4cee13b78a8c6fdc6cb4e643ed"} Jul 05 13:25:07.700344 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:07.700316 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6f6c4984d4-wv9pw" event={"ID":"aaeed32b-6d71-47cd-a134-8357a7b8929b","Type":"ContainerStarted","Data":"e1d327c88caa3cddc3f0f8d54339e2ad75bebe9049a680e7c17b7c68055a52d3"} Jul 05 13:25:07.700432 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:07.700381 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6f6c4984d4-wv9pw" Jul 05 13:25:07.769824 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:07.769705 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6f6c4984d4-wv9pw" podStartSLOduration=1.451961661 podStartE2EDuration="5.769686743s" totalImagesPullingTime="4.317725082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:25:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:25:07.768886489 +0000 UTC m=+384.142162520" watchObservedRunningTime="2026-07-05 13:25:07.769686743 +0000 UTC m=+384.142962782" Jul 05 13:25:08.705431 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:08.705395 2577 generic.go:356] "Generic (PLEG): container finished" podID="c63c9669-04e9-4a44-bb57-d92b31da6368" containerID="e5967c9652ce2971278ea48b781668c67aa34c4cee13b78a8c6fdc6cb4e643ed" exitCode=0 Jul 05 13:25:08.705817 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:08.705448 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" event={"ID":"c63c9669-04e9-4a44-bb57-d92b31da6368","Type":"ContainerDied","Data":"e5967c9652ce2971278ea48b781668c67aa34c4cee13b78a8c6fdc6cb4e643ed"} Jul 05 13:25:09.710630 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:09.710590 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" event={"ID":"c63c9669-04e9-4a44-bb57-d92b31da6368","Type":"ContainerStarted","Data":"6552091215d6e6f5181892f361b2e12df7fdbe6c542bac988ff2b42686dc58bb"} Jul 05 13:25:09.711075 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:09.710725 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" Jul 05 13:25:09.776334 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:09.776282 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" podStartSLOduration=2.083991201 podStartE2EDuration="6.776266202s" totalImagesPullingTime="3.675696462s" totalInitContainerRuntime="1.016578539s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:25:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:25:09.770562321 +0000 UTC m=+386.143838386" watchObservedRunningTime="2026-07-05 13:25:09.776266202 +0000 UTC m=+386.149542234" Jul 05 13:25:18.708234 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:18.708199 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6f6c4984d4-wv9pw" Jul 05 13:25:20.716556 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:20.716520 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b4f468d94-29ndm" Jul 05 13:25:34.160787 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.160757 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5"] Jul 05 13:25:34.177113 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.177087 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.196226 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.196204 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 05 13:25:34.197290 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.197261 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 05 13:25:34.197403 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.197265 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 05 13:25:34.197482 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.197465 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 05 13:25:34.197537 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.197524 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jk5b2\"" Jul 05 13:25:34.197589 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.197576 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 05 13:25:34.198216 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.198200 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 05 13:25:34.208224 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.208205 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5"] Jul 05 13:25:34.319680 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.319626 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6093aaa6-a8a6-4961-bf39-3a6e95a80a00-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-pnnl5\" (UID: \"6093aaa6-a8a6-4961-bf39-3a6e95a80a00\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.319680 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.319685 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6093aaa6-a8a6-4961-bf39-3a6e95a80a00-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-pnnl5\" (UID: \"6093aaa6-a8a6-4961-bf39-3a6e95a80a00\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.319908 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.319772 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6093aaa6-a8a6-4961-bf39-3a6e95a80a00-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-pnnl5\" (UID: \"6093aaa6-a8a6-4961-bf39-3a6e95a80a00\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.319908 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.319808 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6093aaa6-a8a6-4961-bf39-3a6e95a80a00-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-pnnl5\" (UID: \"6093aaa6-a8a6-4961-bf39-3a6e95a80a00\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.319908 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.319844 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-px9mw\" (UniqueName: \"kubernetes.io/projected/6093aaa6-a8a6-4961-bf39-3a6e95a80a00-kube-api-access-px9mw\") pod \"istiod-openshift-gateway-94bb8fbfd-pnnl5\" (UID: \"6093aaa6-a8a6-4961-bf39-3a6e95a80a00\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.319908 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.319895 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6093aaa6-a8a6-4961-bf39-3a6e95a80a00-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-pnnl5\" (UID: \"6093aaa6-a8a6-4961-bf39-3a6e95a80a00\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.320070 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.319920 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6093aaa6-a8a6-4961-bf39-3a6e95a80a00-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-pnnl5\" (UID: \"6093aaa6-a8a6-4961-bf39-3a6e95a80a00\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.421034 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.420954 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6093aaa6-a8a6-4961-bf39-3a6e95a80a00-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-pnnl5\" (UID: \"6093aaa6-a8a6-4961-bf39-3a6e95a80a00\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.421034 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.420994 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6093aaa6-a8a6-4961-bf39-3a6e95a80a00-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-pnnl5\" (UID: \"6093aaa6-a8a6-4961-bf39-3a6e95a80a00\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.421034 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.421023 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6093aaa6-a8a6-4961-bf39-3a6e95a80a00-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-pnnl5\" (UID: \"6093aaa6-a8a6-4961-bf39-3a6e95a80a00\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.421285 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.421045 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6093aaa6-a8a6-4961-bf39-3a6e95a80a00-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-pnnl5\" (UID: \"6093aaa6-a8a6-4961-bf39-3a6e95a80a00\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.421285 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.421072 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-px9mw\" (UniqueName: \"kubernetes.io/projected/6093aaa6-a8a6-4961-bf39-3a6e95a80a00-kube-api-access-px9mw\") pod \"istiod-openshift-gateway-94bb8fbfd-pnnl5\" (UID: \"6093aaa6-a8a6-4961-bf39-3a6e95a80a00\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.421285 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.421114 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6093aaa6-a8a6-4961-bf39-3a6e95a80a00-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-pnnl5\" (UID: \"6093aaa6-a8a6-4961-bf39-3a6e95a80a00\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.421285 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.421172 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6093aaa6-a8a6-4961-bf39-3a6e95a80a00-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-pnnl5\" (UID: \"6093aaa6-a8a6-4961-bf39-3a6e95a80a00\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.421817 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.421791 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6093aaa6-a8a6-4961-bf39-3a6e95a80a00-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-pnnl5\" (UID: \"6093aaa6-a8a6-4961-bf39-3a6e95a80a00\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.423391 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.423361 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6093aaa6-a8a6-4961-bf39-3a6e95a80a00-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-pnnl5\" (UID: \"6093aaa6-a8a6-4961-bf39-3a6e95a80a00\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.423516 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.423501 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6093aaa6-a8a6-4961-bf39-3a6e95a80a00-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-pnnl5\" (UID: \"6093aaa6-a8a6-4961-bf39-3a6e95a80a00\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.423591 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.423534 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6093aaa6-a8a6-4961-bf39-3a6e95a80a00-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-pnnl5\" (UID: \"6093aaa6-a8a6-4961-bf39-3a6e95a80a00\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.423686 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.423663 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6093aaa6-a8a6-4961-bf39-3a6e95a80a00-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-pnnl5\" (UID: \"6093aaa6-a8a6-4961-bf39-3a6e95a80a00\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.438391 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.438371 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6093aaa6-a8a6-4961-bf39-3a6e95a80a00-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-pnnl5\" (UID: \"6093aaa6-a8a6-4961-bf39-3a6e95a80a00\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.536322 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.536289 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-px9mw\" (UniqueName: \"kubernetes.io/projected/6093aaa6-a8a6-4961-bf39-3a6e95a80a00-kube-api-access-px9mw\") pod \"istiod-openshift-gateway-94bb8fbfd-pnnl5\" (UID: \"6093aaa6-a8a6-4961-bf39-3a6e95a80a00\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.786665 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.786563 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:34.940432 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:34.940408 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5"] Jul 05 13:25:34.942523 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:25:34.942495 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6093aaa6_a8a6_4961_bf39_3a6e95a80a00.slice/crio-3e85840086ef569bc59c9b2c5586960d4a7bdea6363cdb3b94b6fd1090f9e36d WatchSource:0}: Error finding container 3e85840086ef569bc59c9b2c5586960d4a7bdea6363cdb3b94b6fd1090f9e36d: Status 404 returned error can't find the container with id 3e85840086ef569bc59c9b2c5586960d4a7bdea6363cdb3b94b6fd1090f9e36d Jul 05 13:25:35.819332 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:35.819289 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" event={"ID":"6093aaa6-a8a6-4961-bf39-3a6e95a80a00","Type":"ContainerStarted","Data":"3e85840086ef569bc59c9b2c5586960d4a7bdea6363cdb3b94b6fd1090f9e36d"} Jul 05 13:25:37.434353 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:37.434309 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 13:25:37.434659 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:37.434387 2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 05 13:25:37.829437 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:37.829403 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" event={"ID":"6093aaa6-a8a6-4961-bf39-3a6e95a80a00","Type":"ContainerStarted","Data":"60f1a15a7c1116440117aea0f367d5e3603843f918d523174e0cda0aebd1afab"} Jul 05 13:25:37.829610 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:37.829477 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:25:37.899072 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:37.899012 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" podStartSLOduration=1.40935396 podStartE2EDuration="3.898993448s" totalImagesPullingTime="2.489639488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:25:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:25:37.893402371 +0000 UTC m=+414.266678405" watchObservedRunningTime="2026-07-05 13:25:37.898993448 +0000 UTC m=+414.272269481" Jul 05 13:25:38.836256 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:38.836219 2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-pnnl5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 05 13:25:38.836658 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:38.836297 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" podUID="6093aaa6-a8a6-4961-bf39-3a6e95a80a00" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 05 13:25:41.835521 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:25:41.835491 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-pnnl5" Jul 05 13:27:44.223254 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:27:44.223175 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gnxvv"] Jul 05 13:27:44.226154 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:27:44.226137 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gnxvv" Jul 05 13:27:44.229109 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:27:44.229089 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xlzrc\"" Jul 05 13:27:44.229307 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:27:44.229295 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 05 13:27:44.229808 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:27:44.229790 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 05 13:27:44.229988 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:27:44.229974 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 05 13:27:44.240586 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:27:44.240561 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gnxvv"] Jul 05 13:27:44.269007 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:27:44.268974 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84p4k\" (UniqueName: \"kubernetes.io/projected/11a891dc-7244-4309-8f4c-89490aa331f8-kube-api-access-84p4k\") pod \"limitador-limitador-64c94fd64f-gnxvv\" (UID: \"11a891dc-7244-4309-8f4c-89490aa331f8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gnxvv" Jul 05 13:27:44.269148 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:27:44.269023 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/11a891dc-7244-4309-8f4c-89490aa331f8-config-file\") pod \"limitador-limitador-64c94fd64f-gnxvv\" (UID: \"11a891dc-7244-4309-8f4c-89490aa331f8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gnxvv" Jul 05 13:27:44.306560 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:27:44.306533 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gnxvv"] Jul 05 13:27:44.370250 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:27:44.370208 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84p4k\" (UniqueName: \"kubernetes.io/projected/11a891dc-7244-4309-8f4c-89490aa331f8-kube-api-access-84p4k\") pod \"limitador-limitador-64c94fd64f-gnxvv\" (UID: \"11a891dc-7244-4309-8f4c-89490aa331f8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gnxvv" Jul 05 13:27:44.370392 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:27:44.370265 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/11a891dc-7244-4309-8f4c-89490aa331f8-config-file\") pod \"limitador-limitador-64c94fd64f-gnxvv\" (UID: \"11a891dc-7244-4309-8f4c-89490aa331f8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gnxvv" Jul 05 13:27:44.370946 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:27:44.370928 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/11a891dc-7244-4309-8f4c-89490aa331f8-config-file\") pod \"limitador-limitador-64c94fd64f-gnxvv\" (UID: \"11a891dc-7244-4309-8f4c-89490aa331f8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gnxvv" Jul 05 13:27:44.379279 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:27:44.379253 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84p4k\" (UniqueName: \"kubernetes.io/projected/11a891dc-7244-4309-8f4c-89490aa331f8-kube-api-access-84p4k\") pod \"limitador-limitador-64c94fd64f-gnxvv\" (UID: \"11a891dc-7244-4309-8f4c-89490aa331f8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gnxvv" Jul 05 13:27:44.537024 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:27:44.536938 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gnxvv" Jul 05 13:27:44.664109 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:27:44.664082 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gnxvv"] Jul 05 13:27:44.666374 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:27:44.666345 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11a891dc_7244_4309_8f4c_89490aa331f8.slice/crio-92c6196e910738e65b5451310759f656762a260094ed77883bf3f70f9323d33a WatchSource:0}: Error finding container 92c6196e910738e65b5451310759f656762a260094ed77883bf3f70f9323d33a: Status 404 returned error can't find the container with id 92c6196e910738e65b5451310759f656762a260094ed77883bf3f70f9323d33a Jul 05 13:27:45.320969 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:27:45.320882 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gnxvv" event={"ID":"11a891dc-7244-4309-8f4c-89490aa331f8","Type":"ContainerStarted","Data":"92c6196e910738e65b5451310759f656762a260094ed77883bf3f70f9323d33a"} Jul 05 13:27:47.331192 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:27:47.331153 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gnxvv" event={"ID":"11a891dc-7244-4309-8f4c-89490aa331f8","Type":"ContainerStarted","Data":"ca0440fc74d3a3cbf3e94a7c8b638b9fec22026551e0c586c23bcd70603775e6"} Jul 05 13:27:47.331593 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:27:47.331267 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-gnxvv" Jul 05 13:27:47.353611 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:27:47.353559 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-gnxvv" podStartSLOduration=0.874769372 podStartE2EDuration="3.353537409s" totalImagesPullingTime="2.478768037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:27:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:27:47.353460657 +0000 UTC m=+543.726736710" watchObservedRunningTime="2026-07-05 13:27:47.353537409 +0000 UTC m=+543.726813441" Jul 05 13:27:58.335583 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:27:58.335551 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-gnxvv" Jul 05 13:28:02.322656 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:02.322616 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gnxvv"] Jul 05 13:28:02.323158 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:02.322828 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-gnxvv" podUID="11a891dc-7244-4309-8f4c-89490aa331f8" containerName="limitador" containerID="cri-o://ca0440fc74d3a3cbf3e94a7c8b638b9fec22026551e0c586c23bcd70603775e6" gracePeriod=30 Jul 05 13:28:02.870325 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:02.870297 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gnxvv" Jul 05 13:28:02.901341 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:02.901270 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/11a891dc-7244-4309-8f4c-89490aa331f8-config-file\") pod \"11a891dc-7244-4309-8f4c-89490aa331f8\" (UID: \"11a891dc-7244-4309-8f4c-89490aa331f8\") " Jul 05 13:28:02.901458 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:02.901413 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84p4k\" (UniqueName: \"kubernetes.io/projected/11a891dc-7244-4309-8f4c-89490aa331f8-kube-api-access-84p4k\") pod \"11a891dc-7244-4309-8f4c-89490aa331f8\" (UID: \"11a891dc-7244-4309-8f4c-89490aa331f8\") " Jul 05 13:28:02.901628 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:02.901602 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11a891dc-7244-4309-8f4c-89490aa331f8-config-file" (OuterVolumeSpecName: "config-file") pod "11a891dc-7244-4309-8f4c-89490aa331f8" (UID: "11a891dc-7244-4309-8f4c-89490aa331f8"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 13:28:02.901725 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:02.901714 2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/11a891dc-7244-4309-8f4c-89490aa331f8-config-file\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:28:02.903703 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:02.903631 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11a891dc-7244-4309-8f4c-89490aa331f8-kube-api-access-84p4k" (OuterVolumeSpecName: "kube-api-access-84p4k") pod "11a891dc-7244-4309-8f4c-89490aa331f8" (UID: "11a891dc-7244-4309-8f4c-89490aa331f8"). InnerVolumeSpecName "kube-api-access-84p4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:28:03.002963 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:03.002926 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84p4k\" (UniqueName: \"kubernetes.io/projected/11a891dc-7244-4309-8f4c-89490aa331f8-kube-api-access-84p4k\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:28:03.391610 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:03.391578 2577 generic.go:356] "Generic (PLEG): container finished" podID="11a891dc-7244-4309-8f4c-89490aa331f8" containerID="ca0440fc74d3a3cbf3e94a7c8b638b9fec22026551e0c586c23bcd70603775e6" exitCode=0 Jul 05 13:28:03.392045 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:03.391625 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gnxvv" Jul 05 13:28:03.392045 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:03.391659 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gnxvv" event={"ID":"11a891dc-7244-4309-8f4c-89490aa331f8","Type":"ContainerDied","Data":"ca0440fc74d3a3cbf3e94a7c8b638b9fec22026551e0c586c23bcd70603775e6"} Jul 05 13:28:03.392045 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:03.391716 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gnxvv" event={"ID":"11a891dc-7244-4309-8f4c-89490aa331f8","Type":"ContainerDied","Data":"92c6196e910738e65b5451310759f656762a260094ed77883bf3f70f9323d33a"} Jul 05 13:28:03.392045 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:03.391752 2577 scope.go:117] "RemoveContainer" containerID="ca0440fc74d3a3cbf3e94a7c8b638b9fec22026551e0c586c23bcd70603775e6" Jul 05 13:28:03.400080 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:03.400057 2577 scope.go:117] "RemoveContainer" containerID="ca0440fc74d3a3cbf3e94a7c8b638b9fec22026551e0c586c23bcd70603775e6" Jul 05 13:28:03.400333 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:28:03.400314 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca0440fc74d3a3cbf3e94a7c8b638b9fec22026551e0c586c23bcd70603775e6\": container with ID starting with ca0440fc74d3a3cbf3e94a7c8b638b9fec22026551e0c586c23bcd70603775e6 not found: ID does not exist" containerID="ca0440fc74d3a3cbf3e94a7c8b638b9fec22026551e0c586c23bcd70603775e6" Jul 05 13:28:03.400413 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:03.400340 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca0440fc74d3a3cbf3e94a7c8b638b9fec22026551e0c586c23bcd70603775e6"} err="failed to get container status \"ca0440fc74d3a3cbf3e94a7c8b638b9fec22026551e0c586c23bcd70603775e6\": rpc error: code = NotFound desc = could not find container \"ca0440fc74d3a3cbf3e94a7c8b638b9fec22026551e0c586c23bcd70603775e6\": container with ID starting with ca0440fc74d3a3cbf3e94a7c8b638b9fec22026551e0c586c23bcd70603775e6 not found: ID does not exist" Jul 05 13:28:03.416758 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:03.416730 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gnxvv"] Jul 05 13:28:03.421068 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:03.421046 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gnxvv"] Jul 05 13:28:04.234980 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:04.234950 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11a891dc-7244-4309-8f4c-89490aa331f8" path="/var/lib/kubelet/pods/11a891dc-7244-4309-8f4c-89490aa331f8/volumes" Jul 05 13:28:05.756450 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:05.756422 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-4jkl7"] Jul 05 13:28:05.756834 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:05.756709 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11a891dc-7244-4309-8f4c-89490aa331f8" containerName="limitador" Jul 05 13:28:05.756834 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:05.756721 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="11a891dc-7244-4309-8f4c-89490aa331f8" containerName="limitador" Jul 05 13:28:05.756834 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:05.756786 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="11a891dc-7244-4309-8f4c-89490aa331f8" containerName="limitador" Jul 05 13:28:05.760940 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:05.760919 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-4jkl7" Jul 05 13:28:05.763361 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:05.763339 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-dm65x\"" Jul 05 13:28:05.763461 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:05.763399 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 05 13:28:05.768255 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:05.768236 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-4jkl7"] Jul 05 13:28:05.824111 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:05.824085 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/450277e1-2155-46de-ad6c-fb1e8a6ba713-data\") pod \"postgres-69fb4594cf-4jkl7\" (UID: \"450277e1-2155-46de-ad6c-fb1e8a6ba713\") " pod="opendatahub/postgres-69fb4594cf-4jkl7" Jul 05 13:28:05.824230 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:05.824128 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqxmb\" (UniqueName: \"kubernetes.io/projected/450277e1-2155-46de-ad6c-fb1e8a6ba713-kube-api-access-bqxmb\") pod \"postgres-69fb4594cf-4jkl7\" (UID: \"450277e1-2155-46de-ad6c-fb1e8a6ba713\") " pod="opendatahub/postgres-69fb4594cf-4jkl7" Jul 05 13:28:05.924930 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:05.924902 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqxmb\" (UniqueName: \"kubernetes.io/projected/450277e1-2155-46de-ad6c-fb1e8a6ba713-kube-api-access-bqxmb\") pod \"postgres-69fb4594cf-4jkl7\" (UID: \"450277e1-2155-46de-ad6c-fb1e8a6ba713\") " pod="opendatahub/postgres-69fb4594cf-4jkl7" Jul 05 13:28:05.925065 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:05.924966 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/450277e1-2155-46de-ad6c-fb1e8a6ba713-data\") pod \"postgres-69fb4594cf-4jkl7\" (UID: \"450277e1-2155-46de-ad6c-fb1e8a6ba713\") " pod="opendatahub/postgres-69fb4594cf-4jkl7" Jul 05 13:28:05.925279 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:05.925264 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/450277e1-2155-46de-ad6c-fb1e8a6ba713-data\") pod \"postgres-69fb4594cf-4jkl7\" (UID: \"450277e1-2155-46de-ad6c-fb1e8a6ba713\") " pod="opendatahub/postgres-69fb4594cf-4jkl7" Jul 05 13:28:05.933546 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:05.933520 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqxmb\" (UniqueName: \"kubernetes.io/projected/450277e1-2155-46de-ad6c-fb1e8a6ba713-kube-api-access-bqxmb\") pod \"postgres-69fb4594cf-4jkl7\" (UID: \"450277e1-2155-46de-ad6c-fb1e8a6ba713\") " pod="opendatahub/postgres-69fb4594cf-4jkl7" Jul 05 13:28:06.071585 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:06.071516 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-4jkl7" Jul 05 13:28:06.200144 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:06.200116 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-4jkl7"] Jul 05 13:28:06.203510 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:28:06.203484 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod450277e1_2155_46de_ad6c_fb1e8a6ba713.slice/crio-896abf46da571d946fac9541b5749b8cfc4869f52eeaf7ac6fa6483027aa46f3 WatchSource:0}: Error finding container 896abf46da571d946fac9541b5749b8cfc4869f52eeaf7ac6fa6483027aa46f3: Status 404 returned error can't find the container with id 896abf46da571d946fac9541b5749b8cfc4869f52eeaf7ac6fa6483027aa46f3 Jul 05 13:28:06.405447 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:06.405410 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-4jkl7" event={"ID":"450277e1-2155-46de-ad6c-fb1e8a6ba713","Type":"ContainerStarted","Data":"896abf46da571d946fac9541b5749b8cfc4869f52eeaf7ac6fa6483027aa46f3"} Jul 05 13:28:11.429257 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:11.429223 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-4jkl7" event={"ID":"450277e1-2155-46de-ad6c-fb1e8a6ba713","Type":"ContainerStarted","Data":"9b6a2bb017221e162d96c1dba93f53da933efb3d18d611b8c388cdeb6c479331"} Jul 05 13:28:11.429553 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:11.429319 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-4jkl7" Jul 05 13:28:11.445465 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:11.445420 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-4jkl7" podStartSLOduration=1.289374384 podStartE2EDuration="6.445399266s" totalImagesPullingTime="5.156024882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:28:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:28:11.445038085 +0000 UTC m=+567.818314155" watchObservedRunningTime="2026-07-05 13:28:11.445399266 +0000 UTC m=+567.818675314" Jul 05 13:28:17.463028 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:17.462996 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-4jkl7" Jul 05 13:28:24.079985 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:24.079948 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-545bdb555d-vc657"] Jul 05 13:28:24.106991 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:24.106958 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-545bdb555d-vc657"] Jul 05 13:28:24.107160 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:24.107078 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-545bdb555d-vc657" Jul 05 13:28:24.109465 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:24.109439 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 05 13:28:24.109465 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:24.109439 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 05 13:28:24.109680 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:24.109484 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-mcq5z\"" Jul 05 13:28:24.184999 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:24.184969 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccb51138-dcfa-41a0-9f01-5c638be35b2c-webhook-cert\") pod \"maas-controller-545bdb555d-vc657\" (UID: \"ccb51138-dcfa-41a0-9f01-5c638be35b2c\") " pod="opendatahub/maas-controller-545bdb555d-vc657" Jul 05 13:28:24.185192 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:24.185005 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq5k7\" (UniqueName: \"kubernetes.io/projected/ccb51138-dcfa-41a0-9f01-5c638be35b2c-kube-api-access-qq5k7\") pod \"maas-controller-545bdb555d-vc657\" (UID: \"ccb51138-dcfa-41a0-9f01-5c638be35b2c\") " pod="opendatahub/maas-controller-545bdb555d-vc657" Jul 05 13:28:24.286035 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:24.286004 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccb51138-dcfa-41a0-9f01-5c638be35b2c-webhook-cert\") pod \"maas-controller-545bdb555d-vc657\" (UID: \"ccb51138-dcfa-41a0-9f01-5c638be35b2c\") " pod="opendatahub/maas-controller-545bdb555d-vc657" Jul 05 13:28:24.286202 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:24.286049 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq5k7\" (UniqueName: \"kubernetes.io/projected/ccb51138-dcfa-41a0-9f01-5c638be35b2c-kube-api-access-qq5k7\") pod \"maas-controller-545bdb555d-vc657\" (UID: \"ccb51138-dcfa-41a0-9f01-5c638be35b2c\") " pod="opendatahub/maas-controller-545bdb555d-vc657" Jul 05 13:28:24.288409 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:24.288387 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccb51138-dcfa-41a0-9f01-5c638be35b2c-webhook-cert\") pod \"maas-controller-545bdb555d-vc657\" (UID: \"ccb51138-dcfa-41a0-9f01-5c638be35b2c\") " pod="opendatahub/maas-controller-545bdb555d-vc657" Jul 05 13:28:24.295958 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:24.295932 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq5k7\" (UniqueName: \"kubernetes.io/projected/ccb51138-dcfa-41a0-9f01-5c638be35b2c-kube-api-access-qq5k7\") pod \"maas-controller-545bdb555d-vc657\" (UID: \"ccb51138-dcfa-41a0-9f01-5c638be35b2c\") " pod="opendatahub/maas-controller-545bdb555d-vc657" Jul 05 13:28:24.416888 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:24.416809 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-545bdb555d-vc657" Jul 05 13:28:24.543703 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:24.543667 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-545bdb555d-vc657"] Jul 05 13:28:24.547483 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:28:24.547453 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccb51138_dcfa_41a0_9f01_5c638be35b2c.slice/crio-15efc62dec3ab13336f0343e2ee96b95ca6eb6680b5a010ca0cf03fcdffc51fc WatchSource:0}: Error finding container 15efc62dec3ab13336f0343e2ee96b95ca6eb6680b5a010ca0cf03fcdffc51fc: Status 404 returned error can't find the container with id 15efc62dec3ab13336f0343e2ee96b95ca6eb6680b5a010ca0cf03fcdffc51fc Jul 05 13:28:25.485719 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:25.485679 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-545bdb555d-vc657" event={"ID":"ccb51138-dcfa-41a0-9f01-5c638be35b2c","Type":"ContainerStarted","Data":"15efc62dec3ab13336f0343e2ee96b95ca6eb6680b5a010ca0cf03fcdffc51fc"} Jul 05 13:28:26.492019 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:26.491988 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-545bdb555d-vc657" event={"ID":"ccb51138-dcfa-41a0-9f01-5c638be35b2c","Type":"ContainerStarted","Data":"46b15d652c495983782b282e477e9bcd4f79c61d4f8d173a4c04c1395ce38315"} Jul 05 13:28:26.492416 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:26.492122 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-545bdb555d-vc657" Jul 05 13:28:26.534811 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:26.534749 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-545bdb555d-vc657" podStartSLOduration=0.75939704 podStartE2EDuration="2.534725961s" totalImagesPullingTime="1.775328921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:28:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:28:26.533162972 +0000 UTC m=+582.906439002" watchObservedRunningTime="2026-07-05 13:28:26.534725961 +0000 UTC m=+582.908002006" Jul 05 13:28:37.501388 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:37.501360 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-545bdb555d-vc657" Jul 05 13:28:38.235713 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:38.235686 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-545bdb555d-vc657"] Jul 05 13:28:38.235870 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:38.235825 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-545bdb555d-vc657" podUID="ccb51138-dcfa-41a0-9f01-5c638be35b2c" containerName="manager" containerID="cri-o://46b15d652c495983782b282e477e9bcd4f79c61d4f8d173a4c04c1395ce38315" gracePeriod=30 Jul 05 13:28:38.466715 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:38.466691 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-545bdb555d-vc657" Jul 05 13:28:38.500430 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:38.500360 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qq5k7\" (UniqueName: \"kubernetes.io/projected/ccb51138-dcfa-41a0-9f01-5c638be35b2c-kube-api-access-qq5k7\") pod \"ccb51138-dcfa-41a0-9f01-5c638be35b2c\" (UID: \"ccb51138-dcfa-41a0-9f01-5c638be35b2c\") " Jul 05 13:28:38.500430 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:38.500422 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccb51138-dcfa-41a0-9f01-5c638be35b2c-webhook-cert\") pod \"ccb51138-dcfa-41a0-9f01-5c638be35b2c\" (UID: \"ccb51138-dcfa-41a0-9f01-5c638be35b2c\") " Jul 05 13:28:38.502450 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:38.502427 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ccb51138-dcfa-41a0-9f01-5c638be35b2c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ccb51138-dcfa-41a0-9f01-5c638be35b2c" (UID: "ccb51138-dcfa-41a0-9f01-5c638be35b2c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:28:38.502752 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:38.502524 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccb51138-dcfa-41a0-9f01-5c638be35b2c-kube-api-access-qq5k7" (OuterVolumeSpecName: "kube-api-access-qq5k7") pod "ccb51138-dcfa-41a0-9f01-5c638be35b2c" (UID: "ccb51138-dcfa-41a0-9f01-5c638be35b2c"). InnerVolumeSpecName "kube-api-access-qq5k7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:28:38.539118 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:38.539089 2577 generic.go:356] "Generic (PLEG): container finished" podID="ccb51138-dcfa-41a0-9f01-5c638be35b2c" containerID="46b15d652c495983782b282e477e9bcd4f79c61d4f8d173a4c04c1395ce38315" exitCode=0 Jul 05 13:28:38.539257 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:38.539132 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-545bdb555d-vc657" Jul 05 13:28:38.539257 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:38.539167 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-545bdb555d-vc657" event={"ID":"ccb51138-dcfa-41a0-9f01-5c638be35b2c","Type":"ContainerDied","Data":"46b15d652c495983782b282e477e9bcd4f79c61d4f8d173a4c04c1395ce38315"} Jul 05 13:28:38.539257 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:38.539208 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-545bdb555d-vc657" event={"ID":"ccb51138-dcfa-41a0-9f01-5c638be35b2c","Type":"ContainerDied","Data":"15efc62dec3ab13336f0343e2ee96b95ca6eb6680b5a010ca0cf03fcdffc51fc"} Jul 05 13:28:38.539257 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:38.539227 2577 scope.go:117] "RemoveContainer" containerID="46b15d652c495983782b282e477e9bcd4f79c61d4f8d173a4c04c1395ce38315" Jul 05 13:28:38.548343 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:38.548256 2577 scope.go:117] "RemoveContainer" containerID="46b15d652c495983782b282e477e9bcd4f79c61d4f8d173a4c04c1395ce38315" Jul 05 13:28:38.548728 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:28:38.548600 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46b15d652c495983782b282e477e9bcd4f79c61d4f8d173a4c04c1395ce38315\": container with ID starting with 46b15d652c495983782b282e477e9bcd4f79c61d4f8d173a4c04c1395ce38315 not found: ID does not exist" containerID="46b15d652c495983782b282e477e9bcd4f79c61d4f8d173a4c04c1395ce38315" Jul 05 13:28:38.548728 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:38.548682 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46b15d652c495983782b282e477e9bcd4f79c61d4f8d173a4c04c1395ce38315"} err="failed to get container status \"46b15d652c495983782b282e477e9bcd4f79c61d4f8d173a4c04c1395ce38315\": rpc error: code = NotFound desc = could not find container \"46b15d652c495983782b282e477e9bcd4f79c61d4f8d173a4c04c1395ce38315\": container with ID starting with 46b15d652c495983782b282e477e9bcd4f79c61d4f8d173a4c04c1395ce38315 not found: ID does not exist" Jul 05 13:28:38.563834 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:38.563804 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-545bdb555d-vc657"] Jul 05 13:28:38.567415 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:38.567396 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-545bdb555d-vc657"] Jul 05 13:28:38.600897 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:38.600872 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qq5k7\" (UniqueName: \"kubernetes.io/projected/ccb51138-dcfa-41a0-9f01-5c638be35b2c-kube-api-access-qq5k7\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:28:38.600897 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:38.600895 2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ccb51138-dcfa-41a0-9f01-5c638be35b2c-webhook-cert\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:28:40.234940 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:40.234906 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccb51138-dcfa-41a0-9f01-5c638be35b2c" path="/var/lib/kubelet/pods/ccb51138-dcfa-41a0-9f01-5c638be35b2c/volumes" Jul 05 13:28:57.633972 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:57.633938 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-8555c8549f-5rzkx"] Jul 05 13:28:57.634413 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:57.634222 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccb51138-dcfa-41a0-9f01-5c638be35b2c" containerName="manager" Jul 05 13:28:57.634413 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:57.634233 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccb51138-dcfa-41a0-9f01-5c638be35b2c" containerName="manager" Jul 05 13:28:57.634413 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:57.634286 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccb51138-dcfa-41a0-9f01-5c638be35b2c" containerName="manager" Jul 05 13:28:57.638504 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:57.638480 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8555c8549f-5rzkx" Jul 05 13:28:57.640882 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:57.640855 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 05 13:28:57.641121 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:57.640904 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-t2n54\"" Jul 05 13:28:57.649284 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:57.649264 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8555c8549f-5rzkx"] Jul 05 13:28:57.739502 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:57.739472 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msq6h\" (UniqueName: \"kubernetes.io/projected/40d4ff53-46d6-424b-b0c2-78c6f1301add-kube-api-access-msq6h\") pod \"maas-api-8555c8549f-5rzkx\" (UID: \"40d4ff53-46d6-424b-b0c2-78c6f1301add\") " pod="opendatahub/maas-api-8555c8549f-5rzkx" Jul 05 13:28:57.739690 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:57.739518 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40d4ff53-46d6-424b-b0c2-78c6f1301add-openshift-service-ca\") pod \"maas-api-8555c8549f-5rzkx\" (UID: \"40d4ff53-46d6-424b-b0c2-78c6f1301add\") " pod="opendatahub/maas-api-8555c8549f-5rzkx" Jul 05 13:28:57.739690 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:57.739546 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40d4ff53-46d6-424b-b0c2-78c6f1301add-maas-api-tls\") pod \"maas-api-8555c8549f-5rzkx\" (UID: \"40d4ff53-46d6-424b-b0c2-78c6f1301add\") " pod="opendatahub/maas-api-8555c8549f-5rzkx" Jul 05 13:28:57.840604 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:57.840571 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msq6h\" (UniqueName: \"kubernetes.io/projected/40d4ff53-46d6-424b-b0c2-78c6f1301add-kube-api-access-msq6h\") pod \"maas-api-8555c8549f-5rzkx\" (UID: \"40d4ff53-46d6-424b-b0c2-78c6f1301add\") " pod="opendatahub/maas-api-8555c8549f-5rzkx" Jul 05 13:28:57.840798 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:57.840610 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40d4ff53-46d6-424b-b0c2-78c6f1301add-openshift-service-ca\") pod \"maas-api-8555c8549f-5rzkx\" (UID: \"40d4ff53-46d6-424b-b0c2-78c6f1301add\") " pod="opendatahub/maas-api-8555c8549f-5rzkx" Jul 05 13:28:57.840798 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:57.840632 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40d4ff53-46d6-424b-b0c2-78c6f1301add-maas-api-tls\") pod \"maas-api-8555c8549f-5rzkx\" (UID: \"40d4ff53-46d6-424b-b0c2-78c6f1301add\") " pod="opendatahub/maas-api-8555c8549f-5rzkx" Jul 05 13:28:57.841290 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:57.841266 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/40d4ff53-46d6-424b-b0c2-78c6f1301add-openshift-service-ca\") pod \"maas-api-8555c8549f-5rzkx\" (UID: \"40d4ff53-46d6-424b-b0c2-78c6f1301add\") " pod="opendatahub/maas-api-8555c8549f-5rzkx" Jul 05 13:28:57.843070 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:57.843050 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/40d4ff53-46d6-424b-b0c2-78c6f1301add-maas-api-tls\") pod \"maas-api-8555c8549f-5rzkx\" (UID: \"40d4ff53-46d6-424b-b0c2-78c6f1301add\") " pod="opendatahub/maas-api-8555c8549f-5rzkx" Jul 05 13:28:57.853441 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:57.853416 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msq6h\" (UniqueName: \"kubernetes.io/projected/40d4ff53-46d6-424b-b0c2-78c6f1301add-kube-api-access-msq6h\") pod \"maas-api-8555c8549f-5rzkx\" (UID: \"40d4ff53-46d6-424b-b0c2-78c6f1301add\") " pod="opendatahub/maas-api-8555c8549f-5rzkx" Jul 05 13:28:57.949108 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:57.949027 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8555c8549f-5rzkx" Jul 05 13:28:58.079979 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:58.079954 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8555c8549f-5rzkx"] Jul 05 13:28:58.082475 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:28:58.082441 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40d4ff53_46d6_424b_b0c2_78c6f1301add.slice/crio-09ebee33eaffff86b3a6451be6e92a307a0a0f9a06401df23b854b42e67f399c WatchSource:0}: Error finding container 09ebee33eaffff86b3a6451be6e92a307a0a0f9a06401df23b854b42e67f399c: Status 404 returned error can't find the container with id 09ebee33eaffff86b3a6451be6e92a307a0a0f9a06401df23b854b42e67f399c Jul 05 13:28:58.619429 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:58.619391 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8555c8549f-5rzkx" event={"ID":"40d4ff53-46d6-424b-b0c2-78c6f1301add","Type":"ContainerStarted","Data":"09ebee33eaffff86b3a6451be6e92a307a0a0f9a06401df23b854b42e67f399c"} Jul 05 13:28:59.624909 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:59.624828 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8555c8549f-5rzkx" event={"ID":"40d4ff53-46d6-424b-b0c2-78c6f1301add","Type":"ContainerStarted","Data":"c20c2ceaf5e3ecd7a16f548e80c1709531aac875c4e3c2d5356a70051648393f"} Jul 05 13:28:59.625275 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:59.624958 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-8555c8549f-5rzkx" Jul 05 13:28:59.644401 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:28:59.644343 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-8555c8549f-5rzkx" podStartSLOduration=1.392108832 podStartE2EDuration="2.644325154s" totalImagesPullingTime="1.252216322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:28:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:28:59.643528022 +0000 UTC m=+616.016804110" watchObservedRunningTime="2026-07-05 13:28:59.644325154 +0000 UTC m=+616.017601188" Jul 05 13:29:05.634907 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:05.634877 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-8555c8549f-5rzkx" Jul 05 13:29:11.758750 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.758718 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9"] Jul 05 13:29:11.761885 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.761862 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:11.765352 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.765314 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 05 13:29:11.765504 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.765349 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 05 13:29:11.765504 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.765376 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5hzdx\"" Jul 05 13:29:11.765504 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.765417 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 05 13:29:11.773531 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.773503 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9"] Jul 05 13:29:11.845467 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.845432 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9\" (UID: \"8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:11.845666 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.845503 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg9zh\" (UniqueName: \"kubernetes.io/projected/8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0-kube-api-access-cg9zh\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9\" (UID: \"8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:11.845666 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.845537 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9\" (UID: \"8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:11.845666 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.845557 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9\" (UID: \"8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:11.845666 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.845578 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9\" (UID: \"8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:11.845666 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.845602 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9\" (UID: \"8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:11.946299 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.946267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg9zh\" (UniqueName: \"kubernetes.io/projected/8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0-kube-api-access-cg9zh\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9\" (UID: \"8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:11.946482 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.946311 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9\" (UID: \"8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:11.946482 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.946344 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9\" (UID: \"8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:11.946482 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.946366 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9\" (UID: \"8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:11.946482 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.946389 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9\" (UID: \"8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:11.946482 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.946414 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9\" (UID: \"8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:11.946842 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.946820 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9\" (UID: \"8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:11.946910 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.946893 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9\" (UID: \"8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:11.947034 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.946937 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9\" (UID: \"8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:11.949146 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.949123 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9\" (UID: \"8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:11.949246 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.949230 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9\" (UID: \"8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:11.958441 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:11.958407 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg9zh\" (UniqueName: \"kubernetes.io/projected/8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0-kube-api-access-cg9zh\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9\" (UID: \"8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:12.073137 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:12.073038 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:12.203867 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:12.203841 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9"] Jul 05 13:29:12.205869 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:29:12.205845 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e8a2578_a9c1_4c15_b1b5_c4a2bf2b4dd0.slice/crio-14739269c991ead7d92ce1931650c7d074533036bbb12a31a10cb7c5efa77f4e WatchSource:0}: Error finding container 14739269c991ead7d92ce1931650c7d074533036bbb12a31a10cb7c5efa77f4e: Status 404 returned error can't find the container with id 14739269c991ead7d92ce1931650c7d074533036bbb12a31a10cb7c5efa77f4e Jul 05 13:29:12.677679 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:12.677618 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" event={"ID":"8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0","Type":"ContainerStarted","Data":"14739269c991ead7d92ce1931650c7d074533036bbb12a31a10cb7c5efa77f4e"} Jul 05 13:29:13.682382 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:13.682349 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" event={"ID":"8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0","Type":"ContainerStarted","Data":"176ee510c3b812bc4cf8cf39549b0185b9f080eb5cf948ef33d2c1b38254b543"} Jul 05 13:29:13.702587 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:13.702524 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" podStartSLOduration=1.732819822 podStartE2EDuration="2.702504523s" totalImagesPullingTime="969.684701ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:29:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:29:13.701576384 +0000 UTC m=+630.074852438" watchObservedRunningTime="2026-07-05 13:29:13.702504523 +0000 UTC m=+630.075780556" Jul 05 13:29:22.074105 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:22.074056 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:22.076446 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:22.074202 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:22.086536 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:22.086515 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:22.728024 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:22.727993 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9" Jul 05 13:29:50.053056 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.053025 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8"] Jul 05 13:29:50.059480 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.059462 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:29:50.062063 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.062042 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 05 13:29:50.065687 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.065664 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8"] Jul 05 13:29:50.158757 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.158719 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb3d373e-c467-4d42-b781-57081532f5b7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v4rz8\" (UID: \"cb3d373e-c467-4d42-b781-57081532f5b7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:29:50.158757 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.158761 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzbpc\" (UniqueName: \"kubernetes.io/projected/cb3d373e-c467-4d42-b781-57081532f5b7-kube-api-access-xzbpc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v4rz8\" (UID: \"cb3d373e-c467-4d42-b781-57081532f5b7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:29:50.159018 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.158793 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb3d373e-c467-4d42-b781-57081532f5b7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v4rz8\" (UID: \"cb3d373e-c467-4d42-b781-57081532f5b7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:29:50.159018 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.158903 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb3d373e-c467-4d42-b781-57081532f5b7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v4rz8\" (UID: \"cb3d373e-c467-4d42-b781-57081532f5b7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:29:50.159018 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.158938 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb3d373e-c467-4d42-b781-57081532f5b7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v4rz8\" (UID: \"cb3d373e-c467-4d42-b781-57081532f5b7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:29:50.159018 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.159006 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb3d373e-c467-4d42-b781-57081532f5b7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v4rz8\" (UID: \"cb3d373e-c467-4d42-b781-57081532f5b7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:29:50.259932 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.259896 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb3d373e-c467-4d42-b781-57081532f5b7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v4rz8\" (UID: \"cb3d373e-c467-4d42-b781-57081532f5b7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:29:50.260104 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.259947 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb3d373e-c467-4d42-b781-57081532f5b7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v4rz8\" (UID: \"cb3d373e-c467-4d42-b781-57081532f5b7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:29:50.260104 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.259971 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb3d373e-c467-4d42-b781-57081532f5b7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v4rz8\" (UID: \"cb3d373e-c467-4d42-b781-57081532f5b7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:29:50.260104 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.259990 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzbpc\" (UniqueName: \"kubernetes.io/projected/cb3d373e-c467-4d42-b781-57081532f5b7-kube-api-access-xzbpc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v4rz8\" (UID: \"cb3d373e-c467-4d42-b781-57081532f5b7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:29:50.260104 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.260010 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb3d373e-c467-4d42-b781-57081532f5b7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v4rz8\" (UID: \"cb3d373e-c467-4d42-b781-57081532f5b7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:29:50.260104 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.260060 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb3d373e-c467-4d42-b781-57081532f5b7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v4rz8\" (UID: \"cb3d373e-c467-4d42-b781-57081532f5b7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:29:50.260379 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.260352 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb3d373e-c467-4d42-b781-57081532f5b7-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v4rz8\" (UID: \"cb3d373e-c467-4d42-b781-57081532f5b7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:29:50.260444 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.260375 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb3d373e-c467-4d42-b781-57081532f5b7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v4rz8\" (UID: \"cb3d373e-c467-4d42-b781-57081532f5b7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:29:50.260444 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.260434 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb3d373e-c467-4d42-b781-57081532f5b7-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v4rz8\" (UID: \"cb3d373e-c467-4d42-b781-57081532f5b7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:29:50.262434 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.262409 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb3d373e-c467-4d42-b781-57081532f5b7-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v4rz8\" (UID: \"cb3d373e-c467-4d42-b781-57081532f5b7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:29:50.262599 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.262582 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb3d373e-c467-4d42-b781-57081532f5b7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v4rz8\" (UID: \"cb3d373e-c467-4d42-b781-57081532f5b7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:29:50.270263 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.270242 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzbpc\" (UniqueName: \"kubernetes.io/projected/cb3d373e-c467-4d42-b781-57081532f5b7-kube-api-access-xzbpc\") pod \"e2e-trlp-test-simulated-kserve-598466548d-v4rz8\" (UID: \"cb3d373e-c467-4d42-b781-57081532f5b7\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:29:50.370470 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.370443 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:29:50.500923 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.500896 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8"] Jul 05 13:29:50.502962 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:29:50.502921 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb3d373e_c467_4d42_b781_57081532f5b7.slice/crio-236e760058c25884a91833c38ceba75954feeb82d4552e34b44ffdaa493d5a72 WatchSource:0}: Error finding container 236e760058c25884a91833c38ceba75954feeb82d4552e34b44ffdaa493d5a72: Status 404 returned error can't find the container with id 236e760058c25884a91833c38ceba75954feeb82d4552e34b44ffdaa493d5a72 Jul 05 13:29:50.504236 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.504220 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 13:29:50.830489 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.830455 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" event={"ID":"cb3d373e-c467-4d42-b781-57081532f5b7","Type":"ContainerStarted","Data":"6db7aff837886031ba6b8ef06e5c5f107806e5714676688612af9c350a1b709a"} Jul 05 13:29:50.830680 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.830503 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" event={"ID":"cb3d373e-c467-4d42-b781-57081532f5b7","Type":"ContainerStarted","Data":"236e760058c25884a91833c38ceba75954feeb82d4552e34b44ffdaa493d5a72"} Jul 05 13:29:50.850371 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:29:50.850327 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" podStartSLOduration=0.693658923 podStartE2EDuration="850.311455ms" totalImagesPullingTime="156.652532ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:29:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:29:50.849698716 +0000 UTC m=+667.222974748" watchObservedRunningTime="2026-07-05 13:29:50.850311455 +0000 UTC m=+667.223587487" Jul 05 13:30:00.371263 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:30:00.371221 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:30:00.371775 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:30:00.371295 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:30:00.383535 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:30:00.383506 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:30:00.882364 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:30:00.882330 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-v4rz8" Jul 05 13:44:31.763876 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:31.763844 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m"] Jul 05 13:44:31.767492 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:31.767466 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m" Jul 05 13:44:31.770306 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:31.770258 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-6a6fcb60-serving-cert\"" Jul 05 13:44:31.779474 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:31.779447 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m"] Jul 05 13:44:31.846782 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:31.846744 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/165b68f4-ef12-4036-bd48-8138f52e2177-maas-api-tls\") pod \"maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m\" (UID: \"165b68f4-ef12-4036-bd48-8138f52e2177\") " pod="opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m" Jul 05 13:44:31.846931 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:31.846867 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/165b68f4-ef12-4036-bd48-8138f52e2177-openshift-service-ca\") pod \"maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m\" (UID: \"165b68f4-ef12-4036-bd48-8138f52e2177\") " pod="opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m" Jul 05 13:44:31.846931 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:31.846897 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xczcp\" (UniqueName: \"kubernetes.io/projected/165b68f4-ef12-4036-bd48-8138f52e2177-kube-api-access-xczcp\") pod \"maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m\" (UID: \"165b68f4-ef12-4036-bd48-8138f52e2177\") " pod="opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m" Jul 05 13:44:31.948144 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:31.948106 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/165b68f4-ef12-4036-bd48-8138f52e2177-maas-api-tls\") pod \"maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m\" (UID: \"165b68f4-ef12-4036-bd48-8138f52e2177\") " pod="opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m" Jul 05 13:44:31.948307 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:31.948194 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/165b68f4-ef12-4036-bd48-8138f52e2177-openshift-service-ca\") pod \"maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m\" (UID: \"165b68f4-ef12-4036-bd48-8138f52e2177\") " pod="opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m" Jul 05 13:44:31.948307 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:31.948224 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xczcp\" (UniqueName: \"kubernetes.io/projected/165b68f4-ef12-4036-bd48-8138f52e2177-kube-api-access-xczcp\") pod \"maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m\" (UID: \"165b68f4-ef12-4036-bd48-8138f52e2177\") " pod="opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m" Jul 05 13:44:31.949008 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:31.948987 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/165b68f4-ef12-4036-bd48-8138f52e2177-openshift-service-ca\") pod \"maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m\" (UID: \"165b68f4-ef12-4036-bd48-8138f52e2177\") " pod="opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m" Jul 05 13:44:31.950962 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:31.950938 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/165b68f4-ef12-4036-bd48-8138f52e2177-maas-api-tls\") pod \"maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m\" (UID: \"165b68f4-ef12-4036-bd48-8138f52e2177\") " pod="opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m" Jul 05 13:44:31.958789 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:31.958764 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xczcp\" (UniqueName: \"kubernetes.io/projected/165b68f4-ef12-4036-bd48-8138f52e2177-kube-api-access-xczcp\") pod \"maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m\" (UID: \"165b68f4-ef12-4036-bd48-8138f52e2177\") " pod="opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m" Jul 05 13:44:32.079952 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:32.079925 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m" Jul 05 13:44:32.217814 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:32.217788 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m"] Jul 05 13:44:32.220120 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:44:32.220087 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod165b68f4_ef12_4036_bd48_8138f52e2177.slice/crio-b7008c807e307fc1f1b484a58bc98d70524dba52812fa1bbf191c363a483c0c3 WatchSource:0}: Error finding container b7008c807e307fc1f1b484a58bc98d70524dba52812fa1bbf191c363a483c0c3: Status 404 returned error can't find the container with id b7008c807e307fc1f1b484a58bc98d70524dba52812fa1bbf191c363a483c0c3 Jul 05 13:44:32.221627 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:32.221607 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 13:44:32.322014 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:32.321977 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m" event={"ID":"165b68f4-ef12-4036-bd48-8138f52e2177","Type":"ContainerStarted","Data":"b7008c807e307fc1f1b484a58bc98d70524dba52812fa1bbf191c363a483c0c3"} Jul 05 13:44:33.327928 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:33.327892 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m" event={"ID":"165b68f4-ef12-4036-bd48-8138f52e2177","Type":"ContainerStarted","Data":"518006618d29d3542c6365338cb7cd3c876e5276b8c1b2a6f43464277f8b71d1"} Jul 05 13:44:33.328347 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:33.328021 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m" Jul 05 13:44:33.346521 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:33.346465 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m" podStartSLOduration=1.888974155 podStartE2EDuration="2.346452531s" totalImagesPullingTime="457.478376ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:44:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:44:33.345802216 +0000 UTC m=+1549.719078290" watchObservedRunningTime="2026-07-05 13:44:33.346452531 +0000 UTC m=+1549.719728563" Jul 05 13:44:36.984680 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:36.984633 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m"] Jul 05 13:44:36.985121 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:36.984875 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m" podUID="165b68f4-ef12-4036-bd48-8138f52e2177" containerName="maas-api" containerID="cri-o://518006618d29d3542c6365338cb7cd3c876e5276b8c1b2a6f43464277f8b71d1" gracePeriod=30 Jul 05 13:44:37.233879 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:37.233854 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m" Jul 05 13:44:37.290777 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:37.290692 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/165b68f4-ef12-4036-bd48-8138f52e2177-openshift-service-ca\") pod \"165b68f4-ef12-4036-bd48-8138f52e2177\" (UID: \"165b68f4-ef12-4036-bd48-8138f52e2177\") " Jul 05 13:44:37.290777 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:37.290737 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/165b68f4-ef12-4036-bd48-8138f52e2177-maas-api-tls\") pod \"165b68f4-ef12-4036-bd48-8138f52e2177\" (UID: \"165b68f4-ef12-4036-bd48-8138f52e2177\") " Jul 05 13:44:37.290777 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:37.290758 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xczcp\" (UniqueName: \"kubernetes.io/projected/165b68f4-ef12-4036-bd48-8138f52e2177-kube-api-access-xczcp\") pod \"165b68f4-ef12-4036-bd48-8138f52e2177\" (UID: \"165b68f4-ef12-4036-bd48-8138f52e2177\") " Jul 05 13:44:37.291057 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:37.291033 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/165b68f4-ef12-4036-bd48-8138f52e2177-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "165b68f4-ef12-4036-bd48-8138f52e2177" (UID: "165b68f4-ef12-4036-bd48-8138f52e2177"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 13:44:37.292842 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:37.292809 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/165b68f4-ef12-4036-bd48-8138f52e2177-kube-api-access-xczcp" (OuterVolumeSpecName: "kube-api-access-xczcp") pod "165b68f4-ef12-4036-bd48-8138f52e2177" (UID: "165b68f4-ef12-4036-bd48-8138f52e2177"). InnerVolumeSpecName "kube-api-access-xczcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:44:37.292944 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:37.292914 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/165b68f4-ef12-4036-bd48-8138f52e2177-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "165b68f4-ef12-4036-bd48-8138f52e2177" (UID: "165b68f4-ef12-4036-bd48-8138f52e2177"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:44:37.345451 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:37.345416 2577 generic.go:356] "Generic (PLEG): container finished" podID="165b68f4-ef12-4036-bd48-8138f52e2177" containerID="518006618d29d3542c6365338cb7cd3c876e5276b8c1b2a6f43464277f8b71d1" exitCode=0 Jul 05 13:44:37.345623 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:37.345464 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m" Jul 05 13:44:37.345623 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:37.345504 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m" event={"ID":"165b68f4-ef12-4036-bd48-8138f52e2177","Type":"ContainerDied","Data":"518006618d29d3542c6365338cb7cd3c876e5276b8c1b2a6f43464277f8b71d1"} Jul 05 13:44:37.345623 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:37.345554 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m" event={"ID":"165b68f4-ef12-4036-bd48-8138f52e2177","Type":"ContainerDied","Data":"b7008c807e307fc1f1b484a58bc98d70524dba52812fa1bbf191c363a483c0c3"} Jul 05 13:44:37.345623 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:37.345576 2577 scope.go:117] "RemoveContainer" containerID="518006618d29d3542c6365338cb7cd3c876e5276b8c1b2a6f43464277f8b71d1" Jul 05 13:44:37.354044 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:37.354027 2577 scope.go:117] "RemoveContainer" containerID="518006618d29d3542c6365338cb7cd3c876e5276b8c1b2a6f43464277f8b71d1" Jul 05 13:44:37.354307 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:44:37.354279 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"518006618d29d3542c6365338cb7cd3c876e5276b8c1b2a6f43464277f8b71d1\": container with ID starting with 518006618d29d3542c6365338cb7cd3c876e5276b8c1b2a6f43464277f8b71d1 not found: ID does not exist" containerID="518006618d29d3542c6365338cb7cd3c876e5276b8c1b2a6f43464277f8b71d1" Jul 05 13:44:37.354372 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:37.354313 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"518006618d29d3542c6365338cb7cd3c876e5276b8c1b2a6f43464277f8b71d1"} err="failed to get container status \"518006618d29d3542c6365338cb7cd3c876e5276b8c1b2a6f43464277f8b71d1\": rpc error: code = NotFound desc = could not find container \"518006618d29d3542c6365338cb7cd3c876e5276b8c1b2a6f43464277f8b71d1\": container with ID starting with 518006618d29d3542c6365338cb7cd3c876e5276b8c1b2a6f43464277f8b71d1 not found: ID does not exist" Jul 05 13:44:37.369165 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:37.369137 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m"] Jul 05 13:44:37.376724 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:37.376705 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-6a6fcb60-bc6678b7b-zt56m"] Jul 05 13:44:37.392162 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:37.392141 2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/165b68f4-ef12-4036-bd48-8138f52e2177-openshift-service-ca\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:44:37.392162 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:37.392162 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/165b68f4-ef12-4036-bd48-8138f52e2177-maas-api-tls\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:44:37.392251 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:37.392172 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xczcp\" (UniqueName: \"kubernetes.io/projected/165b68f4-ef12-4036-bd48-8138f52e2177-kube-api-access-xczcp\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:44:38.235878 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:38.235848 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="165b68f4-ef12-4036-bd48-8138f52e2177" path="/var/lib/kubelet/pods/165b68f4-ef12-4036-bd48-8138f52e2177/volumes" Jul 05 13:44:45.336156 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:45.336121 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42"] Jul 05 13:44:45.336662 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:45.336431 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="165b68f4-ef12-4036-bd48-8138f52e2177" containerName="maas-api" Jul 05 13:44:45.336662 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:45.336443 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="165b68f4-ef12-4036-bd48-8138f52e2177" containerName="maas-api" Jul 05 13:44:45.336662 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:45.336505 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="165b68f4-ef12-4036-bd48-8138f52e2177" containerName="maas-api" Jul 05 13:44:45.339277 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:45.339252 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42" Jul 05 13:44:45.343031 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:45.342995 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-a46d09f1-serving-cert\"" Jul 05 13:44:45.351991 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:45.351959 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42"] Jul 05 13:44:45.457895 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:45.457861 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/109121d0-1836-44b2-b653-ef93b9263a01-openshift-service-ca\") pod \"maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42\" (UID: \"109121d0-1836-44b2-b653-ef93b9263a01\") " pod="opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42" Jul 05 13:44:45.458060 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:45.457907 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjwjf\" (UniqueName: \"kubernetes.io/projected/109121d0-1836-44b2-b653-ef93b9263a01-kube-api-access-hjwjf\") pod \"maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42\" (UID: \"109121d0-1836-44b2-b653-ef93b9263a01\") " pod="opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42" Jul 05 13:44:45.458060 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:45.457940 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/109121d0-1836-44b2-b653-ef93b9263a01-maas-api-tls\") pod \"maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42\" (UID: \"109121d0-1836-44b2-b653-ef93b9263a01\") " pod="opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42" Jul 05 13:44:45.558431 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:45.558394 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/109121d0-1836-44b2-b653-ef93b9263a01-openshift-service-ca\") pod \"maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42\" (UID: \"109121d0-1836-44b2-b653-ef93b9263a01\") " pod="opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42" Jul 05 13:44:45.558431 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:45.558437 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjwjf\" (UniqueName: \"kubernetes.io/projected/109121d0-1836-44b2-b653-ef93b9263a01-kube-api-access-hjwjf\") pod \"maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42\" (UID: \"109121d0-1836-44b2-b653-ef93b9263a01\") " pod="opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42" Jul 05 13:44:45.558618 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:45.558470 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/109121d0-1836-44b2-b653-ef93b9263a01-maas-api-tls\") pod \"maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42\" (UID: \"109121d0-1836-44b2-b653-ef93b9263a01\") " pod="opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42" Jul 05 13:44:45.558618 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:44:45.558595 2577 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-a46d09f1-serving-cert: secret "maas-api-e2e-ait-a46d09f1-serving-cert" not found Jul 05 13:44:45.558717 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:44:45.558695 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/109121d0-1836-44b2-b653-ef93b9263a01-maas-api-tls podName:109121d0-1836-44b2-b653-ef93b9263a01 nodeName:}" failed. No retries permitted until 2026-07-05 13:44:46.058673263 +0000 UTC m=+1562.431949293 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/109121d0-1836-44b2-b653-ef93b9263a01-maas-api-tls") pod "maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42" (UID: "109121d0-1836-44b2-b653-ef93b9263a01") : secret "maas-api-e2e-ait-a46d09f1-serving-cert" not found Jul 05 13:44:45.559119 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:45.559100 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/109121d0-1836-44b2-b653-ef93b9263a01-openshift-service-ca\") pod \"maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42\" (UID: \"109121d0-1836-44b2-b653-ef93b9263a01\") " pod="opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42" Jul 05 13:44:45.571948 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:45.571917 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjwjf\" (UniqueName: \"kubernetes.io/projected/109121d0-1836-44b2-b653-ef93b9263a01-kube-api-access-hjwjf\") pod \"maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42\" (UID: \"109121d0-1836-44b2-b653-ef93b9263a01\") " pod="opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42" Jul 05 13:44:46.061785 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:46.061750 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/109121d0-1836-44b2-b653-ef93b9263a01-maas-api-tls\") pod \"maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42\" (UID: \"109121d0-1836-44b2-b653-ef93b9263a01\") " pod="opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42" Jul 05 13:44:46.064111 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:46.064092 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/109121d0-1836-44b2-b653-ef93b9263a01-maas-api-tls\") pod \"maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42\" (UID: \"109121d0-1836-44b2-b653-ef93b9263a01\") " pod="opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42" Jul 05 13:44:46.250973 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:46.250943 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42" Jul 05 13:44:46.380207 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:46.380183 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42"] Jul 05 13:44:46.382615 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:44:46.382584 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod109121d0_1836_44b2_b653_ef93b9263a01.slice/crio-093b1b456768f096bad6bfb6fa1c7b5c998362024dd716a8304e26ad14b4a1a3 WatchSource:0}: Error finding container 093b1b456768f096bad6bfb6fa1c7b5c998362024dd716a8304e26ad14b4a1a3: Status 404 returned error can't find the container with id 093b1b456768f096bad6bfb6fa1c7b5c998362024dd716a8304e26ad14b4a1a3 Jul 05 13:44:47.393005 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:47.392974 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42" event={"ID":"109121d0-1836-44b2-b653-ef93b9263a01","Type":"ContainerStarted","Data":"ef9d640fa0017b75549b56d7f95564aa49ca08edde4acedcdf0a905c63bf535b"} Jul 05 13:44:47.393382 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:47.393022 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42" event={"ID":"109121d0-1836-44b2-b653-ef93b9263a01","Type":"ContainerStarted","Data":"093b1b456768f096bad6bfb6fa1c7b5c998362024dd716a8304e26ad14b4a1a3"} Jul 05 13:44:47.393382 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:47.393091 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42" Jul 05 13:44:47.412236 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:47.412194 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42" podStartSLOduration=2.138888501 podStartE2EDuration="2.412181277s" totalImagesPullingTime="273.292776ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:44:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:44:47.411789797 +0000 UTC m=+1563.785065856" watchObservedRunningTime="2026-07-05 13:44:47.412181277 +0000 UTC m=+1563.785457314" Jul 05 13:44:50.807772 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:50.807733 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42"] Jul 05 13:44:50.808218 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:50.807910 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42" podUID="109121d0-1836-44b2-b653-ef93b9263a01" containerName="maas-api" containerID="cri-o://ef9d640fa0017b75549b56d7f95564aa49ca08edde4acedcdf0a905c63bf535b" gracePeriod=30 Jul 05 13:44:51.048927 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:51.048900 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42" Jul 05 13:44:51.109547 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:51.109518 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjwjf\" (UniqueName: \"kubernetes.io/projected/109121d0-1836-44b2-b653-ef93b9263a01-kube-api-access-hjwjf\") pod \"109121d0-1836-44b2-b653-ef93b9263a01\" (UID: \"109121d0-1836-44b2-b653-ef93b9263a01\") " Jul 05 13:44:51.109736 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:51.109598 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/109121d0-1836-44b2-b653-ef93b9263a01-maas-api-tls\") pod \"109121d0-1836-44b2-b653-ef93b9263a01\" (UID: \"109121d0-1836-44b2-b653-ef93b9263a01\") " Jul 05 13:44:51.109736 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:51.109719 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/109121d0-1836-44b2-b653-ef93b9263a01-openshift-service-ca\") pod \"109121d0-1836-44b2-b653-ef93b9263a01\" (UID: \"109121d0-1836-44b2-b653-ef93b9263a01\") " Jul 05 13:44:51.110068 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:51.110044 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/109121d0-1836-44b2-b653-ef93b9263a01-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "109121d0-1836-44b2-b653-ef93b9263a01" (UID: "109121d0-1836-44b2-b653-ef93b9263a01"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 13:44:51.111597 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:51.111571 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/109121d0-1836-44b2-b653-ef93b9263a01-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "109121d0-1836-44b2-b653-ef93b9263a01" (UID: "109121d0-1836-44b2-b653-ef93b9263a01"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:44:51.111696 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:51.111614 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/109121d0-1836-44b2-b653-ef93b9263a01-kube-api-access-hjwjf" (OuterVolumeSpecName: "kube-api-access-hjwjf") pod "109121d0-1836-44b2-b653-ef93b9263a01" (UID: "109121d0-1836-44b2-b653-ef93b9263a01"). InnerVolumeSpecName "kube-api-access-hjwjf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:44:51.211191 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:51.211159 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/109121d0-1836-44b2-b653-ef93b9263a01-maas-api-tls\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:44:51.211191 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:51.211185 2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/109121d0-1836-44b2-b653-ef93b9263a01-openshift-service-ca\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:44:51.211191 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:51.211195 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjwjf\" (UniqueName: \"kubernetes.io/projected/109121d0-1836-44b2-b653-ef93b9263a01-kube-api-access-hjwjf\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:44:51.409015 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:51.408920 2577 generic.go:356] "Generic (PLEG): container finished" podID="109121d0-1836-44b2-b653-ef93b9263a01" containerID="ef9d640fa0017b75549b56d7f95564aa49ca08edde4acedcdf0a905c63bf535b" exitCode=0 Jul 05 13:44:51.409015 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:51.408973 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42" Jul 05 13:44:51.409228 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:51.409006 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42" event={"ID":"109121d0-1836-44b2-b653-ef93b9263a01","Type":"ContainerDied","Data":"ef9d640fa0017b75549b56d7f95564aa49ca08edde4acedcdf0a905c63bf535b"} Jul 05 13:44:51.409228 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:51.409064 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42" event={"ID":"109121d0-1836-44b2-b653-ef93b9263a01","Type":"ContainerDied","Data":"093b1b456768f096bad6bfb6fa1c7b5c998362024dd716a8304e26ad14b4a1a3"} Jul 05 13:44:51.409228 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:51.409090 2577 scope.go:117] "RemoveContainer" containerID="ef9d640fa0017b75549b56d7f95564aa49ca08edde4acedcdf0a905c63bf535b" Jul 05 13:44:51.418177 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:51.418152 2577 scope.go:117] "RemoveContainer" containerID="ef9d640fa0017b75549b56d7f95564aa49ca08edde4acedcdf0a905c63bf535b" Jul 05 13:44:51.418457 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:44:51.418439 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef9d640fa0017b75549b56d7f95564aa49ca08edde4acedcdf0a905c63bf535b\": container with ID starting with ef9d640fa0017b75549b56d7f95564aa49ca08edde4acedcdf0a905c63bf535b not found: ID does not exist" containerID="ef9d640fa0017b75549b56d7f95564aa49ca08edde4acedcdf0a905c63bf535b" Jul 05 13:44:51.418513 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:51.418465 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef9d640fa0017b75549b56d7f95564aa49ca08edde4acedcdf0a905c63bf535b"} err="failed to get container status \"ef9d640fa0017b75549b56d7f95564aa49ca08edde4acedcdf0a905c63bf535b\": rpc error: code = NotFound desc = could not find container \"ef9d640fa0017b75549b56d7f95564aa49ca08edde4acedcdf0a905c63bf535b\": container with ID starting with ef9d640fa0017b75549b56d7f95564aa49ca08edde4acedcdf0a905c63bf535b not found: ID does not exist" Jul 05 13:44:51.430193 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:51.430170 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42"] Jul 05 13:44:51.437032 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:51.437009 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-a46d09f1-5c794cb597-nfj42"] Jul 05 13:44:52.234701 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:44:52.234672 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="109121d0-1836-44b2-b653-ef93b9263a01" path="/var/lib/kubelet/pods/109121d0-1836-44b2-b653-ef93b9263a01/volumes" Jul 05 13:45:00.146421 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:00.146387 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29720985-7nnl8"] Jul 05 13:45:00.146789 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:00.146711 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="109121d0-1836-44b2-b653-ef93b9263a01" containerName="maas-api" Jul 05 13:45:00.146789 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:00.146724 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="109121d0-1836-44b2-b653-ef93b9263a01" containerName="maas-api" Jul 05 13:45:00.146789 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:00.146769 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="109121d0-1836-44b2-b653-ef93b9263a01" containerName="maas-api" Jul 05 13:45:00.150901 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:00.150882 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29720985-7nnl8" Jul 05 13:45:00.163338 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:00.163313 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29720985-7nnl8"] Jul 05 13:45:00.288843 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:00.288810 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6m92\" (UniqueName: \"kubernetes.io/projected/02e82422-8fe9-4ab1-ae38-c60d2c6d571d-kube-api-access-x6m92\") pod \"maas-api-key-cleanup-29720985-7nnl8\" (UID: \"02e82422-8fe9-4ab1-ae38-c60d2c6d571d\") " pod="opendatahub/maas-api-key-cleanup-29720985-7nnl8" Jul 05 13:45:00.389388 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:00.389355 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6m92\" (UniqueName: \"kubernetes.io/projected/02e82422-8fe9-4ab1-ae38-c60d2c6d571d-kube-api-access-x6m92\") pod \"maas-api-key-cleanup-29720985-7nnl8\" (UID: \"02e82422-8fe9-4ab1-ae38-c60d2c6d571d\") " pod="opendatahub/maas-api-key-cleanup-29720985-7nnl8" Jul 05 13:45:00.397204 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:00.397138 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6m92\" (UniqueName: \"kubernetes.io/projected/02e82422-8fe9-4ab1-ae38-c60d2c6d571d-kube-api-access-x6m92\") pod \"maas-api-key-cleanup-29720985-7nnl8\" (UID: \"02e82422-8fe9-4ab1-ae38-c60d2c6d571d\") " pod="opendatahub/maas-api-key-cleanup-29720985-7nnl8" Jul 05 13:45:00.459999 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:00.459967 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29720985-7nnl8" Jul 05 13:45:00.598968 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:00.598937 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29720985-7nnl8"] Jul 05 13:45:00.601479 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:45:00.601452 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e82422_8fe9_4ab1_ae38_c60d2c6d571d.slice/crio-c49460dc544b45678a9299d153c1a441a478d8a9d28dbb5ba00f42a53b7516e3 WatchSource:0}: Error finding container c49460dc544b45678a9299d153c1a441a478d8a9d28dbb5ba00f42a53b7516e3: Status 404 returned error can't find the container with id c49460dc544b45678a9299d153c1a441a478d8a9d28dbb5ba00f42a53b7516e3 Jul 05 13:45:01.448993 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:01.448960 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29720985-7nnl8" event={"ID":"02e82422-8fe9-4ab1-ae38-c60d2c6d571d","Type":"ContainerStarted","Data":"c49460dc544b45678a9299d153c1a441a478d8a9d28dbb5ba00f42a53b7516e3"} Jul 05 13:45:03.459898 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:03.459857 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29720985-7nnl8" event={"ID":"02e82422-8fe9-4ab1-ae38-c60d2c6d571d","Type":"ContainerStarted","Data":"5b8cba2b98de341ff7fba6d04d28e065d8d3e9e67c6cdb2e8be6f141b620a4f2"} Jul 05 13:45:03.478002 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:03.477950 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29720985-7nnl8" podStartSLOduration=1.172800163 podStartE2EDuration="3.477933911s" totalImagesPullingTime="2.305133748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:45:03.476489774 +0000 UTC m=+1579.849765806" watchObservedRunningTime="2026-07-05 13:45:03.477933911 +0000 UTC m=+1579.851209942" Jul 05 13:45:04.241499 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:04.241427 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp"] Jul 05 13:45:04.244759 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:04.244740 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp" Jul 05 13:45:04.247105 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:04.247076 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-3984164a-serving-cert\"" Jul 05 13:45:04.256308 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:04.256233 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp"] Jul 05 13:45:04.333428 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:04.333379 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d10f155f-b94f-4c45-abb0-a7e9a9c4542c-maas-api-tls\") pod \"maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp\" (UID: \"d10f155f-b94f-4c45-abb0-a7e9a9c4542c\") " pod="opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp" Jul 05 13:45:04.333592 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:04.333499 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d10f155f-b94f-4c45-abb0-a7e9a9c4542c-openshift-service-ca\") pod \"maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp\" (UID: \"d10f155f-b94f-4c45-abb0-a7e9a9c4542c\") " pod="opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp" Jul 05 13:45:04.333682 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:04.333587 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfg76\" (UniqueName: \"kubernetes.io/projected/d10f155f-b94f-4c45-abb0-a7e9a9c4542c-kube-api-access-zfg76\") pod \"maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp\" (UID: \"d10f155f-b94f-4c45-abb0-a7e9a9c4542c\") " pod="opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp" Jul 05 13:45:04.434563 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:04.434530 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d10f155f-b94f-4c45-abb0-a7e9a9c4542c-maas-api-tls\") pod \"maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp\" (UID: \"d10f155f-b94f-4c45-abb0-a7e9a9c4542c\") " pod="opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp" Jul 05 13:45:04.434740 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:04.434583 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d10f155f-b94f-4c45-abb0-a7e9a9c4542c-openshift-service-ca\") pod \"maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp\" (UID: \"d10f155f-b94f-4c45-abb0-a7e9a9c4542c\") " pod="opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp" Jul 05 13:45:04.434740 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:04.434607 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfg76\" (UniqueName: \"kubernetes.io/projected/d10f155f-b94f-4c45-abb0-a7e9a9c4542c-kube-api-access-zfg76\") pod \"maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp\" (UID: \"d10f155f-b94f-4c45-abb0-a7e9a9c4542c\") " pod="opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp" Jul 05 13:45:04.435184 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:04.435158 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d10f155f-b94f-4c45-abb0-a7e9a9c4542c-openshift-service-ca\") pod \"maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp\" (UID: \"d10f155f-b94f-4c45-abb0-a7e9a9c4542c\") " pod="opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp" Jul 05 13:45:04.436877 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:04.436848 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d10f155f-b94f-4c45-abb0-a7e9a9c4542c-maas-api-tls\") pod \"maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp\" (UID: \"d10f155f-b94f-4c45-abb0-a7e9a9c4542c\") " pod="opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp" Jul 05 13:45:04.464338 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:04.464286 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfg76\" (UniqueName: \"kubernetes.io/projected/d10f155f-b94f-4c45-abb0-a7e9a9c4542c-kube-api-access-zfg76\") pod \"maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp\" (UID: \"d10f155f-b94f-4c45-abb0-a7e9a9c4542c\") " pod="opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp" Jul 05 13:45:04.468049 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:04.468021 2577 generic.go:356] "Generic (PLEG): container finished" podID="02e82422-8fe9-4ab1-ae38-c60d2c6d571d" containerID="5b8cba2b98de341ff7fba6d04d28e065d8d3e9e67c6cdb2e8be6f141b620a4f2" exitCode=0 Jul 05 13:45:04.468149 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:04.468067 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29720985-7nnl8" event={"ID":"02e82422-8fe9-4ab1-ae38-c60d2c6d571d","Type":"ContainerDied","Data":"5b8cba2b98de341ff7fba6d04d28e065d8d3e9e67c6cdb2e8be6f141b620a4f2"} Jul 05 13:45:04.557960 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:04.557878 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp" Jul 05 13:45:04.690780 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:04.690757 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp"] Jul 05 13:45:04.693193 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:45:04.693162 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd10f155f_b94f_4c45_abb0_a7e9a9c4542c.slice/crio-b8de5d7d5e8134883c6f8aa5d9a559c04080fe11992fe54731584becfca0f95b WatchSource:0}: Error finding container b8de5d7d5e8134883c6f8aa5d9a559c04080fe11992fe54731584becfca0f95b: Status 404 returned error can't find the container with id b8de5d7d5e8134883c6f8aa5d9a559c04080fe11992fe54731584becfca0f95b Jul 05 13:45:05.473498 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:05.473458 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp" event={"ID":"d10f155f-b94f-4c45-abb0-a7e9a9c4542c","Type":"ContainerStarted","Data":"365a6c252d8b7417e510269fec342c55a760064e4a5e725d6480038bb747d678"} Jul 05 13:45:05.473901 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:05.473515 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp" event={"ID":"d10f155f-b94f-4c45-abb0-a7e9a9c4542c","Type":"ContainerStarted","Data":"b8de5d7d5e8134883c6f8aa5d9a559c04080fe11992fe54731584becfca0f95b"} Jul 05 13:45:05.493095 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:05.493048 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp" podStartSLOduration=1.152892895 podStartE2EDuration="1.493031009s" totalImagesPullingTime="340.138114ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:45:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:45:05.491750232 +0000 UTC m=+1581.865026289" watchObservedRunningTime="2026-07-05 13:45:05.493031009 +0000 UTC m=+1581.866307041" Jul 05 13:45:05.597586 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:05.597560 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29720985-7nnl8" Jul 05 13:45:05.745253 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:05.745177 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6m92\" (UniqueName: \"kubernetes.io/projected/02e82422-8fe9-4ab1-ae38-c60d2c6d571d-kube-api-access-x6m92\") pod \"02e82422-8fe9-4ab1-ae38-c60d2c6d571d\" (UID: \"02e82422-8fe9-4ab1-ae38-c60d2c6d571d\") " Jul 05 13:45:05.747121 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:05.747100 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02e82422-8fe9-4ab1-ae38-c60d2c6d571d-kube-api-access-x6m92" (OuterVolumeSpecName: "kube-api-access-x6m92") pod "02e82422-8fe9-4ab1-ae38-c60d2c6d571d" (UID: "02e82422-8fe9-4ab1-ae38-c60d2c6d571d"). InnerVolumeSpecName "kube-api-access-x6m92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:45:05.846473 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:05.846447 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6m92\" (UniqueName: \"kubernetes.io/projected/02e82422-8fe9-4ab1-ae38-c60d2c6d571d-kube-api-access-x6m92\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:45:06.480029 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:06.480001 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29720985-7nnl8" Jul 05 13:45:06.480423 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:06.480040 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29720985-7nnl8" event={"ID":"02e82422-8fe9-4ab1-ae38-c60d2c6d571d","Type":"ContainerDied","Data":"c49460dc544b45678a9299d153c1a441a478d8a9d28dbb5ba00f42a53b7516e3"} Jul 05 13:45:06.480423 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:06.480099 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c49460dc544b45678a9299d153c1a441a478d8a9d28dbb5ba00f42a53b7516e3" Jul 05 13:45:06.480423 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:06.480377 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp" Jul 05 13:45:08.994848 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:08.994811 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp"] Jul 05 13:45:08.995253 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:08.995038 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp" podUID="d10f155f-b94f-4c45-abb0-a7e9a9c4542c" containerName="maas-api" containerID="cri-o://365a6c252d8b7417e510269fec342c55a760064e4a5e725d6480038bb747d678" gracePeriod=30 Jul 05 13:45:09.247699 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:09.247624 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp" Jul 05 13:45:09.375850 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:09.375815 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d10f155f-b94f-4c45-abb0-a7e9a9c4542c-maas-api-tls\") pod \"d10f155f-b94f-4c45-abb0-a7e9a9c4542c\" (UID: \"d10f155f-b94f-4c45-abb0-a7e9a9c4542c\") " Jul 05 13:45:09.376028 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:09.375868 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d10f155f-b94f-4c45-abb0-a7e9a9c4542c-openshift-service-ca\") pod \"d10f155f-b94f-4c45-abb0-a7e9a9c4542c\" (UID: \"d10f155f-b94f-4c45-abb0-a7e9a9c4542c\") " Jul 05 13:45:09.376028 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:09.375933 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfg76\" (UniqueName: \"kubernetes.io/projected/d10f155f-b94f-4c45-abb0-a7e9a9c4542c-kube-api-access-zfg76\") pod \"d10f155f-b94f-4c45-abb0-a7e9a9c4542c\" (UID: \"d10f155f-b94f-4c45-abb0-a7e9a9c4542c\") " Jul 05 13:45:09.376239 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:09.376206 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d10f155f-b94f-4c45-abb0-a7e9a9c4542c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d10f155f-b94f-4c45-abb0-a7e9a9c4542c" (UID: "d10f155f-b94f-4c45-abb0-a7e9a9c4542c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 13:45:09.377908 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:09.377885 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d10f155f-b94f-4c45-abb0-a7e9a9c4542c-kube-api-access-zfg76" (OuterVolumeSpecName: "kube-api-access-zfg76") pod "d10f155f-b94f-4c45-abb0-a7e9a9c4542c" (UID: "d10f155f-b94f-4c45-abb0-a7e9a9c4542c"). InnerVolumeSpecName "kube-api-access-zfg76". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:45:09.378002 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:09.377971 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d10f155f-b94f-4c45-abb0-a7e9a9c4542c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d10f155f-b94f-4c45-abb0-a7e9a9c4542c" (UID: "d10f155f-b94f-4c45-abb0-a7e9a9c4542c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:45:09.477378 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:09.477344 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d10f155f-b94f-4c45-abb0-a7e9a9c4542c-maas-api-tls\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:45:09.477378 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:09.477370 2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d10f155f-b94f-4c45-abb0-a7e9a9c4542c-openshift-service-ca\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:45:09.477378 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:09.477380 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfg76\" (UniqueName: \"kubernetes.io/projected/d10f155f-b94f-4c45-abb0-a7e9a9c4542c-kube-api-access-zfg76\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:45:09.498342 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:09.498269 2577 generic.go:356] "Generic (PLEG): container finished" podID="d10f155f-b94f-4c45-abb0-a7e9a9c4542c" containerID="365a6c252d8b7417e510269fec342c55a760064e4a5e725d6480038bb747d678" exitCode=0 Jul 05 13:45:09.498342 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:09.498322 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp" Jul 05 13:45:09.498478 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:09.498321 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp" event={"ID":"d10f155f-b94f-4c45-abb0-a7e9a9c4542c","Type":"ContainerDied","Data":"365a6c252d8b7417e510269fec342c55a760064e4a5e725d6480038bb747d678"} Jul 05 13:45:09.498478 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:09.498433 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp" event={"ID":"d10f155f-b94f-4c45-abb0-a7e9a9c4542c","Type":"ContainerDied","Data":"b8de5d7d5e8134883c6f8aa5d9a559c04080fe11992fe54731584becfca0f95b"} Jul 05 13:45:09.498478 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:09.498459 2577 scope.go:117] "RemoveContainer" containerID="365a6c252d8b7417e510269fec342c55a760064e4a5e725d6480038bb747d678" Jul 05 13:45:09.506788 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:09.506769 2577 scope.go:117] "RemoveContainer" containerID="365a6c252d8b7417e510269fec342c55a760064e4a5e725d6480038bb747d678" Jul 05 13:45:09.507044 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:45:09.507023 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"365a6c252d8b7417e510269fec342c55a760064e4a5e725d6480038bb747d678\": container with ID starting with 365a6c252d8b7417e510269fec342c55a760064e4a5e725d6480038bb747d678 not found: ID does not exist" containerID="365a6c252d8b7417e510269fec342c55a760064e4a5e725d6480038bb747d678" Jul 05 13:45:09.507105 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:09.507055 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"365a6c252d8b7417e510269fec342c55a760064e4a5e725d6480038bb747d678"} err="failed to get container status \"365a6c252d8b7417e510269fec342c55a760064e4a5e725d6480038bb747d678\": rpc error: code = NotFound desc = could not find container \"365a6c252d8b7417e510269fec342c55a760064e4a5e725d6480038bb747d678\": container with ID starting with 365a6c252d8b7417e510269fec342c55a760064e4a5e725d6480038bb747d678 not found: ID does not exist" Jul 05 13:45:09.522251 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:09.522229 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp"] Jul 05 13:45:09.527406 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:09.527385 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-3984164a-5cd46cc66f-2mfnp"] Jul 05 13:45:10.235594 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:45:10.235559 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d10f155f-b94f-4c45-abb0-a7e9a9c4542c" path="/var/lib/kubelet/pods/d10f155f-b94f-4c45-abb0-a7e9a9c4542c/volumes" Jul 05 13:46:57.871592 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:57.871559 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx"] Jul 05 13:46:57.872057 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:57.871864 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d10f155f-b94f-4c45-abb0-a7e9a9c4542c" containerName="maas-api" Jul 05 13:46:57.872057 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:57.871876 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d10f155f-b94f-4c45-abb0-a7e9a9c4542c" containerName="maas-api" Jul 05 13:46:57.872057 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:57.871891 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02e82422-8fe9-4ab1-ae38-c60d2c6d571d" containerName="cleanup" Jul 05 13:46:57.872057 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:57.871897 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="02e82422-8fe9-4ab1-ae38-c60d2c6d571d" containerName="cleanup" Jul 05 13:46:57.872057 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:57.871954 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="02e82422-8fe9-4ab1-ae38-c60d2c6d571d" containerName="cleanup" Jul 05 13:46:57.872057 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:57.871960 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d10f155f-b94f-4c45-abb0-a7e9a9c4542c" containerName="maas-api" Jul 05 13:46:57.874864 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:57.874847 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" Jul 05 13:46:57.878616 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:57.878593 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-cab5d0f5-serving-cert\"" Jul 05 13:46:57.896231 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:57.896198 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx"] Jul 05 13:46:57.944617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:57.944585 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d32f3a0-073a-4349-a94c-f8ad10153e27-maas-api-tls\") pod \"maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx\" (UID: \"0d32f3a0-073a-4349-a94c-f8ad10153e27\") " pod="opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" Jul 05 13:46:57.944803 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:57.944669 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d32f3a0-073a-4349-a94c-f8ad10153e27-openshift-service-ca\") pod \"maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx\" (UID: \"0d32f3a0-073a-4349-a94c-f8ad10153e27\") " pod="opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" Jul 05 13:46:57.944803 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:57.944692 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w9rm\" (UniqueName: \"kubernetes.io/projected/0d32f3a0-073a-4349-a94c-f8ad10153e27-kube-api-access-4w9rm\") pod \"maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx\" (UID: \"0d32f3a0-073a-4349-a94c-f8ad10153e27\") " pod="opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" Jul 05 13:46:58.045299 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:58.045266 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d32f3a0-073a-4349-a94c-f8ad10153e27-openshift-service-ca\") pod \"maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx\" (UID: \"0d32f3a0-073a-4349-a94c-f8ad10153e27\") " pod="opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" Jul 05 13:46:58.045471 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:58.045305 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w9rm\" (UniqueName: \"kubernetes.io/projected/0d32f3a0-073a-4349-a94c-f8ad10153e27-kube-api-access-4w9rm\") pod \"maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx\" (UID: \"0d32f3a0-073a-4349-a94c-f8ad10153e27\") " pod="opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" Jul 05 13:46:58.045471 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:58.045407 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d32f3a0-073a-4349-a94c-f8ad10153e27-maas-api-tls\") pod \"maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx\" (UID: \"0d32f3a0-073a-4349-a94c-f8ad10153e27\") " pod="opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" Jul 05 13:46:58.045544 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:46:58.045525 2577 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-cab5d0f5-serving-cert: secret "maas-api-e2e-mt-cab5d0f5-serving-cert" not found Jul 05 13:46:58.045608 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:46:58.045596 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d32f3a0-073a-4349-a94c-f8ad10153e27-maas-api-tls podName:0d32f3a0-073a-4349-a94c-f8ad10153e27 nodeName:}" failed. No retries permitted until 2026-07-05 13:46:58.545573431 +0000 UTC m=+1694.918849442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0d32f3a0-073a-4349-a94c-f8ad10153e27-maas-api-tls") pod "maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" (UID: "0d32f3a0-073a-4349-a94c-f8ad10153e27") : secret "maas-api-e2e-mt-cab5d0f5-serving-cert" not found Jul 05 13:46:58.046028 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:58.046007 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d32f3a0-073a-4349-a94c-f8ad10153e27-openshift-service-ca\") pod \"maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx\" (UID: \"0d32f3a0-073a-4349-a94c-f8ad10153e27\") " pod="opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" Jul 05 13:46:58.057435 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:58.057404 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w9rm\" (UniqueName: \"kubernetes.io/projected/0d32f3a0-073a-4349-a94c-f8ad10153e27-kube-api-access-4w9rm\") pod \"maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx\" (UID: \"0d32f3a0-073a-4349-a94c-f8ad10153e27\") " pod="opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" Jul 05 13:46:58.550741 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:58.550710 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d32f3a0-073a-4349-a94c-f8ad10153e27-maas-api-tls\") pod \"maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx\" (UID: \"0d32f3a0-073a-4349-a94c-f8ad10153e27\") " pod="opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" Jul 05 13:46:58.553150 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:58.553121 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d32f3a0-073a-4349-a94c-f8ad10153e27-maas-api-tls\") pod \"maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx\" (UID: \"0d32f3a0-073a-4349-a94c-f8ad10153e27\") " pod="opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" Jul 05 13:46:58.784370 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:58.784336 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" Jul 05 13:46:58.917182 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:58.917155 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx"] Jul 05 13:46:58.919006 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:46:58.918979 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d32f3a0_073a_4349_a94c_f8ad10153e27.slice/crio-7806e044b73ee545312186e8ce826cf891075ed1eaa8164e278b3b923d3ca868 WatchSource:0}: Error finding container 7806e044b73ee545312186e8ce826cf891075ed1eaa8164e278b3b923d3ca868: Status 404 returned error can't find the container with id 7806e044b73ee545312186e8ce826cf891075ed1eaa8164e278b3b923d3ca868 Jul 05 13:46:58.941943 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:58.941911 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" event={"ID":"0d32f3a0-073a-4349-a94c-f8ad10153e27","Type":"ContainerStarted","Data":"7806e044b73ee545312186e8ce826cf891075ed1eaa8164e278b3b923d3ca868"} Jul 05 13:46:59.946854 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:59.946820 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" event={"ID":"0d32f3a0-073a-4349-a94c-f8ad10153e27","Type":"ContainerStarted","Data":"748a67baf1fdc2ae3f7602905aba073fd54e7cef9a7bccd154712c31e45048d7"} Jul 05 13:46:59.947214 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:59.946953 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" Jul 05 13:46:59.965973 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:46:59.965927 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" podStartSLOduration=2.5887922740000002 podStartE2EDuration="2.965909249s" totalImagesPullingTime="377.116975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:46:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:46:59.96480747 +0000 UTC m=+1696.338083744" watchObservedRunningTime="2026-07-05 13:46:59.965909249 +0000 UTC m=+1696.339185282" Jul 05 13:47:05.956548 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:05.956468 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" Jul 05 13:47:10.490311 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:10.490277 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx"] Jul 05 13:47:10.490768 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:10.490478 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" podUID="0d32f3a0-073a-4349-a94c-f8ad10153e27" containerName="maas-api" containerID="cri-o://748a67baf1fdc2ae3f7602905aba073fd54e7cef9a7bccd154712c31e45048d7" gracePeriod=30 Jul 05 13:47:10.728145 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:10.728120 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" Jul 05 13:47:10.856111 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:10.856084 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d32f3a0-073a-4349-a94c-f8ad10153e27-openshift-service-ca\") pod \"0d32f3a0-073a-4349-a94c-f8ad10153e27\" (UID: \"0d32f3a0-073a-4349-a94c-f8ad10153e27\") " Jul 05 13:47:10.856289 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:10.856118 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4w9rm\" (UniqueName: \"kubernetes.io/projected/0d32f3a0-073a-4349-a94c-f8ad10153e27-kube-api-access-4w9rm\") pod \"0d32f3a0-073a-4349-a94c-f8ad10153e27\" (UID: \"0d32f3a0-073a-4349-a94c-f8ad10153e27\") " Jul 05 13:47:10.856289 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:10.856157 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d32f3a0-073a-4349-a94c-f8ad10153e27-maas-api-tls\") pod \"0d32f3a0-073a-4349-a94c-f8ad10153e27\" (UID: \"0d32f3a0-073a-4349-a94c-f8ad10153e27\") " Jul 05 13:47:10.856457 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:10.856432 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d32f3a0-073a-4349-a94c-f8ad10153e27-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0d32f3a0-073a-4349-a94c-f8ad10153e27" (UID: "0d32f3a0-073a-4349-a94c-f8ad10153e27"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 13:47:10.858284 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:10.858260 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d32f3a0-073a-4349-a94c-f8ad10153e27-kube-api-access-4w9rm" (OuterVolumeSpecName: "kube-api-access-4w9rm") pod "0d32f3a0-073a-4349-a94c-f8ad10153e27" (UID: "0d32f3a0-073a-4349-a94c-f8ad10153e27"). InnerVolumeSpecName "kube-api-access-4w9rm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:47:10.858363 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:10.858287 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d32f3a0-073a-4349-a94c-f8ad10153e27-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0d32f3a0-073a-4349-a94c-f8ad10153e27" (UID: "0d32f3a0-073a-4349-a94c-f8ad10153e27"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:47:10.956870 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:10.956837 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d32f3a0-073a-4349-a94c-f8ad10153e27-maas-api-tls\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:47:10.956870 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:10.956864 2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d32f3a0-073a-4349-a94c-f8ad10153e27-openshift-service-ca\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:47:10.956870 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:10.956874 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4w9rm\" (UniqueName: \"kubernetes.io/projected/0d32f3a0-073a-4349-a94c-f8ad10153e27-kube-api-access-4w9rm\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:47:10.992450 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:10.992418 2577 generic.go:356] "Generic (PLEG): container finished" podID="0d32f3a0-073a-4349-a94c-f8ad10153e27" containerID="748a67baf1fdc2ae3f7602905aba073fd54e7cef9a7bccd154712c31e45048d7" exitCode=0 Jul 05 13:47:10.992608 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:10.992480 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" Jul 05 13:47:10.992608 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:10.992508 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" event={"ID":"0d32f3a0-073a-4349-a94c-f8ad10153e27","Type":"ContainerDied","Data":"748a67baf1fdc2ae3f7602905aba073fd54e7cef9a7bccd154712c31e45048d7"} Jul 05 13:47:10.992608 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:10.992562 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx" event={"ID":"0d32f3a0-073a-4349-a94c-f8ad10153e27","Type":"ContainerDied","Data":"7806e044b73ee545312186e8ce826cf891075ed1eaa8164e278b3b923d3ca868"} Jul 05 13:47:10.992608 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:10.992585 2577 scope.go:117] "RemoveContainer" containerID="748a67baf1fdc2ae3f7602905aba073fd54e7cef9a7bccd154712c31e45048d7" Jul 05 13:47:11.001003 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:11.000980 2577 scope.go:117] "RemoveContainer" containerID="748a67baf1fdc2ae3f7602905aba073fd54e7cef9a7bccd154712c31e45048d7" Jul 05 13:47:11.001256 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:47:11.001240 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"748a67baf1fdc2ae3f7602905aba073fd54e7cef9a7bccd154712c31e45048d7\": container with ID starting with 748a67baf1fdc2ae3f7602905aba073fd54e7cef9a7bccd154712c31e45048d7 not found: ID does not exist" containerID="748a67baf1fdc2ae3f7602905aba073fd54e7cef9a7bccd154712c31e45048d7" Jul 05 13:47:11.001314 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:11.001264 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"748a67baf1fdc2ae3f7602905aba073fd54e7cef9a7bccd154712c31e45048d7"} err="failed to get container status \"748a67baf1fdc2ae3f7602905aba073fd54e7cef9a7bccd154712c31e45048d7\": rpc error: code = NotFound desc = could not find container \"748a67baf1fdc2ae3f7602905aba073fd54e7cef9a7bccd154712c31e45048d7\": container with ID starting with 748a67baf1fdc2ae3f7602905aba073fd54e7cef9a7bccd154712c31e45048d7 not found: ID does not exist" Jul 05 13:47:11.013474 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:11.013413 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx"] Jul 05 13:47:11.015261 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:11.015238 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-cab5d0f5-77d57fc755-mhmkx"] Jul 05 13:47:12.235080 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:12.235049 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d32f3a0-073a-4349-a94c-f8ad10153e27" path="/var/lib/kubelet/pods/0d32f3a0-073a-4349-a94c-f8ad10153e27/volumes" Jul 05 13:47:41.947916 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:41.947880 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs"] Jul 05 13:47:41.948479 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:41.948312 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d32f3a0-073a-4349-a94c-f8ad10153e27" containerName="maas-api" Jul 05 13:47:41.948479 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:41.948331 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d32f3a0-073a-4349-a94c-f8ad10153e27" containerName="maas-api" Jul 05 13:47:41.948479 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:41.948410 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d32f3a0-073a-4349-a94c-f8ad10153e27" containerName="maas-api" Jul 05 13:47:41.951697 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:41.951670 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" Jul 05 13:47:41.954213 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:41.954191 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-3536bbfe-serving-cert\"" Jul 05 13:47:41.966670 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:41.966624 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs"] Jul 05 13:47:42.009316 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:42.009282 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e1d1e6c-cab4-4473-a886-3b852194e27e-openshift-service-ca\") pod \"maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs\" (UID: \"7e1d1e6c-cab4-4473-a886-3b852194e27e\") " pod="opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" Jul 05 13:47:42.009461 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:42.009322 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e1d1e6c-cab4-4473-a886-3b852194e27e-maas-api-tls\") pod \"maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs\" (UID: \"7e1d1e6c-cab4-4473-a886-3b852194e27e\") " pod="opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" Jul 05 13:47:42.009461 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:42.009361 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfc8q\" (UniqueName: \"kubernetes.io/projected/7e1d1e6c-cab4-4473-a886-3b852194e27e-kube-api-access-cfc8q\") pod \"maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs\" (UID: \"7e1d1e6c-cab4-4473-a886-3b852194e27e\") " pod="opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" Jul 05 13:47:42.110241 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:42.110210 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e1d1e6c-cab4-4473-a886-3b852194e27e-openshift-service-ca\") pod \"maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs\" (UID: \"7e1d1e6c-cab4-4473-a886-3b852194e27e\") " pod="opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" Jul 05 13:47:42.110406 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:42.110250 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e1d1e6c-cab4-4473-a886-3b852194e27e-maas-api-tls\") pod \"maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs\" (UID: \"7e1d1e6c-cab4-4473-a886-3b852194e27e\") " pod="opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" Jul 05 13:47:42.110406 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:42.110296 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfc8q\" (UniqueName: \"kubernetes.io/projected/7e1d1e6c-cab4-4473-a886-3b852194e27e-kube-api-access-cfc8q\") pod \"maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs\" (UID: \"7e1d1e6c-cab4-4473-a886-3b852194e27e\") " pod="opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" Jul 05 13:47:42.110480 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:47:42.110430 2577 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-3536bbfe-serving-cert: secret "maas-api-e2e-mt-3536bbfe-serving-cert" not found Jul 05 13:47:42.110522 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:47:42.110507 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e1d1e6c-cab4-4473-a886-3b852194e27e-maas-api-tls podName:7e1d1e6c-cab4-4473-a886-3b852194e27e nodeName:}" failed. No retries permitted until 2026-07-05 13:47:42.610484735 +0000 UTC m=+1738.983760750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7e1d1e6c-cab4-4473-a886-3b852194e27e-maas-api-tls") pod "maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" (UID: "7e1d1e6c-cab4-4473-a886-3b852194e27e") : secret "maas-api-e2e-mt-3536bbfe-serving-cert" not found Jul 05 13:47:42.110862 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:42.110841 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e1d1e6c-cab4-4473-a886-3b852194e27e-openshift-service-ca\") pod \"maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs\" (UID: \"7e1d1e6c-cab4-4473-a886-3b852194e27e\") " pod="opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" Jul 05 13:47:42.120344 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:42.120311 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfc8q\" (UniqueName: \"kubernetes.io/projected/7e1d1e6c-cab4-4473-a886-3b852194e27e-kube-api-access-cfc8q\") pod \"maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs\" (UID: \"7e1d1e6c-cab4-4473-a886-3b852194e27e\") " pod="opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" Jul 05 13:47:42.614140 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:42.614108 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e1d1e6c-cab4-4473-a886-3b852194e27e-maas-api-tls\") pod \"maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs\" (UID: \"7e1d1e6c-cab4-4473-a886-3b852194e27e\") " pod="opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" Jul 05 13:47:42.616416 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:42.616395 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e1d1e6c-cab4-4473-a886-3b852194e27e-maas-api-tls\") pod \"maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs\" (UID: \"7e1d1e6c-cab4-4473-a886-3b852194e27e\") " pod="opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" Jul 05 13:47:42.863789 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:42.863758 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" Jul 05 13:47:43.013955 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:43.013921 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs"] Jul 05 13:47:43.017946 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:47:43.017916 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e1d1e6c_cab4_4473_a886_3b852194e27e.slice/crio-44abcfaf7c94b9013e0398c014366ed56e019f6a12948cb7bd057b5b27d00254 WatchSource:0}: Error finding container 44abcfaf7c94b9013e0398c014366ed56e019f6a12948cb7bd057b5b27d00254: Status 404 returned error can't find the container with id 44abcfaf7c94b9013e0398c014366ed56e019f6a12948cb7bd057b5b27d00254 Jul 05 13:47:43.125130 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:43.125047 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" event={"ID":"7e1d1e6c-cab4-4473-a886-3b852194e27e","Type":"ContainerStarted","Data":"44abcfaf7c94b9013e0398c014366ed56e019f6a12948cb7bd057b5b27d00254"} Jul 05 13:47:44.130769 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:44.130729 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" event={"ID":"7e1d1e6c-cab4-4473-a886-3b852194e27e","Type":"ContainerStarted","Data":"6fe73741cf8b2360caefb4894f74825646fd7711e08c0c654bd92c87e600f8af"} Jul 05 13:47:44.131153 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:44.130804 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" Jul 05 13:47:44.154885 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:44.154835 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" podStartSLOduration=2.847402336 podStartE2EDuration="3.154818216s" totalImagesPullingTime="307.41588ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:47:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:47:44.153439334 +0000 UTC m=+1740.526715383" watchObservedRunningTime="2026-07-05 13:47:44.154818216 +0000 UTC m=+1740.528094247" Jul 05 13:47:50.140867 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:47:50.140834 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" Jul 05 13:48:14.647552 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:48:14.647519 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs"] Jul 05 13:48:14.648095 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:48:14.647783 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" podUID="7e1d1e6c-cab4-4473-a886-3b852194e27e" containerName="maas-api" containerID="cri-o://6fe73741cf8b2360caefb4894f74825646fd7711e08c0c654bd92c87e600f8af" gracePeriod=30 Jul 05 13:48:14.889079 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:48:14.889056 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" Jul 05 13:48:14.983524 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:48:14.983445 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e1d1e6c-cab4-4473-a886-3b852194e27e-maas-api-tls\") pod \"7e1d1e6c-cab4-4473-a886-3b852194e27e\" (UID: \"7e1d1e6c-cab4-4473-a886-3b852194e27e\") " Jul 05 13:48:14.983524 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:48:14.983486 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e1d1e6c-cab4-4473-a886-3b852194e27e-openshift-service-ca\") pod \"7e1d1e6c-cab4-4473-a886-3b852194e27e\" (UID: \"7e1d1e6c-cab4-4473-a886-3b852194e27e\") " Jul 05 13:48:14.983524 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:48:14.983506 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cfc8q\" (UniqueName: \"kubernetes.io/projected/7e1d1e6c-cab4-4473-a886-3b852194e27e-kube-api-access-cfc8q\") pod \"7e1d1e6c-cab4-4473-a886-3b852194e27e\" (UID: \"7e1d1e6c-cab4-4473-a886-3b852194e27e\") " Jul 05 13:48:14.983876 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:48:14.983853 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e1d1e6c-cab4-4473-a886-3b852194e27e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7e1d1e6c-cab4-4473-a886-3b852194e27e" (UID: "7e1d1e6c-cab4-4473-a886-3b852194e27e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 13:48:14.985717 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:48:14.985684 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e1d1e6c-cab4-4473-a886-3b852194e27e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7e1d1e6c-cab4-4473-a886-3b852194e27e" (UID: "7e1d1e6c-cab4-4473-a886-3b852194e27e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:48:14.985868 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:48:14.985845 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e1d1e6c-cab4-4473-a886-3b852194e27e-kube-api-access-cfc8q" (OuterVolumeSpecName: "kube-api-access-cfc8q") pod "7e1d1e6c-cab4-4473-a886-3b852194e27e" (UID: "7e1d1e6c-cab4-4473-a886-3b852194e27e"). InnerVolumeSpecName "kube-api-access-cfc8q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:48:15.084288 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:48:15.084253 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e1d1e6c-cab4-4473-a886-3b852194e27e-maas-api-tls\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:48:15.084288 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:48:15.084283 2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e1d1e6c-cab4-4473-a886-3b852194e27e-openshift-service-ca\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:48:15.084474 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:48:15.084296 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfc8q\" (UniqueName: \"kubernetes.io/projected/7e1d1e6c-cab4-4473-a886-3b852194e27e-kube-api-access-cfc8q\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:48:15.255188 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:48:15.255101 2577 generic.go:356] "Generic (PLEG): container finished" podID="7e1d1e6c-cab4-4473-a886-3b852194e27e" containerID="6fe73741cf8b2360caefb4894f74825646fd7711e08c0c654bd92c87e600f8af" exitCode=0 Jul 05 13:48:15.255188 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:48:15.255153 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" Jul 05 13:48:15.255387 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:48:15.255189 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" event={"ID":"7e1d1e6c-cab4-4473-a886-3b852194e27e","Type":"ContainerDied","Data":"6fe73741cf8b2360caefb4894f74825646fd7711e08c0c654bd92c87e600f8af"} Jul 05 13:48:15.255387 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:48:15.255239 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs" event={"ID":"7e1d1e6c-cab4-4473-a886-3b852194e27e","Type":"ContainerDied","Data":"44abcfaf7c94b9013e0398c014366ed56e019f6a12948cb7bd057b5b27d00254"} Jul 05 13:48:15.255387 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:48:15.255261 2577 scope.go:117] "RemoveContainer" containerID="6fe73741cf8b2360caefb4894f74825646fd7711e08c0c654bd92c87e600f8af" Jul 05 13:48:15.267540 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:48:15.267520 2577 scope.go:117] "RemoveContainer" containerID="6fe73741cf8b2360caefb4894f74825646fd7711e08c0c654bd92c87e600f8af" Jul 05 13:48:15.267849 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:48:15.267829 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fe73741cf8b2360caefb4894f74825646fd7711e08c0c654bd92c87e600f8af\": container with ID starting with 6fe73741cf8b2360caefb4894f74825646fd7711e08c0c654bd92c87e600f8af not found: ID does not exist" containerID="6fe73741cf8b2360caefb4894f74825646fd7711e08c0c654bd92c87e600f8af" Jul 05 13:48:15.267922 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:48:15.267856 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fe73741cf8b2360caefb4894f74825646fd7711e08c0c654bd92c87e600f8af"} err="failed to get container status \"6fe73741cf8b2360caefb4894f74825646fd7711e08c0c654bd92c87e600f8af\": rpc error: code = NotFound desc = could not find container \"6fe73741cf8b2360caefb4894f74825646fd7711e08c0c654bd92c87e600f8af\": container with ID starting with 6fe73741cf8b2360caefb4894f74825646fd7711e08c0c654bd92c87e600f8af not found: ID does not exist" Jul 05 13:48:15.287328 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:48:15.287300 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs"] Jul 05 13:48:15.290330 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:48:15.290309 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-3536bbfe-7bb98d6f5f-f99zs"] Jul 05 13:48:16.234699 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:48:16.234661 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e1d1e6c-cab4-4473-a886-3b852194e27e" path="/var/lib/kubelet/pods/7e1d1e6c-cab4-4473-a886-3b852194e27e/volumes" Jul 05 13:50:12.981736 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:12.981659 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf"] Jul 05 13:50:12.982164 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:12.982083 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e1d1e6c-cab4-4473-a886-3b852194e27e" containerName="maas-api" Jul 05 13:50:12.982164 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:12.982097 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e1d1e6c-cab4-4473-a886-3b852194e27e" containerName="maas-api" Jul 05 13:50:12.982233 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:12.982181 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e1d1e6c-cab4-4473-a886-3b852194e27e" containerName="maas-api" Jul 05 13:50:12.985284 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:12.985265 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf" Jul 05 13:50:12.992057 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:12.992036 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-76289d-serving-cert\"" Jul 05 13:50:13.005157 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:13.005136 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf"] Jul 05 13:50:13.132601 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:13.132564 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d81c50b-c8f3-4a1b-8b90-60d704ca53f0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf\" (UID: \"9d81c50b-c8f3-4a1b-8b90-60d704ca53f0\") " pod="opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf" Jul 05 13:50:13.132779 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:13.132609 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdkvv\" (UniqueName: \"kubernetes.io/projected/9d81c50b-c8f3-4a1b-8b90-60d704ca53f0-kube-api-access-hdkvv\") pod \"maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf\" (UID: \"9d81c50b-c8f3-4a1b-8b90-60d704ca53f0\") " pod="opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf" Jul 05 13:50:13.132779 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:13.132632 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d81c50b-c8f3-4a1b-8b90-60d704ca53f0-maas-api-tls\") pod \"maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf\" (UID: \"9d81c50b-c8f3-4a1b-8b90-60d704ca53f0\") " pod="opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf" Jul 05 13:50:13.234086 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:13.234001 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d81c50b-c8f3-4a1b-8b90-60d704ca53f0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf\" (UID: \"9d81c50b-c8f3-4a1b-8b90-60d704ca53f0\") " pod="opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf" Jul 05 13:50:13.234086 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:13.234034 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdkvv\" (UniqueName: \"kubernetes.io/projected/9d81c50b-c8f3-4a1b-8b90-60d704ca53f0-kube-api-access-hdkvv\") pod \"maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf\" (UID: \"9d81c50b-c8f3-4a1b-8b90-60d704ca53f0\") " pod="opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf" Jul 05 13:50:13.234086 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:13.234053 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d81c50b-c8f3-4a1b-8b90-60d704ca53f0-maas-api-tls\") pod \"maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf\" (UID: \"9d81c50b-c8f3-4a1b-8b90-60d704ca53f0\") " pod="opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf" Jul 05 13:50:13.234609 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:13.234587 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d81c50b-c8f3-4a1b-8b90-60d704ca53f0-openshift-service-ca\") pod \"maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf\" (UID: \"9d81c50b-c8f3-4a1b-8b90-60d704ca53f0\") " pod="opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf" Jul 05 13:50:13.236449 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:13.236431 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d81c50b-c8f3-4a1b-8b90-60d704ca53f0-maas-api-tls\") pod \"maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf\" (UID: \"9d81c50b-c8f3-4a1b-8b90-60d704ca53f0\") " pod="opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf" Jul 05 13:50:13.252568 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:13.252548 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdkvv\" (UniqueName: \"kubernetes.io/projected/9d81c50b-c8f3-4a1b-8b90-60d704ca53f0-kube-api-access-hdkvv\") pod \"maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf\" (UID: \"9d81c50b-c8f3-4a1b-8b90-60d704ca53f0\") " pod="opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf" Jul 05 13:50:13.295411 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:13.295378 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf" Jul 05 13:50:13.429280 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:13.429248 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf"] Jul 05 13:50:13.432299 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:50:13.432267 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d81c50b_c8f3_4a1b_8b90_60d704ca53f0.slice/crio-273da9038a6539ceafcb6a9548d615265edd29faed7c83ba70e8400d673fd160 WatchSource:0}: Error finding container 273da9038a6539ceafcb6a9548d615265edd29faed7c83ba70e8400d673fd160: Status 404 returned error can't find the container with id 273da9038a6539ceafcb6a9548d615265edd29faed7c83ba70e8400d673fd160 Jul 05 13:50:13.433755 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:13.433733 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 05 13:50:13.719439 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:13.719403 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf" event={"ID":"9d81c50b-c8f3-4a1b-8b90-60d704ca53f0","Type":"ContainerStarted","Data":"273da9038a6539ceafcb6a9548d615265edd29faed7c83ba70e8400d673fd160"} Jul 05 13:50:14.725157 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:14.725119 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf" event={"ID":"9d81c50b-c8f3-4a1b-8b90-60d704ca53f0","Type":"ContainerStarted","Data":"18ed1bfd01d475c3b74660693da5627a117a5b7e043540d0e114f32946460081"} Jul 05 13:50:14.725551 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:14.725216 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf" Jul 05 13:50:14.747929 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:14.747885 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf" podStartSLOduration=2.268838059 podStartE2EDuration="2.747871834s" totalImagesPullingTime="479.033775ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:50:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:50:14.747864664 +0000 UTC m=+1891.121140717" watchObservedRunningTime="2026-07-05 13:50:14.747871834 +0000 UTC m=+1891.121147866" Jul 05 13:50:20.734969 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:20.734939 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf" Jul 05 13:50:20.873702 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:20.870466 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f"] Jul 05 13:50:20.876292 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:20.876267 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f" Jul 05 13:50:20.879242 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:20.879210 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-4b5487-serving-cert\"" Jul 05 13:50:20.886435 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:20.886408 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f"] Jul 05 13:50:20.895383 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:20.895358 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e760487b-6913-4f8f-8519-cad2ff0255d2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f\" (UID: \"e760487b-6913-4f8f-8519-cad2ff0255d2\") " pod="opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f" Jul 05 13:50:20.895503 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:20.895391 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6v7s\" (UniqueName: \"kubernetes.io/projected/e760487b-6913-4f8f-8519-cad2ff0255d2-kube-api-access-q6v7s\") pod \"maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f\" (UID: \"e760487b-6913-4f8f-8519-cad2ff0255d2\") " pod="opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f" Jul 05 13:50:20.895503 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:20.895483 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e760487b-6913-4f8f-8519-cad2ff0255d2-maas-api-tls\") pod \"maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f\" (UID: \"e760487b-6913-4f8f-8519-cad2ff0255d2\") " pod="opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f" Jul 05 13:50:20.996028 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:20.995943 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e760487b-6913-4f8f-8519-cad2ff0255d2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f\" (UID: \"e760487b-6913-4f8f-8519-cad2ff0255d2\") " pod="opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f" Jul 05 13:50:20.996028 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:20.995980 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6v7s\" (UniqueName: \"kubernetes.io/projected/e760487b-6913-4f8f-8519-cad2ff0255d2-kube-api-access-q6v7s\") pod \"maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f\" (UID: \"e760487b-6913-4f8f-8519-cad2ff0255d2\") " pod="opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f" Jul 05 13:50:20.996250 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:20.996032 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e760487b-6913-4f8f-8519-cad2ff0255d2-maas-api-tls\") pod \"maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f\" (UID: \"e760487b-6913-4f8f-8519-cad2ff0255d2\") " pod="opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f" Jul 05 13:50:20.996585 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:20.996560 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e760487b-6913-4f8f-8519-cad2ff0255d2-openshift-service-ca\") pod \"maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f\" (UID: \"e760487b-6913-4f8f-8519-cad2ff0255d2\") " pod="opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f" Jul 05 13:50:20.998451 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:20.998429 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e760487b-6913-4f8f-8519-cad2ff0255d2-maas-api-tls\") pod \"maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f\" (UID: \"e760487b-6913-4f8f-8519-cad2ff0255d2\") " pod="opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f" Jul 05 13:50:21.004547 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:21.004528 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6v7s\" (UniqueName: \"kubernetes.io/projected/e760487b-6913-4f8f-8519-cad2ff0255d2-kube-api-access-q6v7s\") pod \"maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f\" (UID: \"e760487b-6913-4f8f-8519-cad2ff0255d2\") " pod="opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f" Jul 05 13:50:21.191255 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:21.191219 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f" Jul 05 13:50:21.327567 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:21.327542 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f"] Jul 05 13:50:21.330034 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:50:21.330005 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode760487b_6913_4f8f_8519_cad2ff0255d2.slice/crio-3d50caf4a93ae15b4753d209ab78fa40873832d2f9523d55aadf05168391d799 WatchSource:0}: Error finding container 3d50caf4a93ae15b4753d209ab78fa40873832d2f9523d55aadf05168391d799: Status 404 returned error can't find the container with id 3d50caf4a93ae15b4753d209ab78fa40873832d2f9523d55aadf05168391d799 Jul 05 13:50:21.756734 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:21.756701 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f" event={"ID":"e760487b-6913-4f8f-8519-cad2ff0255d2","Type":"ContainerStarted","Data":"3782defc766d2168b39b8b561f10cef571307c0f2cdea8a5372c0d19539be443"} Jul 05 13:50:21.757178 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:21.756751 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f" event={"ID":"e760487b-6913-4f8f-8519-cad2ff0255d2","Type":"ContainerStarted","Data":"3d50caf4a93ae15b4753d209ab78fa40873832d2f9523d55aadf05168391d799"} Jul 05 13:50:21.757178 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:21.756839 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f" Jul 05 13:50:21.777192 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:21.777140 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f" podStartSLOduration=1.449677807 podStartE2EDuration="1.777125158s" totalImagesPullingTime="327.447351ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:50:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:50:21.775162892 +0000 UTC m=+1898.148438952" watchObservedRunningTime="2026-07-05 13:50:21.777125158 +0000 UTC m=+1898.150401190" Jul 05 13:50:27.766060 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:50:27.766028 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f" Jul 05 13:51:36.141582 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:51:36.141503 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf"] Jul 05 13:51:36.142080 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:51:36.141722 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf" podUID="9d81c50b-c8f3-4a1b-8b90-60d704ca53f0" containerName="maas-api" containerID="cri-o://18ed1bfd01d475c3b74660693da5627a117a5b7e043540d0e114f32946460081" gracePeriod=30 Jul 05 13:51:36.382302 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:51:36.382279 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf" Jul 05 13:51:36.539314 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:51:36.539228 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d81c50b-c8f3-4a1b-8b90-60d704ca53f0-maas-api-tls\") pod \"9d81c50b-c8f3-4a1b-8b90-60d704ca53f0\" (UID: \"9d81c50b-c8f3-4a1b-8b90-60d704ca53f0\") " Jul 05 13:51:36.539314 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:51:36.539308 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdkvv\" (UniqueName: \"kubernetes.io/projected/9d81c50b-c8f3-4a1b-8b90-60d704ca53f0-kube-api-access-hdkvv\") pod \"9d81c50b-c8f3-4a1b-8b90-60d704ca53f0\" (UID: \"9d81c50b-c8f3-4a1b-8b90-60d704ca53f0\") " Jul 05 13:51:36.539523 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:51:36.539347 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d81c50b-c8f3-4a1b-8b90-60d704ca53f0-openshift-service-ca\") pod \"9d81c50b-c8f3-4a1b-8b90-60d704ca53f0\" (UID: \"9d81c50b-c8f3-4a1b-8b90-60d704ca53f0\") " Jul 05 13:51:36.539833 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:51:36.539804 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d81c50b-c8f3-4a1b-8b90-60d704ca53f0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9d81c50b-c8f3-4a1b-8b90-60d704ca53f0" (UID: "9d81c50b-c8f3-4a1b-8b90-60d704ca53f0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 13:51:36.541369 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:51:36.541346 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d81c50b-c8f3-4a1b-8b90-60d704ca53f0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9d81c50b-c8f3-4a1b-8b90-60d704ca53f0" (UID: "9d81c50b-c8f3-4a1b-8b90-60d704ca53f0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:51:36.541467 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:51:36.541406 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d81c50b-c8f3-4a1b-8b90-60d704ca53f0-kube-api-access-hdkvv" (OuterVolumeSpecName: "kube-api-access-hdkvv") pod "9d81c50b-c8f3-4a1b-8b90-60d704ca53f0" (UID: "9d81c50b-c8f3-4a1b-8b90-60d704ca53f0"). InnerVolumeSpecName "kube-api-access-hdkvv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:51:36.639898 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:51:36.639869 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdkvv\" (UniqueName: \"kubernetes.io/projected/9d81c50b-c8f3-4a1b-8b90-60d704ca53f0-kube-api-access-hdkvv\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:51:36.639898 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:51:36.639895 2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d81c50b-c8f3-4a1b-8b90-60d704ca53f0-openshift-service-ca\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:51:36.639898 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:51:36.639904 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d81c50b-c8f3-4a1b-8b90-60d704ca53f0-maas-api-tls\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:51:37.071863 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:51:37.071832 2577 generic.go:356] "Generic (PLEG): container finished" podID="9d81c50b-c8f3-4a1b-8b90-60d704ca53f0" containerID="18ed1bfd01d475c3b74660693da5627a117a5b7e043540d0e114f32946460081" exitCode=0 Jul 05 13:51:37.072032 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:51:37.071879 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf" Jul 05 13:51:37.072032 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:51:37.071916 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf" event={"ID":"9d81c50b-c8f3-4a1b-8b90-60d704ca53f0","Type":"ContainerDied","Data":"18ed1bfd01d475c3b74660693da5627a117a5b7e043540d0e114f32946460081"} Jul 05 13:51:37.072032 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:51:37.071965 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf" event={"ID":"9d81c50b-c8f3-4a1b-8b90-60d704ca53f0","Type":"ContainerDied","Data":"273da9038a6539ceafcb6a9548d615265edd29faed7c83ba70e8400d673fd160"} Jul 05 13:51:37.072032 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:51:37.071991 2577 scope.go:117] "RemoveContainer" containerID="18ed1bfd01d475c3b74660693da5627a117a5b7e043540d0e114f32946460081" Jul 05 13:51:37.080211 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:51:37.080192 2577 scope.go:117] "RemoveContainer" containerID="18ed1bfd01d475c3b74660693da5627a117a5b7e043540d0e114f32946460081" Jul 05 13:51:37.080456 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:51:37.080435 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"18ed1bfd01d475c3b74660693da5627a117a5b7e043540d0e114f32946460081\": container with ID starting with 18ed1bfd01d475c3b74660693da5627a117a5b7e043540d0e114f32946460081 not found: ID does not exist" containerID="18ed1bfd01d475c3b74660693da5627a117a5b7e043540d0e114f32946460081" Jul 05 13:51:37.080510 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:51:37.080465 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"18ed1bfd01d475c3b74660693da5627a117a5b7e043540d0e114f32946460081"} err="failed to get container status \"18ed1bfd01d475c3b74660693da5627a117a5b7e043540d0e114f32946460081\": rpc error: code = NotFound desc = could not find container \"18ed1bfd01d475c3b74660693da5627a117a5b7e043540d0e114f32946460081\": container with ID starting with 18ed1bfd01d475c3b74660693da5627a117a5b7e043540d0e114f32946460081 not found: ID does not exist" Jul 05 13:51:37.095826 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:51:37.095802 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf"] Jul 05 13:51:37.097041 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:51:37.097024 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-76289d-78c8b8dc9-4zmbf"] Jul 05 13:51:38.235037 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:51:38.234998 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d81c50b-c8f3-4a1b-8b90-60d704ca53f0" path="/var/lib/kubelet/pods/9d81c50b-c8f3-4a1b-8b90-60d704ca53f0/volumes" Jul 05 13:52:19.428536 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:19.428503 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f"] Jul 05 13:52:19.429042 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:19.428757 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f" podUID="e760487b-6913-4f8f-8519-cad2ff0255d2" containerName="maas-api" containerID="cri-o://3782defc766d2168b39b8b561f10cef571307c0f2cdea8a5372c0d19539be443" gracePeriod=30 Jul 05 13:52:19.666570 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:19.666545 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f" Jul 05 13:52:19.803796 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:19.803713 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6v7s\" (UniqueName: \"kubernetes.io/projected/e760487b-6913-4f8f-8519-cad2ff0255d2-kube-api-access-q6v7s\") pod \"e760487b-6913-4f8f-8519-cad2ff0255d2\" (UID: \"e760487b-6913-4f8f-8519-cad2ff0255d2\") " Jul 05 13:52:19.803938 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:19.803814 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e760487b-6913-4f8f-8519-cad2ff0255d2-maas-api-tls\") pod \"e760487b-6913-4f8f-8519-cad2ff0255d2\" (UID: \"e760487b-6913-4f8f-8519-cad2ff0255d2\") " Jul 05 13:52:19.803938 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:19.803844 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e760487b-6913-4f8f-8519-cad2ff0255d2-openshift-service-ca\") pod \"e760487b-6913-4f8f-8519-cad2ff0255d2\" (UID: \"e760487b-6913-4f8f-8519-cad2ff0255d2\") " Jul 05 13:52:19.804205 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:19.804181 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e760487b-6913-4f8f-8519-cad2ff0255d2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e760487b-6913-4f8f-8519-cad2ff0255d2" (UID: "e760487b-6913-4f8f-8519-cad2ff0255d2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 13:52:19.805797 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:19.805765 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e760487b-6913-4f8f-8519-cad2ff0255d2-kube-api-access-q6v7s" (OuterVolumeSpecName: "kube-api-access-q6v7s") pod "e760487b-6913-4f8f-8519-cad2ff0255d2" (UID: "e760487b-6913-4f8f-8519-cad2ff0255d2"). InnerVolumeSpecName "kube-api-access-q6v7s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:52:19.805912 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:19.805839 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e760487b-6913-4f8f-8519-cad2ff0255d2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e760487b-6913-4f8f-8519-cad2ff0255d2" (UID: "e760487b-6913-4f8f-8519-cad2ff0255d2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:52:19.904286 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:19.904258 2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e760487b-6913-4f8f-8519-cad2ff0255d2-openshift-service-ca\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:52:19.904286 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:19.904281 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6v7s\" (UniqueName: \"kubernetes.io/projected/e760487b-6913-4f8f-8519-cad2ff0255d2-kube-api-access-q6v7s\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:52:19.904436 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:19.904291 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e760487b-6913-4f8f-8519-cad2ff0255d2-maas-api-tls\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:52:20.253610 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:20.253577 2577 generic.go:356] "Generic (PLEG): container finished" podID="e760487b-6913-4f8f-8519-cad2ff0255d2" containerID="3782defc766d2168b39b8b561f10cef571307c0f2cdea8a5372c0d19539be443" exitCode=0 Jul 05 13:52:20.253748 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:20.253616 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f" Jul 05 13:52:20.253748 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:20.253666 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f" event={"ID":"e760487b-6913-4f8f-8519-cad2ff0255d2","Type":"ContainerDied","Data":"3782defc766d2168b39b8b561f10cef571307c0f2cdea8a5372c0d19539be443"} Jul 05 13:52:20.253748 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:20.253716 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f" event={"ID":"e760487b-6913-4f8f-8519-cad2ff0255d2","Type":"ContainerDied","Data":"3d50caf4a93ae15b4753d209ab78fa40873832d2f9523d55aadf05168391d799"} Jul 05 13:52:20.253748 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:20.253738 2577 scope.go:117] "RemoveContainer" containerID="3782defc766d2168b39b8b561f10cef571307c0f2cdea8a5372c0d19539be443" Jul 05 13:52:20.262068 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:20.262052 2577 scope.go:117] "RemoveContainer" containerID="3782defc766d2168b39b8b561f10cef571307c0f2cdea8a5372c0d19539be443" Jul 05 13:52:20.262336 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:52:20.262318 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3782defc766d2168b39b8b561f10cef571307c0f2cdea8a5372c0d19539be443\": container with ID starting with 3782defc766d2168b39b8b561f10cef571307c0f2cdea8a5372c0d19539be443 not found: ID does not exist" containerID="3782defc766d2168b39b8b561f10cef571307c0f2cdea8a5372c0d19539be443" Jul 05 13:52:20.262407 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:20.262350 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3782defc766d2168b39b8b561f10cef571307c0f2cdea8a5372c0d19539be443"} err="failed to get container status \"3782defc766d2168b39b8b561f10cef571307c0f2cdea8a5372c0d19539be443\": rpc error: code = NotFound desc = could not find container \"3782defc766d2168b39b8b561f10cef571307c0f2cdea8a5372c0d19539be443\": container with ID starting with 3782defc766d2168b39b8b561f10cef571307c0f2cdea8a5372c0d19539be443 not found: ID does not exist" Jul 05 13:52:20.280051 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:20.280025 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f"] Jul 05 13:52:20.288442 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:20.288418 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-4b5487-5b6d48b758-4jz9f"] Jul 05 13:52:22.235579 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:22.235543 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e760487b-6913-4f8f-8519-cad2ff0255d2" path="/var/lib/kubelet/pods/e760487b-6913-4f8f-8519-cad2ff0255d2/volumes" Jul 05 13:52:29.657820 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:29.657783 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm"] Jul 05 13:52:29.658272 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:29.658228 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d81c50b-c8f3-4a1b-8b90-60d704ca53f0" containerName="maas-api" Jul 05 13:52:29.658272 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:29.658249 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d81c50b-c8f3-4a1b-8b90-60d704ca53f0" containerName="maas-api" Jul 05 13:52:29.658272 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:29.658268 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e760487b-6913-4f8f-8519-cad2ff0255d2" containerName="maas-api" Jul 05 13:52:29.658431 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:29.658277 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e760487b-6913-4f8f-8519-cad2ff0255d2" containerName="maas-api" Jul 05 13:52:29.658431 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:29.658350 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d81c50b-c8f3-4a1b-8b90-60d704ca53f0" containerName="maas-api" Jul 05 13:52:29.658431 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:29.658364 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e760487b-6913-4f8f-8519-cad2ff0255d2" containerName="maas-api" Jul 05 13:52:29.662752 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:29.662727 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm" Jul 05 13:52:29.666005 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:29.665987 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-4fa5fb-serving-cert\"" Jul 05 13:52:29.673869 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:29.673847 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm"] Jul 05 13:52:29.788768 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:29.788738 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc42e186-b415-43c1-af89-b44b9885fc6a-openshift-service-ca\") pod \"maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm\" (UID: \"bc42e186-b415-43c1-af89-b44b9885fc6a\") " pod="opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm" Jul 05 13:52:29.788946 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:29.788793 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc42e186-b415-43c1-af89-b44b9885fc6a-maas-api-tls\") pod \"maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm\" (UID: \"bc42e186-b415-43c1-af89-b44b9885fc6a\") " pod="opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm" Jul 05 13:52:29.788946 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:29.788875 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbzns\" (UniqueName: \"kubernetes.io/projected/bc42e186-b415-43c1-af89-b44b9885fc6a-kube-api-access-nbzns\") pod \"maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm\" (UID: \"bc42e186-b415-43c1-af89-b44b9885fc6a\") " pod="opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm" Jul 05 13:52:29.889273 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:29.889239 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc42e186-b415-43c1-af89-b44b9885fc6a-openshift-service-ca\") pod \"maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm\" (UID: \"bc42e186-b415-43c1-af89-b44b9885fc6a\") " pod="opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm" Jul 05 13:52:29.889401 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:29.889282 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc42e186-b415-43c1-af89-b44b9885fc6a-maas-api-tls\") pod \"maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm\" (UID: \"bc42e186-b415-43c1-af89-b44b9885fc6a\") " pod="opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm" Jul 05 13:52:29.889401 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:29.889321 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbzns\" (UniqueName: \"kubernetes.io/projected/bc42e186-b415-43c1-af89-b44b9885fc6a-kube-api-access-nbzns\") pod \"maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm\" (UID: \"bc42e186-b415-43c1-af89-b44b9885fc6a\") " pod="opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm" Jul 05 13:52:29.889875 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:29.889854 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc42e186-b415-43c1-af89-b44b9885fc6a-openshift-service-ca\") pod \"maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm\" (UID: \"bc42e186-b415-43c1-af89-b44b9885fc6a\") " pod="opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm" Jul 05 13:52:29.891794 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:29.891767 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc42e186-b415-43c1-af89-b44b9885fc6a-maas-api-tls\") pod \"maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm\" (UID: \"bc42e186-b415-43c1-af89-b44b9885fc6a\") " pod="opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm" Jul 05 13:52:29.899832 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:29.899811 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbzns\" (UniqueName: \"kubernetes.io/projected/bc42e186-b415-43c1-af89-b44b9885fc6a-kube-api-access-nbzns\") pod \"maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm\" (UID: \"bc42e186-b415-43c1-af89-b44b9885fc6a\") " pod="opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm" Jul 05 13:52:29.974061 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:29.974005 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm" Jul 05 13:52:30.126962 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:30.126940 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm"] Jul 05 13:52:30.129151 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:52:30.129126 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc42e186_b415_43c1_af89_b44b9885fc6a.slice/crio-41ed01324d688a4d008e7ab68c777bb7f061009a76819171763d07f4599fa00c WatchSource:0}: Error finding container 41ed01324d688a4d008e7ab68c777bb7f061009a76819171763d07f4599fa00c: Status 404 returned error can't find the container with id 41ed01324d688a4d008e7ab68c777bb7f061009a76819171763d07f4599fa00c Jul 05 13:52:30.298036 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:30.297956 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm" event={"ID":"bc42e186-b415-43c1-af89-b44b9885fc6a","Type":"ContainerStarted","Data":"41ed01324d688a4d008e7ab68c777bb7f061009a76819171763d07f4599fa00c"} Jul 05 13:52:31.303300 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:31.303268 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm" event={"ID":"bc42e186-b415-43c1-af89-b44b9885fc6a","Type":"ContainerStarted","Data":"48b00c8a7e504e9a844dc068bc352540a067fc69bf16cfccd0b4a5fe236d25b8"} Jul 05 13:52:31.303706 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:31.303380 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm" Jul 05 13:52:31.341067 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:31.341011 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm" podStartSLOduration=1.97793201 podStartE2EDuration="2.340990044s" totalImagesPullingTime="363.058034ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:52:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:52:31.338379193 +0000 UTC m=+2027.711655226" watchObservedRunningTime="2026-07-05 13:52:31.340990044 +0000 UTC m=+2027.714266073" Jul 05 13:52:37.313513 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:37.313483 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm" Jul 05 13:52:37.674110 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:37.674076 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj"] Jul 05 13:52:37.678786 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:37.678754 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj" Jul 05 13:52:37.683741 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:37.683715 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-ed2315-serving-cert\"" Jul 05 13:52:37.693098 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:37.693056 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj"] Jul 05 13:52:37.855724 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:37.855687 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95845b5d-fcff-486c-9775-513fde88f395-openshift-service-ca\") pod \"maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj\" (UID: \"95845b5d-fcff-486c-9775-513fde88f395\") " pod="opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj" Jul 05 13:52:37.855902 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:37.855758 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7qcr\" (UniqueName: \"kubernetes.io/projected/95845b5d-fcff-486c-9775-513fde88f395-kube-api-access-j7qcr\") pod \"maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj\" (UID: \"95845b5d-fcff-486c-9775-513fde88f395\") " pod="opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj" Jul 05 13:52:37.855902 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:37.855816 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95845b5d-fcff-486c-9775-513fde88f395-maas-api-tls\") pod \"maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj\" (UID: \"95845b5d-fcff-486c-9775-513fde88f395\") " pod="opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj" Jul 05 13:52:37.957063 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:37.956985 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7qcr\" (UniqueName: \"kubernetes.io/projected/95845b5d-fcff-486c-9775-513fde88f395-kube-api-access-j7qcr\") pod \"maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj\" (UID: \"95845b5d-fcff-486c-9775-513fde88f395\") " pod="opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj" Jul 05 13:52:37.957063 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:37.957028 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95845b5d-fcff-486c-9775-513fde88f395-maas-api-tls\") pod \"maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj\" (UID: \"95845b5d-fcff-486c-9775-513fde88f395\") " pod="opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj" Jul 05 13:52:37.957063 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:37.957057 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95845b5d-fcff-486c-9775-513fde88f395-openshift-service-ca\") pod \"maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj\" (UID: \"95845b5d-fcff-486c-9775-513fde88f395\") " pod="opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj" Jul 05 13:52:37.957609 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:37.957590 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95845b5d-fcff-486c-9775-513fde88f395-openshift-service-ca\") pod \"maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj\" (UID: \"95845b5d-fcff-486c-9775-513fde88f395\") " pod="opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj" Jul 05 13:52:37.959496 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:37.959475 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95845b5d-fcff-486c-9775-513fde88f395-maas-api-tls\") pod \"maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj\" (UID: \"95845b5d-fcff-486c-9775-513fde88f395\") " pod="opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj" Jul 05 13:52:37.973736 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:37.973706 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7qcr\" (UniqueName: \"kubernetes.io/projected/95845b5d-fcff-486c-9775-513fde88f395-kube-api-access-j7qcr\") pod \"maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj\" (UID: \"95845b5d-fcff-486c-9775-513fde88f395\") " pod="opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj" Jul 05 13:52:37.993533 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:37.993498 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj" Jul 05 13:52:38.144367 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:52:38.144303 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95845b5d_fcff_486c_9775_513fde88f395.slice/crio-abfc0ae493377d9791980e310c60a89cd713cdd1593b8a751a83b09973f5d666 WatchSource:0}: Error finding container abfc0ae493377d9791980e310c60a89cd713cdd1593b8a751a83b09973f5d666: Status 404 returned error can't find the container with id abfc0ae493377d9791980e310c60a89cd713cdd1593b8a751a83b09973f5d666 Jul 05 13:52:38.151409 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:38.151379 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj"] Jul 05 13:52:38.333410 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:38.333374 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj" event={"ID":"95845b5d-fcff-486c-9775-513fde88f395","Type":"ContainerStarted","Data":"abfc0ae493377d9791980e310c60a89cd713cdd1593b8a751a83b09973f5d666"} Jul 05 13:52:39.339173 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:39.339140 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj" event={"ID":"95845b5d-fcff-486c-9775-513fde88f395","Type":"ContainerStarted","Data":"1ffb5e8d33bd35c165049ee201ff7d7b2fcf22cbc129071988c1aac1b2c5ebee"} Jul 05 13:52:39.339564 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:39.339272 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj" Jul 05 13:52:39.359956 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:39.359905 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj" podStartSLOduration=2.066663278 podStartE2EDuration="2.359890941s" totalImagesPullingTime="293.227663ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:52:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:52:39.359060273 +0000 UTC m=+2035.732336305" watchObservedRunningTime="2026-07-05 13:52:39.359890941 +0000 UTC m=+2035.733166972" Jul 05 13:52:45.347953 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:45.347927 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj" Jul 05 13:52:51.399228 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:51.399192 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm"] Jul 05 13:52:51.399875 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:51.399413 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm" podUID="bc42e186-b415-43c1-af89-b44b9885fc6a" containerName="maas-api" containerID="cri-o://48b00c8a7e504e9a844dc068bc352540a067fc69bf16cfccd0b4a5fe236d25b8" gracePeriod=30 Jul 05 13:52:51.636474 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:51.636450 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm" Jul 05 13:52:51.662773 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:51.662701 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc42e186-b415-43c1-af89-b44b9885fc6a-openshift-service-ca\") pod \"bc42e186-b415-43c1-af89-b44b9885fc6a\" (UID: \"bc42e186-b415-43c1-af89-b44b9885fc6a\") " Jul 05 13:52:51.662889 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:51.662781 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbzns\" (UniqueName: \"kubernetes.io/projected/bc42e186-b415-43c1-af89-b44b9885fc6a-kube-api-access-nbzns\") pod \"bc42e186-b415-43c1-af89-b44b9885fc6a\" (UID: \"bc42e186-b415-43c1-af89-b44b9885fc6a\") " Jul 05 13:52:51.662889 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:51.662832 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc42e186-b415-43c1-af89-b44b9885fc6a-maas-api-tls\") pod \"bc42e186-b415-43c1-af89-b44b9885fc6a\" (UID: \"bc42e186-b415-43c1-af89-b44b9885fc6a\") " Jul 05 13:52:51.663081 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:51.663061 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc42e186-b415-43c1-af89-b44b9885fc6a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bc42e186-b415-43c1-af89-b44b9885fc6a" (UID: "bc42e186-b415-43c1-af89-b44b9885fc6a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 13:52:51.664803 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:51.664775 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc42e186-b415-43c1-af89-b44b9885fc6a-kube-api-access-nbzns" (OuterVolumeSpecName: "kube-api-access-nbzns") pod "bc42e186-b415-43c1-af89-b44b9885fc6a" (UID: "bc42e186-b415-43c1-af89-b44b9885fc6a"). InnerVolumeSpecName "kube-api-access-nbzns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:52:51.664943 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:51.664917 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc42e186-b415-43c1-af89-b44b9885fc6a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bc42e186-b415-43c1-af89-b44b9885fc6a" (UID: "bc42e186-b415-43c1-af89-b44b9885fc6a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:52:51.764203 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:51.764168 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbzns\" (UniqueName: \"kubernetes.io/projected/bc42e186-b415-43c1-af89-b44b9885fc6a-kube-api-access-nbzns\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:52:51.764203 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:51.764196 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bc42e186-b415-43c1-af89-b44b9885fc6a-maas-api-tls\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:52:51.764203 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:51.764205 2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bc42e186-b415-43c1-af89-b44b9885fc6a-openshift-service-ca\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:52:52.395004 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:52.394969 2577 generic.go:356] "Generic (PLEG): container finished" podID="bc42e186-b415-43c1-af89-b44b9885fc6a" containerID="48b00c8a7e504e9a844dc068bc352540a067fc69bf16cfccd0b4a5fe236d25b8" exitCode=0 Jul 05 13:52:52.395182 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:52.395006 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm" event={"ID":"bc42e186-b415-43c1-af89-b44b9885fc6a","Type":"ContainerDied","Data":"48b00c8a7e504e9a844dc068bc352540a067fc69bf16cfccd0b4a5fe236d25b8"} Jul 05 13:52:52.395182 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:52.395021 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm" Jul 05 13:52:52.395182 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:52.395065 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm" event={"ID":"bc42e186-b415-43c1-af89-b44b9885fc6a","Type":"ContainerDied","Data":"41ed01324d688a4d008e7ab68c777bb7f061009a76819171763d07f4599fa00c"} Jul 05 13:52:52.395182 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:52.395088 2577 scope.go:117] "RemoveContainer" containerID="48b00c8a7e504e9a844dc068bc352540a067fc69bf16cfccd0b4a5fe236d25b8" Jul 05 13:52:52.403345 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:52.403098 2577 scope.go:117] "RemoveContainer" containerID="48b00c8a7e504e9a844dc068bc352540a067fc69bf16cfccd0b4a5fe236d25b8" Jul 05 13:52:52.403573 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:52:52.403382 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48b00c8a7e504e9a844dc068bc352540a067fc69bf16cfccd0b4a5fe236d25b8\": container with ID starting with 48b00c8a7e504e9a844dc068bc352540a067fc69bf16cfccd0b4a5fe236d25b8 not found: ID does not exist" containerID="48b00c8a7e504e9a844dc068bc352540a067fc69bf16cfccd0b4a5fe236d25b8" Jul 05 13:52:52.403573 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:52.403407 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48b00c8a7e504e9a844dc068bc352540a067fc69bf16cfccd0b4a5fe236d25b8"} err="failed to get container status \"48b00c8a7e504e9a844dc068bc352540a067fc69bf16cfccd0b4a5fe236d25b8\": rpc error: code = NotFound desc = could not find container \"48b00c8a7e504e9a844dc068bc352540a067fc69bf16cfccd0b4a5fe236d25b8\": container with ID starting with 48b00c8a7e504e9a844dc068bc352540a067fc69bf16cfccd0b4a5fe236d25b8 not found: ID does not exist" Jul 05 13:52:52.413405 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:52.413383 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm"] Jul 05 13:52:52.418025 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:52.418006 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-4fa5fb-84dff55b9d-bh5jm"] Jul 05 13:52:54.235181 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:54.235140 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc42e186-b415-43c1-af89-b44b9885fc6a" path="/var/lib/kubelet/pods/bc42e186-b415-43c1-af89-b44b9885fc6a/volumes" Jul 05 13:52:58.850882 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:58.850848 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj"] Jul 05 13:52:58.851332 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:58.851093 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj" podUID="95845b5d-fcff-486c-9775-513fde88f395" containerName="maas-api" containerID="cri-o://1ffb5e8d33bd35c165049ee201ff7d7b2fcf22cbc129071988c1aac1b2c5ebee" gracePeriod=30 Jul 05 13:52:59.092753 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:59.092730 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj" Jul 05 13:52:59.124402 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:59.124311 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7qcr\" (UniqueName: \"kubernetes.io/projected/95845b5d-fcff-486c-9775-513fde88f395-kube-api-access-j7qcr\") pod \"95845b5d-fcff-486c-9775-513fde88f395\" (UID: \"95845b5d-fcff-486c-9775-513fde88f395\") " Jul 05 13:52:59.124402 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:59.124375 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95845b5d-fcff-486c-9775-513fde88f395-openshift-service-ca\") pod \"95845b5d-fcff-486c-9775-513fde88f395\" (UID: \"95845b5d-fcff-486c-9775-513fde88f395\") " Jul 05 13:52:59.124402 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:59.124398 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95845b5d-fcff-486c-9775-513fde88f395-maas-api-tls\") pod \"95845b5d-fcff-486c-9775-513fde88f395\" (UID: \"95845b5d-fcff-486c-9775-513fde88f395\") " Jul 05 13:52:59.124786 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:59.124755 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95845b5d-fcff-486c-9775-513fde88f395-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "95845b5d-fcff-486c-9775-513fde88f395" (UID: "95845b5d-fcff-486c-9775-513fde88f395"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 13:52:59.126502 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:59.126476 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95845b5d-fcff-486c-9775-513fde88f395-kube-api-access-j7qcr" (OuterVolumeSpecName: "kube-api-access-j7qcr") pod "95845b5d-fcff-486c-9775-513fde88f395" (UID: "95845b5d-fcff-486c-9775-513fde88f395"). InnerVolumeSpecName "kube-api-access-j7qcr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:52:59.126579 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:59.126547 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95845b5d-fcff-486c-9775-513fde88f395-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "95845b5d-fcff-486c-9775-513fde88f395" (UID: "95845b5d-fcff-486c-9775-513fde88f395"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:52:59.225567 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:59.225522 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7qcr\" (UniqueName: \"kubernetes.io/projected/95845b5d-fcff-486c-9775-513fde88f395-kube-api-access-j7qcr\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:52:59.225567 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:59.225563 2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95845b5d-fcff-486c-9775-513fde88f395-openshift-service-ca\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:52:59.225567 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:59.225576 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95845b5d-fcff-486c-9775-513fde88f395-maas-api-tls\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:52:59.425784 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:59.425696 2577 generic.go:356] "Generic (PLEG): container finished" podID="95845b5d-fcff-486c-9775-513fde88f395" containerID="1ffb5e8d33bd35c165049ee201ff7d7b2fcf22cbc129071988c1aac1b2c5ebee" exitCode=0 Jul 05 13:52:59.425784 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:59.425739 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj" Jul 05 13:52:59.425958 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:59.425785 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj" event={"ID":"95845b5d-fcff-486c-9775-513fde88f395","Type":"ContainerDied","Data":"1ffb5e8d33bd35c165049ee201ff7d7b2fcf22cbc129071988c1aac1b2c5ebee"} Jul 05 13:52:59.425958 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:59.425835 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj" event={"ID":"95845b5d-fcff-486c-9775-513fde88f395","Type":"ContainerDied","Data":"abfc0ae493377d9791980e310c60a89cd713cdd1593b8a751a83b09973f5d666"} Jul 05 13:52:59.425958 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:59.425857 2577 scope.go:117] "RemoveContainer" containerID="1ffb5e8d33bd35c165049ee201ff7d7b2fcf22cbc129071988c1aac1b2c5ebee" Jul 05 13:52:59.434034 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:59.434014 2577 scope.go:117] "RemoveContainer" containerID="1ffb5e8d33bd35c165049ee201ff7d7b2fcf22cbc129071988c1aac1b2c5ebee" Jul 05 13:52:59.434319 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:52:59.434296 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ffb5e8d33bd35c165049ee201ff7d7b2fcf22cbc129071988c1aac1b2c5ebee\": container with ID starting with 1ffb5e8d33bd35c165049ee201ff7d7b2fcf22cbc129071988c1aac1b2c5ebee not found: ID does not exist" containerID="1ffb5e8d33bd35c165049ee201ff7d7b2fcf22cbc129071988c1aac1b2c5ebee" Jul 05 13:52:59.434411 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:59.434326 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ffb5e8d33bd35c165049ee201ff7d7b2fcf22cbc129071988c1aac1b2c5ebee"} err="failed to get container status \"1ffb5e8d33bd35c165049ee201ff7d7b2fcf22cbc129071988c1aac1b2c5ebee\": rpc error: code = NotFound desc = could not find container \"1ffb5e8d33bd35c165049ee201ff7d7b2fcf22cbc129071988c1aac1b2c5ebee\": container with ID starting with 1ffb5e8d33bd35c165049ee201ff7d7b2fcf22cbc129071988c1aac1b2c5ebee not found: ID does not exist" Jul 05 13:52:59.446475 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:59.446450 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj"] Jul 05 13:52:59.449556 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:52:59.449535 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-ed2315-6dfc994f67-cdpqj"] Jul 05 13:53:00.234588 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:00.234553 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95845b5d-fcff-486c-9775-513fde88f395" path="/var/lib/kubelet/pods/95845b5d-fcff-486c-9775-513fde88f395/volumes" Jul 05 13:53:09.116692 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:09.116597 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk"] Jul 05 13:53:09.117027 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:09.116907 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc42e186-b415-43c1-af89-b44b9885fc6a" containerName="maas-api" Jul 05 13:53:09.117027 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:09.116919 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc42e186-b415-43c1-af89-b44b9885fc6a" containerName="maas-api" Jul 05 13:53:09.117027 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:09.116936 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95845b5d-fcff-486c-9775-513fde88f395" containerName="maas-api" Jul 05 13:53:09.117027 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:09.116952 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="95845b5d-fcff-486c-9775-513fde88f395" containerName="maas-api" Jul 05 13:53:09.117027 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:09.117003 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc42e186-b415-43c1-af89-b44b9885fc6a" containerName="maas-api" Jul 05 13:53:09.117027 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:09.117013 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="95845b5d-fcff-486c-9775-513fde88f395" containerName="maas-api" Jul 05 13:53:09.121089 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:09.121071 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" Jul 05 13:53:09.123848 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:09.123825 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-6096ec-serving-cert\"" Jul 05 13:53:09.142989 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:09.142966 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk"] Jul 05 13:53:09.211470 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:09.211443 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3945ac6-36f7-4900-aedf-b4b290ed6080-maas-api-tls\") pod \"maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk\" (UID: \"f3945ac6-36f7-4900-aedf-b4b290ed6080\") " pod="opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" Jul 05 13:53:09.211610 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:09.211473 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3945ac6-36f7-4900-aedf-b4b290ed6080-openshift-service-ca\") pod \"maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk\" (UID: \"f3945ac6-36f7-4900-aedf-b4b290ed6080\") " pod="opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" Jul 05 13:53:09.211610 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:09.211515 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcw9p\" (UniqueName: \"kubernetes.io/projected/f3945ac6-36f7-4900-aedf-b4b290ed6080-kube-api-access-rcw9p\") pod \"maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk\" (UID: \"f3945ac6-36f7-4900-aedf-b4b290ed6080\") " pod="opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" Jul 05 13:53:09.312547 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:09.312517 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3945ac6-36f7-4900-aedf-b4b290ed6080-maas-api-tls\") pod \"maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk\" (UID: \"f3945ac6-36f7-4900-aedf-b4b290ed6080\") " pod="opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" Jul 05 13:53:09.312547 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:09.312547 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3945ac6-36f7-4900-aedf-b4b290ed6080-openshift-service-ca\") pod \"maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk\" (UID: \"f3945ac6-36f7-4900-aedf-b4b290ed6080\") " pod="opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" Jul 05 13:53:09.312851 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:09.312587 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcw9p\" (UniqueName: \"kubernetes.io/projected/f3945ac6-36f7-4900-aedf-b4b290ed6080-kube-api-access-rcw9p\") pod \"maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk\" (UID: \"f3945ac6-36f7-4900-aedf-b4b290ed6080\") " pod="opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" Jul 05 13:53:09.312851 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:53:09.312706 2577 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-6096ec-serving-cert: secret "maas-api-e2e-shared-a-6096ec-serving-cert" not found Jul 05 13:53:09.312851 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:53:09.312782 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3945ac6-36f7-4900-aedf-b4b290ed6080-maas-api-tls podName:f3945ac6-36f7-4900-aedf-b4b290ed6080 nodeName:}" failed. No retries permitted until 2026-07-05 13:53:09.812760035 +0000 UTC m=+2066.186036060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f3945ac6-36f7-4900-aedf-b4b290ed6080-maas-api-tls") pod "maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" (UID: "f3945ac6-36f7-4900-aedf-b4b290ed6080") : secret "maas-api-e2e-shared-a-6096ec-serving-cert" not found Jul 05 13:53:09.313233 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:09.313213 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3945ac6-36f7-4900-aedf-b4b290ed6080-openshift-service-ca\") pod \"maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk\" (UID: \"f3945ac6-36f7-4900-aedf-b4b290ed6080\") " pod="opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" Jul 05 13:53:09.324122 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:09.324094 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcw9p\" (UniqueName: \"kubernetes.io/projected/f3945ac6-36f7-4900-aedf-b4b290ed6080-kube-api-access-rcw9p\") pod \"maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk\" (UID: \"f3945ac6-36f7-4900-aedf-b4b290ed6080\") " pod="opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" Jul 05 13:53:09.823152 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:09.823108 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3945ac6-36f7-4900-aedf-b4b290ed6080-maas-api-tls\") pod \"maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk\" (UID: \"f3945ac6-36f7-4900-aedf-b4b290ed6080\") " pod="opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" Jul 05 13:53:09.825550 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:09.825523 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3945ac6-36f7-4900-aedf-b4b290ed6080-maas-api-tls\") pod \"maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk\" (UID: \"f3945ac6-36f7-4900-aedf-b4b290ed6080\") " pod="opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" Jul 05 13:53:10.030770 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:10.030733 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" Jul 05 13:53:10.170514 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:10.170479 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk"] Jul 05 13:53:10.172455 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:53:10.172426 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3945ac6_36f7_4900_aedf_b4b290ed6080.slice/crio-676aee35ec754cf541eab9c251958cad89bbd8f04c6aaee2c5f225f929962cde WatchSource:0}: Error finding container 676aee35ec754cf541eab9c251958cad89bbd8f04c6aaee2c5f225f929962cde: Status 404 returned error can't find the container with id 676aee35ec754cf541eab9c251958cad89bbd8f04c6aaee2c5f225f929962cde Jul 05 13:53:10.473681 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:10.473585 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" event={"ID":"f3945ac6-36f7-4900-aedf-b4b290ed6080","Type":"ContainerStarted","Data":"676aee35ec754cf541eab9c251958cad89bbd8f04c6aaee2c5f225f929962cde"} Jul 05 13:53:11.480172 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:11.480139 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" event={"ID":"f3945ac6-36f7-4900-aedf-b4b290ed6080","Type":"ContainerStarted","Data":"118bab3a995bd6d9dd6b216f53df29ed44537e58d70548212073dc9216aaebbc"} Jul 05 13:53:11.480577 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:11.480268 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" Jul 05 13:53:11.502264 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:11.502212 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" podStartSLOduration=2.160026999 podStartE2EDuration="2.502192571s" totalImagesPullingTime="342.165572ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:53:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:53:11.500344551 +0000 UTC m=+2067.873620565" watchObservedRunningTime="2026-07-05 13:53:11.502192571 +0000 UTC m=+2067.875468603" Jul 05 13:53:16.960499 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:16.960460 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2"] Jul 05 13:53:16.964192 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:16.964166 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" Jul 05 13:53:16.966966 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:16.966943 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-6579e1-serving-cert\"" Jul 05 13:53:16.974292 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:16.974262 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2"] Jul 05 13:53:17.084961 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:17.084930 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a14eb4e-df68-4695-be1d-98cfc994a11f-maas-api-tls\") pod \"maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2\" (UID: \"8a14eb4e-df68-4695-be1d-98cfc994a11f\") " pod="opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" Jul 05 13:53:17.085139 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:17.084970 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5svk\" (UniqueName: \"kubernetes.io/projected/8a14eb4e-df68-4695-be1d-98cfc994a11f-kube-api-access-r5svk\") pod \"maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2\" (UID: \"8a14eb4e-df68-4695-be1d-98cfc994a11f\") " pod="opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" Jul 05 13:53:17.085139 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:17.084998 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a14eb4e-df68-4695-be1d-98cfc994a11f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2\" (UID: \"8a14eb4e-df68-4695-be1d-98cfc994a11f\") " pod="opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" Jul 05 13:53:17.186231 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:17.186193 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a14eb4e-df68-4695-be1d-98cfc994a11f-maas-api-tls\") pod \"maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2\" (UID: \"8a14eb4e-df68-4695-be1d-98cfc994a11f\") " pod="opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" Jul 05 13:53:17.186231 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:17.186232 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5svk\" (UniqueName: \"kubernetes.io/projected/8a14eb4e-df68-4695-be1d-98cfc994a11f-kube-api-access-r5svk\") pod \"maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2\" (UID: \"8a14eb4e-df68-4695-be1d-98cfc994a11f\") " pod="opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" Jul 05 13:53:17.186478 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:17.186256 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a14eb4e-df68-4695-be1d-98cfc994a11f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2\" (UID: \"8a14eb4e-df68-4695-be1d-98cfc994a11f\") " pod="opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" Jul 05 13:53:17.186478 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:53:17.186363 2577 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-b-6579e1-serving-cert: secret "maas-api-e2e-shared-b-6579e1-serving-cert" not found Jul 05 13:53:17.186478 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:53:17.186431 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8a14eb4e-df68-4695-be1d-98cfc994a11f-maas-api-tls podName:8a14eb4e-df68-4695-be1d-98cfc994a11f nodeName:}" failed. No retries permitted until 2026-07-05 13:53:17.6864117 +0000 UTC m=+2074.059687710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8a14eb4e-df68-4695-be1d-98cfc994a11f-maas-api-tls") pod "maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" (UID: "8a14eb4e-df68-4695-be1d-98cfc994a11f") : secret "maas-api-e2e-shared-b-6579e1-serving-cert" not found Jul 05 13:53:17.186927 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:17.186906 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a14eb4e-df68-4695-be1d-98cfc994a11f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2\" (UID: \"8a14eb4e-df68-4695-be1d-98cfc994a11f\") " pod="opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" Jul 05 13:53:17.209747 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:17.209715 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5svk\" (UniqueName: \"kubernetes.io/projected/8a14eb4e-df68-4695-be1d-98cfc994a11f-kube-api-access-r5svk\") pod \"maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2\" (UID: \"8a14eb4e-df68-4695-be1d-98cfc994a11f\") " pod="opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" Jul 05 13:53:17.489193 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:17.489169 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" Jul 05 13:53:17.690143 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:17.690104 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a14eb4e-df68-4695-be1d-98cfc994a11f-maas-api-tls\") pod \"maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2\" (UID: \"8a14eb4e-df68-4695-be1d-98cfc994a11f\") " pod="opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" Jul 05 13:53:17.692505 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:17.692482 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a14eb4e-df68-4695-be1d-98cfc994a11f-maas-api-tls\") pod \"maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2\" (UID: \"8a14eb4e-df68-4695-be1d-98cfc994a11f\") " pod="opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" Jul 05 13:53:17.875218 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:17.875185 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" Jul 05 13:53:18.021473 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:18.021451 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2"] Jul 05 13:53:18.023857 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:53:18.023829 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a14eb4e_df68_4695_be1d_98cfc994a11f.slice/crio-674aa2b47d7c969b29f6fc009b647a4223ca8c6ccf6c3c6b7cbce3db2b74ee77 WatchSource:0}: Error finding container 674aa2b47d7c969b29f6fc009b647a4223ca8c6ccf6c3c6b7cbce3db2b74ee77: Status 404 returned error can't find the container with id 674aa2b47d7c969b29f6fc009b647a4223ca8c6ccf6c3c6b7cbce3db2b74ee77 Jul 05 13:53:18.512495 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:18.512461 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" event={"ID":"8a14eb4e-df68-4695-be1d-98cfc994a11f","Type":"ContainerStarted","Data":"3985533e5396ad8d5398c429e5817750c09a98f388b1f53ca07e0da5e4076665"} Jul 05 13:53:18.512669 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:18.512511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" event={"ID":"8a14eb4e-df68-4695-be1d-98cfc994a11f","Type":"ContainerStarted","Data":"674aa2b47d7c969b29f6fc009b647a4223ca8c6ccf6c3c6b7cbce3db2b74ee77"} Jul 05 13:53:18.512669 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:18.512575 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" Jul 05 13:53:18.542510 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:18.542463 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" podStartSLOduration=2.221618668 podStartE2EDuration="2.542444194s" totalImagesPullingTime="320.825526ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:53:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:53:18.541784523 +0000 UTC m=+2074.915060552" watchObservedRunningTime="2026-07-05 13:53:18.542444194 +0000 UTC m=+2074.915720228" Jul 05 13:53:24.522272 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:53:24.522236 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" Jul 05 13:55:58.653276 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.653241 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5"] Jul 05 13:55:58.656445 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.656427 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:55:58.659793 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.659734 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6096ec\"/\"kube-root-ca.crt\"" Jul 05 13:55:58.659793 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.659772 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6096ec\"/\"sub-test-model-6096ec-kserve-self-signed-certs\"" Jul 05 13:55:58.659975 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.659828 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-6096ec\"/\"default-dockercfg-djr8f\"" Jul 05 13:55:58.659975 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.659840 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-6096ec\"/\"openshift-service-ca.crt\"" Jul 05 13:55:58.667374 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.667353 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5"] Jul 05 13:55:58.831027 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.830992 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-model-cache\") pod \"sub-test-model-6096ec-kserve-ff89b6585-rj7s5\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:55:58.831226 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.831032 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-tls-certs\") pod \"sub-test-model-6096ec-kserve-ff89b6585-rj7s5\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:55:58.831226 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.831072 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-home\") pod \"sub-test-model-6096ec-kserve-ff89b6585-rj7s5\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:55:58.831226 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.831160 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-tmp-dir\") pod \"sub-test-model-6096ec-kserve-ff89b6585-rj7s5\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:55:58.831226 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.831193 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znqs9\" (UniqueName: \"kubernetes.io/projected/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-kube-api-access-znqs9\") pod \"sub-test-model-6096ec-kserve-ff89b6585-rj7s5\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:55:58.831374 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.831268 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-dshm\") pod \"sub-test-model-6096ec-kserve-ff89b6585-rj7s5\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:55:58.931922 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.931845 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-model-cache\") pod \"sub-test-model-6096ec-kserve-ff89b6585-rj7s5\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:55:58.931922 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.931881 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-tls-certs\") pod \"sub-test-model-6096ec-kserve-ff89b6585-rj7s5\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:55:58.931922 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.931899 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-home\") pod \"sub-test-model-6096ec-kserve-ff89b6585-rj7s5\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:55:58.931922 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.931922 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-tmp-dir\") pod \"sub-test-model-6096ec-kserve-ff89b6585-rj7s5\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:55:58.932287 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.931946 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znqs9\" (UniqueName: \"kubernetes.io/projected/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-kube-api-access-znqs9\") pod \"sub-test-model-6096ec-kserve-ff89b6585-rj7s5\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:55:58.932287 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.931984 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-dshm\") pod \"sub-test-model-6096ec-kserve-ff89b6585-rj7s5\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:55:58.932430 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.932330 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-tmp-dir\") pod \"sub-test-model-6096ec-kserve-ff89b6585-rj7s5\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:55:58.932430 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.932381 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-model-cache\") pod \"sub-test-model-6096ec-kserve-ff89b6585-rj7s5\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:55:58.932430 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.932414 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-home\") pod \"sub-test-model-6096ec-kserve-ff89b6585-rj7s5\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:55:58.934226 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.934199 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-dshm\") pod \"sub-test-model-6096ec-kserve-ff89b6585-rj7s5\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:55:58.934466 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.934447 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-tls-certs\") pod \"sub-test-model-6096ec-kserve-ff89b6585-rj7s5\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:55:58.942602 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.942581 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znqs9\" (UniqueName: \"kubernetes.io/projected/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-kube-api-access-znqs9\") pod \"sub-test-model-6096ec-kserve-ff89b6585-rj7s5\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:55:58.967699 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:58.967670 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:55:59.093711 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:59.093689 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5"] Jul 05 13:55:59.095663 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:55:59.095625 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51a8133a_8a1a_417a_aa1a_2e4fb85f64d4.slice/crio-d0f03daa09c3b8b8981c6c3635cb216447b064ba167d2eacc1874371191a5738 WatchSource:0}: Error finding container d0f03daa09c3b8b8981c6c3635cb216447b064ba167d2eacc1874371191a5738: Status 404 returned error can't find the container with id d0f03daa09c3b8b8981c6c3635cb216447b064ba167d2eacc1874371191a5738 Jul 05 13:55:59.175590 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:59.175516 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" event={"ID":"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4","Type":"ContainerStarted","Data":"8334c5743b2e5385a8bbc1f3d61e5802fe4cbd3ebf131b32f61b1e3ed9047ccd"} Jul 05 13:55:59.175590 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:59.175564 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" event={"ID":"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4","Type":"ContainerStarted","Data":"d0f03daa09c3b8b8981c6c3635cb216447b064ba167d2eacc1874371191a5738"} Jul 05 13:55:59.193045 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:55:59.192939 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" podStartSLOduration=1.192917566 podStartE2EDuration="1.192917566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 13:55:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:55:59.192134932 +0000 UTC m=+2235.565410988" watchObservedRunningTime="2026-07-05 13:55:59.192917566 +0000 UTC m=+2235.566193601" Jul 05 13:56:08.967920 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:56:08.967835 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:56:08.967920 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:56:08.967884 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:56:08.980424 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:56:08.980397 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:56:09.226034 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:56:09.225950 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:57:07.384386 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:07.384351 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5"] Jul 05 13:57:22.404137 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:22.404084 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" podUID="51a8133a-8a1a-417a-aa1a-2e4fb85f64d4" containerName="main" containerID="cri-o://8334c5743b2e5385a8bbc1f3d61e5802fe4cbd3ebf131b32f61b1e3ed9047ccd" gracePeriod=45 Jul 05 13:57:22.640048 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:22.640025 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:57:22.722607 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:22.722527 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znqs9\" (UniqueName: \"kubernetes.io/projected/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-kube-api-access-znqs9\") pod \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " Jul 05 13:57:22.722607 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:22.722581 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-home\") pod \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " Jul 05 13:57:22.722814 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:22.722625 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-dshm\") pod \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " Jul 05 13:57:22.722814 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:22.722678 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-tmp-dir\") pod \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " Jul 05 13:57:22.722814 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:22.722709 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-tls-certs\") pod \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " Jul 05 13:57:22.722814 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:22.722790 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-model-cache\") pod \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\" (UID: \"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4\") " Jul 05 13:57:22.723022 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:22.722874 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-home" (OuterVolumeSpecName: "home") pod "51a8133a-8a1a-417a-aa1a-2e4fb85f64d4" (UID: "51a8133a-8a1a-417a-aa1a-2e4fb85f64d4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 13:57:22.723022 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:22.722954 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "51a8133a-8a1a-417a-aa1a-2e4fb85f64d4" (UID: "51a8133a-8a1a-417a-aa1a-2e4fb85f64d4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 13:57:22.723126 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:22.723038 2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-home\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:57:22.723126 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:22.723082 2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-tmp-dir\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:57:22.723126 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:22.723109 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-model-cache" (OuterVolumeSpecName: "model-cache") pod "51a8133a-8a1a-417a-aa1a-2e4fb85f64d4" (UID: "51a8133a-8a1a-417a-aa1a-2e4fb85f64d4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 13:57:22.724853 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:22.724827 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-dshm" (OuterVolumeSpecName: "dshm") pod "51a8133a-8a1a-417a-aa1a-2e4fb85f64d4" (UID: "51a8133a-8a1a-417a-aa1a-2e4fb85f64d4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 05 13:57:22.724957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:22.724895 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "51a8133a-8a1a-417a-aa1a-2e4fb85f64d4" (UID: "51a8133a-8a1a-417a-aa1a-2e4fb85f64d4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:57:22.724957 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:22.724925 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-kube-api-access-znqs9" (OuterVolumeSpecName: "kube-api-access-znqs9") pod "51a8133a-8a1a-417a-aa1a-2e4fb85f64d4" (UID: "51a8133a-8a1a-417a-aa1a-2e4fb85f64d4"). InnerVolumeSpecName "kube-api-access-znqs9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:57:22.824372 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:22.824326 2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-model-cache\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:57:22.824372 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:22.824367 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znqs9\" (UniqueName: \"kubernetes.io/projected/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-kube-api-access-znqs9\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:57:22.824372 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:22.824378 2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-dshm\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:57:22.824598 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:22.824386 2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4-tls-certs\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:57:23.518028 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:23.517999 2577 generic.go:356] "Generic (PLEG): container finished" podID="51a8133a-8a1a-417a-aa1a-2e4fb85f64d4" containerID="8334c5743b2e5385a8bbc1f3d61e5802fe4cbd3ebf131b32f61b1e3ed9047ccd" exitCode=0 Jul 05 13:57:23.518467 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:23.518036 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" Jul 05 13:57:23.518467 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:23.518074 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" event={"ID":"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4","Type":"ContainerDied","Data":"8334c5743b2e5385a8bbc1f3d61e5802fe4cbd3ebf131b32f61b1e3ed9047ccd"} Jul 05 13:57:23.518467 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:23.518126 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5" event={"ID":"51a8133a-8a1a-417a-aa1a-2e4fb85f64d4","Type":"ContainerDied","Data":"d0f03daa09c3b8b8981c6c3635cb216447b064ba167d2eacc1874371191a5738"} Jul 05 13:57:23.518467 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:23.518154 2577 scope.go:117] "RemoveContainer" containerID="8334c5743b2e5385a8bbc1f3d61e5802fe4cbd3ebf131b32f61b1e3ed9047ccd" Jul 05 13:57:23.526518 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:23.526502 2577 scope.go:117] "RemoveContainer" containerID="8334c5743b2e5385a8bbc1f3d61e5802fe4cbd3ebf131b32f61b1e3ed9047ccd" Jul 05 13:57:23.526796 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:57:23.526769 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8334c5743b2e5385a8bbc1f3d61e5802fe4cbd3ebf131b32f61b1e3ed9047ccd\": container with ID starting with 8334c5743b2e5385a8bbc1f3d61e5802fe4cbd3ebf131b32f61b1e3ed9047ccd not found: ID does not exist" containerID="8334c5743b2e5385a8bbc1f3d61e5802fe4cbd3ebf131b32f61b1e3ed9047ccd" Jul 05 13:57:23.526882 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:23.526807 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8334c5743b2e5385a8bbc1f3d61e5802fe4cbd3ebf131b32f61b1e3ed9047ccd"} err="failed to get container status \"8334c5743b2e5385a8bbc1f3d61e5802fe4cbd3ebf131b32f61b1e3ed9047ccd\": rpc error: code = NotFound desc = could not find container \"8334c5743b2e5385a8bbc1f3d61e5802fe4cbd3ebf131b32f61b1e3ed9047ccd\": container with ID starting with 8334c5743b2e5385a8bbc1f3d61e5802fe4cbd3ebf131b32f61b1e3ed9047ccd not found: ID does not exist" Jul 05 13:57:23.539811 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:23.539786 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5"] Jul 05 13:57:23.543625 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:23.543603 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-6096ec/sub-test-model-6096ec-kserve-ff89b6585-rj7s5"] Jul 05 13:57:24.234876 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:57:24.234845 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51a8133a-8a1a-417a-aa1a-2e4fb85f64d4" path="/var/lib/kubelet/pods/51a8133a-8a1a-417a-aa1a-2e4fb85f64d4/volumes" Jul 05 13:58:37.139622 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:58:37.139585 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk"] Jul 05 13:58:37.140143 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:58:37.139824 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" podUID="f3945ac6-36f7-4900-aedf-b4b290ed6080" containerName="maas-api" containerID="cri-o://118bab3a995bd6d9dd6b216f53df29ed44537e58d70548212073dc9216aaebbc" gracePeriod=30 Jul 05 13:58:37.383120 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:58:37.383096 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" Jul 05 13:58:37.538487 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:58:37.538393 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3945ac6-36f7-4900-aedf-b4b290ed6080-maas-api-tls\") pod \"f3945ac6-36f7-4900-aedf-b4b290ed6080\" (UID: \"f3945ac6-36f7-4900-aedf-b4b290ed6080\") " Jul 05 13:58:37.538487 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:58:37.538473 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3945ac6-36f7-4900-aedf-b4b290ed6080-openshift-service-ca\") pod \"f3945ac6-36f7-4900-aedf-b4b290ed6080\" (UID: \"f3945ac6-36f7-4900-aedf-b4b290ed6080\") " Jul 05 13:58:37.538698 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:58:37.538525 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcw9p\" (UniqueName: \"kubernetes.io/projected/f3945ac6-36f7-4900-aedf-b4b290ed6080-kube-api-access-rcw9p\") pod \"f3945ac6-36f7-4900-aedf-b4b290ed6080\" (UID: \"f3945ac6-36f7-4900-aedf-b4b290ed6080\") " Jul 05 13:58:37.538904 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:58:37.538876 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3945ac6-36f7-4900-aedf-b4b290ed6080-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f3945ac6-36f7-4900-aedf-b4b290ed6080" (UID: "f3945ac6-36f7-4900-aedf-b4b290ed6080"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 13:58:37.540565 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:58:37.540546 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3945ac6-36f7-4900-aedf-b4b290ed6080-kube-api-access-rcw9p" (OuterVolumeSpecName: "kube-api-access-rcw9p") pod "f3945ac6-36f7-4900-aedf-b4b290ed6080" (UID: "f3945ac6-36f7-4900-aedf-b4b290ed6080"). InnerVolumeSpecName "kube-api-access-rcw9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:58:37.540623 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:58:37.540601 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3945ac6-36f7-4900-aedf-b4b290ed6080-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f3945ac6-36f7-4900-aedf-b4b290ed6080" (UID: "f3945ac6-36f7-4900-aedf-b4b290ed6080"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:58:37.639247 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:58:37.639211 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3945ac6-36f7-4900-aedf-b4b290ed6080-maas-api-tls\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:58:37.639247 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:58:37.639239 2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3945ac6-36f7-4900-aedf-b4b290ed6080-openshift-service-ca\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:58:37.639247 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:58:37.639249 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcw9p\" (UniqueName: \"kubernetes.io/projected/f3945ac6-36f7-4900-aedf-b4b290ed6080-kube-api-access-rcw9p\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:58:37.826224 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:58:37.826168 2577 generic.go:356] "Generic (PLEG): container finished" podID="f3945ac6-36f7-4900-aedf-b4b290ed6080" containerID="118bab3a995bd6d9dd6b216f53df29ed44537e58d70548212073dc9216aaebbc" exitCode=0 Jul 05 13:58:37.826224 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:58:37.826208 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" event={"ID":"f3945ac6-36f7-4900-aedf-b4b290ed6080","Type":"ContainerDied","Data":"118bab3a995bd6d9dd6b216f53df29ed44537e58d70548212073dc9216aaebbc"} Jul 05 13:58:37.826224 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:58:37.826224 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" Jul 05 13:58:37.826471 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:58:37.826261 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk" event={"ID":"f3945ac6-36f7-4900-aedf-b4b290ed6080","Type":"ContainerDied","Data":"676aee35ec754cf541eab9c251958cad89bbd8f04c6aaee2c5f225f929962cde"} Jul 05 13:58:37.826471 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:58:37.826291 2577 scope.go:117] "RemoveContainer" containerID="118bab3a995bd6d9dd6b216f53df29ed44537e58d70548212073dc9216aaebbc" Jul 05 13:58:37.835056 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:58:37.835036 2577 scope.go:117] "RemoveContainer" containerID="118bab3a995bd6d9dd6b216f53df29ed44537e58d70548212073dc9216aaebbc" Jul 05 13:58:37.835308 ip-10-0-132-227 kubenswrapper[2577]: E0705 13:58:37.835290 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"118bab3a995bd6d9dd6b216f53df29ed44537e58d70548212073dc9216aaebbc\": container with ID starting with 118bab3a995bd6d9dd6b216f53df29ed44537e58d70548212073dc9216aaebbc not found: ID does not exist" containerID="118bab3a995bd6d9dd6b216f53df29ed44537e58d70548212073dc9216aaebbc" Jul 05 13:58:37.835363 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:58:37.835319 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"118bab3a995bd6d9dd6b216f53df29ed44537e58d70548212073dc9216aaebbc"} err="failed to get container status \"118bab3a995bd6d9dd6b216f53df29ed44537e58d70548212073dc9216aaebbc\": rpc error: code = NotFound desc = could not find container \"118bab3a995bd6d9dd6b216f53df29ed44537e58d70548212073dc9216aaebbc\": container with ID starting with 118bab3a995bd6d9dd6b216f53df29ed44537e58d70548212073dc9216aaebbc not found: ID does not exist" Jul 05 13:58:37.850532 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:58:37.850509 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk"] Jul 05 13:58:37.858954 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:58:37.858932 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-6096ec-6877688c46-5hjjk"] Jul 05 13:58:38.235679 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:58:38.235588 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3945ac6-36f7-4900-aedf-b4b290ed6080" path="/var/lib/kubelet/pods/f3945ac6-36f7-4900-aedf-b4b290ed6080/volumes" Jul 05 13:59:20.842858 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:20.842736 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2"] Jul 05 13:59:20.843408 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:20.842980 2577 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" podUID="8a14eb4e-df68-4695-be1d-98cfc994a11f" containerName="maas-api" containerID="cri-o://3985533e5396ad8d5398c429e5817750c09a98f388b1f53ca07e0da5e4076665" gracePeriod=30 Jul 05 13:59:21.001267 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:21.001231 2577 generic.go:356] "Generic (PLEG): container finished" podID="8a14eb4e-df68-4695-be1d-98cfc994a11f" containerID="3985533e5396ad8d5398c429e5817750c09a98f388b1f53ca07e0da5e4076665" exitCode=0 Jul 05 13:59:21.001410 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:21.001300 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" event={"ID":"8a14eb4e-df68-4695-be1d-98cfc994a11f","Type":"ContainerDied","Data":"3985533e5396ad8d5398c429e5817750c09a98f388b1f53ca07e0da5e4076665"} Jul 05 13:59:21.078683 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:21.078656 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" Jul 05 13:59:21.194617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:21.194551 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a14eb4e-df68-4695-be1d-98cfc994a11f-maas-api-tls\") pod \"8a14eb4e-df68-4695-be1d-98cfc994a11f\" (UID: \"8a14eb4e-df68-4695-be1d-98cfc994a11f\") " Jul 05 13:59:21.194617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:21.194593 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5svk\" (UniqueName: \"kubernetes.io/projected/8a14eb4e-df68-4695-be1d-98cfc994a11f-kube-api-access-r5svk\") pod \"8a14eb4e-df68-4695-be1d-98cfc994a11f\" (UID: \"8a14eb4e-df68-4695-be1d-98cfc994a11f\") " Jul 05 13:59:21.194617 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:21.194613 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a14eb4e-df68-4695-be1d-98cfc994a11f-openshift-service-ca\") pod \"8a14eb4e-df68-4695-be1d-98cfc994a11f\" (UID: \"8a14eb4e-df68-4695-be1d-98cfc994a11f\") " Jul 05 13:59:21.194985 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:21.194960 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a14eb4e-df68-4695-be1d-98cfc994a11f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8a14eb4e-df68-4695-be1d-98cfc994a11f" (UID: "8a14eb4e-df68-4695-be1d-98cfc994a11f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 05 13:59:21.196701 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:21.196675 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a14eb4e-df68-4695-be1d-98cfc994a11f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8a14eb4e-df68-4695-be1d-98cfc994a11f" (UID: "8a14eb4e-df68-4695-be1d-98cfc994a11f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 05 13:59:21.196781 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:21.196705 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a14eb4e-df68-4695-be1d-98cfc994a11f-kube-api-access-r5svk" (OuterVolumeSpecName: "kube-api-access-r5svk") pod "8a14eb4e-df68-4695-be1d-98cfc994a11f" (UID: "8a14eb4e-df68-4695-be1d-98cfc994a11f"). InnerVolumeSpecName "kube-api-access-r5svk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 13:59:21.295281 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:21.295248 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8a14eb4e-df68-4695-be1d-98cfc994a11f-maas-api-tls\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:59:21.295281 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:21.295277 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5svk\" (UniqueName: \"kubernetes.io/projected/8a14eb4e-df68-4695-be1d-98cfc994a11f-kube-api-access-r5svk\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:59:21.295457 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:21.295290 2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8a14eb4e-df68-4695-be1d-98cfc994a11f-openshift-service-ca\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 13:59:22.006409 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:22.006376 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" event={"ID":"8a14eb4e-df68-4695-be1d-98cfc994a11f","Type":"ContainerDied","Data":"674aa2b47d7c969b29f6fc009b647a4223ca8c6ccf6c3c6b7cbce3db2b74ee77"} Jul 05 13:59:22.006848 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:22.006455 2577 scope.go:117] "RemoveContainer" containerID="3985533e5396ad8d5398c429e5817750c09a98f388b1f53ca07e0da5e4076665" Jul 05 13:59:22.006848 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:22.006384 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2" Jul 05 13:59:22.028485 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:22.028458 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2"] Jul 05 13:59:22.032030 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:22.032009 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-6579e1-7cc9f6ffc-hhsp2"] Jul 05 13:59:22.235002 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:22.234969 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a14eb4e-df68-4695-be1d-98cfc994a11f" path="/var/lib/kubelet/pods/8a14eb4e-df68-4695-be1d-98cfc994a11f/volumes" Jul 05 13:59:33.593563 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:33.593516 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8555c8549f-5rzkx_40d4ff53-46d6-424b-b0c2-78c6f1301add/maas-api/0.log" Jul 05 13:59:33.802458 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:33.802430 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29720985-7nnl8_02e82422-8fe9-4ab1-ae38-c60d2c6d571d/cleanup/0.log" Jul 05 13:59:34.268136 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:34.268106 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4f468d94-29ndm_c63c9669-04e9-4a44-bb57-d92b31da6368/manager/0.log" Jul 05 13:59:34.274171 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:34.274152 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4f468d94-29ndm_c63c9669-04e9-4a44-bb57-d92b31da6368/copy-manifests/0.log" Jul 05 13:59:34.625748 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:34.625725 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-4jkl7_450277e1-2155-46de-ad6c-fb1e8a6ba713/postgres/0.log" Jul 05 13:59:37.107799 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:37.107769 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-pnnl5_6093aaa6-a8a6-4961-bf39-3a6e95a80a00/discovery/0.log" Jul 05 13:59:38.120005 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:38.119980 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-8fqm9_8e8a2578-a9c1-4c15-b1b5-c4a2bf2b4dd0/main/0.log" Jul 05 13:59:38.336041 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:38.336012 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-v4rz8_cb3d373e-c467-4d42-b781-57081532f5b7/main/0.log" Jul 05 13:59:45.093027 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:45.092996 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-f76k8_e32393bd-7852-45d8-864c-169ed011c28b/global-pull-secret-syncer/0.log" Jul 05 13:59:45.316538 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:45.316495 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xk5gp_0bac94b6-2965-4acf-9cd6-1a74309d4254/konnectivity-agent/0.log" Jul 05 13:59:45.335848 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:45.335805 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-227.ec2.internal_4599d8e1fbf9c314f1658bf65accfac0/haproxy/0.log" Jul 05 13:59:53.061240 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:53.061146 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-8h7lj_fdf6e11e-1418-4ee5-a10f-fc85fdc7f786/kube-state-metrics/0.log" Jul 05 13:59:53.081188 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:53.081162 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-8h7lj_fdf6e11e-1418-4ee5-a10f-fc85fdc7f786/kube-rbac-proxy-main/0.log" Jul 05 13:59:53.103422 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:53.103398 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-8h7lj_fdf6e11e-1418-4ee5-a10f-fc85fdc7f786/kube-rbac-proxy-self/0.log" Jul 05 13:59:53.196570 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:53.196532 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6b7x4_302c1e68-5cb5-445e-91f8-81bdb6cb89ce/node-exporter/0.log" Jul 05 13:59:53.283057 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:53.283033 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6b7x4_302c1e68-5cb5-445e-91f8-81bdb6cb89ce/kube-rbac-proxy/0.log" Jul 05 13:59:53.334742 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:53.334724 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6b7x4_302c1e68-5cb5-445e-91f8-81bdb6cb89ce/init-textfile/0.log" Jul 05 13:59:55.042265 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.042228 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb"] Jul 05 13:59:55.042690 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.042588 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3945ac6-36f7-4900-aedf-b4b290ed6080" containerName="maas-api" Jul 05 13:59:55.042690 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.042607 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3945ac6-36f7-4900-aedf-b4b290ed6080" containerName="maas-api" Jul 05 13:59:55.042690 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.042621 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51a8133a-8a1a-417a-aa1a-2e4fb85f64d4" containerName="main" Jul 05 13:59:55.042690 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.042627 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="51a8133a-8a1a-417a-aa1a-2e4fb85f64d4" containerName="main" Jul 05 13:59:55.042690 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.042653 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a14eb4e-df68-4695-be1d-98cfc994a11f" containerName="maas-api" Jul 05 13:59:55.042690 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.042659 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a14eb4e-df68-4695-be1d-98cfc994a11f" containerName="maas-api" Jul 05 13:59:55.042883 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.042717 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a14eb4e-df68-4695-be1d-98cfc994a11f" containerName="maas-api" Jul 05 13:59:55.042883 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.042728 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3945ac6-36f7-4900-aedf-b4b290ed6080" containerName="maas-api" Jul 05 13:59:55.042883 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.042734 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="51a8133a-8a1a-417a-aa1a-2e4fb85f64d4" containerName="main" Jul 05 13:59:55.045607 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.045586 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb" Jul 05 13:59:55.047915 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.047895 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tjmkf\"/\"default-dockercfg-6mf8z\"" Jul 05 13:59:55.048822 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.048797 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tjmkf\"/\"kube-root-ca.crt\"" Jul 05 13:59:55.048822 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.048815 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tjmkf\"/\"openshift-service-ca.crt\"" Jul 05 13:59:55.059602 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.059577 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb"] Jul 05 13:59:55.060454 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.060437 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7306c1d1-adac-47f8-bf91-634953692e55-lib-modules\") pod \"perf-node-gather-daemonset-qcksb\" (UID: \"7306c1d1-adac-47f8-bf91-634953692e55\") " pod="openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb" Jul 05 13:59:55.060547 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.060463 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7306c1d1-adac-47f8-bf91-634953692e55-sys\") pod \"perf-node-gather-daemonset-qcksb\" (UID: \"7306c1d1-adac-47f8-bf91-634953692e55\") " pod="openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb" Jul 05 13:59:55.060600 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.060561 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7306c1d1-adac-47f8-bf91-634953692e55-podres\") pod \"perf-node-gather-daemonset-qcksb\" (UID: \"7306c1d1-adac-47f8-bf91-634953692e55\") " pod="openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb" Jul 05 13:59:55.060653 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.060609 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhh86\" (UniqueName: \"kubernetes.io/projected/7306c1d1-adac-47f8-bf91-634953692e55-kube-api-access-vhh86\") pod \"perf-node-gather-daemonset-qcksb\" (UID: \"7306c1d1-adac-47f8-bf91-634953692e55\") " pod="openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb" Jul 05 13:59:55.060653 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.060630 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7306c1d1-adac-47f8-bf91-634953692e55-proc\") pod \"perf-node-gather-daemonset-qcksb\" (UID: \"7306c1d1-adac-47f8-bf91-634953692e55\") " pod="openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb" Jul 05 13:59:55.161691 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.161661 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7306c1d1-adac-47f8-bf91-634953692e55-podres\") pod \"perf-node-gather-daemonset-qcksb\" (UID: \"7306c1d1-adac-47f8-bf91-634953692e55\") " pod="openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb" Jul 05 13:59:55.161871 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.161706 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhh86\" (UniqueName: \"kubernetes.io/projected/7306c1d1-adac-47f8-bf91-634953692e55-kube-api-access-vhh86\") pod \"perf-node-gather-daemonset-qcksb\" (UID: \"7306c1d1-adac-47f8-bf91-634953692e55\") " pod="openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb" Jul 05 13:59:55.161871 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.161729 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7306c1d1-adac-47f8-bf91-634953692e55-proc\") pod \"perf-node-gather-daemonset-qcksb\" (UID: \"7306c1d1-adac-47f8-bf91-634953692e55\") " pod="openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb" Jul 05 13:59:55.161871 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.161745 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7306c1d1-adac-47f8-bf91-634953692e55-lib-modules\") pod \"perf-node-gather-daemonset-qcksb\" (UID: \"7306c1d1-adac-47f8-bf91-634953692e55\") " pod="openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb" Jul 05 13:59:55.161871 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.161761 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7306c1d1-adac-47f8-bf91-634953692e55-sys\") pod \"perf-node-gather-daemonset-qcksb\" (UID: \"7306c1d1-adac-47f8-bf91-634953692e55\") " pod="openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb" Jul 05 13:59:55.161871 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.161836 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7306c1d1-adac-47f8-bf91-634953692e55-podres\") pod \"perf-node-gather-daemonset-qcksb\" (UID: \"7306c1d1-adac-47f8-bf91-634953692e55\") " pod="openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb" Jul 05 13:59:55.161871 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.161842 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7306c1d1-adac-47f8-bf91-634953692e55-sys\") pod \"perf-node-gather-daemonset-qcksb\" (UID: \"7306c1d1-adac-47f8-bf91-634953692e55\") " pod="openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb" Jul 05 13:59:55.161871 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.161841 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7306c1d1-adac-47f8-bf91-634953692e55-proc\") pod \"perf-node-gather-daemonset-qcksb\" (UID: \"7306c1d1-adac-47f8-bf91-634953692e55\") " pod="openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb" Jul 05 13:59:55.162121 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.161890 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7306c1d1-adac-47f8-bf91-634953692e55-lib-modules\") pod \"perf-node-gather-daemonset-qcksb\" (UID: \"7306c1d1-adac-47f8-bf91-634953692e55\") " pod="openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb" Jul 05 13:59:55.170863 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.170838 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhh86\" (UniqueName: \"kubernetes.io/projected/7306c1d1-adac-47f8-bf91-634953692e55-kube-api-access-vhh86\") pod \"perf-node-gather-daemonset-qcksb\" (UID: \"7306c1d1-adac-47f8-bf91-634953692e55\") " pod="openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb" Jul 05 13:59:55.355572 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.355531 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb" Jul 05 13:59:55.484858 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:55.484832 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb"] Jul 05 13:59:55.487099 ip-10-0-132-227 kubenswrapper[2577]: W0705 13:59:55.487073 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7306c1d1_adac_47f8_bf91_634953692e55.slice/crio-cfd5eb5a1a3a6bd5426e4cfb70d6ee5ff7e335dad28e87ec05d1e49114481c68 WatchSource:0}: Error finding container cfd5eb5a1a3a6bd5426e4cfb70d6ee5ff7e335dad28e87ec05d1e49114481c68: Status 404 returned error can't find the container with id cfd5eb5a1a3a6bd5426e4cfb70d6ee5ff7e335dad28e87ec05d1e49114481c68 Jul 05 13:59:56.149757 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:56.149721 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb" event={"ID":"7306c1d1-adac-47f8-bf91-634953692e55","Type":"ContainerStarted","Data":"836bbcd7eca83dc1761ac30801b2749dbba4aac42bf05fff5a2096e25cc6b118"} Jul 05 13:59:56.150147 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:56.149773 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb" event={"ID":"7306c1d1-adac-47f8-bf91-634953692e55","Type":"ContainerStarted","Data":"cfd5eb5a1a3a6bd5426e4cfb70d6ee5ff7e335dad28e87ec05d1e49114481c68"} Jul 05 13:59:56.150147 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:56.149831 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb" Jul 05 13:59:56.168309 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:56.168257 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb" podStartSLOduration=1.168242885 podStartE2EDuration="1.168242885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-05 13:59:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 13:59:56.167418996 +0000 UTC m=+2472.540695075" watchObservedRunningTime="2026-07-05 13:59:56.168242885 +0000 UTC m=+2472.541518917" Jul 05 13:59:57.984965 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:57.984933 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bx6rk_05aca99d-967b-4612-a4bf-eec008dea6a8/dns/0.log" Jul 05 13:59:58.008446 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:58.008420 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bx6rk_05aca99d-967b-4612-a4bf-eec008dea6a8/kube-rbac-proxy/0.log" Jul 05 13:59:58.174839 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:58.174810 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rpcxs_550ceb2c-2505-4654-802f-4de1c9384663/dns-node-resolver/0.log" Jul 05 13:59:58.803301 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:58.803271 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sjwl5_fb44c8db-1344-4303-adda-626772a8308f/node-ca/0.log" Jul 05 13:59:59.848492 ip-10-0-132-227 kubenswrapper[2577]: I0705 13:59:59.848461 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-pnnl5_6093aaa6-a8a6-4961-bf39-3a6e95a80a00/discovery/0.log" Jul 05 14:00:00.179132 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:00.179039 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29721000-tp552"] Jul 05 14:00:00.182202 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:00.182185 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721000-tp552" Jul 05 14:00:00.198259 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:00.198235 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6fbh\" (UniqueName: \"kubernetes.io/projected/e54a3862-35fa-44c3-8bbb-67a41c5e36a2-kube-api-access-s6fbh\") pod \"maas-api-key-cleanup-29721000-tp552\" (UID: \"e54a3862-35fa-44c3-8bbb-67a41c5e36a2\") " pod="opendatahub/maas-api-key-cleanup-29721000-tp552" Jul 05 14:00:00.207610 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:00.207590 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29721000-tp552"] Jul 05 14:00:00.299212 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:00.299174 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6fbh\" (UniqueName: \"kubernetes.io/projected/e54a3862-35fa-44c3-8bbb-67a41c5e36a2-kube-api-access-s6fbh\") pod \"maas-api-key-cleanup-29721000-tp552\" (UID: \"e54a3862-35fa-44c3-8bbb-67a41c5e36a2\") " pod="opendatahub/maas-api-key-cleanup-29721000-tp552" Jul 05 14:00:00.309061 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:00.309038 2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6fbh\" (UniqueName: \"kubernetes.io/projected/e54a3862-35fa-44c3-8bbb-67a41c5e36a2-kube-api-access-s6fbh\") pod \"maas-api-key-cleanup-29721000-tp552\" (UID: \"e54a3862-35fa-44c3-8bbb-67a41c5e36a2\") " pod="opendatahub/maas-api-key-cleanup-29721000-tp552" Jul 05 14:00:00.491262 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:00.491173 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721000-tp552" Jul 05 14:00:00.625103 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:00.625072 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29721000-tp552"] Jul 05 14:00:00.628608 ip-10-0-132-227 kubenswrapper[2577]: W0705 14:00:00.628575 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode54a3862_35fa_44c3_8bbb_67a41c5e36a2.slice/crio-d01767189f3fd6a6b389d0d199d9516b74c1bbd7813e964ab66cf363f7adcc1d WatchSource:0}: Error finding container d01767189f3fd6a6b389d0d199d9516b74c1bbd7813e964ab66cf363f7adcc1d: Status 404 returned error can't find the container with id d01767189f3fd6a6b389d0d199d9516b74c1bbd7813e964ab66cf363f7adcc1d Jul 05 14:00:00.873260 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:00.873237 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lmrck_7139a2d1-8d78-4ee6-810e-cadde0d0d131/serve-healthcheck-canary/0.log" Jul 05 14:00:01.171982 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:01.171941 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721000-tp552" event={"ID":"e54a3862-35fa-44c3-8bbb-67a41c5e36a2","Type":"ContainerStarted","Data":"274939daea5a2dd3936eaa498a9db09ef7302c51ffdc7311ab117bc445fd51d3"} Jul 05 14:00:01.172124 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:01.171998 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721000-tp552" event={"ID":"e54a3862-35fa-44c3-8bbb-67a41c5e36a2","Type":"ContainerStarted","Data":"d01767189f3fd6a6b389d0d199d9516b74c1bbd7813e964ab66cf363f7adcc1d"} Jul 05 14:00:01.191173 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:01.191121 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29721000-tp552" podStartSLOduration=1.191105268 podStartE2EDuration="1.191105268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-05 14:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-05 14:00:01.188961014 +0000 UTC m=+2477.562237070" watchObservedRunningTime="2026-07-05 14:00:01.191105268 +0000 UTC m=+2477.564381297" Jul 05 14:00:01.394810 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:01.394781 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2x7hd_9e28539f-e30b-42c4-8dc4-cb7289a76f15/kube-rbac-proxy/0.log" Jul 05 14:00:01.473671 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:01.473632 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2x7hd_9e28539f-e30b-42c4-8dc4-cb7289a76f15/exporter/0.log" Jul 05 14:00:01.510340 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:01.510314 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2x7hd_9e28539f-e30b-42c4-8dc4-cb7289a76f15/extractor/0.log" Jul 05 14:00:02.163308 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:02.163280 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tjmkf/perf-node-gather-daemonset-qcksb" Jul 05 14:00:02.177536 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:02.177506 2577 generic.go:356] "Generic (PLEG): container finished" podID="e54a3862-35fa-44c3-8bbb-67a41c5e36a2" containerID="274939daea5a2dd3936eaa498a9db09ef7302c51ffdc7311ab117bc445fd51d3" exitCode=0 Jul 05 14:00:02.177665 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:02.177555 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721000-tp552" event={"ID":"e54a3862-35fa-44c3-8bbb-67a41c5e36a2","Type":"ContainerDied","Data":"274939daea5a2dd3936eaa498a9db09ef7302c51ffdc7311ab117bc445fd51d3"} Jul 05 14:00:03.307967 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:03.307944 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721000-tp552" Jul 05 14:00:03.325556 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:03.325525 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6fbh\" (UniqueName: \"kubernetes.io/projected/e54a3862-35fa-44c3-8bbb-67a41c5e36a2-kube-api-access-s6fbh\") pod \"e54a3862-35fa-44c3-8bbb-67a41c5e36a2\" (UID: \"e54a3862-35fa-44c3-8bbb-67a41c5e36a2\") " Jul 05 14:00:03.327920 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:03.327890 2577 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e54a3862-35fa-44c3-8bbb-67a41c5e36a2-kube-api-access-s6fbh" (OuterVolumeSpecName: "kube-api-access-s6fbh") pod "e54a3862-35fa-44c3-8bbb-67a41c5e36a2" (UID: "e54a3862-35fa-44c3-8bbb-67a41c5e36a2"). InnerVolumeSpecName "kube-api-access-s6fbh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 05 14:00:03.426386 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:03.426344 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6fbh\" (UniqueName: \"kubernetes.io/projected/e54a3862-35fa-44c3-8bbb-67a41c5e36a2-kube-api-access-s6fbh\") on node \"ip-10-0-132-227.ec2.internal\" DevicePath \"\"" Jul 05 14:00:04.163918 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:04.163890 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8555c8549f-5rzkx_40d4ff53-46d6-424b-b0c2-78c6f1301add/maas-api/0.log" Jul 05 14:00:04.187605 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:04.187573 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29721000-tp552" event={"ID":"e54a3862-35fa-44c3-8bbb-67a41c5e36a2","Type":"ContainerDied","Data":"d01767189f3fd6a6b389d0d199d9516b74c1bbd7813e964ab66cf363f7adcc1d"} Jul 05 14:00:04.187605 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:04.187606 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29721000-tp552" Jul 05 14:00:04.187795 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:04.187620 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d01767189f3fd6a6b389d0d199d9516b74c1bbd7813e964ab66cf363f7adcc1d" Jul 05 14:00:04.212671 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:04.212629 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29720985-7nnl8_02e82422-8fe9-4ab1-ae38-c60d2c6d571d/cleanup/0.log" Jul 05 14:00:04.245232 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:04.245202 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29721000-tp552_e54a3862-35fa-44c3-8bbb-67a41c5e36a2/cleanup/0.log" Jul 05 14:00:04.481329 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:04.481265 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4f468d94-29ndm_c63c9669-04e9-4a44-bb57-d92b31da6368/manager/0.log" Jul 05 14:00:04.514993 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:04.514968 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b4f468d94-29ndm_c63c9669-04e9-4a44-bb57-d92b31da6368/copy-manifests/0.log" Jul 05 14:00:04.761597 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:04.761516 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-4jkl7_450277e1-2155-46de-ad6c-fb1e8a6ba713/postgres/0.log" Jul 05 14:00:06.142221 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:06.142102 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-pnnl5_6093aaa6-a8a6-4961-bf39-3a6e95a80a00/discovery/0.log" Jul 05 14:00:06.142592 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:06.142550 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6f6c4984d4-wv9pw_aaeed32b-6d71-47cd-a134-8357a7b8929b/manager/0.log" Jul 05 14:00:07.538367 ip-10-0-132-227 kubenswrapper[2577]: I0705 14:00:07.538331 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-pnnl5_6093aaa6-a8a6-4961-bf39-3a6e95a80a00/discovery/0.log"