Jul 21 14:58:51.573217 ip-10-0-133-162 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 21 14:58:51.573226 ip-10-0-133-162 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 21 14:58:51.573233 ip-10-0-133-162 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 21 14:58:51.573474 ip-10-0-133-162 systemd[1]: Failed to start Kubernetes Kubelet. Jul 21 14:59:01.732204 ip-10-0-133-162 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 21 14:59:01.732220 ip-10-0-133-162 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8d1c7803addd4d1d87e4b9288cbd0090 -- Jul 21 15:01:02.196220 ip-10-0-133-162 systemd[1]: Starting Kubernetes Kubelet... Jul 21 15:01:02.618443 ip-10-0-133-162 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 15:01:02.618443 ip-10-0-133-162 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 21 15:01:02.618443 ip-10-0-133-162 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 15:01:02.618443 ip-10-0-133-162 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 21 15:01:02.618443 ip-10-0-133-162 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 15:01:02.620619 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.620518 2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 21 15:01:02.624695 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624674 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 15:01:02.624695 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624694 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 15:01:02.624767 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624698 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 15:01:02.624767 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624702 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 15:01:02.624767 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624705 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 15:01:02.624767 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624709 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 15:01:02.624767 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624712 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 15:01:02.624767 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624716 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 15:01:02.624767 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624720 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 15:01:02.624767 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624724 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 15:01:02.624767 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624728 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 15:01:02.624767 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624731 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 15:01:02.624767 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624735 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 15:01:02.624767 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624738 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 15:01:02.624767 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624740 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 15:01:02.624767 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624744 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 15:01:02.624767 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624746 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 15:01:02.624767 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624749 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 15:01:02.624767 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624752 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 15:01:02.624767 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624755 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 15:01:02.624767 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624758 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 15:01:02.624767 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624761 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 15:01:02.625294 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624763 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 15:01:02.625294 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624767 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 15:01:02.625294 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624770 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 21 15:01:02.625294 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624773 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 15:01:02.625294 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624776 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 15:01:02.625294 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624780 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 15:01:02.625294 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624783 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 15:01:02.625294 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624786 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 15:01:02.625294 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624789 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 15:01:02.625294 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624792 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 15:01:02.625294 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624795 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 15:01:02.625294 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624797 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 15:01:02.625294 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624800 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 15:01:02.625294 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624809 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 15:01:02.625294 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624812 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 15:01:02.625294 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624815 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 15:01:02.625294 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624817 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 15:01:02.625294 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624820 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 15:01:02.625294 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624823 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 15:01:02.625294 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624825 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 15:01:02.625294 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624829 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 15:01:02.625851 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624832 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 15:01:02.625851 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624835 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 15:01:02.625851 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624837 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 15:01:02.625851 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624840 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 15:01:02.625851 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624842 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 15:01:02.625851 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624845 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 15:01:02.625851 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624848 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 15:01:02.625851 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624850 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 15:01:02.625851 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624853 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 15:01:02.625851 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624856 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 15:01:02.625851 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624859 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 15:01:02.625851 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624861 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 15:01:02.625851 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624865 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 15:01:02.625851 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624868 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 15:01:02.625851 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624871 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 15:01:02.625851 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624874 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 15:01:02.625851 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624877 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 15:01:02.625851 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624879 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 15:01:02.625851 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624883 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 15:01:02.626364 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624886 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 15:01:02.626364 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624888 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 15:01:02.626364 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624891 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 15:01:02.626364 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624894 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 15:01:02.626364 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624899 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 15:01:02.626364 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624903 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 15:01:02.626364 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624906 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 15:01:02.626364 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624908 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 15:01:02.626364 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624911 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 15:01:02.626364 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624916 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 15:01:02.626364 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624920 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 15:01:02.626364 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624923 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 15:01:02.626364 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624926 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 15:01:02.626364 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624939 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 15:01:02.626364 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624942 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 15:01:02.626364 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624946 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 15:01:02.626364 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624948 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 15:01:02.626364 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624951 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 15:01:02.626364 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624954 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 15:01:02.626848 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624957 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 15:01:02.626848 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624960 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 15:01:02.626848 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624963 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 15:01:02.626848 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624980 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 15:01:02.626848 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624983 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 15:01:02.626848 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624987 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 15:01:02.626848 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624991 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 15:01:02.626848 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624994 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 15:01:02.626848 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.624997 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 15:01:02.626848 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625000 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 15:01:02.626848 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625003 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 15:01:02.626848 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625006 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 15:01:02.626848 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625009 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 15:01:02.626848 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625011 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 15:01:02.626848 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625015 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 15:01:02.626848 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625018 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 15:01:02.626848 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625020 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 15:01:02.626848 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625025 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 15:01:02.626848 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625800 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 15:01:02.627447 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625809 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 15:01:02.627447 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625813 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 15:01:02.627447 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625816 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 15:01:02.627447 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625819 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 15:01:02.627447 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625823 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 15:01:02.627447 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625826 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 15:01:02.627447 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625829 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 15:01:02.627447 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625832 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 15:01:02.627447 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625836 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 15:01:02.627447 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625839 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 15:01:02.627447 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625842 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 21 15:01:02.627447 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625845 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 15:01:02.627447 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625847 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 15:01:02.627447 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625850 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 15:01:02.627447 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625853 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 15:01:02.627447 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625856 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 15:01:02.627447 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625859 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 15:01:02.627447 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625862 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 15:01:02.627447 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625866 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 15:01:02.627447 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625869 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 15:01:02.627987 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625872 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 15:01:02.627987 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625874 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 15:01:02.627987 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625877 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 15:01:02.627987 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625881 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 15:01:02.627987 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625883 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 15:01:02.627987 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625886 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 15:01:02.627987 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625891 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 15:01:02.627987 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625895 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 15:01:02.627987 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625898 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 15:01:02.627987 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625901 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 15:01:02.627987 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625904 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 15:01:02.627987 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625907 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 15:01:02.627987 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625910 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 15:01:02.627987 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625912 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 15:01:02.627987 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625915 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 15:01:02.627987 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625919 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 15:01:02.627987 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625921 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 15:01:02.627987 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625924 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 15:01:02.627987 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625927 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 15:01:02.628484 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625930 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 15:01:02.628484 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625933 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 15:01:02.628484 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625936 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 15:01:02.628484 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625939 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 15:01:02.628484 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625941 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 15:01:02.628484 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625944 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 15:01:02.628484 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625947 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 15:01:02.628484 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625950 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 15:01:02.628484 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625953 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 15:01:02.628484 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625956 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 15:01:02.628484 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625958 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 15:01:02.628484 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625962 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 15:01:02.628484 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625980 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 15:01:02.628484 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625984 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 15:01:02.628484 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625987 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 15:01:02.628484 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625990 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 15:01:02.628484 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625993 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 15:01:02.628484 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625996 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 15:01:02.628484 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.625999 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 15:01:02.628484 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626002 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 15:01:02.629029 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626005 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 15:01:02.629029 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626007 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 15:01:02.629029 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626010 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 15:01:02.629029 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626013 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 15:01:02.629029 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626015 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 15:01:02.629029 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626018 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 15:01:02.629029 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626021 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 15:01:02.629029 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626024 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 15:01:02.629029 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626027 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 15:01:02.629029 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626030 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 15:01:02.629029 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626034 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 15:01:02.629029 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626036 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 15:01:02.629029 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626039 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 15:01:02.629029 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626042 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 15:01:02.629029 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626046 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 15:01:02.629029 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626050 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 15:01:02.629029 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626053 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 15:01:02.629029 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626056 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 15:01:02.629029 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626059 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 15:01:02.629029 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626062 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 15:01:02.629576 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626065 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 15:01:02.629576 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626068 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 15:01:02.629576 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626070 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 15:01:02.629576 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626073 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 15:01:02.629576 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626076 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 15:01:02.629576 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626079 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 15:01:02.629576 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626082 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 15:01:02.629576 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626085 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 15:01:02.629576 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626087 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 15:01:02.629576 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626090 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 15:01:02.629576 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626093 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 15:01:02.629576 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626095 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 15:01:02.629576 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626098 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 15:01:02.629576 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626101 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 15:01:02.629576 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626104 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 15:01:02.629576 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626106 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 15:01:02.629576 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626110 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 15:01:02.629576 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626114 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 15:01:02.629576 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626117 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 15:01:02.630085 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626529 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 15:01:02.630085 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626534 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 15:01:02.630085 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626537 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 15:01:02.630085 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626540 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 15:01:02.630085 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626543 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 15:01:02.630085 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626546 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 15:01:02.630085 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626548 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 15:01:02.630085 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626551 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 15:01:02.630085 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626557 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 15:01:02.630085 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626561 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 15:01:02.630085 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626564 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 15:01:02.630085 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626567 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 15:01:02.630085 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626569 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 15:01:02.630085 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626572 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 15:01:02.630085 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626575 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 15:01:02.630085 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626578 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 15:01:02.630085 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626581 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 15:01:02.630085 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626584 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 15:01:02.630085 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626587 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 15:01:02.630085 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626590 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 15:01:02.630597 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626594 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 15:01:02.630597 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626598 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 15:01:02.630597 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626602 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 15:01:02.630597 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626605 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 15:01:02.630597 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626608 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 15:01:02.630597 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626611 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 15:01:02.630597 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626613 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 15:01:02.630597 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626616 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 15:01:02.630597 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626619 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 15:01:02.630597 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626622 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 15:01:02.630597 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626625 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 15:01:02.630597 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626627 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 15:01:02.630597 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626631 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 15:01:02.630597 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626634 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 15:01:02.630597 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626638 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 15:01:02.630597 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626642 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 15:01:02.630597 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626645 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 15:01:02.630597 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626649 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 15:01:02.630597 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626652 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 15:01:02.631157 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626655 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 15:01:02.631157 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626658 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 15:01:02.631157 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626661 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 15:01:02.631157 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626664 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 15:01:02.631157 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626667 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 15:01:02.631157 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626670 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 15:01:02.631157 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626672 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 15:01:02.631157 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626675 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 15:01:02.631157 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626678 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 15:01:02.631157 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626681 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 15:01:02.631157 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626684 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 15:01:02.631157 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626687 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 15:01:02.631157 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626689 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 15:01:02.631157 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626692 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 15:01:02.631157 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626695 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 15:01:02.631157 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626698 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 15:01:02.631157 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626701 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 15:01:02.631157 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626704 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 15:01:02.631157 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626706 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 15:01:02.632209 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626709 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 15:01:02.632209 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626712 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 15:01:02.632209 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626715 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 15:01:02.632209 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626719 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 15:01:02.632209 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626722 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 15:01:02.632209 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626724 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 15:01:02.632209 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626727 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 15:01:02.632209 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626730 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 15:01:02.632209 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626733 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 15:01:02.632209 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626735 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 15:01:02.632209 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626738 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 15:01:02.632209 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626741 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 15:01:02.632209 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626743 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 15:01:02.632209 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626746 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 15:01:02.632209 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626749 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 15:01:02.632209 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626751 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 15:01:02.632209 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626754 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 15:01:02.632209 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626757 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 15:01:02.632209 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626760 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 15:01:02.632706 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626763 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 15:01:02.632706 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626766 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 15:01:02.632706 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626768 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 15:01:02.632706 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626774 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 15:01:02.632706 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626777 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 15:01:02.632706 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626780 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 15:01:02.632706 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626783 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 15:01:02.632706 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626786 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 15:01:02.632706 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626789 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 15:01:02.632706 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626792 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 15:01:02.632706 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626794 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 15:01:02.632706 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626797 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 15:01:02.632706 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626800 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 15:01:02.632706 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626802 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 15:01:02.632706 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626805 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 15:01:02.632706 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626808 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 21 15:01:02.632706 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626811 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 15:01:02.632706 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626814 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 15:01:02.632706 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626817 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 15:01:02.632706 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626819 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626822 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.626825 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.626905 2577 flags.go:64] FLAG: --address="0.0.0.0" Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.626912 2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.626919 2577 flags.go:64] FLAG: --anonymous-auth="true" Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.626925 2577 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.626929 2577 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.626933 2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.626937 2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.626942 2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.626946 2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.626949 2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.626953 2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.626957 2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.626960 2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.626979 2577 flags.go:64] FLAG: --cgroup-root="" Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.626982 2577 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.626986 2577 flags.go:64] FLAG: --client-ca-file="" Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.626989 2577 flags.go:64] FLAG: --cloud-provider="external" Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.626992 2577 flags.go:64] FLAG: --cluster-dns="[]" Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627013 2577 flags.go:64] FLAG: --cluster-domain="" Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627017 2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627022 2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 21 15:01:02.633293 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627026 2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627031 2577 flags.go:64] FLAG: --container-log-max-files="5" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627035 2577 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627039 2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627042 2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627048 2577 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627052 2577 flags.go:64] FLAG: --contention-profiling="false" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627055 2577 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627059 2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627062 2577 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627065 2577 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627069 2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627073 2577 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627076 2577 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627079 2577 flags.go:64] FLAG: --enable-load-reader="false" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627082 2577 flags.go:64] FLAG: --enable-server="true" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627086 2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627091 2577 flags.go:64] FLAG: --event-burst="100" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627094 2577 flags.go:64] FLAG: --event-qps="50" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627097 2577 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627102 2577 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627105 2577 flags.go:64] FLAG: --eviction-hard="" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627109 2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627112 2577 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627118 2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 21 15:01:02.633917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627121 2577 flags.go:64] FLAG: --eviction-soft="" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627125 2577 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627128 2577 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627131 2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627134 2577 flags.go:64] FLAG: --experimental-mounter-path="" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627137 2577 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627141 2577 flags.go:64] FLAG: --fail-swap-on="true" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627144 2577 flags.go:64] FLAG: --feature-gates="" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627148 2577 flags.go:64] FLAG: --file-check-frequency="20s" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627151 2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627155 2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627158 2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627163 2577 flags.go:64] FLAG: --healthz-port="10248" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627166 2577 flags.go:64] FLAG: --help="false" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627169 2577 flags.go:64] FLAG: --hostname-override="ip-10-0-133-162.ec2.internal" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627173 2577 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627176 2577 flags.go:64] FLAG: --http-check-frequency="20s" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627179 2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627183 2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627187 2577 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627190 2577 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627193 2577 flags.go:64] FLAG: --image-service-endpoint="" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627196 2577 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 21 15:01:02.634567 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627199 2577 flags.go:64] FLAG: --kube-api-burst="100" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627203 2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627206 2577 flags.go:64] FLAG: --kube-api-qps="50" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627210 2577 flags.go:64] FLAG: --kube-reserved="" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627213 2577 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627217 2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627220 2577 flags.go:64] FLAG: --kubelet-cgroups="" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627224 2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627229 2577 flags.go:64] FLAG: --lock-file="" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627232 2577 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627235 2577 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627238 2577 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627244 2577 flags.go:64] FLAG: --log-json-split-stream="false" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627247 2577 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627250 2577 flags.go:64] FLAG: --log-text-split-stream="false" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627253 2577 flags.go:64] FLAG: --logging-format="text" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627257 2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627260 2577 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627264 2577 flags.go:64] FLAG: --manifest-url="" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627267 2577 flags.go:64] FLAG: --manifest-url-header="" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627272 2577 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627277 2577 flags.go:64] FLAG: --max-open-files="1000000" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627287 2577 flags.go:64] FLAG: --max-pods="110" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627290 2577 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627293 2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 21 15:01:02.635215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627296 2577 flags.go:64] FLAG: --memory-manager-policy="None" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627300 2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627303 2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627306 2577 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627309 2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627317 2577 flags.go:64] FLAG: --node-status-max-images="50" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627320 2577 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627323 2577 flags.go:64] FLAG: --oom-score-adj="-999" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627326 2577 flags.go:64] FLAG: --pod-cidr="" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627330 2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627335 2577 flags.go:64] FLAG: --pod-manifest-path="" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627338 2577 flags.go:64] FLAG: --pod-max-pids="-1" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627341 2577 flags.go:64] FLAG: --pods-per-core="0" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627345 2577 flags.go:64] FLAG: --port="10250" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627348 2577 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627351 2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08ccf9398da3e6a6e" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627356 2577 flags.go:64] FLAG: --qos-reserved="" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627359 2577 flags.go:64] FLAG: --read-only-port="10255" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627363 2577 flags.go:64] FLAG: --register-node="true" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627366 2577 flags.go:64] FLAG: --register-with-taints="" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627370 2577 flags.go:64] FLAG: --registry-burst="10" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627373 2577 flags.go:64] FLAG: --registry-qps="5" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627376 2577 flags.go:64] FLAG: --reserved-cpus="" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627379 2577 flags.go:64] FLAG: --reserved-memory="" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627383 2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 21 15:01:02.636167 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627387 2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627390 2577 flags.go:64] FLAG: --rotate-certificates="false" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627393 2577 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627398 2577 flags.go:64] FLAG: --runonce="false" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627402 2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627405 2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627408 2577 flags.go:64] FLAG: --seccomp-default="false" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627411 2577 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627415 2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627418 2577 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627421 2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627424 2577 flags.go:64] FLAG: --storage-driver-password="root" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627427 2577 flags.go:64] FLAG: --storage-driver-secure="false" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627431 2577 flags.go:64] FLAG: --storage-driver-table="stats" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627434 2577 flags.go:64] FLAG: --storage-driver-user="root" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627437 2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627440 2577 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627443 2577 flags.go:64] FLAG: --system-cgroups="" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627446 2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627452 2577 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627456 2577 flags.go:64] FLAG: --tls-cert-file="" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627459 2577 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627464 2577 flags.go:64] FLAG: --tls-min-version="" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627468 2577 flags.go:64] FLAG: --tls-private-key-file="" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627471 2577 flags.go:64] FLAG: --topology-manager-policy="none" Jul 21 15:01:02.637243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627474 2577 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 21 15:01:02.637957 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627478 2577 flags.go:64] FLAG: --topology-manager-scope="container" Jul 21 15:01:02.637957 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627481 2577 flags.go:64] FLAG: --v="2" Jul 21 15:01:02.637957 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627485 2577 flags.go:64] FLAG: --version="false" Jul 21 15:01:02.637957 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627490 2577 flags.go:64] FLAG: --vmodule="" Jul 21 15:01:02.637957 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627494 2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 21 15:01:02.637957 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.627497 2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 21 15:01:02.637957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627621 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 15:01:02.637957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627625 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 15:01:02.637957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627629 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 15:01:02.637957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627634 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 15:01:02.637957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627638 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 15:01:02.637957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627642 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 15:01:02.637957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627646 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 15:01:02.637957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627651 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 15:01:02.637957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627655 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 15:01:02.637957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627658 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 15:01:02.637957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627660 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 15:01:02.637957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627663 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 15:01:02.637957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627666 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 15:01:02.637957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627669 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 15:01:02.637957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627672 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 15:01:02.638610 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627675 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 15:01:02.638610 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627677 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 15:01:02.638610 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627680 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 15:01:02.638610 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627683 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 15:01:02.638610 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627686 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 15:01:02.638610 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627688 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 15:01:02.638610 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627691 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 15:01:02.638610 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627694 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 15:01:02.638610 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627699 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 15:01:02.638610 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627701 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 15:01:02.638610 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627704 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 15:01:02.638610 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627707 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 15:01:02.638610 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627710 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 15:01:02.638610 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627713 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 15:01:02.638610 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627715 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 15:01:02.638610 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627718 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 15:01:02.638610 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627721 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 15:01:02.638610 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627724 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 15:01:02.638610 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627726 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 15:01:02.638610 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627729 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 15:01:02.639172 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627737 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 15:01:02.639172 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627740 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 15:01:02.639172 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627743 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 15:01:02.639172 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627748 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 15:01:02.639172 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627751 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 15:01:02.639172 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627754 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 15:01:02.639172 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627757 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 15:01:02.639172 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627760 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 15:01:02.639172 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627762 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 15:01:02.639172 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627766 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 15:01:02.639172 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627769 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 15:01:02.639172 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627771 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 15:01:02.639172 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627774 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 15:01:02.639172 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627777 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 15:01:02.639172 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627780 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 15:01:02.639172 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627783 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 15:01:02.639172 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627786 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 15:01:02.639172 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627788 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 15:01:02.639172 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627791 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 15:01:02.639671 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627794 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 15:01:02.639671 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627799 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 15:01:02.639671 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627801 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 15:01:02.639671 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627806 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 15:01:02.639671 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627809 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 15:01:02.639671 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627813 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 15:01:02.639671 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627816 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 15:01:02.639671 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627819 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 15:01:02.639671 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627822 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 15:01:02.639671 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627826 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 15:01:02.639671 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627829 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 15:01:02.639671 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627832 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 15:01:02.639671 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627835 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 15:01:02.639671 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627840 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 15:01:02.639671 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627843 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 15:01:02.639671 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627845 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 15:01:02.639671 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627848 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 15:01:02.639671 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627851 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 15:01:02.639671 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627854 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 15:01:02.640197 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627856 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 21 15:01:02.640197 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627859 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 15:01:02.640197 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627862 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 15:01:02.640197 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627864 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 15:01:02.640197 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627867 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 15:01:02.640197 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627870 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 15:01:02.640197 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627873 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 15:01:02.640197 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627876 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 15:01:02.640197 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627878 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 15:01:02.640197 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627881 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 15:01:02.640197 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627884 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 15:01:02.640197 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627887 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 15:01:02.640197 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627890 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 15:01:02.640197 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627892 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 15:01:02.640197 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627897 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 15:01:02.640197 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627901 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 15:01:02.640197 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627903 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 15:01:02.640197 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627906 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 15:01:02.640197 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627909 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 15:01:02.640197 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627912 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 15:01:02.640724 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627915 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 15:01:02.640724 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627918 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 15:01:02.640724 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627921 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 15:01:02.640724 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627923 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 15:01:02.640724 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627926 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 15:01:02.640724 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.627929 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 15:01:02.640724 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.628639 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 15:01:02.640724 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.638046 2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 21 15:01:02.640724 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.638067 2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 21 15:01:02.640724 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.638090 2577 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 21 15:01:02.640724 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.638101 2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 21 15:01:02.640724 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638166 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 15:01:02.640724 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638172 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 15:01:02.640724 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638176 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 15:01:02.640724 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638179 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 15:01:02.641149 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638183 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 15:01:02.641149 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638187 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 15:01:02.641149 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638190 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 21 15:01:02.641149 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638193 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 15:01:02.641149 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638196 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 15:01:02.641149 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638199 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 15:01:02.641149 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638202 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 15:01:02.641149 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638205 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 15:01:02.641149 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638209 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 15:01:02.641149 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638212 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 15:01:02.641149 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638214 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 15:01:02.641149 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638217 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 15:01:02.641149 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638220 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 15:01:02.641149 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638223 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 15:01:02.641149 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638226 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 15:01:02.641149 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638229 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 15:01:02.641149 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638231 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 15:01:02.641149 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638234 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 15:01:02.641149 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638237 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 15:01:02.641149 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638240 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 15:01:02.641687 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638243 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 15:01:02.641687 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638247 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 15:01:02.641687 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638249 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 15:01:02.641687 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638252 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 15:01:02.641687 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638256 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 15:01:02.641687 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638259 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 15:01:02.641687 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638262 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 15:01:02.641687 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638267 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 15:01:02.641687 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638271 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 15:01:02.641687 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638275 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 15:01:02.641687 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638279 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 15:01:02.641687 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638282 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 15:01:02.641687 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638284 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 15:01:02.641687 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638287 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 15:01:02.641687 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638290 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 15:01:02.641687 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638293 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 15:01:02.641687 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638296 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 15:01:02.641687 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638299 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 15:01:02.641687 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638302 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 15:01:02.642367 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638305 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 15:01:02.642367 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638308 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 15:01:02.642367 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638311 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 15:01:02.642367 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638313 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 15:01:02.642367 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638316 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 15:01:02.642367 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638319 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 15:01:02.642367 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638322 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 15:01:02.642367 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638325 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 15:01:02.642367 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638328 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 15:01:02.642367 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638331 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 15:01:02.642367 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638334 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 15:01:02.642367 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638337 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 15:01:02.642367 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638340 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 15:01:02.642367 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638343 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 15:01:02.642367 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638345 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 15:01:02.642367 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638349 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 15:01:02.642367 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638352 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 15:01:02.642367 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638355 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 15:01:02.642367 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638358 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 15:01:02.642367 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638361 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 15:01:02.642908 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638364 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 15:01:02.642908 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638367 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 15:01:02.642908 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638370 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 15:01:02.642908 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638373 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 15:01:02.642908 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638375 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 15:01:02.642908 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638378 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 15:01:02.642908 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638381 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 15:01:02.642908 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638383 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 15:01:02.642908 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638386 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 15:01:02.642908 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638389 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 15:01:02.642908 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638391 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 15:01:02.642908 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638394 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 15:01:02.642908 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638397 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 15:01:02.642908 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638399 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 15:01:02.642908 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638402 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 15:01:02.642908 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638405 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 15:01:02.642908 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638409 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 15:01:02.642908 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638412 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 15:01:02.642908 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638415 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 15:01:02.642908 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638417 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 15:01:02.643522 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638420 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 15:01:02.643522 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638423 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 15:01:02.643522 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638426 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 15:01:02.643522 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638428 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 15:01:02.643522 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638431 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 15:01:02.643522 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638434 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 15:01:02.643522 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638436 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 15:01:02.643522 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638440 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 15:01:02.643522 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638444 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 15:01:02.643522 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638450 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 15:01:02.643522 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638455 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 15:01:02.643522 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638458 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 15:01:02.643522 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638461 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 15:01:02.643522 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638465 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 15:01:02.643522 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638468 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 15:01:02.643522 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638470 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 15:01:02.643957 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.638476 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 15:01:02.643957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638606 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 15:01:02.643957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638612 2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 15:01:02.643957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638615 2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 15:01:02.643957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638618 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 15:01:02.643957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638621 2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 15:01:02.643957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638624 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 15:01:02.643957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638628 2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 15:01:02.643957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638630 2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 15:01:02.643957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638633 2577 feature_gate.go:328] unrecognized feature gate: Example Jul 21 15:01:02.643957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638636 2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 15:01:02.643957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638639 2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 15:01:02.643957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638642 2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 15:01:02.643957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638645 2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 15:01:02.643957 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638648 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 15:01:02.644428 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638651 2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 15:01:02.644428 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638654 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 15:01:02.644428 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638657 2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 15:01:02.644428 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638659 2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 15:01:02.644428 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638662 2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 15:01:02.644428 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638665 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 15:01:02.644428 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638667 2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 15:01:02.644428 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638670 2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 15:01:02.644428 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638673 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 15:01:02.644428 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638676 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 15:01:02.644428 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638679 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 15:01:02.644428 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638682 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 15:01:02.644428 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638685 2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 15:01:02.644428 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638688 2577 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 15:01:02.644428 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638691 2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 15:01:02.644428 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638694 2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 15:01:02.644428 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638696 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 15:01:02.644428 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638700 2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 15:01:02.644428 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638702 2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 15:01:02.644959 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638705 2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 15:01:02.644959 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638708 2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 15:01:02.644959 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638711 2577 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 15:01:02.644959 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638714 2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 15:01:02.644959 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638716 2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 15:01:02.644959 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638719 2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 15:01:02.644959 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638724 2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 15:01:02.644959 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638727 2577 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 15:01:02.644959 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638730 2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 15:01:02.644959 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638733 2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 15:01:02.644959 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638736 2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 15:01:02.644959 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638739 2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 15:01:02.644959 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638743 2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 15:01:02.644959 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638746 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 15:01:02.644959 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638750 2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 15:01:02.644959 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638753 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 15:01:02.644959 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638756 2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 15:01:02.644959 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638761 2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 15:01:02.644959 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638765 2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 15:01:02.645481 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638768 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 15:01:02.645481 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638771 2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 15:01:02.645481 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638774 2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 15:01:02.645481 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638778 2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 15:01:02.645481 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638782 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 15:01:02.645481 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638785 2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 15:01:02.645481 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638788 2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 15:01:02.645481 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638791 2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 15:01:02.645481 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638793 2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 15:01:02.645481 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638796 2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 15:01:02.645481 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638800 2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 15:01:02.645481 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638803 2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 15:01:02.645481 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638805 2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 15:01:02.645481 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638808 2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 15:01:02.645481 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638811 2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 15:01:02.645481 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638813 2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 15:01:02.645481 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638816 2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 15:01:02.645481 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638819 2577 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 15:01:02.645481 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638821 2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 15:01:02.646112 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638824 2577 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 15:01:02.646112 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638827 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 15:01:02.646112 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638830 2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 15:01:02.646112 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638833 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 15:01:02.646112 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638835 2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 15:01:02.646112 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638838 2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 15:01:02.646112 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638841 2577 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 15:01:02.646112 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638844 2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 15:01:02.646112 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638847 2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 15:01:02.646112 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638850 2577 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 15:01:02.646112 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638852 2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 15:01:02.646112 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638855 2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 15:01:02.646112 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638858 2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 15:01:02.646112 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638860 2577 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 15:01:02.646112 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638863 2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 15:01:02.646112 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638866 2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 15:01:02.646112 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638868 2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 15:01:02.646112 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638871 2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 15:01:02.646112 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638874 2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 15:01:02.646112 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638877 2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 15:01:02.646988 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638880 2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 15:01:02.646988 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638882 2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 15:01:02.646988 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638885 2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 15:01:02.646988 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638888 2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 15:01:02.646988 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638891 2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 15:01:02.646988 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638894 2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 15:01:02.646988 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638896 2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 15:01:02.646988 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:02.638899 2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 15:01:02.646988 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.638904 2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 15:01:02.646988 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.639059 2577 server.go:962] "Client rotation is on, will bootstrap in background" Jul 21 15:01:02.646988 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.641398 2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 21 15:01:02.646988 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.643059 2577 server.go:1019] "Starting client certificate rotation" Jul 21 15:01:02.646988 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.643178 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 15:01:02.646988 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.643218 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 15:01:02.647606 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.646674 2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 15:01:02.648381 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.648362 2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 15:01:02.665285 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.665257 2577 log.go:25] "Validated CRI v1 runtime API" Jul 21 15:01:02.669037 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.669018 2577 log.go:25] "Validated CRI v1 image API" Jul 21 15:01:02.669947 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.669927 2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 21 15:01:02.673611 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.673583 2577 fs.go:135] Filesystem UUIDs: map[4bdcb696-8db8-4338-847e-31de8c77c871:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ac40874b-8093-4eda-89b8-08f78b5eab92:/dev/nvme0n1p3] Jul 21 15:01:02.673611 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.673607 2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 21 15:01:02.676575 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.676555 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 15:01:02.681221 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.680898 2577 manager.go:216] Machine: {Timestamp:2026-07-21 15:01:02.679047107 +0000 UTC m=+0.363702722 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100181 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2834cd00ac1908cfa6c5f704dc6e46 SystemUUID:ec2834cd-00ac-1908-cfa6-c5f704dc6e46 BootID:8d1c7803-addd-4d1d-87e4-b9288cbd0090 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:78:bd:d2:a8:2b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:78:bd:d2:a8:2b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:5f:07:e0:5e:8e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 21 15:01:02.681221 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.681205 2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 21 15:01:02.681387 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.681316 2577 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 21 15:01:02.684712 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.684684 2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 21 15:01:02.684864 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.684716 2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-162.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 21 15:01:02.686059 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.686047 2577 topology_manager.go:138] "Creating topology manager with none policy" Jul 21 15:01:02.686097 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.686062 2577 container_manager_linux.go:309] "Creating device plugin manager" Jul 21 15:01:02.686097 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.686070 2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 15:01:02.686895 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.686884 2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 15:01:02.688291 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.688278 2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 21 15:01:02.691869 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.691853 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 21 15:01:02.692014 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.692003 2577 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 21 15:01:02.692058 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.692036 2577 kubelet.go:486] "Attempting to sync node with API server" Jul 21 15:01:02.692058 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.692048 2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 21 15:01:02.692128 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.692063 2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 21 15:01:02.692128 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.692074 2577 kubelet.go:398] "Adding apiserver pod source" Jul 21 15:01:02.692128 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.692086 2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 21 15:01:02.692511 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.692498 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 15:01:02.692554 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.692524 2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 15:01:02.694959 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.694942 2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 21 15:01:02.696414 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.696398 2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 21 15:01:02.696479 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.696432 2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 21 15:01:02.697187 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.697175 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 21 15:01:02.697230 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.697192 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 21 15:01:02.697230 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.697199 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 21 15:01:02.697230 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.697206 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 21 15:01:02.697230 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.697215 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 21 15:01:02.697230 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.697222 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 21 15:01:02.697369 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.697319 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 21 15:01:02.697369 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.697327 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 21 15:01:02.697369 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.697335 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 21 15:01:02.697369 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.697342 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 21 15:01:02.697369 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.697351 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 21 15:01:02.697369 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.697359 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 21 15:01:02.698157 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.698135 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 21 15:01:02.698157 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.698158 2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 21 15:01:02.701795 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.701777 2577 server.go:1268] "Started kubelet" Jul 21 15:01:02.701911 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.701878 2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 21 15:01:02.702000 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.701925 2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 21 15:01:02.702052 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.702022 2577 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 21 15:01:02.702920 ip-10-0-133-162 systemd[1]: Started Kubernetes Kubelet. Jul 21 15:01:02.703192 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.703162 2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 21 15:01:02.703767 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:02.703746 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 21 15:01:02.703830 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.703783 2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-162.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 21 15:01:02.703985 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:02.703939 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 21 15:01:02.704989 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.704945 2577 server.go:310] "Adding debug handlers to kubelet server" Jul 21 15:01:02.708354 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:02.708333 2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 21 15:01:02.708666 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:02.707492 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-162.ec2.internal.18c4562379230d8a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-162.ec2.internal,UID:ip-10-0-133-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-162.ec2.internal,},FirstTimestamp:2026-07-21 15:01:02.701743498 +0000 UTC m=+0.386399098,LastTimestamp:2026-07-21 15:01:02.701743498 +0000 UTC m=+0.386399098,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-162.ec2.internal,}" Jul 21 15:01:02.710397 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.710381 2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 21 15:01:02.710397 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.710387 2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 21 15:01:02.711059 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:02.710938 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-162.ec2.internal\" not found" Jul 21 15:01:02.711149 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.711116 2577 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 21 15:01:02.711149 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.711133 2577 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 21 15:01:02.711235 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.711209 2577 reconstruct.go:97] "Volume reconstruction finished" Jul 21 15:01:02.711291 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.711241 2577 reconciler.go:29] "Reconciler: start to sync state" Jul 21 15:01:02.711291 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.711251 2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 21 15:01:02.711371 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.711314 2577 factory.go:55] Registering systemd factory Jul 21 15:01:02.711371 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.711330 2577 factory.go:223] Registration of the systemd container factory successfully Jul 21 15:01:02.711580 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.711562 2577 factory.go:153] Registering CRI-O factory Jul 21 15:01:02.711658 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.711584 2577 factory.go:223] Registration of the crio container factory successfully Jul 21 15:01:02.711658 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.711642 2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 21 15:01:02.711750 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.711668 2577 factory.go:103] Registering Raw factory Jul 21 15:01:02.711750 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.711685 2577 manager.go:1196] Started watching for new ooms in manager Jul 21 15:01:02.712403 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.712364 2577 manager.go:349] Starting recovery of all containers Jul 21 15:01:02.713701 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.713662 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jwxds" Jul 21 15:01:02.722841 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:02.722668 2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-162.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 21 15:01:02.722841 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:02.722756 2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 21 15:01:02.724409 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.724378 2577 manager.go:354] Recovery completed Jul 21 15:01:02.726012 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:02.725955 2577 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 21 15:01:02.729448 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.729427 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 15:01:02.731643 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.731624 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientMemory" Jul 21 15:01:02.731742 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.731661 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 15:01:02.731742 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.731677 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientPID" Jul 21 15:01:02.732341 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.732316 2577 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 21 15:01:02.732341 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.732336 2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 21 15:01:02.732461 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.732352 2577 state_mem.go:36] "Initialized new in-memory state store" Jul 21 15:01:02.732461 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.732329 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 15:01:02.733194 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.733175 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientMemory" Jul 21 15:01:02.733253 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.733207 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 15:01:02.733253 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.733223 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientPID" Jul 21 15:01:02.733321 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.733277 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jwxds" Jul 21 15:01:02.734090 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:02.734000 2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-162.ec2.internal.18c456237aeb47f1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-162.ec2.internal,UID:ip-10-0-133-162.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-162.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-162.ec2.internal,},FirstTimestamp:2026-07-21 15:01:02.731642865 +0000 UTC m=+0.416298474,LastTimestamp:2026-07-21 15:01:02.731642865 +0000 UTC m=+0.416298474,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-162.ec2.internal,}" Jul 21 15:01:02.734928 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.734912 2577 policy_none.go:49] "None policy: Start" Jul 21 15:01:02.735084 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.734932 2577 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 21 15:01:02.735084 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.734946 2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 21 15:01:02.736004 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.735991 2577 policy_none.go:47] "Start" Jul 21 15:01:02.775757 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.775694 2577 manager.go:337] "Starting Device Plugin manager" Jul 21 15:01:02.775757 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:02.775732 2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 21 15:01:02.775757 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.775745 2577 server.go:87] "Starting device plugin registration server" Jul 21 15:01:02.776166 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.776152 2577 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 21 15:01:02.776224 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.776171 2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 21 15:01:02.776285 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.776269 2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 21 15:01:02.776384 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.776361 2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 21 15:01:02.776384 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.776376 2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 21 15:01:02.776948 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:02.776922 2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 21 15:01:02.777018 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:02.776985 2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-162.ec2.internal\" not found" Jul 21 15:01:02.877069 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.877015 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 15:01:02.879158 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.879141 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientMemory" Jul 21 15:01:02.879244 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.879174 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 15:01:02.879244 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.879186 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientPID" Jul 21 15:01:02.879244 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.879214 2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-162.ec2.internal" Jul 21 15:01:02.888589 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.888553 2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-162.ec2.internal" Jul 21 15:01:02.888688 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:02.888591 2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-162.ec2.internal\": node \"ip-10-0-133-162.ec2.internal\" not found" Jul 21 15:01:02.890384 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.890347 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 21 15:01:02.891639 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.891616 2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 21 15:01:02.891718 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.891659 2577 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 21 15:01:02.891718 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.891713 2577 kubelet.go:2448] "Starting kubelet main sync loop" Jul 21 15:01:02.891802 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:02.891758 2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 21 15:01:02.894120 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.894102 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 15:01:02.906996 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:02.906952 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-162.ec2.internal\" not found" Jul 21 15:01:02.995118 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.995054 2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-162.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal"] Jul 21 15:01:02.995326 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.995190 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 15:01:02.997052 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.997030 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientMemory" Jul 21 15:01:02.997141 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.997073 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 15:01:02.997141 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.997097 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientPID" Jul 21 15:01:02.998524 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.998509 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 15:01:02.998636 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.998620 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-162.ec2.internal" Jul 21 15:01:02.998687 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.998655 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 15:01:02.999339 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.999324 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientMemory" Jul 21 15:01:02.999429 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.999331 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientMemory" Jul 21 15:01:02.999429 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.999352 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 15:01:02.999429 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.999363 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientPID" Jul 21 15:01:02.999429 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.999370 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 15:01:02.999429 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:02.999385 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientPID" Jul 21 15:01:03.000693 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.000673 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal" Jul 21 15:01:03.000750 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.000716 2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 15:01:03.001472 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.001451 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientMemory" Jul 21 15:01:03.001574 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.001485 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 15:01:03.001574 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.001499 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeHasSufficientPID" Jul 21 15:01:03.007963 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:03.007942 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-162.ec2.internal\" not found" Jul 21 15:01:03.013753 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.013734 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/32f0b3f620b4c36d7994f3f2b1278b0c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal\" (UID: \"32f0b3f620b4c36d7994f3f2b1278b0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal" Jul 21 15:01:03.013822 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.013762 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32f0b3f620b4c36d7994f3f2b1278b0c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal\" (UID: \"32f0b3f620b4c36d7994f3f2b1278b0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal" Jul 21 15:01:03.013822 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.013781 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0a7da5646d11ae196ceeecffb05398c-config\") pod \"kube-apiserver-proxy-ip-10-0-133-162.ec2.internal\" (UID: \"e0a7da5646d11ae196ceeecffb05398c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-162.ec2.internal" Jul 21 15:01:03.017628 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:03.017608 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-162.ec2.internal\" not found" node="ip-10-0-133-162.ec2.internal" Jul 21 15:01:03.022296 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:03.022278 2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-162.ec2.internal\" not found" node="ip-10-0-133-162.ec2.internal" Jul 21 15:01:03.108430 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:03.108351 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-162.ec2.internal\" not found" Jul 21 15:01:03.114132 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.114104 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0a7da5646d11ae196ceeecffb05398c-config\") pod \"kube-apiserver-proxy-ip-10-0-133-162.ec2.internal\" (UID: \"e0a7da5646d11ae196ceeecffb05398c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-162.ec2.internal" Jul 21 15:01:03.114197 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.114139 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/32f0b3f620b4c36d7994f3f2b1278b0c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal\" (UID: \"32f0b3f620b4c36d7994f3f2b1278b0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal" Jul 21 15:01:03.114197 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.114159 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32f0b3f620b4c36d7994f3f2b1278b0c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal\" (UID: \"32f0b3f620b4c36d7994f3f2b1278b0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal" Jul 21 15:01:03.114197 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.114190 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32f0b3f620b4c36d7994f3f2b1278b0c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal\" (UID: \"32f0b3f620b4c36d7994f3f2b1278b0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal" Jul 21 15:01:03.114302 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.114221 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e0a7da5646d11ae196ceeecffb05398c-config\") pod \"kube-apiserver-proxy-ip-10-0-133-162.ec2.internal\" (UID: \"e0a7da5646d11ae196ceeecffb05398c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-162.ec2.internal" Jul 21 15:01:03.114302 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.114221 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/32f0b3f620b4c36d7994f3f2b1278b0c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal\" (UID: \"32f0b3f620b4c36d7994f3f2b1278b0c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal" Jul 21 15:01:03.209674 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:03.209632 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-162.ec2.internal\" not found" Jul 21 15:01:03.317297 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:03.317266 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-162.ec2.internal\" not found" Jul 21 15:01:03.320733 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.320718 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-162.ec2.internal" Jul 21 15:01:03.328403 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.328379 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal" Jul 21 15:01:03.417567 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:03.417471 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-162.ec2.internal\" not found" Jul 21 15:01:03.518557 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:03.518513 2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-162.ec2.internal\" not found" Jul 21 15:01:03.537873 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.537848 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 15:01:03.611078 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.611043 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-162.ec2.internal" Jul 21 15:01:03.623436 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.623411 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 15:01:03.625415 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.625398 2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal" Jul 21 15:01:03.635985 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.635964 2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 15:01:03.642628 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.642603 2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 21 15:01:03.642787 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.642765 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 15:01:03.642831 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.642791 2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 15:01:03.692296 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.692197 2577 apiserver.go:52] "Watching apiserver" Jul 21 15:01:03.710669 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.710544 2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 21 15:01:03.711444 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.711422 2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 21 15:01:03.711774 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.711752 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-t22z2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx","openshift-cluster-node-tuning-operator/tuned-m8fpb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal","openshift-multus/multus-gjxv9","openshift-network-operator/iptables-alerter-p6ndv","openshift-ovn-kubernetes/ovnkube-node-mfv5x","kube-system/kube-apiserver-proxy-ip-10-0-133-162.ec2.internal","openshift-dns/node-resolver-z5vz5","openshift-image-registry/node-ca-8hjhr","openshift-multus/multus-additional-cni-plugins-plxr5","openshift-multus/network-metrics-daemon-zdtw9","openshift-network-diagnostics/network-check-target-nf7mq","kube-system/global-pull-secret-syncer-rj7km"] Jul 21 15:01:03.713289 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.713268 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8hjhr" Jul 21 15:01:03.714878 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.714859 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:03.715006 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:03.714936 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nf7mq" podUID="ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d" Jul 21 15:01:03.715654 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.715635 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 21 15:01:03.715757 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.715737 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 21 15:01:03.715857 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.715820 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 21 15:01:03.715994 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.715953 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wqkqt\"" Jul 21 15:01:03.716063 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.716053 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.717215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.717197 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:03.717314 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:03.717264 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj7km" podUID="4bef143c-d202-45f2-85ea-ae75c3d6812e" Jul 21 15:01:03.718292 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.718270 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.718685 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.718664 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gm5zf\"" Jul 21 15:01:03.718781 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.718713 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 21 15:01:03.718781 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.718775 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 21 15:01:03.719426 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.719410 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p6ndv" Jul 21 15:01:03.720600 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.720580 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bmdkv\"" Jul 21 15:01:03.720600 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.720601 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z5vz5" Jul 21 15:01:03.720994 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.720975 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 21 15:01:03.721247 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.721229 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 21 15:01:03.721320 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.721281 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 21 15:01:03.721381 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.721326 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 21 15:01:03.721742 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.721725 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 21 15:01:03.721963 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.721933 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 21 15:01:03.722035 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.721989 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 21 15:01:03.722240 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.722223 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.722363 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.722348 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-p8v9g\"" Jul 21 15:01:03.723513 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.723495 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:03.724521 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.724503 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 21 15:01:03.724705 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.724686 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 21 15:01:03.724798 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.724734 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 21 15:01:03.724798 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.724761 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t22z2" Jul 21 15:01:03.724956 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.724932 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f52qs\"" Jul 21 15:01:03.725132 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.725072 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 21 15:01:03.725217 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.725202 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 21 15:01:03.725289 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.725272 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 21 15:01:03.725357 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.725345 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 21 15:01:03.725405 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.725389 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 21 15:01:03.725703 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.725687 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zp99c\"" Jul 21 15:01:03.725817 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.725803 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 21 15:01:03.725876 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.725805 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 21 15:01:03.725933 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.725880 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 21 15:01:03.726006 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.725945 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xzs6t\"" Jul 21 15:01:03.726285 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.726269 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.727507 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.727483 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:03.727601 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.727540 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 21 15:01:03.727601 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.727544 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m8m2l\"" Jul 21 15:01:03.727601 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:03.727555 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdtw9" podUID="7b297c76-9cfa-44de-82d8-a62027a7f081" Jul 21 15:01:03.727736 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.727646 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 21 15:01:03.727821 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.727804 2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 15:01:03.728962 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.728934 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 21 15:01:03.729068 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.729006 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lhpl8\"" Jul 21 15:01:03.729068 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.729047 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 21 15:01:03.737405 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.737347 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 14:56:03 +0000 UTC" deadline="2028-03-07 22:43:03.718735517 +0000 UTC" Jul 21 15:01:03.737508 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.737404 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14287h41m59.98133553s" Jul 21 15:01:03.744386 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.744360 2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vd869" Jul 21 15:01:03.761346 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.761323 2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vd869" Jul 21 15:01:03.762927 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.762909 2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 15:01:03.774505 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.774483 2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 15:01:03.813265 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.813234 2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 21 15:01:03.819066 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819041 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-etc-kubernetes\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.819217 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819077 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwfv8\" (UniqueName: \"kubernetes.io/projected/e8af705e-4863-4cb5-af5c-0d1657d19d1b-kube-api-access-hwfv8\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.819217 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819108 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-multus-conf-dir\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.819217 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819131 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/28ca6fdc-cd9e-49b0-a85c-495a164abbcd-device-dir\") pod \"aws-ebs-csi-driver-node-g8vlx\" (UID: \"28ca6fdc-cd9e-49b0-a85c-495a164abbcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:03.819217 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819154 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a3f1c14-41af-4531-8e95-d0735bf01095-host-slash\") pod \"iptables-alerter-p6ndv\" (UID: \"6a3f1c14-41af-4531-8e95-d0735bf01095\") " pod="openshift-network-operator/iptables-alerter-p6ndv" Jul 21 15:01:03.819217 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819177 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec99e5c6-a468-4067-a9f9-120ab64e1a1f-tmp-dir\") pod \"node-resolver-z5vz5\" (UID: \"ec99e5c6-a468-4067-a9f9-120ab64e1a1f\") " pod="openshift-dns/node-resolver-z5vz5" Jul 21 15:01:03.819217 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819200 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4kk4\" (UniqueName: \"kubernetes.io/projected/b5b08086-eac8-4329-a903-a73b5e8503ce-kube-api-access-c4kk4\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.819532 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819227 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret\") pod \"global-pull-secret-syncer-rj7km\" (UID: \"4bef143c-d202-45f2-85ea-ae75c3d6812e\") " pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:03.819532 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819255 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e5d5637f-5cd7-4b29-bb1c-c8b5c45786c2-konnectivity-ca\") pod \"konnectivity-agent-t22z2\" (UID: \"e5d5637f-5cd7-4b29-bb1c-c8b5c45786c2\") " pod="kube-system/konnectivity-agent-t22z2" Jul 21 15:01:03.819532 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819282 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-system-cni-dir\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.819532 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819309 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4bef143c-d202-45f2-85ea-ae75c3d6812e-dbus\") pod \"global-pull-secret-syncer-rj7km\" (UID: \"4bef143c-d202-45f2-85ea-ae75c3d6812e\") " pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:03.819532 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819335 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4e65841-4011-4525-ba59-2effd740f791-cni-binary-copy\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.819532 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819359 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-host-run-k8s-cni-cncf-io\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.819532 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819416 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-host-run-netns\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.819532 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819443 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8af705e-4863-4cb5-af5c-0d1657d19d1b-tmp\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.819532 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819471 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-system-cni-dir\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.819532 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819495 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-multus-cni-dir\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.819532 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819525 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-host-var-lib-cni-multus\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.820074 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819553 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p7kw\" (UniqueName: \"kubernetes.io/projected/d4e65841-4011-4525-ba59-2effd740f791-kube-api-access-9p7kw\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.820074 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819579 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-host-kubelet\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.820074 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819618 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d4e65841-4011-4525-ba59-2effd740f791-multus-daemon-config\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.820074 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819717 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6970a7ea-4844-421f-8399-44aff10ce67d-host\") pod \"node-ca-8hjhr\" (UID: \"6970a7ea-4844-421f-8399-44aff10ce67d\") " pod="openshift-image-registry/node-ca-8hjhr" Jul 21 15:01:03.820074 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819760 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6970a7ea-4844-421f-8399-44aff10ce67d-serviceca\") pod \"node-ca-8hjhr\" (UID: \"6970a7ea-4844-421f-8399-44aff10ce67d\") " pod="openshift-image-registry/node-ca-8hjhr" Jul 21 15:01:03.820074 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819806 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-etc-modprobe-d\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.820074 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819840 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-etc-sysctl-conf\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.820074 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819862 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-lib-modules\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.820074 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819886 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/28ca6fdc-cd9e-49b0-a85c-495a164abbcd-registration-dir\") pod \"aws-ebs-csi-driver-node-g8vlx\" (UID: \"28ca6fdc-cd9e-49b0-a85c-495a164abbcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:03.820074 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819906 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-systemd-units\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.820074 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819925 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-host-slash\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.820074 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819951 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-node-log\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.820074 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.819999 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-host-cni-bin\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.820074 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820031 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/28ca6fdc-cd9e-49b0-a85c-495a164abbcd-sys-fs\") pod \"aws-ebs-csi-driver-node-g8vlx\" (UID: \"28ca6fdc-cd9e-49b0-a85c-495a164abbcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:03.820074 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820048 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq5l9\" (UniqueName: \"kubernetes.io/projected/28ca6fdc-cd9e-49b0-a85c-495a164abbcd-kube-api-access-hq5l9\") pod \"aws-ebs-csi-driver-node-g8vlx\" (UID: \"28ca6fdc-cd9e-49b0-a85c-495a164abbcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:03.820074 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820065 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e5d5637f-5cd7-4b29-bb1c-c8b5c45786c2-agent-certs\") pod \"konnectivity-agent-t22z2\" (UID: \"e5d5637f-5cd7-4b29-bb1c-c8b5c45786c2\") " pod="kube-system/konnectivity-agent-t22z2" Jul 21 15:01:03.820646 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820098 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e8af705e-4863-4cb5-af5c-0d1657d19d1b-etc-tuned\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.820646 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820122 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-host-cni-netd\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.820646 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820155 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.820646 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820185 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdlmt\" (UniqueName: \"kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt\") pod \"network-check-target-nf7mq\" (UID: \"ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d\") " pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:03.820646 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820226 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-os-release\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.820646 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820266 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-hostroot\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.820646 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820304 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-host-run-multus-certs\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.820646 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820362 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/28ca6fdc-cd9e-49b0-a85c-495a164abbcd-etc-selinux\") pod \"aws-ebs-csi-driver-node-g8vlx\" (UID: \"28ca6fdc-cd9e-49b0-a85c-495a164abbcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:03.820646 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820400 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drdvz\" (UniqueName: \"kubernetes.io/projected/ec99e5c6-a468-4067-a9f9-120ab64e1a1f-kube-api-access-drdvz\") pod \"node-resolver-z5vz5\" (UID: \"ec99e5c6-a468-4067-a9f9-120ab64e1a1f\") " pod="openshift-dns/node-resolver-z5vz5" Jul 21 15:01:03.820646 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820451 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5b08086-eac8-4329-a903-a73b5e8503ce-ovnkube-config\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.820646 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820515 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5b08086-eac8-4329-a903-a73b5e8503ce-ovn-node-metrics-cert\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.820646 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820543 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/28ca6fdc-cd9e-49b0-a85c-495a164abbcd-socket-dir\") pod \"aws-ebs-csi-driver-node-g8vlx\" (UID: \"28ca6fdc-cd9e-49b0-a85c-495a164abbcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:03.820646 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820560 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6a3f1c14-41af-4531-8e95-d0735bf01095-iptables-alerter-script\") pod \"iptables-alerter-p6ndv\" (UID: \"6a3f1c14-41af-4531-8e95-d0735bf01095\") " pod="openshift-network-operator/iptables-alerter-p6ndv" Jul 21 15:01:03.820646 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820576 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvjm7\" (UniqueName: \"kubernetes.io/projected/6a3f1c14-41af-4531-8e95-d0735bf01095-kube-api-access-wvjm7\") pod \"iptables-alerter-p6ndv\" (UID: \"6a3f1c14-41af-4531-8e95-d0735bf01095\") " pod="openshift-network-operator/iptables-alerter-p6ndv" Jul 21 15:01:03.820646 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820600 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-os-release\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.820646 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820625 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-tuning-conf-dir\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.821355 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820652 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-var-lib-kubelet\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.821355 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820674 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-host\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.821355 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820690 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/28ca6fdc-cd9e-49b0-a85c-495a164abbcd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g8vlx\" (UID: \"28ca6fdc-cd9e-49b0-a85c-495a164abbcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:03.821355 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820727 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-run-systemd\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.821355 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820761 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-log-socket\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.821355 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820826 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.821355 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820853 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgd49\" (UniqueName: \"kubernetes.io/projected/7b297c76-9cfa-44de-82d8-a62027a7f081-kube-api-access-lgd49\") pod \"network-metrics-daemon-zdtw9\" (UID: \"7b297c76-9cfa-44de-82d8-a62027a7f081\") " pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:03.821355 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820893 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4bef143c-d202-45f2-85ea-ae75c3d6812e-kubelet-config\") pod \"global-pull-secret-syncer-rj7km\" (UID: \"4bef143c-d202-45f2-85ea-ae75c3d6812e\") " pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:03.821355 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.820968 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5b08086-eac8-4329-a903-a73b5e8503ce-env-overrides\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.821355 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821004 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5b08086-eac8-4329-a903-a73b5e8503ce-ovnkube-script-lib\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.821355 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821048 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ec99e5c6-a468-4067-a9f9-120ab64e1a1f-hosts-file\") pod \"node-resolver-z5vz5\" (UID: \"ec99e5c6-a468-4067-a9f9-120ab64e1a1f\") " pod="openshift-dns/node-resolver-z5vz5" Jul 21 15:01:03.821355 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821079 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-run-ovn\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.821355 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821104 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.821355 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821120 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9jd2\" (UniqueName: \"kubernetes.io/projected/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-kube-api-access-z9jd2\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.821355 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821137 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-host-var-lib-cni-bin\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.821355 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821170 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-host-var-lib-kubelet\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.822085 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821190 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.822085 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821205 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-etc-systemd\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.822085 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821220 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-multus-socket-dir-parent\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.822085 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821241 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-etc-kubernetes\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.822085 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821299 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-cnibin\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.822085 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821333 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs\") pod \"network-metrics-daemon-zdtw9\" (UID: \"7b297c76-9cfa-44de-82d8-a62027a7f081\") " pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:03.822085 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821357 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lhjn\" (UniqueName: \"kubernetes.io/projected/6970a7ea-4844-421f-8399-44aff10ce67d-kube-api-access-6lhjn\") pod \"node-ca-8hjhr\" (UID: \"6970a7ea-4844-421f-8399-44aff10ce67d\") " pod="openshift-image-registry/node-ca-8hjhr" Jul 21 15:01:03.822085 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821384 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-etc-sysctl-d\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.822085 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821426 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-run\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.822085 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821457 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-sys\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.822085 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821486 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-host-run-netns\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.822085 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821514 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-var-lib-openvswitch\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.822085 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821542 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-cni-binary-copy\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.822085 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821569 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-etc-sysconfig\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.822085 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821592 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-cnibin\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.822085 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821619 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-etc-openvswitch\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.822839 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.821648 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-run-openvswitch\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.895698 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:03.895640 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0a7da5646d11ae196ceeecffb05398c.slice/crio-1d9a3cab7d2ec6bff788891a748caeb4af796d3f9b4df3bc57cc9d65680263f6 WatchSource:0}: Error finding container 1d9a3cab7d2ec6bff788891a748caeb4af796d3f9b4df3bc57cc9d65680263f6: Status 404 returned error can't find the container with id 1d9a3cab7d2ec6bff788891a748caeb4af796d3f9b4df3bc57cc9d65680263f6 Jul 21 15:01:03.902406 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.902389 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 15:01:03.922527 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922497 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4bef143c-d202-45f2-85ea-ae75c3d6812e-dbus\") pod \"global-pull-secret-syncer-rj7km\" (UID: \"4bef143c-d202-45f2-85ea-ae75c3d6812e\") " pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:03.922662 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922533 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4e65841-4011-4525-ba59-2effd740f791-cni-binary-copy\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.922662 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922552 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-host-run-k8s-cni-cncf-io\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.922662 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922573 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-host-run-netns\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.922662 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922628 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-host-run-netns\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.922662 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922639 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-host-run-k8s-cni-cncf-io\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.922861 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922662 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8af705e-4863-4cb5-af5c-0d1657d19d1b-tmp\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.922861 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922681 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4bef143c-d202-45f2-85ea-ae75c3d6812e-dbus\") pod \"global-pull-secret-syncer-rj7km\" (UID: \"4bef143c-d202-45f2-85ea-ae75c3d6812e\") " pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:03.922861 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922709 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-system-cni-dir\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.922861 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922729 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-multus-cni-dir\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.922861 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922755 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-host-var-lib-cni-multus\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.922861 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922775 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p7kw\" (UniqueName: \"kubernetes.io/projected/d4e65841-4011-4525-ba59-2effd740f791-kube-api-access-9p7kw\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.922861 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922789 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-system-cni-dir\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.922861 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922809 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-host-kubelet\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.922861 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922851 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-multus-cni-dir\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.922861 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922860 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-host-kubelet\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.923371 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922864 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-host-var-lib-cni-multus\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.923371 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922889 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d4e65841-4011-4525-ba59-2effd740f791-multus-daemon-config\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.923371 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922927 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6970a7ea-4844-421f-8399-44aff10ce67d-host\") pod \"node-ca-8hjhr\" (UID: \"6970a7ea-4844-421f-8399-44aff10ce67d\") " pod="openshift-image-registry/node-ca-8hjhr" Jul 21 15:01:03.923371 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922950 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6970a7ea-4844-421f-8399-44aff10ce67d-serviceca\") pod \"node-ca-8hjhr\" (UID: \"6970a7ea-4844-421f-8399-44aff10ce67d\") " pod="openshift-image-registry/node-ca-8hjhr" Jul 21 15:01:03.923371 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922968 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-etc-modprobe-d\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.923371 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922988 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-etc-sysctl-conf\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.923371 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.922969 2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 21 15:01:03.923371 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923050 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6970a7ea-4844-421f-8399-44aff10ce67d-host\") pod \"node-ca-8hjhr\" (UID: \"6970a7ea-4844-421f-8399-44aff10ce67d\") " pod="openshift-image-registry/node-ca-8hjhr" Jul 21 15:01:03.923371 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923145 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-etc-sysctl-conf\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.923371 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923152 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-lib-modules\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.923371 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923180 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/28ca6fdc-cd9e-49b0-a85c-495a164abbcd-registration-dir\") pod \"aws-ebs-csi-driver-node-g8vlx\" (UID: \"28ca6fdc-cd9e-49b0-a85c-495a164abbcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:03.923371 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923175 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-etc-modprobe-d\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.923371 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923214 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-systemd-units\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.923371 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923251 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-host-slash\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.923371 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923254 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/28ca6fdc-cd9e-49b0-a85c-495a164abbcd-registration-dir\") pod \"aws-ebs-csi-driver-node-g8vlx\" (UID: \"28ca6fdc-cd9e-49b0-a85c-495a164abbcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:03.923371 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923277 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-node-log\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.923371 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923298 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-systemd-units\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.923371 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923304 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-host-cni-bin\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.924269 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923298 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-lib-modules\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.924269 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923341 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-host-slash\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.924269 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923343 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-node-log\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.924269 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923353 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-host-cni-bin\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.924269 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923361 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/28ca6fdc-cd9e-49b0-a85c-495a164abbcd-sys-fs\") pod \"aws-ebs-csi-driver-node-g8vlx\" (UID: \"28ca6fdc-cd9e-49b0-a85c-495a164abbcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:03.924269 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923392 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq5l9\" (UniqueName: \"kubernetes.io/projected/28ca6fdc-cd9e-49b0-a85c-495a164abbcd-kube-api-access-hq5l9\") pod \"aws-ebs-csi-driver-node-g8vlx\" (UID: \"28ca6fdc-cd9e-49b0-a85c-495a164abbcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:03.924269 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923408 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/28ca6fdc-cd9e-49b0-a85c-495a164abbcd-sys-fs\") pod \"aws-ebs-csi-driver-node-g8vlx\" (UID: \"28ca6fdc-cd9e-49b0-a85c-495a164abbcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:03.924269 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923420 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e5d5637f-5cd7-4b29-bb1c-c8b5c45786c2-agent-certs\") pod \"konnectivity-agent-t22z2\" (UID: \"e5d5637f-5cd7-4b29-bb1c-c8b5c45786c2\") " pod="kube-system/konnectivity-agent-t22z2" Jul 21 15:01:03.924269 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923443 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e8af705e-4863-4cb5-af5c-0d1657d19d1b-etc-tuned\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.924269 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923465 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-host-cni-netd\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.924269 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923488 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.924269 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923515 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdlmt\" (UniqueName: \"kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt\") pod \"network-check-target-nf7mq\" (UID: \"ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d\") " pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:03.924269 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923538 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-os-release\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.924269 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923552 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6970a7ea-4844-421f-8399-44aff10ce67d-serviceca\") pod \"node-ca-8hjhr\" (UID: \"6970a7ea-4844-421f-8399-44aff10ce67d\") " pod="openshift-image-registry/node-ca-8hjhr" Jul 21 15:01:03.924269 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923613 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-host-cni-netd\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.924269 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923561 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-hostroot\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.924269 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923655 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-hostroot\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.924269 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923654 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-host-run-multus-certs\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.925252 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923756 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.925252 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923823 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-os-release\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.925252 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923856 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/28ca6fdc-cd9e-49b0-a85c-495a164abbcd-etc-selinux\") pod \"aws-ebs-csi-driver-node-g8vlx\" (UID: \"28ca6fdc-cd9e-49b0-a85c-495a164abbcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:03.925252 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923882 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-host-run-multus-certs\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.925252 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923947 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drdvz\" (UniqueName: \"kubernetes.io/projected/ec99e5c6-a468-4067-a9f9-120ab64e1a1f-kube-api-access-drdvz\") pod \"node-resolver-z5vz5\" (UID: \"ec99e5c6-a468-4067-a9f9-120ab64e1a1f\") " pod="openshift-dns/node-resolver-z5vz5" Jul 21 15:01:03.925252 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.923975 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5b08086-eac8-4329-a903-a73b5e8503ce-ovnkube-config\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.925252 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924020 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5b08086-eac8-4329-a903-a73b5e8503ce-ovn-node-metrics-cert\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.925252 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924047 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/28ca6fdc-cd9e-49b0-a85c-495a164abbcd-socket-dir\") pod \"aws-ebs-csi-driver-node-g8vlx\" (UID: \"28ca6fdc-cd9e-49b0-a85c-495a164abbcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:03.925252 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924069 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d4e65841-4011-4525-ba59-2effd740f791-cni-binary-copy\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.925252 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924088 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6a3f1c14-41af-4531-8e95-d0735bf01095-iptables-alerter-script\") pod \"iptables-alerter-p6ndv\" (UID: \"6a3f1c14-41af-4531-8e95-d0735bf01095\") " pod="openshift-network-operator/iptables-alerter-p6ndv" Jul 21 15:01:03.925252 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924017 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/28ca6fdc-cd9e-49b0-a85c-495a164abbcd-etc-selinux\") pod \"aws-ebs-csi-driver-node-g8vlx\" (UID: \"28ca6fdc-cd9e-49b0-a85c-495a164abbcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:03.925252 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924148 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d4e65841-4011-4525-ba59-2effd740f791-multus-daemon-config\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.925252 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924179 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvjm7\" (UniqueName: \"kubernetes.io/projected/6a3f1c14-41af-4531-8e95-d0735bf01095-kube-api-access-wvjm7\") pod \"iptables-alerter-p6ndv\" (UID: \"6a3f1c14-41af-4531-8e95-d0735bf01095\") " pod="openshift-network-operator/iptables-alerter-p6ndv" Jul 21 15:01:03.925252 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924209 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-os-release\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.925252 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924254 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-tuning-conf-dir\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.925252 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924282 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-var-lib-kubelet\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.925252 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924303 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-host\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.926152 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924440 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/28ca6fdc-cd9e-49b0-a85c-495a164abbcd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g8vlx\" (UID: \"28ca6fdc-cd9e-49b0-a85c-495a164abbcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:03.926152 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924466 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-run-systemd\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.926152 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924492 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-log-socket\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.926152 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924499 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-var-lib-kubelet\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.926152 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924536 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-log-socket\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.926152 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924550 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-host\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.926152 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924585 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.926152 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924688 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-os-release\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.926152 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924690 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-tuning-conf-dir\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.926152 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924755 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgd49\" (UniqueName: \"kubernetes.io/projected/7b297c76-9cfa-44de-82d8-a62027a7f081-kube-api-access-lgd49\") pod \"network-metrics-daemon-zdtw9\" (UID: \"7b297c76-9cfa-44de-82d8-a62027a7f081\") " pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:03.926152 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924785 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4bef143c-d202-45f2-85ea-ae75c3d6812e-kubelet-config\") pod \"global-pull-secret-syncer-rj7km\" (UID: \"4bef143c-d202-45f2-85ea-ae75c3d6812e\") " pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:03.926152 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924851 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5b08086-eac8-4329-a903-a73b5e8503ce-env-overrides\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.926152 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924880 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5b08086-eac8-4329-a903-a73b5e8503ce-ovnkube-script-lib\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.926152 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924934 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ec99e5c6-a468-4067-a9f9-120ab64e1a1f-hosts-file\") pod \"node-resolver-z5vz5\" (UID: \"ec99e5c6-a468-4067-a9f9-120ab64e1a1f\") " pod="openshift-dns/node-resolver-z5vz5" Jul 21 15:01:03.926152 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.924958 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-run-ovn\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.926152 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.925004 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.926152 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.925017 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4bef143c-d202-45f2-85ea-ae75c3d6812e-kubelet-config\") pod \"global-pull-secret-syncer-rj7km\" (UID: \"4bef143c-d202-45f2-85ea-ae75c3d6812e\") " pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:03.926945 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.925036 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9jd2\" (UniqueName: \"kubernetes.io/projected/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-kube-api-access-z9jd2\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.926945 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.925067 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-run-ovn\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.926945 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.925080 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-host-var-lib-cni-bin\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.926945 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.925195 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b5b08086-eac8-4329-a903-a73b5e8503ce-ovnkube-config\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.926945 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.925235 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ec99e5c6-a468-4067-a9f9-120ab64e1a1f-hosts-file\") pod \"node-resolver-z5vz5\" (UID: \"ec99e5c6-a468-4067-a9f9-120ab64e1a1f\") " pod="openshift-dns/node-resolver-z5vz5" Jul 21 15:01:03.926945 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.925298 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-host-var-lib-cni-bin\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.926945 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.925340 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-host-var-lib-kubelet\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.926945 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.925570 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b5b08086-eac8-4329-a903-a73b5e8503ce-env-overrides\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.926945 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.925654 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/28ca6fdc-cd9e-49b0-a85c-495a164abbcd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g8vlx\" (UID: \"28ca6fdc-cd9e-49b0-a85c-495a164abbcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:03.926945 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.925714 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b5b08086-eac8-4329-a903-a73b5e8503ce-ovnkube-script-lib\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.926945 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.925766 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-host-var-lib-kubelet\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.926945 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.925773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.926945 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.925814 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-run-systemd\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.926945 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.925869 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-etc-systemd\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.926945 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.925896 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.926945 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.925896 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6a3f1c14-41af-4531-8e95-d0735bf01095-iptables-alerter-script\") pod \"iptables-alerter-p6ndv\" (UID: \"6a3f1c14-41af-4531-8e95-d0735bf01095\") " pod="openshift-network-operator/iptables-alerter-p6ndv" Jul 21 15:01:03.926945 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.925923 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-multus-socket-dir-parent\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.927809 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.925972 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-etc-kubernetes\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.927809 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.925999 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-etc-systemd\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.927809 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926016 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/28ca6fdc-cd9e-49b0-a85c-495a164abbcd-socket-dir\") pod \"aws-ebs-csi-driver-node-g8vlx\" (UID: \"28ca6fdc-cd9e-49b0-a85c-495a164abbcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:03.927809 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926019 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-cnibin\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.927809 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926050 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs\") pod \"network-metrics-daemon-zdtw9\" (UID: \"7b297c76-9cfa-44de-82d8-a62027a7f081\") " pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:03.927809 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926060 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-host-run-ovn-kubernetes\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.927809 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926064 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-etc-kubernetes\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.927809 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926103 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lhjn\" (UniqueName: \"kubernetes.io/projected/6970a7ea-4844-421f-8399-44aff10ce67d-kube-api-access-6lhjn\") pod \"node-ca-8hjhr\" (UID: \"6970a7ea-4844-421f-8399-44aff10ce67d\") " pod="openshift-image-registry/node-ca-8hjhr" Jul 21 15:01:03.927809 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926105 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-multus-socket-dir-parent\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.927809 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926135 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-etc-sysctl-d\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.927809 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:03.926188 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 15:01:03.927809 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926251 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.927809 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926315 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-run\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.927809 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926374 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-run\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.927809 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926396 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-etc-sysctl-d\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.927809 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926429 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-cnibin\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.927809 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:03.926471 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs podName:7b297c76-9cfa-44de-82d8-a62027a7f081 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:04.426331463 +0000 UTC m=+2.110987066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs") pod "network-metrics-daemon-zdtw9" (UID: "7b297c76-9cfa-44de-82d8-a62027a7f081") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 15:01:03.928376 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926493 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-sys\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.928376 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926533 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-sys\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.928376 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926557 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-host-run-netns\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.928376 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926587 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-var-lib-openvswitch\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.928376 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926614 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-cni-binary-copy\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.928376 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926641 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-etc-sysconfig\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.928376 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926650 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-host-run-netns\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.928376 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926668 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-cnibin\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.928376 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926694 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-etc-openvswitch\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.928376 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926707 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-etc-sysconfig\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.928376 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926719 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-var-lib-openvswitch\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.928376 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926720 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-run-openvswitch\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.928376 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926778 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-cnibin\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.928376 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926783 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-etc-kubernetes\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.928376 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926777 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-etc-openvswitch\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.928376 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926817 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwfv8\" (UniqueName: \"kubernetes.io/projected/e8af705e-4863-4cb5-af5c-0d1657d19d1b-kube-api-access-hwfv8\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.928376 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926825 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b5b08086-eac8-4329-a903-a73b5e8503ce-run-openvswitch\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.928376 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-multus-conf-dir\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.928912 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926855 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e8af705e-4863-4cb5-af5c-0d1657d19d1b-tmp\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.928912 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926877 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/28ca6fdc-cd9e-49b0-a85c-495a164abbcd-device-dir\") pod \"aws-ebs-csi-driver-node-g8vlx\" (UID: \"28ca6fdc-cd9e-49b0-a85c-495a164abbcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:03.928912 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.926881 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e8af705e-4863-4cb5-af5c-0d1657d19d1b-etc-kubernetes\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.928912 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.927024 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a3f1c14-41af-4531-8e95-d0735bf01095-host-slash\") pod \"iptables-alerter-p6ndv\" (UID: \"6a3f1c14-41af-4531-8e95-d0735bf01095\") " pod="openshift-network-operator/iptables-alerter-p6ndv" Jul 21 15:01:03.928912 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.927058 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec99e5c6-a468-4067-a9f9-120ab64e1a1f-tmp-dir\") pod \"node-resolver-z5vz5\" (UID: \"ec99e5c6-a468-4067-a9f9-120ab64e1a1f\") " pod="openshift-dns/node-resolver-z5vz5" Jul 21 15:01:03.928912 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.927077 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b5b08086-eac8-4329-a903-a73b5e8503ce-ovn-node-metrics-cert\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.928912 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.927030 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/28ca6fdc-cd9e-49b0-a85c-495a164abbcd-device-dir\") pod \"aws-ebs-csi-driver-node-g8vlx\" (UID: \"28ca6fdc-cd9e-49b0-a85c-495a164abbcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:03.928912 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.927099 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6a3f1c14-41af-4531-8e95-d0735bf01095-host-slash\") pod \"iptables-alerter-p6ndv\" (UID: \"6a3f1c14-41af-4531-8e95-d0735bf01095\") " pod="openshift-network-operator/iptables-alerter-p6ndv" Jul 21 15:01:03.928912 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.927062 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d4e65841-4011-4525-ba59-2effd740f791-multus-conf-dir\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.928912 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.927156 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-cni-binary-copy\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.928912 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.927125 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4kk4\" (UniqueName: \"kubernetes.io/projected/b5b08086-eac8-4329-a903-a73b5e8503ce-kube-api-access-c4kk4\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.928912 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.927210 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret\") pod \"global-pull-secret-syncer-rj7km\" (UID: \"4bef143c-d202-45f2-85ea-ae75c3d6812e\") " pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:03.928912 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.927237 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e5d5637f-5cd7-4b29-bb1c-c8b5c45786c2-konnectivity-ca\") pod \"konnectivity-agent-t22z2\" (UID: \"e5d5637f-5cd7-4b29-bb1c-c8b5c45786c2\") " pod="kube-system/konnectivity-agent-t22z2" Jul 21 15:01:03.928912 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.927251 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e5d5637f-5cd7-4b29-bb1c-c8b5c45786c2-agent-certs\") pod \"konnectivity-agent-t22z2\" (UID: \"e5d5637f-5cd7-4b29-bb1c-c8b5c45786c2\") " pod="kube-system/konnectivity-agent-t22z2" Jul 21 15:01:03.928912 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.927272 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-system-cni-dir\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.928912 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:03.927340 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 15:01:03.928912 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.927397 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec99e5c6-a468-4067-a9f9-120ab64e1a1f-tmp-dir\") pod \"node-resolver-z5vz5\" (UID: \"ec99e5c6-a468-4067-a9f9-120ab64e1a1f\") " pod="openshift-dns/node-resolver-z5vz5" Jul 21 15:01:03.929423 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:03.927455 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret podName:4bef143c-d202-45f2-85ea-ae75c3d6812e nodeName:}" failed. No retries permitted until 2026-07-21 15:01:04.427441115 +0000 UTC m=+2.112096701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret") pod "global-pull-secret-syncer-rj7km" (UID: "4bef143c-d202-45f2-85ea-ae75c3d6812e") : object "kube-system"/"original-pull-secret" not registered Jul 21 15:01:03.929423 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.927344 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-system-cni-dir\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.929423 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.927789 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e5d5637f-5cd7-4b29-bb1c-c8b5c45786c2-konnectivity-ca\") pod \"konnectivity-agent-t22z2\" (UID: \"e5d5637f-5cd7-4b29-bb1c-c8b5c45786c2\") " pod="kube-system/konnectivity-agent-t22z2" Jul 21 15:01:03.929423 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.928536 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e8af705e-4863-4cb5-af5c-0d1657d19d1b-etc-tuned\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:03.932164 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:03.932141 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 15:01:03.932285 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:03.932167 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 15:01:03.932285 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:03.932184 2577 projected.go:196] Error preparing data for projected volume kube-api-access-bdlmt for pod openshift-network-diagnostics/network-check-target-nf7mq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 15:01:03.932285 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:03.932237 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt podName:ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d nodeName:}" failed. No retries permitted until 2026-07-21 15:01:04.432221368 +0000 UTC m=+2.116876994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bdlmt" (UniqueName: "kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt") pod "network-check-target-nf7mq" (UID: "ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 15:01:03.932862 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.932836 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq5l9\" (UniqueName: \"kubernetes.io/projected/28ca6fdc-cd9e-49b0-a85c-495a164abbcd-kube-api-access-hq5l9\") pod \"aws-ebs-csi-driver-node-g8vlx\" (UID: \"28ca6fdc-cd9e-49b0-a85c-495a164abbcd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:03.932948 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.932928 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p7kw\" (UniqueName: \"kubernetes.io/projected/d4e65841-4011-4525-ba59-2effd740f791-kube-api-access-9p7kw\") pod \"multus-gjxv9\" (UID: \"d4e65841-4011-4525-ba59-2effd740f791\") " pod="openshift-multus/multus-gjxv9" Jul 21 15:01:03.933434 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.933409 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvjm7\" (UniqueName: \"kubernetes.io/projected/6a3f1c14-41af-4531-8e95-d0735bf01095-kube-api-access-wvjm7\") pod \"iptables-alerter-p6ndv\" (UID: \"6a3f1c14-41af-4531-8e95-d0735bf01095\") " pod="openshift-network-operator/iptables-alerter-p6ndv" Jul 21 15:01:03.933551 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.933534 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drdvz\" (UniqueName: \"kubernetes.io/projected/ec99e5c6-a468-4067-a9f9-120ab64e1a1f-kube-api-access-drdvz\") pod \"node-resolver-z5vz5\" (UID: \"ec99e5c6-a468-4067-a9f9-120ab64e1a1f\") " pod="openshift-dns/node-resolver-z5vz5" Jul 21 15:01:03.935451 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.935434 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lhjn\" (UniqueName: \"kubernetes.io/projected/6970a7ea-4844-421f-8399-44aff10ce67d-kube-api-access-6lhjn\") pod \"node-ca-8hjhr\" (UID: \"6970a7ea-4844-421f-8399-44aff10ce67d\") " pod="openshift-image-registry/node-ca-8hjhr" Jul 21 15:01:03.935663 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.935646 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgd49\" (UniqueName: \"kubernetes.io/projected/7b297c76-9cfa-44de-82d8-a62027a7f081-kube-api-access-lgd49\") pod \"network-metrics-daemon-zdtw9\" (UID: \"7b297c76-9cfa-44de-82d8-a62027a7f081\") " pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:03.935869 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.935851 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9jd2\" (UniqueName: \"kubernetes.io/projected/0dbb0449-f6cd-4fbe-ab4a-02e54935dc53-kube-api-access-z9jd2\") pod \"multus-additional-cni-plugins-plxr5\" (UID: \"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53\") " pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:03.937875 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.937851 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4kk4\" (UniqueName: \"kubernetes.io/projected/b5b08086-eac8-4329-a903-a73b5e8503ce-kube-api-access-c4kk4\") pod \"ovnkube-node-mfv5x\" (UID: \"b5b08086-eac8-4329-a903-a73b5e8503ce\") " pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:03.937957 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:03.937909 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwfv8\" (UniqueName: \"kubernetes.io/projected/e8af705e-4863-4cb5-af5c-0d1657d19d1b-kube-api-access-hwfv8\") pod \"tuned-m8fpb\" (UID: \"e8af705e-4863-4cb5-af5c-0d1657d19d1b\") " pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:04.041084 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.040991 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8hjhr" Jul 21 15:01:04.052517 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:04.052487 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6970a7ea_4844_421f_8399_44aff10ce67d.slice/crio-45885a2b80d035e620c3ea696a89b9488bff0d5e5b132fa8cdcbf54a18047c65 WatchSource:0}: Error finding container 45885a2b80d035e620c3ea696a89b9488bff0d5e5b132fa8cdcbf54a18047c65: Status 404 returned error can't find the container with id 45885a2b80d035e620c3ea696a89b9488bff0d5e5b132fa8cdcbf54a18047c65 Jul 21 15:01:04.059055 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.059032 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" Jul 21 15:01:04.068024 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:04.067997 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8af705e_4863_4cb5_af5c_0d1657d19d1b.slice/crio-5cf14ed9239356784ebb8acc2d86b182a88416a55d5e01cb92a5119b157d832e WatchSource:0}: Error finding container 5cf14ed9239356784ebb8acc2d86b182a88416a55d5e01cb92a5119b157d832e: Status 404 returned error can't find the container with id 5cf14ed9239356784ebb8acc2d86b182a88416a55d5e01cb92a5119b157d832e Jul 21 15:01:04.083212 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.083182 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gjxv9" Jul 21 15:01:04.088358 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.088335 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p6ndv" Jul 21 15:01:04.092595 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:04.092571 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e65841_4011_4525_ba59_2effd740f791.slice/crio-d41dcc6ffac7cd2dea47abfd949ca2245101f1fb3beb0874f34de1d8f93da59a WatchSource:0}: Error finding container d41dcc6ffac7cd2dea47abfd949ca2245101f1fb3beb0874f34de1d8f93da59a: Status 404 returned error can't find the container with id d41dcc6ffac7cd2dea47abfd949ca2245101f1fb3beb0874f34de1d8f93da59a Jul 21 15:01:04.097327 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:04.097302 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a3f1c14_41af_4531_8e95_d0735bf01095.slice/crio-5867b2b564f89450059507c6d5e90b0798fb0d278dbcedd18145adb240d80d79 WatchSource:0}: Error finding container 5867b2b564f89450059507c6d5e90b0798fb0d278dbcedd18145adb240d80d79: Status 404 returned error can't find the container with id 5867b2b564f89450059507c6d5e90b0798fb0d278dbcedd18145adb240d80d79 Jul 21 15:01:04.105057 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.105037 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z5vz5" Jul 21 15:01:04.114845 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:04.114810 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec99e5c6_a468_4067_a9f9_120ab64e1a1f.slice/crio-64d8dc52dd6a807a3246614cdf15932dea31049e94dd795fff8fa24518083b14 WatchSource:0}: Error finding container 64d8dc52dd6a807a3246614cdf15932dea31049e94dd795fff8fa24518083b14: Status 404 returned error can't find the container with id 64d8dc52dd6a807a3246614cdf15932dea31049e94dd795fff8fa24518083b14 Jul 21 15:01:04.118575 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.118557 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:04.128471 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:04.128442 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5b08086_eac8_4329_a903_a73b5e8503ce.slice/crio-5b53f4b83c21c6054930816935452420379a9db9cd24db0807323884425a75a1 WatchSource:0}: Error finding container 5b53f4b83c21c6054930816935452420379a9db9cd24db0807323884425a75a1: Status 404 returned error can't find the container with id 5b53f4b83c21c6054930816935452420379a9db9cd24db0807323884425a75a1 Jul 21 15:01:04.132947 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.132921 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" Jul 21 15:01:04.138528 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.138502 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-t22z2" Jul 21 15:01:04.142257 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:04.142234 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28ca6fdc_cd9e_49b0_a85c_495a164abbcd.slice/crio-263e6c1159b245400b9dc691a32c4db6a778b37d26b48b926c71470f9182f47f WatchSource:0}: Error finding container 263e6c1159b245400b9dc691a32c4db6a778b37d26b48b926c71470f9182f47f: Status 404 returned error can't find the container with id 263e6c1159b245400b9dc691a32c4db6a778b37d26b48b926c71470f9182f47f Jul 21 15:01:04.142966 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.142939 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-plxr5" Jul 21 15:01:04.148097 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:04.148072 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5d5637f_5cd7_4b29_bb1c_c8b5c45786c2.slice/crio-49bdd0242649943cb99290e90acbe53b5667a60414b4022e54ac657dd7799b60 WatchSource:0}: Error finding container 49bdd0242649943cb99290e90acbe53b5667a60414b4022e54ac657dd7799b60: Status 404 returned error can't find the container with id 49bdd0242649943cb99290e90acbe53b5667a60414b4022e54ac657dd7799b60 Jul 21 15:01:04.153462 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:04.153442 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0dbb0449_f6cd_4fbe_ab4a_02e54935dc53.slice/crio-9418cc930af42edbe34add7ab772850f3675eba61110841796cf9ab5fe3a1d24 WatchSource:0}: Error finding container 9418cc930af42edbe34add7ab772850f3675eba61110841796cf9ab5fe3a1d24: Status 404 returned error can't find the container with id 9418cc930af42edbe34add7ab772850f3675eba61110841796cf9ab5fe3a1d24 Jul 21 15:01:04.430294 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.430202 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs\") pod \"network-metrics-daemon-zdtw9\" (UID: \"7b297c76-9cfa-44de-82d8-a62027a7f081\") " pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:04.430294 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.430256 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret\") pod \"global-pull-secret-syncer-rj7km\" (UID: \"4bef143c-d202-45f2-85ea-ae75c3d6812e\") " pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:04.430501 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:04.430384 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 15:01:04.430501 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:04.430471 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 15:01:04.430501 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:04.430492 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs podName:7b297c76-9cfa-44de-82d8-a62027a7f081 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:05.430470236 +0000 UTC m=+3.115125839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs") pod "network-metrics-daemon-zdtw9" (UID: "7b297c76-9cfa-44de-82d8-a62027a7f081") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 15:01:04.430634 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:04.430525 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret podName:4bef143c-d202-45f2-85ea-ae75c3d6812e nodeName:}" failed. No retries permitted until 2026-07-21 15:01:05.430508783 +0000 UTC m=+3.115164373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret") pod "global-pull-secret-syncer-rj7km" (UID: "4bef143c-d202-45f2-85ea-ae75c3d6812e") : object "kube-system"/"original-pull-secret" not registered Jul 21 15:01:04.531335 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.531296 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdlmt\" (UniqueName: \"kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt\") pod \"network-check-target-nf7mq\" (UID: \"ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d\") " pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:04.531568 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:04.531543 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 15:01:04.531697 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:04.531595 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 15:01:04.531697 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:04.531610 2577 projected.go:196] Error preparing data for projected volume kube-api-access-bdlmt for pod openshift-network-diagnostics/network-check-target-nf7mq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 15:01:04.531697 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:04.531685 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt podName:ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d nodeName:}" failed. No retries permitted until 2026-07-21 15:01:05.531665049 +0000 UTC m=+3.216320657 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bdlmt" (UniqueName: "kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt") pod "network-check-target-nf7mq" (UID: "ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 15:01:04.764057 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.763951 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 14:56:04 +0000 UTC" deadline="2027-12-26 03:17:06.082618212 +0000 UTC" Jul 21 15:01:04.764057 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.763995 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12540h16m1.318628089s" Jul 21 15:01:04.820034 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.819997 2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 15:01:04.899807 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.899689 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" event={"ID":"b5b08086-eac8-4329-a903-a73b5e8503ce","Type":"ContainerStarted","Data":"5b53f4b83c21c6054930816935452420379a9db9cd24db0807323884425a75a1"} Jul 21 15:01:04.901803 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.901768 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z5vz5" event={"ID":"ec99e5c6-a468-4067-a9f9-120ab64e1a1f","Type":"ContainerStarted","Data":"64d8dc52dd6a807a3246614cdf15932dea31049e94dd795fff8fa24518083b14"} Jul 21 15:01:04.905369 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.905340 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-162.ec2.internal" event={"ID":"e0a7da5646d11ae196ceeecffb05398c","Type":"ContainerStarted","Data":"1d9a3cab7d2ec6bff788891a748caeb4af796d3f9b4df3bc57cc9d65680263f6"} Jul 21 15:01:04.908859 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.908831 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p6ndv" event={"ID":"6a3f1c14-41af-4531-8e95-d0735bf01095","Type":"ContainerStarted","Data":"5867b2b564f89450059507c6d5e90b0798fb0d278dbcedd18145adb240d80d79"} Jul 21 15:01:04.911828 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.911712 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gjxv9" event={"ID":"d4e65841-4011-4525-ba59-2effd740f791","Type":"ContainerStarted","Data":"d41dcc6ffac7cd2dea47abfd949ca2245101f1fb3beb0874f34de1d8f93da59a"} Jul 21 15:01:04.914181 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.914075 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" event={"ID":"e8af705e-4863-4cb5-af5c-0d1657d19d1b","Type":"ContainerStarted","Data":"5cf14ed9239356784ebb8acc2d86b182a88416a55d5e01cb92a5119b157d832e"} Jul 21 15:01:04.916523 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.916443 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8hjhr" event={"ID":"6970a7ea-4844-421f-8399-44aff10ce67d","Type":"ContainerStarted","Data":"45885a2b80d035e620c3ea696a89b9488bff0d5e5b132fa8cdcbf54a18047c65"} Jul 21 15:01:04.918862 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.918783 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-plxr5" event={"ID":"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53","Type":"ContainerStarted","Data":"9418cc930af42edbe34add7ab772850f3675eba61110841796cf9ab5fe3a1d24"} Jul 21 15:01:04.920805 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.920694 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t22z2" event={"ID":"e5d5637f-5cd7-4b29-bb1c-c8b5c45786c2","Type":"ContainerStarted","Data":"49bdd0242649943cb99290e90acbe53b5667a60414b4022e54ac657dd7799b60"} Jul 21 15:01:04.923866 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:04.923800 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" event={"ID":"28ca6fdc-cd9e-49b0-a85c-495a164abbcd","Type":"ContainerStarted","Data":"263e6c1159b245400b9dc691a32c4db6a778b37d26b48b926c71470f9182f47f"} Jul 21 15:01:05.439408 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:05.439361 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs\") pod \"network-metrics-daemon-zdtw9\" (UID: \"7b297c76-9cfa-44de-82d8-a62027a7f081\") " pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:05.439630 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:05.439433 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret\") pod \"global-pull-secret-syncer-rj7km\" (UID: \"4bef143c-d202-45f2-85ea-ae75c3d6812e\") " pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:05.439630 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:05.439597 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 15:01:05.439750 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:05.439662 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret podName:4bef143c-d202-45f2-85ea-ae75c3d6812e nodeName:}" failed. No retries permitted until 2026-07-21 15:01:07.439643723 +0000 UTC m=+5.124299316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret") pod "global-pull-secret-syncer-rj7km" (UID: "4bef143c-d202-45f2-85ea-ae75c3d6812e") : object "kube-system"/"original-pull-secret" not registered Jul 21 15:01:05.440096 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:05.440069 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 15:01:05.440184 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:05.440148 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs podName:7b297c76-9cfa-44de-82d8-a62027a7f081 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:07.440127854 +0000 UTC m=+5.124783457 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs") pod "network-metrics-daemon-zdtw9" (UID: "7b297c76-9cfa-44de-82d8-a62027a7f081") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 15:01:05.453313 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:05.453278 2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 15:01:05.540558 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:05.540515 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdlmt\" (UniqueName: \"kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt\") pod \"network-check-target-nf7mq\" (UID: \"ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d\") " pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:05.540792 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:05.540766 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 15:01:05.540792 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:05.540791 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 15:01:05.540934 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:05.540805 2577 projected.go:196] Error preparing data for projected volume kube-api-access-bdlmt for pod openshift-network-diagnostics/network-check-target-nf7mq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 15:01:05.540934 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:05.540871 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt podName:ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d nodeName:}" failed. No retries permitted until 2026-07-21 15:01:07.540850812 +0000 UTC m=+5.225506407 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bdlmt" (UniqueName: "kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt") pod "network-check-target-nf7mq" (UID: "ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 15:01:05.765101 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:05.764967 2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 14:56:04 +0000 UTC" deadline="2028-04-07 07:39:59.351751236 +0000 UTC" Jul 21 15:01:05.765101 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:05.765023 2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15016h38m53.586733301s" Jul 21 15:01:05.892087 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:05.892049 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:05.892284 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:05.892212 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdtw9" podUID="7b297c76-9cfa-44de-82d8-a62027a7f081" Jul 21 15:01:05.892666 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:05.892643 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:05.892760 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:05.892746 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nf7mq" podUID="ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d" Jul 21 15:01:05.892822 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:05.892806 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:05.892915 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:05.892883 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj7km" podUID="4bef143c-d202-45f2-85ea-ae75c3d6812e" Jul 21 15:01:07.458990 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:07.458942 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs\") pod \"network-metrics-daemon-zdtw9\" (UID: \"7b297c76-9cfa-44de-82d8-a62027a7f081\") " pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:07.459475 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:07.459010 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret\") pod \"global-pull-secret-syncer-rj7km\" (UID: \"4bef143c-d202-45f2-85ea-ae75c3d6812e\") " pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:07.459475 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:07.459113 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 15:01:07.459475 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:07.459152 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 15:01:07.459475 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:07.459196 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs podName:7b297c76-9cfa-44de-82d8-a62027a7f081 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:11.45917285 +0000 UTC m=+9.143828458 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs") pod "network-metrics-daemon-zdtw9" (UID: "7b297c76-9cfa-44de-82d8-a62027a7f081") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 15:01:07.459475 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:07.459217 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret podName:4bef143c-d202-45f2-85ea-ae75c3d6812e nodeName:}" failed. No retries permitted until 2026-07-21 15:01:11.459206135 +0000 UTC m=+9.143861737 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret") pod "global-pull-secret-syncer-rj7km" (UID: "4bef143c-d202-45f2-85ea-ae75c3d6812e") : object "kube-system"/"original-pull-secret" not registered Jul 21 15:01:07.559895 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:07.559852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdlmt\" (UniqueName: \"kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt\") pod \"network-check-target-nf7mq\" (UID: \"ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d\") " pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:07.560131 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:07.560058 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 15:01:07.560131 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:07.560127 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 15:01:07.560266 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:07.560143 2577 projected.go:196] Error preparing data for projected volume kube-api-access-bdlmt for pod openshift-network-diagnostics/network-check-target-nf7mq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 15:01:07.560266 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:07.560210 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt podName:ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d nodeName:}" failed. No retries permitted until 2026-07-21 15:01:11.560190151 +0000 UTC m=+9.244845751 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bdlmt" (UniqueName: "kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt") pod "network-check-target-nf7mq" (UID: "ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 15:01:07.893036 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:07.892946 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:07.893260 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:07.893094 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj7km" podUID="4bef143c-d202-45f2-85ea-ae75c3d6812e" Jul 21 15:01:07.893686 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:07.893464 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:07.893686 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:07.893578 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nf7mq" podUID="ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d" Jul 21 15:01:07.893686 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:07.893637 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:07.893934 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:07.893730 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdtw9" podUID="7b297c76-9cfa-44de-82d8-a62027a7f081" Jul 21 15:01:09.892475 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:09.892439 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:09.892993 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:09.892439 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:09.892993 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:09.892584 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj7km" podUID="4bef143c-d202-45f2-85ea-ae75c3d6812e" Jul 21 15:01:09.892993 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:09.892691 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nf7mq" podUID="ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d" Jul 21 15:01:09.892993 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:09.892439 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:09.892993 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:09.892796 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdtw9" podUID="7b297c76-9cfa-44de-82d8-a62027a7f081" Jul 21 15:01:11.492460 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:11.492206 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs\") pod \"network-metrics-daemon-zdtw9\" (UID: \"7b297c76-9cfa-44de-82d8-a62027a7f081\") " pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:11.492888 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:11.492495 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret\") pod \"global-pull-secret-syncer-rj7km\" (UID: \"4bef143c-d202-45f2-85ea-ae75c3d6812e\") " pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:11.492888 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:11.492385 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 15:01:11.492888 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:11.492627 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs podName:7b297c76-9cfa-44de-82d8-a62027a7f081 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:19.492600972 +0000 UTC m=+17.177256571 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs") pod "network-metrics-daemon-zdtw9" (UID: "7b297c76-9cfa-44de-82d8-a62027a7f081") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 15:01:11.492888 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:11.492642 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 15:01:11.492888 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:11.492693 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret podName:4bef143c-d202-45f2-85ea-ae75c3d6812e nodeName:}" failed. No retries permitted until 2026-07-21 15:01:19.492675593 +0000 UTC m=+17.177331181 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret") pod "global-pull-secret-syncer-rj7km" (UID: "4bef143c-d202-45f2-85ea-ae75c3d6812e") : object "kube-system"/"original-pull-secret" not registered Jul 21 15:01:11.593771 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:11.593736 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdlmt\" (UniqueName: \"kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt\") pod \"network-check-target-nf7mq\" (UID: \"ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d\") " pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:11.594008 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:11.593868 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 15:01:11.594008 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:11.593904 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 15:01:11.594008 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:11.593915 2577 projected.go:196] Error preparing data for projected volume kube-api-access-bdlmt for pod openshift-network-diagnostics/network-check-target-nf7mq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 15:01:11.594008 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:11.593991 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt podName:ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d nodeName:}" failed. No retries permitted until 2026-07-21 15:01:19.593961846 +0000 UTC m=+17.278617442 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bdlmt" (UniqueName: "kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt") pod "network-check-target-nf7mq" (UID: "ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 15:01:11.892490 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:11.891985 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:11.892490 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:11.892023 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:11.892490 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:11.891985 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:11.892490 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:11.892121 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nf7mq" podUID="ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d" Jul 21 15:01:11.892490 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:11.892212 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj7km" podUID="4bef143c-d202-45f2-85ea-ae75c3d6812e" Jul 21 15:01:11.892490 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:11.892303 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdtw9" podUID="7b297c76-9cfa-44de-82d8-a62027a7f081" Jul 21 15:01:13.892002 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:13.891964 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:13.892002 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:13.891981 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:13.892549 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:13.892130 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdtw9" podUID="7b297c76-9cfa-44de-82d8-a62027a7f081" Jul 21 15:01:13.893237 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:13.892196 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nf7mq" podUID="ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d" Jul 21 15:01:13.893237 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:13.892968 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:13.895387 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:13.893519 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj7km" podUID="4bef143c-d202-45f2-85ea-ae75c3d6812e" Jul 21 15:01:15.892329 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:15.892278 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:15.892329 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:15.892309 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:15.892843 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:15.892290 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:15.892843 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:15.892426 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdtw9" podUID="7b297c76-9cfa-44de-82d8-a62027a7f081" Jul 21 15:01:15.892843 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:15.892512 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj7km" podUID="4bef143c-d202-45f2-85ea-ae75c3d6812e" Jul 21 15:01:15.892843 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:15.892612 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nf7mq" podUID="ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d" Jul 21 15:01:17.892487 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:17.892447 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:17.892949 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:17.892486 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:17.892949 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:17.892578 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj7km" podUID="4bef143c-d202-45f2-85ea-ae75c3d6812e" Jul 21 15:01:17.892949 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:17.892635 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdtw9" podUID="7b297c76-9cfa-44de-82d8-a62027a7f081" Jul 21 15:01:17.892949 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:17.892651 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:17.892949 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:17.892720 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nf7mq" podUID="ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d" Jul 21 15:01:19.554379 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:19.554334 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs\") pod \"network-metrics-daemon-zdtw9\" (UID: \"7b297c76-9cfa-44de-82d8-a62027a7f081\") " pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:19.554379 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:19.554387 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret\") pod \"global-pull-secret-syncer-rj7km\" (UID: \"4bef143c-d202-45f2-85ea-ae75c3d6812e\") " pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:19.555024 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:19.554506 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 15:01:19.555024 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:19.554560 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret podName:4bef143c-d202-45f2-85ea-ae75c3d6812e nodeName:}" failed. No retries permitted until 2026-07-21 15:01:35.554547204 +0000 UTC m=+33.239202794 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret") pod "global-pull-secret-syncer-rj7km" (UID: "4bef143c-d202-45f2-85ea-ae75c3d6812e") : object "kube-system"/"original-pull-secret" not registered Jul 21 15:01:19.555024 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:19.554506 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 15:01:19.555024 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:19.554591 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs podName:7b297c76-9cfa-44de-82d8-a62027a7f081 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:35.554584578 +0000 UTC m=+33.239240163 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs") pod "network-metrics-daemon-zdtw9" (UID: "7b297c76-9cfa-44de-82d8-a62027a7f081") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 15:01:19.655400 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:19.655353 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdlmt\" (UniqueName: \"kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt\") pod \"network-check-target-nf7mq\" (UID: \"ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d\") " pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:19.655587 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:19.655490 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 15:01:19.655587 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:19.655519 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 15:01:19.655587 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:19.655535 2577 projected.go:196] Error preparing data for projected volume kube-api-access-bdlmt for pod openshift-network-diagnostics/network-check-target-nf7mq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 15:01:19.655737 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:19.655598 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt podName:ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d nodeName:}" failed. No retries permitted until 2026-07-21 15:01:35.655582243 +0000 UTC m=+33.340237833 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bdlmt" (UniqueName: "kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt") pod "network-check-target-nf7mq" (UID: "ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 15:01:19.892235 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:19.892148 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:19.892235 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:19.892172 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:19.892454 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:19.892148 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:19.892454 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:19.892265 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj7km" podUID="4bef143c-d202-45f2-85ea-ae75c3d6812e" Jul 21 15:01:19.892454 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:19.892349 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdtw9" podUID="7b297c76-9cfa-44de-82d8-a62027a7f081" Jul 21 15:01:19.892454 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:19.892424 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nf7mq" podUID="ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d" Jul 21 15:01:21.892573 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:21.892535 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:21.892573 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:21.892568 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:21.893124 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:21.892535 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:21.893124 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:21.892673 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nf7mq" podUID="ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d" Jul 21 15:01:21.893124 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:21.892777 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdtw9" podUID="7b297c76-9cfa-44de-82d8-a62027a7f081" Jul 21 15:01:21.893124 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:21.892863 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj7km" podUID="4bef143c-d202-45f2-85ea-ae75c3d6812e" Jul 21 15:01:23.892353 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:23.892115 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:23.893270 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:23.892115 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:23.893270 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:23.892461 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nf7mq" podUID="ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d" Jul 21 15:01:23.893270 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:23.892115 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:23.893270 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:23.892561 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj7km" podUID="4bef143c-d202-45f2-85ea-ae75c3d6812e" Jul 21 15:01:23.893270 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:23.892666 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdtw9" podUID="7b297c76-9cfa-44de-82d8-a62027a7f081" Jul 21 15:01:23.964040 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:23.964003 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" event={"ID":"28ca6fdc-cd9e-49b0-a85c-495a164abbcd","Type":"ContainerStarted","Data":"6f8de75ae14ccfd2dcd30a8de996330c6ee574e1fddeab0cd7c2212bd3b3c4a9"} Jul 21 15:01:23.965795 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:23.965765 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfv5x_b5b08086-eac8-4329-a903-a73b5e8503ce/ovn-acl-logging/0.log" Jul 21 15:01:23.966199 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:23.966175 2577 generic.go:356] "Generic (PLEG): container finished" podID="b5b08086-eac8-4329-a903-a73b5e8503ce" containerID="0bf61f3bfe339a3eb7e5b8a0b680dd011f9299e19f30bc9b0dcafeca7a97fd31" exitCode=1 Jul 21 15:01:23.966322 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:23.966247 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" event={"ID":"b5b08086-eac8-4329-a903-a73b5e8503ce","Type":"ContainerDied","Data":"0bf61f3bfe339a3eb7e5b8a0b680dd011f9299e19f30bc9b0dcafeca7a97fd31"} Jul 21 15:01:23.966368 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:23.966326 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" event={"ID":"b5b08086-eac8-4329-a903-a73b5e8503ce","Type":"ContainerStarted","Data":"4d3c03b85d59953d700c24ae2f01496624848eea0276d34f8b4f3fe0a7ea1062"} Jul 21 15:01:23.968719 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:23.967982 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z5vz5" event={"ID":"ec99e5c6-a468-4067-a9f9-120ab64e1a1f","Type":"ContainerStarted","Data":"4caaeac905d1f3dc25767ec222fed053b7d007abad5e09ac250e6f8b327bc4ad"} Jul 21 15:01:23.970718 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:23.970691 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-162.ec2.internal" event={"ID":"e0a7da5646d11ae196ceeecffb05398c","Type":"ContainerStarted","Data":"2a9460942e92d52a16aeb93e0df2cb474c278431e2c9c2507e71beb27fba5c93"} Jul 21 15:01:23.972332 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:23.972307 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gjxv9" event={"ID":"d4e65841-4011-4525-ba59-2effd740f791","Type":"ContainerStarted","Data":"f35bbb6d7cf8bf19d766f256c4e0c8bdd1e4ed09292018fffbc5cc6459cf1985"} Jul 21 15:01:23.973908 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:23.973865 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" event={"ID":"e8af705e-4863-4cb5-af5c-0d1657d19d1b","Type":"ContainerStarted","Data":"115243842bdf6eacd0354a46ef3c85608752f341d9ef6cbe08e4dc570169bbf9"} Jul 21 15:01:23.975327 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:23.975300 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8hjhr" event={"ID":"6970a7ea-4844-421f-8399-44aff10ce67d","Type":"ContainerStarted","Data":"ac3bb9efefe5fefaac58901bb712395128fb4a7e885bfd4320070b5dd99d725f"} Jul 21 15:01:23.976412 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:23.976393 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal" event={"ID":"32f0b3f620b4c36d7994f3f2b1278b0c","Type":"ContainerStarted","Data":"4ad2cfcafecceda6d0048388b59c73fdb82fe6934b07b5e08de7bee5b19ac229"} Jul 21 15:01:23.978042 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:23.978018 2577 generic.go:356] "Generic (PLEG): container finished" podID="0dbb0449-f6cd-4fbe-ab4a-02e54935dc53" containerID="1391a62b33895c62ec27054dffdb6b488c508bf754087f7b51a0d14d5a34543b" exitCode=0 Jul 21 15:01:23.978149 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:23.978103 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-plxr5" event={"ID":"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53","Type":"ContainerDied","Data":"1391a62b33895c62ec27054dffdb6b488c508bf754087f7b51a0d14d5a34543b"} Jul 21 15:01:23.979560 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:23.979536 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-t22z2" event={"ID":"e5d5637f-5cd7-4b29-bb1c-c8b5c45786c2","Type":"ContainerStarted","Data":"2f3d257dfa4aa9d9d684059488d0a0bd39fbe3a89b029be6ec78dc5f87aff733"} Jul 21 15:01:23.994532 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:23.994480 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z5vz5" podStartSLOduration=11.296656009 podStartE2EDuration="20.99446083s" totalImagesPullingTime="9.697804821s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:01:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:23.994377339 +0000 UTC m=+21.679032947" watchObservedRunningTime="2026-07-21 15:01:23.99446083 +0000 UTC m=+21.679116433" Jul 21 15:01:24.010809 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:24.010755 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-t22z2" podStartSLOduration=11.346171407 podStartE2EDuration="21.01073604s" totalImagesPullingTime="9.664564633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:01:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:24.010232548 +0000 UTC m=+21.694888147" watchObservedRunningTime="2026-07-21 15:01:24.01073604 +0000 UTC m=+21.695391648" Jul 21 15:01:24.029802 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:24.029708 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8hjhr" podStartSLOduration=13.069535556 podStartE2EDuration="21.029691271s" totalImagesPullingTime="7.960155715s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:01:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:24.029555444 +0000 UTC m=+21.714211052" watchObservedRunningTime="2026-07-21 15:01:24.029691271 +0000 UTC m=+21.714346879" Jul 21 15:01:24.047836 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:24.047769 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gjxv9" podStartSLOduration=1.903289601 podStartE2EDuration="21.047748661s" totalImagesPullingTime="19.14445906s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:01:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:24.047246213 +0000 UTC m=+21.731901820" watchObservedRunningTime="2026-07-21 15:01:24.047748661 +0000 UTC m=+21.732404267" Jul 21 15:01:24.089216 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:24.089095 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-162.ec2.internal" podStartSLOduration=20.089077528 podStartE2EDuration="20.089077528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:01:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:24.088396278 +0000 UTC m=+21.773051885" watchObservedRunningTime="2026-07-21 15:01:24.089077528 +0000 UTC m=+21.773733136" Jul 21 15:01:24.106742 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:24.106686 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m8fpb" podStartSLOduration=10.456967409 podStartE2EDuration="21.106665802s" totalImagesPullingTime="10.649698393s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:01:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:24.105956711 +0000 UTC m=+21.790612321" watchObservedRunningTime="2026-07-21 15:01:24.106665802 +0000 UTC m=+21.791321409" Jul 21 15:01:24.121876 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:24.121845 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-t22z2" Jul 21 15:01:24.122672 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:24.122639 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-t22z2" Jul 21 15:01:24.982441 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:24.982408 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p6ndv" event={"ID":"6a3f1c14-41af-4531-8e95-d0735bf01095","Type":"ContainerStarted","Data":"e34ba9264a07f39d028b080be80945a71b64741611f89777e56f0e2c1c19a241"} Jul 21 15:01:24.983271 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:24.983251 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-t22z2" Jul 21 15:01:24.983377 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:24.983303 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-t22z2" Jul 21 15:01:24.999287 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:24.999241 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p6ndv" podStartSLOduration=13.08304297 podStartE2EDuration="21.999226096s" totalImagesPullingTime="8.916183126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:01:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:24.99899021 +0000 UTC m=+22.683645836" watchObservedRunningTime="2026-07-21 15:01:24.999226096 +0000 UTC m=+22.683881714" Jul 21 15:01:25.170904 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:25.170865 2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 21 15:01:25.790795 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:25.790639 2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T15:01:25.170884725Z","UUID":"8d23e3d1-48c9-42c9-b731-0a0a4c6855aa","Handler":null,"Name":"","Endpoint":""} Jul 21 15:01:25.792084 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:25.792063 2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 21 15:01:25.792211 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:25.792102 2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 21 15:01:25.892292 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:25.892250 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:25.892457 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:25.892258 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:25.892457 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:25.892401 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdtw9" podUID="7b297c76-9cfa-44de-82d8-a62027a7f081" Jul 21 15:01:25.892457 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:25.892265 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:25.892457 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:25.892449 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nf7mq" podUID="ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d" Jul 21 15:01:25.892623 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:25.892529 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj7km" podUID="4bef143c-d202-45f2-85ea-ae75c3d6812e" Jul 21 15:01:25.986775 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:25.986734 2577 generic.go:356] "Generic (PLEG): container finished" podID="32f0b3f620b4c36d7994f3f2b1278b0c" containerID="17e7a49edeb635e3472bc1058de772d3280c5ef3c6d1b69d189d325bfb28356d" exitCode=0 Jul 21 15:01:25.987298 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:25.986819 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal" event={"ID":"32f0b3f620b4c36d7994f3f2b1278b0c","Type":"ContainerDied","Data":"17e7a49edeb635e3472bc1058de772d3280c5ef3c6d1b69d189d325bfb28356d"} Jul 21 15:01:25.989162 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:25.989094 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" event={"ID":"28ca6fdc-cd9e-49b0-a85c-495a164abbcd","Type":"ContainerStarted","Data":"72d5949929980f1c18421b207303132ccf303cedc50a2560ed14ae122a973fdb"} Jul 21 15:01:25.992630 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:25.992598 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfv5x_b5b08086-eac8-4329-a903-a73b5e8503ce/ovn-acl-logging/0.log" Jul 21 15:01:25.993104 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:25.992991 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" event={"ID":"b5b08086-eac8-4329-a903-a73b5e8503ce","Type":"ContainerStarted","Data":"ce351f7ec9b8ceb0a3b7175c8a986bc323f042779bb8c88b6d50ec86314767e7"} Jul 21 15:01:25.993104 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:25.993077 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" event={"ID":"b5b08086-eac8-4329-a903-a73b5e8503ce","Type":"ContainerStarted","Data":"7cbe17f7a37245d6c6abad52339828b5b3989238032b39cb789d4dc8cd82af5f"} Jul 21 15:01:25.993277 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:25.993128 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" event={"ID":"b5b08086-eac8-4329-a903-a73b5e8503ce","Type":"ContainerStarted","Data":"323007bb2dd7c670519c6486c754d041ebf97ada40dd7dce9c263ee9db7bffde"} Jul 21 15:01:25.993277 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:25.993174 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" event={"ID":"b5b08086-eac8-4329-a903-a73b5e8503ce","Type":"ContainerStarted","Data":"b7ee562584874904dc74a983b63f4981a8fcaf729b76bae8ac9a36e6cc1234cf"} Jul 21 15:01:26.996777 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:26.996737 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" event={"ID":"28ca6fdc-cd9e-49b0-a85c-495a164abbcd","Type":"ContainerStarted","Data":"17c0d780126b5365c93c1a60083c943c4ae92558efbc238d24297a65308e1a9f"} Jul 21 15:01:26.998574 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:26.998551 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal" event={"ID":"32f0b3f620b4c36d7994f3f2b1278b0c","Type":"ContainerStarted","Data":"734f94e07583dbad79f141ced2dda87d003aee8e1417a6bd0efb8f6240c52b43"} Jul 21 15:01:27.020289 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:27.020250 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g8vlx" podStartSLOduration=11.103024896 podStartE2EDuration="24.020236213s" totalImagesPullingTime="12.917211317s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:01:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:27.020128181 +0000 UTC m=+24.704783801" watchObservedRunningTime="2026-07-21 15:01:27.020236213 +0000 UTC m=+24.704891820" Jul 21 15:01:27.037216 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:27.037177 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-162.ec2.internal" podStartSLOduration=23.037166004 podStartE2EDuration="23.037166004s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:01:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:27.036872189 +0000 UTC m=+24.721527796" watchObservedRunningTime="2026-07-21 15:01:27.037166004 +0000 UTC m=+24.721821610" Jul 21 15:01:27.892946 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:27.892884 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:27.892946 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:27.892936 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:27.893192 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:27.892936 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:27.893192 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:27.893047 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdtw9" podUID="7b297c76-9cfa-44de-82d8-a62027a7f081" Jul 21 15:01:27.893192 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:27.893145 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nf7mq" podUID="ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d" Jul 21 15:01:27.893343 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:27.893244 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj7km" podUID="4bef143c-d202-45f2-85ea-ae75c3d6812e" Jul 21 15:01:28.004243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:28.004211 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfv5x_b5b08086-eac8-4329-a903-a73b5e8503ce/ovn-acl-logging/0.log" Jul 21 15:01:28.004685 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:28.004659 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" event={"ID":"b5b08086-eac8-4329-a903-a73b5e8503ce","Type":"ContainerStarted","Data":"a31bac3148d0474a2438f67af3d0538d6eaabce1bb897c1cf8ae559157d160b0"} Jul 21 15:01:29.892288 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:29.892043 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:29.892695 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:29.892095 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:29.892695 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:29.892339 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj7km" podUID="4bef143c-d202-45f2-85ea-ae75c3d6812e" Jul 21 15:01:29.892695 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:29.892095 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:29.892695 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:29.892416 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nf7mq" podUID="ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d" Jul 21 15:01:29.892695 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:29.892496 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdtw9" podUID="7b297c76-9cfa-44de-82d8-a62027a7f081" Jul 21 15:01:31.015837 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:31.015667 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfv5x_b5b08086-eac8-4329-a903-a73b5e8503ce/ovn-acl-logging/0.log" Jul 21 15:01:31.017332 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:31.016097 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" event={"ID":"b5b08086-eac8-4329-a903-a73b5e8503ce","Type":"ContainerStarted","Data":"580885cbb041281be935e84896f1315a2a8a111b8bb0aa11bf5529afc73012c6"} Jul 21 15:01:31.892405 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:31.892369 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:31.892405 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:31.892393 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:31.892628 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:31.892402 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:31.892628 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:31.892490 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nf7mq" podUID="ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d" Jul 21 15:01:31.892628 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:31.892554 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj7km" podUID="4bef143c-d202-45f2-85ea-ae75c3d6812e" Jul 21 15:01:31.892718 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:31.892630 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdtw9" podUID="7b297c76-9cfa-44de-82d8-a62027a7f081" Jul 21 15:01:32.019640 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:32.019608 2577 generic.go:356] "Generic (PLEG): container finished" podID="0dbb0449-f6cd-4fbe-ab4a-02e54935dc53" containerID="726689b6ee783d7abe8df758ba476315f8a703aac9ed6f57c2527ab7f4ab89a7" exitCode=0 Jul 21 15:01:32.020165 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:32.019697 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-plxr5" event={"ID":"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53","Type":"ContainerDied","Data":"726689b6ee783d7abe8df758ba476315f8a703aac9ed6f57c2527ab7f4ab89a7"} Jul 21 15:01:32.023553 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:32.021241 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:32.023553 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:32.021334 2577 scope.go:117] "RemoveContainer" containerID="0bf61f3bfe339a3eb7e5b8a0b680dd011f9299e19f30bc9b0dcafeca7a97fd31" Jul 21 15:01:32.039726 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:32.039704 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:33.030120 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:33.029964 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfv5x_b5b08086-eac8-4329-a903-a73b5e8503ce/ovn-acl-logging/0.log" Jul 21 15:01:33.030559 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:33.030508 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" event={"ID":"b5b08086-eac8-4329-a903-a73b5e8503ce","Type":"ContainerStarted","Data":"670abb5037d55405aa854cd6cfc66e00d881bd699ca4a64518ffaff69b410966"} Jul 21 15:01:33.031451 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:33.031317 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:33.031990 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:33.031545 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:33.049359 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:33.049336 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:01:33.070139 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:33.070092 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" podStartSLOduration=9.37105848 podStartE2EDuration="30.070077345s" totalImagesPullingTime="20.699018865s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:01:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:33.068517679 +0000 UTC m=+30.753173287" watchObservedRunningTime="2026-07-21 15:01:33.070077345 +0000 UTC m=+30.754732952" Jul 21 15:01:33.224143 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:33.224055 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nf7mq"] Jul 21 15:01:33.224308 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:33.224186 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:33.224371 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:33.224303 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nf7mq" podUID="ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d" Jul 21 15:01:33.224869 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:33.224847 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zdtw9"] Jul 21 15:01:33.224969 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:33.224958 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:33.225085 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:33.225031 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdtw9" podUID="7b297c76-9cfa-44de-82d8-a62027a7f081" Jul 21 15:01:33.230420 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:33.230398 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rj7km"] Jul 21 15:01:33.230585 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:33.230572 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:33.230662 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:33.230645 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj7km" podUID="4bef143c-d202-45f2-85ea-ae75c3d6812e" Jul 21 15:01:34.036607 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:34.036528 2577 generic.go:356] "Generic (PLEG): container finished" podID="0dbb0449-f6cd-4fbe-ab4a-02e54935dc53" containerID="df428e2211e5b6fb54eddf7be98b0303df0b7f558b00f1d569bce98c70c5f669" exitCode=0 Jul 21 15:01:34.037043 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:34.036608 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-plxr5" event={"ID":"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53","Type":"ContainerDied","Data":"df428e2211e5b6fb54eddf7be98b0303df0b7f558b00f1d569bce98c70c5f669"} Jul 21 15:01:34.892120 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:34.892080 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:34.892120 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:34.892083 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:34.892120 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:34.892085 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:34.892387 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:34.892236 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdtw9" podUID="7b297c76-9cfa-44de-82d8-a62027a7f081" Jul 21 15:01:34.892387 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:34.892278 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj7km" podUID="4bef143c-d202-45f2-85ea-ae75c3d6812e" Jul 21 15:01:34.892387 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:34.892369 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nf7mq" podUID="ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d" Jul 21 15:01:35.064154 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:35.064106 2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" podUID="b5b08086-eac8-4329-a903-a73b5e8503ce" containerName="ovnkube-controller" probeResult="failure" output="" Jul 21 15:01:35.569100 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:35.569069 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs\") pod \"network-metrics-daemon-zdtw9\" (UID: \"7b297c76-9cfa-44de-82d8-a62027a7f081\") " pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:35.569243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:35.569109 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret\") pod \"global-pull-secret-syncer-rj7km\" (UID: \"4bef143c-d202-45f2-85ea-ae75c3d6812e\") " pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:35.569243 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:35.569211 2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 15:01:35.569243 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:35.569215 2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 15:01:35.569339 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:35.569261 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret podName:4bef143c-d202-45f2-85ea-ae75c3d6812e nodeName:}" failed. No retries permitted until 2026-07-21 15:02:07.569248147 +0000 UTC m=+65.253903733 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret") pod "global-pull-secret-syncer-rj7km" (UID: "4bef143c-d202-45f2-85ea-ae75c3d6812e") : object "kube-system"/"original-pull-secret" not registered Jul 21 15:01:35.569339 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:35.569281 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs podName:7b297c76-9cfa-44de-82d8-a62027a7f081 nodeName:}" failed. No retries permitted until 2026-07-21 15:02:07.569268214 +0000 UTC m=+65.253923799 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs") pod "network-metrics-daemon-zdtw9" (UID: "7b297c76-9cfa-44de-82d8-a62027a7f081") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 15:01:35.670200 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:35.670172 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdlmt\" (UniqueName: \"kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt\") pod \"network-check-target-nf7mq\" (UID: \"ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d\") " pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:35.670320 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:35.670284 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 15:01:35.670320 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:35.670299 2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 15:01:35.670320 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:35.670307 2577 projected.go:196] Error preparing data for projected volume kube-api-access-bdlmt for pod openshift-network-diagnostics/network-check-target-nf7mq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 15:01:35.670418 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:35.670350 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt podName:ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d nodeName:}" failed. No retries permitted until 2026-07-21 15:02:07.670337723 +0000 UTC m=+65.354993311 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bdlmt" (UniqueName: "kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt") pod "network-check-target-nf7mq" (UID: "ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 15:01:36.043831 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:36.043605 2577 generic.go:356] "Generic (PLEG): container finished" podID="0dbb0449-f6cd-4fbe-ab4a-02e54935dc53" containerID="60b289788d7847f389c108d0c0f0dbf04e74d2eb5e39b95424828705d8d219ed" exitCode=0 Jul 21 15:01:36.043831 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:36.043640 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-plxr5" event={"ID":"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53","Type":"ContainerDied","Data":"60b289788d7847f389c108d0c0f0dbf04e74d2eb5e39b95424828705d8d219ed"} Jul 21 15:01:36.892566 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:36.892536 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:36.893040 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:36.892545 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:36.893040 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:36.892665 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rj7km" podUID="4bef143c-d202-45f2-85ea-ae75c3d6812e" Jul 21 15:01:36.893040 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:36.893032 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:36.893193 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:36.893144 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zdtw9" podUID="7b297c76-9cfa-44de-82d8-a62027a7f081" Jul 21 15:01:36.893253 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:36.893226 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nf7mq" podUID="ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d" Jul 21 15:01:38.121509 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.121479 2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-162.ec2.internal" event="NodeReady" Jul 21 15:01:38.122032 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.121632 2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 21 15:01:38.172353 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.172324 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5pps2"] Jul 21 15:01:38.196879 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.196853 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9vh8s"] Jul 21 15:01:38.197053 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.196986 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5pps2" Jul 21 15:01:38.199842 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.199801 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9pl9l\"" Jul 21 15:01:38.199842 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.199808 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 21 15:01:38.200041 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.199876 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 21 15:01:38.200162 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.200139 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 21 15:01:38.223112 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.223082 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5pps2"] Jul 21 15:01:38.223249 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.223124 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lns5j"] Jul 21 15:01:38.223249 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.223223 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9vh8s" Jul 21 15:01:38.225911 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.225868 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hlkkf\"" Jul 21 15:01:38.226024 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.226012 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 21 15:01:38.226386 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.226371 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 21 15:01:38.226496 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.226478 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 21 15:01:38.226655 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.226638 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 21 15:01:38.250053 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.250029 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9vh8s"] Jul 21 15:01:38.250153 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.250069 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lns5j"] Jul 21 15:01:38.250192 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.250155 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lns5j" Jul 21 15:01:38.252747 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.252722 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 21 15:01:38.252747 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.252743 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 21 15:01:38.252983 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.252966 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sj9xq\"" Jul 21 15:01:38.289773 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.289745 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/441bba4c-a860-4ba2-a6e2-5de8b038472c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9vh8s\" (UID: \"441bba4c-a860-4ba2-a6e2-5de8b038472c\") " pod="openshift-insights/insights-runtime-extractor-9vh8s" Jul 21 15:01:38.289939 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.289792 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/653ea0e6-eb3d-47af-921b-2926185c6d84-cert\") pod \"ingress-canary-5pps2\" (UID: \"653ea0e6-eb3d-47af-921b-2926185c6d84\") " pod="openshift-ingress-canary/ingress-canary-5pps2" Jul 21 15:01:38.289939 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.289818 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p78h7\" (UniqueName: \"kubernetes.io/projected/653ea0e6-eb3d-47af-921b-2926185c6d84-kube-api-access-p78h7\") pod \"ingress-canary-5pps2\" (UID: \"653ea0e6-eb3d-47af-921b-2926185c6d84\") " pod="openshift-ingress-canary/ingress-canary-5pps2" Jul 21 15:01:38.290047 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.289980 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/441bba4c-a860-4ba2-a6e2-5de8b038472c-data-volume\") pod \"insights-runtime-extractor-9vh8s\" (UID: \"441bba4c-a860-4ba2-a6e2-5de8b038472c\") " pod="openshift-insights/insights-runtime-extractor-9vh8s" Jul 21 15:01:38.290047 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.290018 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf2j4\" (UniqueName: \"kubernetes.io/projected/441bba4c-a860-4ba2-a6e2-5de8b038472c-kube-api-access-tf2j4\") pod \"insights-runtime-extractor-9vh8s\" (UID: \"441bba4c-a860-4ba2-a6e2-5de8b038472c\") " pod="openshift-insights/insights-runtime-extractor-9vh8s" Jul 21 15:01:38.290120 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.290050 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/441bba4c-a860-4ba2-a6e2-5de8b038472c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vh8s\" (UID: \"441bba4c-a860-4ba2-a6e2-5de8b038472c\") " pod="openshift-insights/insights-runtime-extractor-9vh8s" Jul 21 15:01:38.290120 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.290079 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/441bba4c-a860-4ba2-a6e2-5de8b038472c-crio-socket\") pod \"insights-runtime-extractor-9vh8s\" (UID: \"441bba4c-a860-4ba2-a6e2-5de8b038472c\") " pod="openshift-insights/insights-runtime-extractor-9vh8s" Jul 21 15:01:38.391223 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.391118 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/653ea0e6-eb3d-47af-921b-2926185c6d84-cert\") pod \"ingress-canary-5pps2\" (UID: \"653ea0e6-eb3d-47af-921b-2926185c6d84\") " pod="openshift-ingress-canary/ingress-canary-5pps2" Jul 21 15:01:38.391381 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.391257 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p78h7\" (UniqueName: \"kubernetes.io/projected/653ea0e6-eb3d-47af-921b-2926185c6d84-kube-api-access-p78h7\") pod \"ingress-canary-5pps2\" (UID: \"653ea0e6-eb3d-47af-921b-2926185c6d84\") " pod="openshift-ingress-canary/ingress-canary-5pps2" Jul 21 15:01:38.391381 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.391309 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-metrics-tls\") pod \"dns-default-lns5j\" (UID: \"6eaa6b6f-8079-4df1-b17c-3e6078ec6db1\") " pod="openshift-dns/dns-default-lns5j" Jul 21 15:01:38.391381 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.391330 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-tmp-dir\") pod \"dns-default-lns5j\" (UID: \"6eaa6b6f-8079-4df1-b17c-3e6078ec6db1\") " pod="openshift-dns/dns-default-lns5j" Jul 21 15:01:38.391539 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.391398 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/441bba4c-a860-4ba2-a6e2-5de8b038472c-data-volume\") pod \"insights-runtime-extractor-9vh8s\" (UID: \"441bba4c-a860-4ba2-a6e2-5de8b038472c\") " pod="openshift-insights/insights-runtime-extractor-9vh8s" Jul 21 15:01:38.391539 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.391454 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf2j4\" (UniqueName: \"kubernetes.io/projected/441bba4c-a860-4ba2-a6e2-5de8b038472c-kube-api-access-tf2j4\") pod \"insights-runtime-extractor-9vh8s\" (UID: \"441bba4c-a860-4ba2-a6e2-5de8b038472c\") " pod="openshift-insights/insights-runtime-extractor-9vh8s" Jul 21 15:01:38.391539 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.391508 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/441bba4c-a860-4ba2-a6e2-5de8b038472c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vh8s\" (UID: \"441bba4c-a860-4ba2-a6e2-5de8b038472c\") " pod="openshift-insights/insights-runtime-extractor-9vh8s" Jul 21 15:01:38.391685 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.391541 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/441bba4c-a860-4ba2-a6e2-5de8b038472c-crio-socket\") pod \"insights-runtime-extractor-9vh8s\" (UID: \"441bba4c-a860-4ba2-a6e2-5de8b038472c\") " pod="openshift-insights/insights-runtime-extractor-9vh8s" Jul 21 15:01:38.391685 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.391578 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-config-volume\") pod \"dns-default-lns5j\" (UID: \"6eaa6b6f-8079-4df1-b17c-3e6078ec6db1\") " pod="openshift-dns/dns-default-lns5j" Jul 21 15:01:38.391685 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.391610 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28bds\" (UniqueName: \"kubernetes.io/projected/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-kube-api-access-28bds\") pod \"dns-default-lns5j\" (UID: \"6eaa6b6f-8079-4df1-b17c-3e6078ec6db1\") " pod="openshift-dns/dns-default-lns5j" Jul 21 15:01:38.391685 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.391659 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/441bba4c-a860-4ba2-a6e2-5de8b038472c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9vh8s\" (UID: \"441bba4c-a860-4ba2-a6e2-5de8b038472c\") " pod="openshift-insights/insights-runtime-extractor-9vh8s" Jul 21 15:01:38.391936 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.391695 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/441bba4c-a860-4ba2-a6e2-5de8b038472c-data-volume\") pod \"insights-runtime-extractor-9vh8s\" (UID: \"441bba4c-a860-4ba2-a6e2-5de8b038472c\") " pod="openshift-insights/insights-runtime-extractor-9vh8s" Jul 21 15:01:38.391936 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:38.391662 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 15:01:38.391936 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:38.391848 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/441bba4c-a860-4ba2-a6e2-5de8b038472c-insights-runtime-extractor-tls podName:441bba4c-a860-4ba2-a6e2-5de8b038472c nodeName:}" failed. No retries permitted until 2026-07-21 15:01:38.891823948 +0000 UTC m=+36.576479551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/441bba4c-a860-4ba2-a6e2-5de8b038472c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9vh8s" (UID: "441bba4c-a860-4ba2-a6e2-5de8b038472c") : secret "insights-runtime-extractor-tls" not found Jul 21 15:01:38.391936 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.391934 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/441bba4c-a860-4ba2-a6e2-5de8b038472c-crio-socket\") pod \"insights-runtime-extractor-9vh8s\" (UID: \"441bba4c-a860-4ba2-a6e2-5de8b038472c\") " pod="openshift-insights/insights-runtime-extractor-9vh8s" Jul 21 15:01:38.392270 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.392242 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/441bba4c-a860-4ba2-a6e2-5de8b038472c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9vh8s\" (UID: \"441bba4c-a860-4ba2-a6e2-5de8b038472c\") " pod="openshift-insights/insights-runtime-extractor-9vh8s" Jul 21 15:01:38.395903 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.395873 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/653ea0e6-eb3d-47af-921b-2926185c6d84-cert\") pod \"ingress-canary-5pps2\" (UID: \"653ea0e6-eb3d-47af-921b-2926185c6d84\") " pod="openshift-ingress-canary/ingress-canary-5pps2" Jul 21 15:01:38.410526 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.410505 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p78h7\" (UniqueName: \"kubernetes.io/projected/653ea0e6-eb3d-47af-921b-2926185c6d84-kube-api-access-p78h7\") pod \"ingress-canary-5pps2\" (UID: \"653ea0e6-eb3d-47af-921b-2926185c6d84\") " pod="openshift-ingress-canary/ingress-canary-5pps2" Jul 21 15:01:38.413000 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.412978 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf2j4\" (UniqueName: \"kubernetes.io/projected/441bba4c-a860-4ba2-a6e2-5de8b038472c-kube-api-access-tf2j4\") pod \"insights-runtime-extractor-9vh8s\" (UID: \"441bba4c-a860-4ba2-a6e2-5de8b038472c\") " pod="openshift-insights/insights-runtime-extractor-9vh8s" Jul 21 15:01:38.492764 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.492734 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-metrics-tls\") pod \"dns-default-lns5j\" (UID: \"6eaa6b6f-8079-4df1-b17c-3e6078ec6db1\") " pod="openshift-dns/dns-default-lns5j" Jul 21 15:01:38.492764 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.492767 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-tmp-dir\") pod \"dns-default-lns5j\" (UID: \"6eaa6b6f-8079-4df1-b17c-3e6078ec6db1\") " pod="openshift-dns/dns-default-lns5j" Jul 21 15:01:38.492972 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.492829 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-config-volume\") pod \"dns-default-lns5j\" (UID: \"6eaa6b6f-8079-4df1-b17c-3e6078ec6db1\") " pod="openshift-dns/dns-default-lns5j" Jul 21 15:01:38.492972 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.492851 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28bds\" (UniqueName: \"kubernetes.io/projected/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-kube-api-access-28bds\") pod \"dns-default-lns5j\" (UID: \"6eaa6b6f-8079-4df1-b17c-3e6078ec6db1\") " pod="openshift-dns/dns-default-lns5j" Jul 21 15:01:38.492972 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:38.492903 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 15:01:38.493128 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:38.492986 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-metrics-tls podName:6eaa6b6f-8079-4df1-b17c-3e6078ec6db1 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:38.992965072 +0000 UTC m=+36.677620668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-metrics-tls") pod "dns-default-lns5j" (UID: "6eaa6b6f-8079-4df1-b17c-3e6078ec6db1") : secret "dns-default-metrics-tls" not found Jul 21 15:01:38.493294 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.493272 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-tmp-dir\") pod \"dns-default-lns5j\" (UID: \"6eaa6b6f-8079-4df1-b17c-3e6078ec6db1\") " pod="openshift-dns/dns-default-lns5j" Jul 21 15:01:38.493528 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.493508 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-config-volume\") pod \"dns-default-lns5j\" (UID: \"6eaa6b6f-8079-4df1-b17c-3e6078ec6db1\") " pod="openshift-dns/dns-default-lns5j" Jul 21 15:01:38.502238 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.502192 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28bds\" (UniqueName: \"kubernetes.io/projected/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-kube-api-access-28bds\") pod \"dns-default-lns5j\" (UID: \"6eaa6b6f-8079-4df1-b17c-3e6078ec6db1\") " pod="openshift-dns/dns-default-lns5j" Jul 21 15:01:38.508010 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.507967 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5pps2" Jul 21 15:01:38.760074 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.759887 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5pps2"] Jul 21 15:01:38.892782 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.892746 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:01:38.892964 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.892746 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:01:38.892964 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.892747 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:01:38.896126 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.896105 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d8gzv\"" Jul 21 15:01:38.896242 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.896147 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 15:01:38.896242 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.896227 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 15:01:38.896526 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.896507 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/441bba4c-a860-4ba2-a6e2-5de8b038472c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vh8s\" (UID: \"441bba4c-a860-4ba2-a6e2-5de8b038472c\") " pod="openshift-insights/insights-runtime-extractor-9vh8s" Jul 21 15:01:38.896709 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:38.896693 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 15:01:38.896785 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:38.896761 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/441bba4c-a860-4ba2-a6e2-5de8b038472c-insights-runtime-extractor-tls podName:441bba4c-a860-4ba2-a6e2-5de8b038472c nodeName:}" failed. No retries permitted until 2026-07-21 15:01:39.896743443 +0000 UTC m=+37.581399031 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/441bba4c-a860-4ba2-a6e2-5de8b038472c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9vh8s" (UID: "441bba4c-a860-4ba2-a6e2-5de8b038472c") : secret "insights-runtime-extractor-tls" not found Jul 21 15:01:38.897243 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.897222 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zxdnr\"" Jul 21 15:01:38.897394 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.897356 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 15:01:38.897394 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.897372 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 15:01:38.997314 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:38.997003 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-metrics-tls\") pod \"dns-default-lns5j\" (UID: \"6eaa6b6f-8079-4df1-b17c-3e6078ec6db1\") " pod="openshift-dns/dns-default-lns5j" Jul 21 15:01:38.997465 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:38.997145 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 15:01:38.997465 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:38.997427 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-metrics-tls podName:6eaa6b6f-8079-4df1-b17c-3e6078ec6db1 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:39.997401186 +0000 UTC m=+37.682056791 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-metrics-tls") pod "dns-default-lns5j" (UID: "6eaa6b6f-8079-4df1-b17c-3e6078ec6db1") : secret "dns-default-metrics-tls" not found Jul 21 15:01:39.906481 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:39.906445 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/441bba4c-a860-4ba2-a6e2-5de8b038472c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vh8s\" (UID: \"441bba4c-a860-4ba2-a6e2-5de8b038472c\") " pod="openshift-insights/insights-runtime-extractor-9vh8s" Jul 21 15:01:39.907246 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:39.906597 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 15:01:39.907246 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:39.906671 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/441bba4c-a860-4ba2-a6e2-5de8b038472c-insights-runtime-extractor-tls podName:441bba4c-a860-4ba2-a6e2-5de8b038472c nodeName:}" failed. No retries permitted until 2026-07-21 15:01:41.906655847 +0000 UTC m=+39.591311434 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/441bba4c-a860-4ba2-a6e2-5de8b038472c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9vh8s" (UID: "441bba4c-a860-4ba2-a6e2-5de8b038472c") : secret "insights-runtime-extractor-tls" not found Jul 21 15:01:40.007496 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:40.007462 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-metrics-tls\") pod \"dns-default-lns5j\" (UID: \"6eaa6b6f-8079-4df1-b17c-3e6078ec6db1\") " pod="openshift-dns/dns-default-lns5j" Jul 21 15:01:40.007667 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:40.007643 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 15:01:40.007750 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:40.007736 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-metrics-tls podName:6eaa6b6f-8079-4df1-b17c-3e6078ec6db1 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:42.007711932 +0000 UTC m=+39.692367533 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-metrics-tls") pod "dns-default-lns5j" (UID: "6eaa6b6f-8079-4df1-b17c-3e6078ec6db1") : secret "dns-default-metrics-tls" not found Jul 21 15:01:40.263185 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:40.263084 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod653ea0e6_eb3d_47af_921b_2926185c6d84.slice/crio-4faa11961b8e221b3c78f42f87d572ff5237a436d9aed927d10c3601ee1e6461 WatchSource:0}: Error finding container 4faa11961b8e221b3c78f42f87d572ff5237a436d9aed927d10c3601ee1e6461: Status 404 returned error can't find the container with id 4faa11961b8e221b3c78f42f87d572ff5237a436d9aed927d10c3601ee1e6461 Jul 21 15:01:41.060065 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:41.060025 2577 generic.go:356] "Generic (PLEG): container finished" podID="0dbb0449-f6cd-4fbe-ab4a-02e54935dc53" containerID="29e18c039159675fe19ea7ace0448bfda04ee2cc3060fedde5bee9d1220f7335" exitCode=0 Jul 21 15:01:41.060500 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:41.060155 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-plxr5" event={"ID":"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53","Type":"ContainerDied","Data":"29e18c039159675fe19ea7ace0448bfda04ee2cc3060fedde5bee9d1220f7335"} Jul 21 15:01:41.061408 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:41.061387 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5pps2" event={"ID":"653ea0e6-eb3d-47af-921b-2926185c6d84","Type":"ContainerStarted","Data":"4faa11961b8e221b3c78f42f87d572ff5237a436d9aed927d10c3601ee1e6461"} Jul 21 15:01:41.924783 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:41.924749 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/441bba4c-a860-4ba2-a6e2-5de8b038472c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vh8s\" (UID: \"441bba4c-a860-4ba2-a6e2-5de8b038472c\") " pod="openshift-insights/insights-runtime-extractor-9vh8s" Jul 21 15:01:41.924938 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:41.924864 2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 15:01:41.924938 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:41.924937 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/441bba4c-a860-4ba2-a6e2-5de8b038472c-insights-runtime-extractor-tls podName:441bba4c-a860-4ba2-a6e2-5de8b038472c nodeName:}" failed. No retries permitted until 2026-07-21 15:01:45.924919688 +0000 UTC m=+43.609575292 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/441bba4c-a860-4ba2-a6e2-5de8b038472c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9vh8s" (UID: "441bba4c-a860-4ba2-a6e2-5de8b038472c") : secret "insights-runtime-extractor-tls" not found Jul 21 15:01:42.025349 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:42.025320 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-metrics-tls\") pod \"dns-default-lns5j\" (UID: \"6eaa6b6f-8079-4df1-b17c-3e6078ec6db1\") " pod="openshift-dns/dns-default-lns5j" Jul 21 15:01:42.025505 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:42.025489 2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 15:01:42.025583 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:01:42.025571 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-metrics-tls podName:6eaa6b6f-8079-4df1-b17c-3e6078ec6db1 nodeName:}" failed. No retries permitted until 2026-07-21 15:01:46.025550034 +0000 UTC m=+43.710205632 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-metrics-tls") pod "dns-default-lns5j" (UID: "6eaa6b6f-8079-4df1-b17c-3e6078ec6db1") : secret "dns-default-metrics-tls" not found Jul 21 15:01:42.067070 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:42.067034 2577 generic.go:356] "Generic (PLEG): container finished" podID="0dbb0449-f6cd-4fbe-ab4a-02e54935dc53" containerID="c7c0c4f8371f1a7e1f2db4cd6b16dea89878e7bd455f5664135779792a76d953" exitCode=0 Jul 21 15:01:42.067513 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:42.067097 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-plxr5" event={"ID":"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53","Type":"ContainerDied","Data":"c7c0c4f8371f1a7e1f2db4cd6b16dea89878e7bd455f5664135779792a76d953"} Jul 21 15:01:43.072329 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:43.072287 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-plxr5" event={"ID":"0dbb0449-f6cd-4fbe-ab4a-02e54935dc53","Type":"ContainerStarted","Data":"9685a7abeaae696a2ec6a5d7c9f5b9c5c494050a7286e15954e6de4f610ddff7"} Jul 21 15:01:43.100569 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:43.100531 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-plxr5" podStartSLOduration=7.256302773 podStartE2EDuration="40.100514417s" totalImagesPullingTime="32.844211644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:01:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:43.099373699 +0000 UTC m=+40.784029306" watchObservedRunningTime="2026-07-21 15:01:43.100514417 +0000 UTC m=+40.785170025" Jul 21 15:01:44.076173 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:44.076138 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5pps2" event={"ID":"653ea0e6-eb3d-47af-921b-2926185c6d84","Type":"ContainerStarted","Data":"486e534f2d1fa01f01c23eccfe56adfb085c337fd35d4e3643aed9cc09b2787b"} Jul 21 15:01:44.097470 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:44.097426 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5pps2" podStartSLOduration=3.341152573 podStartE2EDuration="6.09741131s" totalImagesPullingTime="2.756258737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:44.096611909 +0000 UTC m=+41.781267517" watchObservedRunningTime="2026-07-21 15:01:44.09741131 +0000 UTC m=+41.782066916" Jul 21 15:01:45.954430 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:45.954398 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/441bba4c-a860-4ba2-a6e2-5de8b038472c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vh8s\" (UID: \"441bba4c-a860-4ba2-a6e2-5de8b038472c\") " pod="openshift-insights/insights-runtime-extractor-9vh8s" Jul 21 15:01:45.957593 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:45.957574 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/441bba4c-a860-4ba2-a6e2-5de8b038472c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9vh8s\" (UID: \"441bba4c-a860-4ba2-a6e2-5de8b038472c\") " pod="openshift-insights/insights-runtime-extractor-9vh8s" Jul 21 15:01:46.034156 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:46.034130 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9vh8s" Jul 21 15:01:46.055369 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:46.055342 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-metrics-tls\") pod \"dns-default-lns5j\" (UID: \"6eaa6b6f-8079-4df1-b17c-3e6078ec6db1\") " pod="openshift-dns/dns-default-lns5j" Jul 21 15:01:46.057472 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:46.057453 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6eaa6b6f-8079-4df1-b17c-3e6078ec6db1-metrics-tls\") pod \"dns-default-lns5j\" (UID: \"6eaa6b6f-8079-4df1-b17c-3e6078ec6db1\") " pod="openshift-dns/dns-default-lns5j" Jul 21 15:01:46.059433 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:46.059420 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lns5j" Jul 21 15:01:46.212310 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:46.212279 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9vh8s"] Jul 21 15:01:46.216041 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:46.216013 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod441bba4c_a860_4ba2_a6e2_5de8b038472c.slice/crio-386763ee3d8ca2148f06be0f58fbb54e6ce1aaff16acdfe674b52e6e2f2d4742 WatchSource:0}: Error finding container 386763ee3d8ca2148f06be0f58fbb54e6ce1aaff16acdfe674b52e6e2f2d4742: Status 404 returned error can't find the container with id 386763ee3d8ca2148f06be0f58fbb54e6ce1aaff16acdfe674b52e6e2f2d4742 Jul 21 15:01:46.260802 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:46.260776 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lns5j"] Jul 21 15:01:46.263965 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:01:46.263942 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eaa6b6f_8079_4df1_b17c_3e6078ec6db1.slice/crio-5a52e9a799e1dfd747f9e03df12d772cbd8aafb5c960690335b00f340a39f786 WatchSource:0}: Error finding container 5a52e9a799e1dfd747f9e03df12d772cbd8aafb5c960690335b00f340a39f786: Status 404 returned error can't find the container with id 5a52e9a799e1dfd747f9e03df12d772cbd8aafb5c960690335b00f340a39f786 Jul 21 15:01:47.084482 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:47.084446 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lns5j" event={"ID":"6eaa6b6f-8079-4df1-b17c-3e6078ec6db1","Type":"ContainerStarted","Data":"5a52e9a799e1dfd747f9e03df12d772cbd8aafb5c960690335b00f340a39f786"} Jul 21 15:01:47.085487 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:47.085466 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9vh8s" event={"ID":"441bba4c-a860-4ba2-a6e2-5de8b038472c","Type":"ContainerStarted","Data":"386763ee3d8ca2148f06be0f58fbb54e6ce1aaff16acdfe674b52e6e2f2d4742"} Jul 21 15:01:50.095009 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:50.094968 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lns5j" event={"ID":"6eaa6b6f-8079-4df1-b17c-3e6078ec6db1","Type":"ContainerStarted","Data":"93d17939d52ae579895ee34771427d9975bd7f85397be0310a32c5e41b88955e"} Jul 21 15:01:50.095447 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:50.095030 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lns5j" event={"ID":"6eaa6b6f-8079-4df1-b17c-3e6078ec6db1","Type":"ContainerStarted","Data":"d038f7bef3279fdc46127732fbf42b11580052280a1eb6b323faf5684afa336c"} Jul 21 15:01:50.095447 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:50.095111 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lns5j" Jul 21 15:01:50.116475 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:50.116426 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lns5j" podStartSLOduration=9.380255451 podStartE2EDuration="12.116412121s" totalImagesPullingTime="2.73615667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:01:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:50.114783589 +0000 UTC m=+47.799439209" watchObservedRunningTime="2026-07-21 15:01:50.116412121 +0000 UTC m=+47.801067706" Jul 21 15:01:54.106626 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:54.106593 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9vh8s" event={"ID":"441bba4c-a860-4ba2-a6e2-5de8b038472c","Type":"ContainerStarted","Data":"fb5be2760bed1aca33e17cb7960c16b64e08a4a64b8453d6bdd87fa1138bfc50"} Jul 21 15:01:58.120587 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:01:58.120552 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9vh8s" event={"ID":"441bba4c-a860-4ba2-a6e2-5de8b038472c","Type":"ContainerStarted","Data":"cbe94cdb4896ecbfd1720b7cd12d480f92e8fee358ba446127513eb2a2fefa4a"} Jul 21 15:02:00.100007 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:00.099969 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lns5j" Jul 21 15:02:01.726866 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.726831 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-tqdxd"] Jul 21 15:02:01.745146 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.745121 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l"] Jul 21 15:02:01.745272 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.745177 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tqdxd" Jul 21 15:02:01.753373 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.753350 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 21 15:02:01.753578 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.753564 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rl66v\"" Jul 21 15:02:01.753960 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.753944 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 21 15:02:01.762677 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.762658 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" Jul 21 15:02:01.772434 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.772405 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 21 15:02:01.772434 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.772413 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 21 15:02:01.772609 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.772511 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/edc3b8ca-971a-4928-b123-0fa5a06281b2-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-tqdxd\" (UID: \"edc3b8ca-971a-4928-b123-0fa5a06281b2\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tqdxd" Jul 21 15:02:01.772609 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.772580 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/edc3b8ca-971a-4928-b123-0fa5a06281b2-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-tqdxd\" (UID: \"edc3b8ca-971a-4928-b123-0fa5a06281b2\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tqdxd" Jul 21 15:02:01.772749 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.772720 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 21 15:02:01.773226 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.773206 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-tqdxd"] Jul 21 15:02:01.773546 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.773526 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 21 15:02:01.773641 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.773583 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 21 15:02:01.778863 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.778842 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 21 15:02:01.778966 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.778842 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 21 15:02:01.798309 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.798286 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l"] Jul 21 15:02:01.838770 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.838747 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4hq2c"] Jul 21 15:02:01.855106 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.855086 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4hq2c" Jul 21 15:02:01.859815 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.859769 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 21 15:02:01.860005 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.859978 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-zhv2x\"" Jul 21 15:02:01.870372 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.870353 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4hq2c"] Jul 21 15:02:01.873261 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.873237 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f9f4fd5b-73e8-4174-94be-141e1e5033a6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7656d69d77-c976l\" (UID: \"f9f4fd5b-73e8-4174-94be-141e1e5033a6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" Jul 21 15:02:01.873353 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.873278 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/edc3b8ca-971a-4928-b123-0fa5a06281b2-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-tqdxd\" (UID: \"edc3b8ca-971a-4928-b123-0fa5a06281b2\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tqdxd" Jul 21 15:02:01.873353 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.873309 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f9f4fd5b-73e8-4174-94be-141e1e5033a6-ca\") pod \"cluster-proxy-proxy-agent-7656d69d77-c976l\" (UID: \"f9f4fd5b-73e8-4174-94be-141e1e5033a6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" Jul 21 15:02:01.873463 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.873351 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/95837223-713f-47b0-b113-33ebe75ccde9-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-4hq2c\" (UID: \"95837223-713f-47b0-b113-33ebe75ccde9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4hq2c" Jul 21 15:02:01.873516 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.873463 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f9f4fd5b-73e8-4174-94be-141e1e5033a6-hub\") pod \"cluster-proxy-proxy-agent-7656d69d77-c976l\" (UID: \"f9f4fd5b-73e8-4174-94be-141e1e5033a6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" Jul 21 15:02:01.873516 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.873493 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt66t\" (UniqueName: \"kubernetes.io/projected/f9f4fd5b-73e8-4174-94be-141e1e5033a6-kube-api-access-vt66t\") pod \"cluster-proxy-proxy-agent-7656d69d77-c976l\" (UID: \"f9f4fd5b-73e8-4174-94be-141e1e5033a6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" Jul 21 15:02:01.873611 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.873531 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9f4fd5b-73e8-4174-94be-141e1e5033a6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7656d69d77-c976l\" (UID: \"f9f4fd5b-73e8-4174-94be-141e1e5033a6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" Jul 21 15:02:01.873611 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.873597 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/edc3b8ca-971a-4928-b123-0fa5a06281b2-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-tqdxd\" (UID: \"edc3b8ca-971a-4928-b123-0fa5a06281b2\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tqdxd" Jul 21 15:02:01.873709 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.873642 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f9f4fd5b-73e8-4174-94be-141e1e5033a6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7656d69d77-c976l\" (UID: \"f9f4fd5b-73e8-4174-94be-141e1e5033a6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" Jul 21 15:02:01.874180 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.874159 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/edc3b8ca-971a-4928-b123-0fa5a06281b2-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-tqdxd\" (UID: \"edc3b8ca-971a-4928-b123-0fa5a06281b2\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tqdxd" Jul 21 15:02:01.875745 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.875725 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/edc3b8ca-971a-4928-b123-0fa5a06281b2-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-tqdxd\" (UID: \"edc3b8ca-971a-4928-b123-0fa5a06281b2\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tqdxd" Jul 21 15:02:01.974643 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.974616 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f9f4fd5b-73e8-4174-94be-141e1e5033a6-hub\") pod \"cluster-proxy-proxy-agent-7656d69d77-c976l\" (UID: \"f9f4fd5b-73e8-4174-94be-141e1e5033a6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" Jul 21 15:02:01.974643 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.974642 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt66t\" (UniqueName: \"kubernetes.io/projected/f9f4fd5b-73e8-4174-94be-141e1e5033a6-kube-api-access-vt66t\") pod \"cluster-proxy-proxy-agent-7656d69d77-c976l\" (UID: \"f9f4fd5b-73e8-4174-94be-141e1e5033a6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" Jul 21 15:02:01.974822 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.974671 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9f4fd5b-73e8-4174-94be-141e1e5033a6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7656d69d77-c976l\" (UID: \"f9f4fd5b-73e8-4174-94be-141e1e5033a6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" Jul 21 15:02:01.974822 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.974716 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f9f4fd5b-73e8-4174-94be-141e1e5033a6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7656d69d77-c976l\" (UID: \"f9f4fd5b-73e8-4174-94be-141e1e5033a6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" Jul 21 15:02:01.974822 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.974752 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f9f4fd5b-73e8-4174-94be-141e1e5033a6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7656d69d77-c976l\" (UID: \"f9f4fd5b-73e8-4174-94be-141e1e5033a6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" Jul 21 15:02:01.974822 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.974799 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f9f4fd5b-73e8-4174-94be-141e1e5033a6-ca\") pod \"cluster-proxy-proxy-agent-7656d69d77-c976l\" (UID: \"f9f4fd5b-73e8-4174-94be-141e1e5033a6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" Jul 21 15:02:01.975070 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.974828 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/95837223-713f-47b0-b113-33ebe75ccde9-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-4hq2c\" (UID: \"95837223-713f-47b0-b113-33ebe75ccde9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4hq2c" Jul 21 15:02:01.975679 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.975654 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9f4fd5b-73e8-4174-94be-141e1e5033a6-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7656d69d77-c976l\" (UID: \"f9f4fd5b-73e8-4174-94be-141e1e5033a6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" Jul 21 15:02:01.977237 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.977185 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f9f4fd5b-73e8-4174-94be-141e1e5033a6-hub\") pod \"cluster-proxy-proxy-agent-7656d69d77-c976l\" (UID: \"f9f4fd5b-73e8-4174-94be-141e1e5033a6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" Jul 21 15:02:01.977319 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.977285 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f9f4fd5b-73e8-4174-94be-141e1e5033a6-ca\") pod \"cluster-proxy-proxy-agent-7656d69d77-c976l\" (UID: \"f9f4fd5b-73e8-4174-94be-141e1e5033a6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" Jul 21 15:02:01.977359 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.977342 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/95837223-713f-47b0-b113-33ebe75ccde9-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-4hq2c\" (UID: \"95837223-713f-47b0-b113-33ebe75ccde9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4hq2c" Jul 21 15:02:01.977532 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.977516 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f9f4fd5b-73e8-4174-94be-141e1e5033a6-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7656d69d77-c976l\" (UID: \"f9f4fd5b-73e8-4174-94be-141e1e5033a6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" Jul 21 15:02:01.977697 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.977678 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f9f4fd5b-73e8-4174-94be-141e1e5033a6-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7656d69d77-c976l\" (UID: \"f9f4fd5b-73e8-4174-94be-141e1e5033a6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" Jul 21 15:02:01.984812 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:01.984788 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt66t\" (UniqueName: \"kubernetes.io/projected/f9f4fd5b-73e8-4174-94be-141e1e5033a6-kube-api-access-vt66t\") pod \"cluster-proxy-proxy-agent-7656d69d77-c976l\" (UID: \"f9f4fd5b-73e8-4174-94be-141e1e5033a6\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" Jul 21 15:02:02.054871 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:02.054846 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tqdxd" Jul 21 15:02:02.078018 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:02.077984 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" Jul 21 15:02:02.140630 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:02.140592 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9vh8s" event={"ID":"441bba4c-a860-4ba2-a6e2-5de8b038472c","Type":"ContainerStarted","Data":"ed37d6426c7cd24d889d82f3d1e22260183ca2581283d3098a9ccaf90a56464e"} Jul 21 15:02:02.165699 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:02.165615 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9vh8s" podStartSLOduration=9.243101768 podStartE2EDuration="24.165595158s" totalImagesPullingTime="14.92249339s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:01:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:02.165170566 +0000 UTC m=+59.849826172" watchObservedRunningTime="2026-07-21 15:02:02.165595158 +0000 UTC m=+59.850250766" Jul 21 15:02:02.166177 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:02.166122 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4hq2c" Jul 21 15:02:02.189619 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:02.189589 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-tqdxd"] Jul 21 15:02:02.192773 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:02:02.192746 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedc3b8ca_971a_4928_b123_0fa5a06281b2.slice/crio-4db056258e5cdd3b8c04e2239dc0351ad67430adc18b1bd44fd32a9caf6b864c WatchSource:0}: Error finding container 4db056258e5cdd3b8c04e2239dc0351ad67430adc18b1bd44fd32a9caf6b864c: Status 404 returned error can't find the container with id 4db056258e5cdd3b8c04e2239dc0351ad67430adc18b1bd44fd32a9caf6b864c Jul 21 15:02:02.216859 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:02.216689 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l"] Jul 21 15:02:02.221925 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:02:02.221862 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9f4fd5b_73e8_4174_94be_141e1e5033a6.slice/crio-f73a77d08db0bd5e7aa83f5c7effe7a6dad1613ad2a0f026c6e6c4f6a2a89e10 WatchSource:0}: Error finding container f73a77d08db0bd5e7aa83f5c7effe7a6dad1613ad2a0f026c6e6c4f6a2a89e10: Status 404 returned error can't find the container with id f73a77d08db0bd5e7aa83f5c7effe7a6dad1613ad2a0f026c6e6c4f6a2a89e10 Jul 21 15:02:02.290971 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:02.290919 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4hq2c"] Jul 21 15:02:02.294600 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:02:02.294570 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95837223_713f_47b0_b113_33ebe75ccde9.slice/crio-4ef600d421b293a44017d77f4da65392026750c1f05f3dd7f52eacb2a205211d WatchSource:0}: Error finding container 4ef600d421b293a44017d77f4da65392026750c1f05f3dd7f52eacb2a205211d: Status 404 returned error can't find the container with id 4ef600d421b293a44017d77f4da65392026750c1f05f3dd7f52eacb2a205211d Jul 21 15:02:03.145046 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:03.145006 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" event={"ID":"f9f4fd5b-73e8-4174-94be-141e1e5033a6","Type":"ContainerStarted","Data":"f73a77d08db0bd5e7aa83f5c7effe7a6dad1613ad2a0f026c6e6c4f6a2a89e10"} Jul 21 15:02:03.146353 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:03.146310 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4hq2c" event={"ID":"95837223-713f-47b0-b113-33ebe75ccde9","Type":"ContainerStarted","Data":"4ef600d421b293a44017d77f4da65392026750c1f05f3dd7f52eacb2a205211d"} Jul 21 15:02:03.147639 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:03.147610 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tqdxd" event={"ID":"edc3b8ca-971a-4928-b123-0fa5a06281b2","Type":"ContainerStarted","Data":"4db056258e5cdd3b8c04e2239dc0351ad67430adc18b1bd44fd32a9caf6b864c"} Jul 21 15:02:04.153569 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:04.153530 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4hq2c" event={"ID":"95837223-713f-47b0-b113-33ebe75ccde9","Type":"ContainerStarted","Data":"b8608a0a173518ba038274138182c002c288fbf91eeefe71f281c4f0e3b53401"} Jul 21 15:02:04.154082 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:04.153905 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4hq2c" Jul 21 15:02:04.156515 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:04.156465 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tqdxd" event={"ID":"edc3b8ca-971a-4928-b123-0fa5a06281b2","Type":"ContainerStarted","Data":"988b0428b656071bd3d5de4c58d47340100d31663f6fa9134341909fdfbd3438"} Jul 21 15:02:04.160523 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:04.160494 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4hq2c" Jul 21 15:02:04.171160 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:04.171109 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-4hq2c" podStartSLOduration=1.5429913100000001 podStartE2EDuration="3.171092171s" totalImagesPullingTime="1.628100861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:04.169885872 +0000 UTC m=+61.854541482" watchObservedRunningTime="2026-07-21 15:02:04.171092171 +0000 UTC m=+61.855747772" Jul 21 15:02:04.205922 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:04.205792 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-tqdxd" podStartSLOduration=1.476933064 podStartE2EDuration="3.205773426s" totalImagesPullingTime="1.728840362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:04.205409714 +0000 UTC m=+61.890065322" watchObservedRunningTime="2026-07-21 15:02:04.205773426 +0000 UTC m=+61.890429033" Jul 21 15:02:05.052082 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.052045 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mfv5x" Jul 21 15:02:05.247473 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.247438 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-4fm68"] Jul 21 15:02:05.254070 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.254038 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-4fm68" Jul 21 15:02:05.257620 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.257248 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 21 15:02:05.257620 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.257293 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 21 15:02:05.257620 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.257305 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-kzmnp\"" Jul 21 15:02:05.257620 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.257298 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 21 15:02:05.257620 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.257343 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 21 15:02:05.257620 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.257305 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 21 15:02:05.265280 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.265253 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-4fm68"] Jul 21 15:02:05.299464 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.299427 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab631f36-e043-4fb6-9dbb-21f324fe34f5-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-4fm68\" (UID: \"ab631f36-e043-4fb6-9dbb-21f324fe34f5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4fm68" Jul 21 15:02:05.299464 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.299475 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab631f36-e043-4fb6-9dbb-21f324fe34f5-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-4fm68\" (UID: \"ab631f36-e043-4fb6-9dbb-21f324fe34f5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4fm68" Jul 21 15:02:05.299714 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.299580 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-676cp\" (UniqueName: \"kubernetes.io/projected/ab631f36-e043-4fb6-9dbb-21f324fe34f5-kube-api-access-676cp\") pod \"prometheus-operator-5945b5cfd-4fm68\" (UID: \"ab631f36-e043-4fb6-9dbb-21f324fe34f5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4fm68" Jul 21 15:02:05.299714 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.299623 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab631f36-e043-4fb6-9dbb-21f324fe34f5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-4fm68\" (UID: \"ab631f36-e043-4fb6-9dbb-21f324fe34f5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4fm68" Jul 21 15:02:05.400408 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.400326 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-676cp\" (UniqueName: \"kubernetes.io/projected/ab631f36-e043-4fb6-9dbb-21f324fe34f5-kube-api-access-676cp\") pod \"prometheus-operator-5945b5cfd-4fm68\" (UID: \"ab631f36-e043-4fb6-9dbb-21f324fe34f5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4fm68" Jul 21 15:02:05.400408 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.400382 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab631f36-e043-4fb6-9dbb-21f324fe34f5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-4fm68\" (UID: \"ab631f36-e043-4fb6-9dbb-21f324fe34f5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4fm68" Jul 21 15:02:05.400659 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.400630 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab631f36-e043-4fb6-9dbb-21f324fe34f5-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-4fm68\" (UID: \"ab631f36-e043-4fb6-9dbb-21f324fe34f5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4fm68" Jul 21 15:02:05.400782 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.400678 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab631f36-e043-4fb6-9dbb-21f324fe34f5-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-4fm68\" (UID: \"ab631f36-e043-4fb6-9dbb-21f324fe34f5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4fm68" Jul 21 15:02:05.401473 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.401448 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ab631f36-e043-4fb6-9dbb-21f324fe34f5-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-4fm68\" (UID: \"ab631f36-e043-4fb6-9dbb-21f324fe34f5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4fm68" Jul 21 15:02:05.403659 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.403633 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ab631f36-e043-4fb6-9dbb-21f324fe34f5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-4fm68\" (UID: \"ab631f36-e043-4fb6-9dbb-21f324fe34f5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4fm68" Jul 21 15:02:05.404324 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.404303 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab631f36-e043-4fb6-9dbb-21f324fe34f5-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-4fm68\" (UID: \"ab631f36-e043-4fb6-9dbb-21f324fe34f5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4fm68" Jul 21 15:02:05.408884 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.408859 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-676cp\" (UniqueName: \"kubernetes.io/projected/ab631f36-e043-4fb6-9dbb-21f324fe34f5-kube-api-access-676cp\") pod \"prometheus-operator-5945b5cfd-4fm68\" (UID: \"ab631f36-e043-4fb6-9dbb-21f324fe34f5\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-4fm68" Jul 21 15:02:05.569029 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.568991 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-4fm68" Jul 21 15:02:05.709247 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:05.709215 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-4fm68"] Jul 21 15:02:05.712883 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:02:05.712856 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab631f36_e043_4fb6_9dbb_21f324fe34f5.slice/crio-1eddbd1b8c6e288ad732d25ff8dce9450c9ce91157e248f22122638bacc08f8c WatchSource:0}: Error finding container 1eddbd1b8c6e288ad732d25ff8dce9450c9ce91157e248f22122638bacc08f8c: Status 404 returned error can't find the container with id 1eddbd1b8c6e288ad732d25ff8dce9450c9ce91157e248f22122638bacc08f8c Jul 21 15:02:06.165441 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:06.165402 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-4fm68" event={"ID":"ab631f36-e043-4fb6-9dbb-21f324fe34f5","Type":"ContainerStarted","Data":"1eddbd1b8c6e288ad732d25ff8dce9450c9ce91157e248f22122638bacc08f8c"} Jul 21 15:02:07.172103 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:07.172020 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" event={"ID":"f9f4fd5b-73e8-4174-94be-141e1e5033a6","Type":"ContainerStarted","Data":"b7f565255e4ee01f3545353343a4366d4303ee27fcdcdea24f1eda443778ef4e"} Jul 21 15:02:07.172103 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:07.172069 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" event={"ID":"f9f4fd5b-73e8-4174-94be-141e1e5033a6","Type":"ContainerStarted","Data":"bdff3bb07da0eafaca3fa481060b64ae0211f17e63df7f6f0f4333c4ef5b8f5d"} Jul 21 15:02:07.172103 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:07.172086 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" event={"ID":"f9f4fd5b-73e8-4174-94be-141e1e5033a6","Type":"ContainerStarted","Data":"2858444769be90fe76e47e0583a6504c293d1cd11fc2316aa0b91dcb9a302510"} Jul 21 15:02:07.192667 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:07.192604 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7656d69d77-c976l" podStartSLOduration=1.573259163 podStartE2EDuration="6.19258467s" totalImagesPullingTime="4.619325507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:02:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:07.192006824 +0000 UTC m=+64.876662431" watchObservedRunningTime="2026-07-21 15:02:07.19258467 +0000 UTC m=+64.877240270" Jul 21 15:02:07.617806 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:07.617765 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs\") pod \"network-metrics-daemon-zdtw9\" (UID: \"7b297c76-9cfa-44de-82d8-a62027a7f081\") " pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:02:07.618023 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:07.617821 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret\") pod \"global-pull-secret-syncer-rj7km\" (UID: \"4bef143c-d202-45f2-85ea-ae75c3d6812e\") " pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:02:07.620765 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:07.620736 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 15:02:07.621642 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:07.621623 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 15:02:07.631766 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:07.631741 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b297c76-9cfa-44de-82d8-a62027a7f081-metrics-certs\") pod \"network-metrics-daemon-zdtw9\" (UID: \"7b297c76-9cfa-44de-82d8-a62027a7f081\") " pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:02:07.631882 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:07.631771 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4bef143c-d202-45f2-85ea-ae75c3d6812e-original-pull-secret\") pod \"global-pull-secret-syncer-rj7km\" (UID: \"4bef143c-d202-45f2-85ea-ae75c3d6812e\") " pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:02:07.705091 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:07.705047 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rj7km" Jul 21 15:02:07.715592 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:07.715568 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d8gzv\"" Jul 21 15:02:07.719092 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:07.719068 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdlmt\" (UniqueName: \"kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt\") pod \"network-check-target-nf7mq\" (UID: \"ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d\") " pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:02:07.722077 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:07.722050 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 15:02:07.723044 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:07.723021 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zdtw9" Jul 21 15:02:07.732799 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:07.732779 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 15:02:07.743601 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:07.743578 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdlmt\" (UniqueName: \"kubernetes.io/projected/ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d-kube-api-access-bdlmt\") pod \"network-check-target-nf7mq\" (UID: \"ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d\") " pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:02:07.971007 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:07.970968 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rj7km"] Jul 21 15:02:07.973706 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:02:07.973684 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bef143c_d202_45f2_85ea_ae75c3d6812e.slice/crio-1e68bf2a1a2fcf9af25f3ecd0d5d0f8faef74fdb1b3ebd5aa34c998227b8fc69 WatchSource:0}: Error finding container 1e68bf2a1a2fcf9af25f3ecd0d5d0f8faef74fdb1b3ebd5aa34c998227b8fc69: Status 404 returned error can't find the container with id 1e68bf2a1a2fcf9af25f3ecd0d5d0f8faef74fdb1b3ebd5aa34c998227b8fc69 Jul 21 15:02:07.987471 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:07.987433 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zdtw9"] Jul 21 15:02:07.992968 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:02:07.992933 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b297c76_9cfa_44de_82d8_a62027a7f081.slice/crio-aeda944ffe469df7ae58ab5b7b8034456952e8c92a2707bde4e2c936637db25d WatchSource:0}: Error finding container aeda944ffe469df7ae58ab5b7b8034456952e8c92a2707bde4e2c936637db25d: Status 404 returned error can't find the container with id aeda944ffe469df7ae58ab5b7b8034456952e8c92a2707bde4e2c936637db25d Jul 21 15:02:08.020831 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:08.020798 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zxdnr\"" Jul 21 15:02:08.028836 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:08.028813 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:02:08.166163 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:08.166084 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nf7mq"] Jul 21 15:02:08.169236 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:02:08.169210 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad871b9b_ed50_4cf4_9e2b_8aad7681fa2d.slice/crio-ec0bdf5421f03fffafd28b65778fe4e538d03e8908c01f70d72eb31d60a68877 WatchSource:0}: Error finding container ec0bdf5421f03fffafd28b65778fe4e538d03e8908c01f70d72eb31d60a68877: Status 404 returned error can't find the container with id ec0bdf5421f03fffafd28b65778fe4e538d03e8908c01f70d72eb31d60a68877 Jul 21 15:02:08.178139 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:08.178110 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zdtw9" event={"ID":"7b297c76-9cfa-44de-82d8-a62027a7f081","Type":"ContainerStarted","Data":"aeda944ffe469df7ae58ab5b7b8034456952e8c92a2707bde4e2c936637db25d"} Jul 21 15:02:08.179985 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:08.179949 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-4fm68" event={"ID":"ab631f36-e043-4fb6-9dbb-21f324fe34f5","Type":"ContainerStarted","Data":"720db1178cdd5a8ac901c5ca5aec4be95f03c85bc6e298721321bf72d8cc5e3e"} Jul 21 15:02:08.180090 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:08.180002 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-4fm68" event={"ID":"ab631f36-e043-4fb6-9dbb-21f324fe34f5","Type":"ContainerStarted","Data":"619fdb7bbf76b85baeb3501f468486732b0fb91d4acac0d32ef5812df036dcfb"} Jul 21 15:02:08.181042 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:08.181019 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rj7km" event={"ID":"4bef143c-d202-45f2-85ea-ae75c3d6812e","Type":"ContainerStarted","Data":"1e68bf2a1a2fcf9af25f3ecd0d5d0f8faef74fdb1b3ebd5aa34c998227b8fc69"} Jul 21 15:02:08.182006 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:08.181989 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nf7mq" event={"ID":"ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d","Type":"ContainerStarted","Data":"ec0bdf5421f03fffafd28b65778fe4e538d03e8908c01f70d72eb31d60a68877"} Jul 21 15:02:08.199073 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:08.199026 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-4fm68" podStartSLOduration=1.063339258 podStartE2EDuration="3.199011648s" totalImagesPullingTime="2.13567239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:02:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:08.198224743 +0000 UTC m=+65.882880346" watchObservedRunningTime="2026-07-21 15:02:08.199011648 +0000 UTC m=+65.883667256" Jul 21 15:02:09.186662 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.186577 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zdtw9" event={"ID":"7b297c76-9cfa-44de-82d8-a62027a7f081","Type":"ContainerStarted","Data":"3eabd9b363052eb1d1d8c45d83272f60222fdb5acae58d20da55402012916ca4"} Jul 21 15:02:09.186662 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.186631 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zdtw9" event={"ID":"7b297c76-9cfa-44de-82d8-a62027a7f081","Type":"ContainerStarted","Data":"21e5eac7aefe9fd1401200d42361e46c2a2b429e374f68cef32313dfe6f2004d"} Jul 21 15:02:09.206254 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.206214 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zdtw9" podStartSLOduration=65.311571847 podStartE2EDuration="1m6.206197665s" totalImagesPullingTime="894.625818ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:01:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:09.205101331 +0000 UTC m=+66.889756959" watchObservedRunningTime="2026-07-21 15:02:09.206197665 +0000 UTC m=+66.890853274" Jul 21 15:02:09.612824 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.612790 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-44kxl"] Jul 21 15:02:09.615695 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.615672 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" Jul 21 15:02:09.618195 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.618147 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 21 15:02:09.619223 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.619203 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-jwfnc\"" Jul 21 15:02:09.619337 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.619270 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 21 15:02:09.619438 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.619421 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 21 15:02:09.625046 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.625019 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zfj5v"] Jul 21 15:02:09.627117 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.627095 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.631453 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.631199 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 21 15:02:09.631453 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.631256 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 21 15:02:09.631662 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.631642 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pkzcx\"" Jul 21 15:02:09.632392 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.632371 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 21 15:02:09.633290 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.632958 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/58b8eb28-dd6d-4eff-889e-10d2e6014b34-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-44kxl\" (UID: \"58b8eb28-dd6d-4eff-889e-10d2e6014b34\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" Jul 21 15:02:09.633290 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.633009 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58b8eb28-dd6d-4eff-889e-10d2e6014b34-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-44kxl\" (UID: \"58b8eb28-dd6d-4eff-889e-10d2e6014b34\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" Jul 21 15:02:09.633290 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.633045 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58b8eb28-dd6d-4eff-889e-10d2e6014b34-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-44kxl\" (UID: \"58b8eb28-dd6d-4eff-889e-10d2e6014b34\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" Jul 21 15:02:09.633290 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.633080 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z66gp\" (UniqueName: \"kubernetes.io/projected/58b8eb28-dd6d-4eff-889e-10d2e6014b34-kube-api-access-z66gp\") pod \"kube-state-metrics-56c5594674-44kxl\" (UID: \"58b8eb28-dd6d-4eff-889e-10d2e6014b34\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" Jul 21 15:02:09.633290 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.633162 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/58b8eb28-dd6d-4eff-889e-10d2e6014b34-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-44kxl\" (UID: \"58b8eb28-dd6d-4eff-889e-10d2e6014b34\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" Jul 21 15:02:09.633290 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.633201 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/58b8eb28-dd6d-4eff-889e-10d2e6014b34-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-44kxl\" (UID: \"58b8eb28-dd6d-4eff-889e-10d2e6014b34\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" Jul 21 15:02:09.634989 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.634908 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-44kxl"] Jul 21 15:02:09.733786 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.733751 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/01a930f2-8b11-4609-b3da-e0805e69a026-node-exporter-textfile\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.733977 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.733802 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/58b8eb28-dd6d-4eff-889e-10d2e6014b34-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-44kxl\" (UID: \"58b8eb28-dd6d-4eff-889e-10d2e6014b34\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" Jul 21 15:02:09.733977 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.733832 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01a930f2-8b11-4609-b3da-e0805e69a026-node-exporter-tls\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.733977 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.733864 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58b8eb28-dd6d-4eff-889e-10d2e6014b34-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-44kxl\" (UID: \"58b8eb28-dd6d-4eff-889e-10d2e6014b34\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" Jul 21 15:02:09.733977 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.733911 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/01a930f2-8b11-4609-b3da-e0805e69a026-root\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.733977 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:02:09.733938 2577 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 21 15:02:09.734257 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.733976 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58b8eb28-dd6d-4eff-889e-10d2e6014b34-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-44kxl\" (UID: \"58b8eb28-dd6d-4eff-889e-10d2e6014b34\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" Jul 21 15:02:09.734257 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:02:09.734004 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58b8eb28-dd6d-4eff-889e-10d2e6014b34-kube-state-metrics-tls podName:58b8eb28-dd6d-4eff-889e-10d2e6014b34 nodeName:}" failed. No retries permitted until 2026-07-21 15:02:10.233983313 +0000 UTC m=+67.918638930 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/58b8eb28-dd6d-4eff-889e-10d2e6014b34-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-44kxl" (UID: "58b8eb28-dd6d-4eff-889e-10d2e6014b34") : secret "kube-state-metrics-tls" not found Jul 21 15:02:09.734257 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.734037 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z66gp\" (UniqueName: \"kubernetes.io/projected/58b8eb28-dd6d-4eff-889e-10d2e6014b34-kube-api-access-z66gp\") pod \"kube-state-metrics-56c5594674-44kxl\" (UID: \"58b8eb28-dd6d-4eff-889e-10d2e6014b34\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" Jul 21 15:02:09.734257 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.734070 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01a930f2-8b11-4609-b3da-e0805e69a026-sys\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.734257 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.734095 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01a930f2-8b11-4609-b3da-e0805e69a026-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.734257 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.734126 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01a930f2-8b11-4609-b3da-e0805e69a026-metrics-client-ca\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.734257 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.734160 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/01a930f2-8b11-4609-b3da-e0805e69a026-node-exporter-accelerators-collector-config\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.734257 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.734194 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/58b8eb28-dd6d-4eff-889e-10d2e6014b34-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-44kxl\" (UID: \"58b8eb28-dd6d-4eff-889e-10d2e6014b34\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" Jul 21 15:02:09.734257 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.734227 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/58b8eb28-dd6d-4eff-889e-10d2e6014b34-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-44kxl\" (UID: \"58b8eb28-dd6d-4eff-889e-10d2e6014b34\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" Jul 21 15:02:09.734257 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.734252 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c4h7\" (UniqueName: \"kubernetes.io/projected/01a930f2-8b11-4609-b3da-e0805e69a026-kube-api-access-9c4h7\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.734697 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.734475 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/01a930f2-8b11-4609-b3da-e0805e69a026-node-exporter-wtmp\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.734697 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.734633 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/58b8eb28-dd6d-4eff-889e-10d2e6014b34-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-44kxl\" (UID: \"58b8eb28-dd6d-4eff-889e-10d2e6014b34\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" Jul 21 15:02:09.734771 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.734737 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58b8eb28-dd6d-4eff-889e-10d2e6014b34-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-44kxl\" (UID: \"58b8eb28-dd6d-4eff-889e-10d2e6014b34\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" Jul 21 15:02:09.735051 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.735028 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/58b8eb28-dd6d-4eff-889e-10d2e6014b34-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-44kxl\" (UID: \"58b8eb28-dd6d-4eff-889e-10d2e6014b34\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" Jul 21 15:02:09.736713 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.736680 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58b8eb28-dd6d-4eff-889e-10d2e6014b34-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-44kxl\" (UID: \"58b8eb28-dd6d-4eff-889e-10d2e6014b34\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" Jul 21 15:02:09.743065 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.743041 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z66gp\" (UniqueName: \"kubernetes.io/projected/58b8eb28-dd6d-4eff-889e-10d2e6014b34-kube-api-access-z66gp\") pod \"kube-state-metrics-56c5594674-44kxl\" (UID: \"58b8eb28-dd6d-4eff-889e-10d2e6014b34\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" Jul 21 15:02:09.835722 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.835688 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01a930f2-8b11-4609-b3da-e0805e69a026-node-exporter-tls\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.835856 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.835736 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/01a930f2-8b11-4609-b3da-e0805e69a026-root\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.835856 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.835767 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01a930f2-8b11-4609-b3da-e0805e69a026-sys\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.835856 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.835790 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01a930f2-8b11-4609-b3da-e0805e69a026-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.835856 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.835819 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01a930f2-8b11-4609-b3da-e0805e69a026-metrics-client-ca\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.835856 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:02:09.835824 2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 21 15:02:09.835856 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.835852 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/01a930f2-8b11-4609-b3da-e0805e69a026-node-exporter-accelerators-collector-config\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.836186 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.835875 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/01a930f2-8b11-4609-b3da-e0805e69a026-sys\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.836186 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:02:09.835906 2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a930f2-8b11-4609-b3da-e0805e69a026-node-exporter-tls podName:01a930f2-8b11-4609-b3da-e0805e69a026 nodeName:}" failed. No retries permitted until 2026-07-21 15:02:10.335869926 +0000 UTC m=+68.020525513 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/01a930f2-8b11-4609-b3da-e0805e69a026-node-exporter-tls") pod "node-exporter-zfj5v" (UID: "01a930f2-8b11-4609-b3da-e0805e69a026") : secret "node-exporter-tls" not found Jul 21 15:02:09.836186 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.835882 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/01a930f2-8b11-4609-b3da-e0805e69a026-root\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.836186 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.835965 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c4h7\" (UniqueName: \"kubernetes.io/projected/01a930f2-8b11-4609-b3da-e0805e69a026-kube-api-access-9c4h7\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.836186 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.836020 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/01a930f2-8b11-4609-b3da-e0805e69a026-node-exporter-wtmp\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.836186 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.836064 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/01a930f2-8b11-4609-b3da-e0805e69a026-node-exporter-textfile\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.836454 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.836215 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/01a930f2-8b11-4609-b3da-e0805e69a026-node-exporter-wtmp\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.836454 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.836358 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/01a930f2-8b11-4609-b3da-e0805e69a026-node-exporter-textfile\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.836548 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.836525 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/01a930f2-8b11-4609-b3da-e0805e69a026-node-exporter-accelerators-collector-config\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.836776 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.836754 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/01a930f2-8b11-4609-b3da-e0805e69a026-metrics-client-ca\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.838860 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.838835 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/01a930f2-8b11-4609-b3da-e0805e69a026-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:09.845467 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:09.845435 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c4h7\" (UniqueName: \"kubernetes.io/projected/01a930f2-8b11-4609-b3da-e0805e69a026-kube-api-access-9c4h7\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:10.239154 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:10.239116 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/58b8eb28-dd6d-4eff-889e-10d2e6014b34-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-44kxl\" (UID: \"58b8eb28-dd6d-4eff-889e-10d2e6014b34\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" Jul 21 15:02:10.242373 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:10.242326 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/58b8eb28-dd6d-4eff-889e-10d2e6014b34-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-44kxl\" (UID: \"58b8eb28-dd6d-4eff-889e-10d2e6014b34\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" Jul 21 15:02:10.340148 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:10.340109 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01a930f2-8b11-4609-b3da-e0805e69a026-node-exporter-tls\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:10.342746 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:10.342723 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/01a930f2-8b11-4609-b3da-e0805e69a026-node-exporter-tls\") pod \"node-exporter-zfj5v\" (UID: \"01a930f2-8b11-4609-b3da-e0805e69a026\") " pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:10.528126 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:10.528047 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" Jul 21 15:02:10.539272 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:10.539197 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zfj5v" Jul 21 15:02:10.551600 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:02:10.551571 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a930f2_8b11_4609_b3da_e0805e69a026.slice/crio-874fe16fd786b5592f2e513d451ac1c69118217344cb62350008b60cb82d1dde WatchSource:0}: Error finding container 874fe16fd786b5592f2e513d451ac1c69118217344cb62350008b60cb82d1dde: Status 404 returned error can't find the container with id 874fe16fd786b5592f2e513d451ac1c69118217344cb62350008b60cb82d1dde Jul 21 15:02:10.692812 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:10.692675 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-44kxl"] Jul 21 15:02:10.696275 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:02:10.696239 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b8eb28_dd6d_4eff_889e_10d2e6014b34.slice/crio-e361f7957e71e54da653e5a4a8b4b6c0f60570791baf8d4229e42951fe51fd83 WatchSource:0}: Error finding container e361f7957e71e54da653e5a4a8b4b6c0f60570791baf8d4229e42951fe51fd83: Status 404 returned error can't find the container with id e361f7957e71e54da653e5a4a8b4b6c0f60570791baf8d4229e42951fe51fd83 Jul 21 15:02:11.196578 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:11.196491 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" event={"ID":"58b8eb28-dd6d-4eff-889e-10d2e6014b34","Type":"ContainerStarted","Data":"e361f7957e71e54da653e5a4a8b4b6c0f60570791baf8d4229e42951fe51fd83"} Jul 21 15:02:11.197969 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:11.197936 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zfj5v" event={"ID":"01a930f2-8b11-4609-b3da-e0805e69a026","Type":"ContainerStarted","Data":"874fe16fd786b5592f2e513d451ac1c69118217344cb62350008b60cb82d1dde"} Jul 21 15:02:12.719053 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.719018 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm"] Jul 21 15:02:12.722108 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.722080 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.724728 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.724694 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 21 15:02:12.724728 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.724703 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 21 15:02:12.725008 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.724759 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 21 15:02:12.725008 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.724792 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 21 15:02:12.725008 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.724947 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 21 15:02:12.725008 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.724996 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-tpjcl\"" Jul 21 15:02:12.725205 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.725015 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2djbo9gq6as6t\"" Jul 21 15:02:12.735201 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.735179 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm"] Jul 21 15:02:12.758579 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.758546 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7d6237d-4c22-4602-aa9a-5fc0ac336730-metrics-client-ca\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.758732 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.758585 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7d6237d-4c22-4602-aa9a-5fc0ac336730-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.758732 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.758617 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e7d6237d-4c22-4602-aa9a-5fc0ac336730-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.758732 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.758692 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7d6237d-4c22-4602-aa9a-5fc0ac336730-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.758887 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.758747 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e7d6237d-4c22-4602-aa9a-5fc0ac336730-secret-grpc-tls\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.758887 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.758783 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xc9p\" (UniqueName: \"kubernetes.io/projected/e7d6237d-4c22-4602-aa9a-5fc0ac336730-kube-api-access-8xc9p\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.758887 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.758811 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e7d6237d-4c22-4602-aa9a-5fc0ac336730-secret-thanos-querier-tls\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.758887 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.758853 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e7d6237d-4c22-4602-aa9a-5fc0ac336730-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.859831 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.859783 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e7d6237d-4c22-4602-aa9a-5fc0ac336730-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.860030 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.859846 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7d6237d-4c22-4602-aa9a-5fc0ac336730-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.860030 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.859909 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e7d6237d-4c22-4602-aa9a-5fc0ac336730-secret-grpc-tls\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.860030 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.859949 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xc9p\" (UniqueName: \"kubernetes.io/projected/e7d6237d-4c22-4602-aa9a-5fc0ac336730-kube-api-access-8xc9p\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.860030 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.859977 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e7d6237d-4c22-4602-aa9a-5fc0ac336730-secret-thanos-querier-tls\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.860030 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.860004 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e7d6237d-4c22-4602-aa9a-5fc0ac336730-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.860362 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.860056 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7d6237d-4c22-4602-aa9a-5fc0ac336730-metrics-client-ca\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.860362 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.860080 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7d6237d-4c22-4602-aa9a-5fc0ac336730-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.860976 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.860881 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7d6237d-4c22-4602-aa9a-5fc0ac336730-metrics-client-ca\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.862984 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.862954 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e7d6237d-4c22-4602-aa9a-5fc0ac336730-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.863213 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.863190 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e7d6237d-4c22-4602-aa9a-5fc0ac336730-secret-thanos-querier-tls\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.863435 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.863412 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e7d6237d-4c22-4602-aa9a-5fc0ac336730-secret-grpc-tls\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.863681 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.863658 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e7d6237d-4c22-4602-aa9a-5fc0ac336730-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.863863 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.863822 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7d6237d-4c22-4602-aa9a-5fc0ac336730-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.864034 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.863924 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7d6237d-4c22-4602-aa9a-5fc0ac336730-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:12.869044 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:12.869018 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xc9p\" (UniqueName: \"kubernetes.io/projected/e7d6237d-4c22-4602-aa9a-5fc0ac336730-kube-api-access-8xc9p\") pod \"thanos-querier-54ff46bdc5-rt6rm\" (UID: \"e7d6237d-4c22-4602-aa9a-5fc0ac336730\") " pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:13.032943 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:13.032848 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:13.923551 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:13.923520 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6d4548cbfd-x6xkk"] Jul 21 15:02:13.951282 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:13.951245 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6d4548cbfd-x6xkk"] Jul 21 15:02:13.951444 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:13.951359 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:13.955604 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:13.955574 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 21 15:02:13.955604 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:13.955601 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 21 15:02:13.955604 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:13.955605 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 21 15:02:13.955856 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:13.955632 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 21 15:02:13.955856 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:13.955574 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-dsxjb\"" Jul 21 15:02:13.956029 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:13.956010 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-3nk6pbuv0fiid\"" Jul 21 15:02:13.968714 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:13.968691 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvzc7\" (UniqueName: \"kubernetes.io/projected/39640cd9-5c53-4a9f-a21d-02db1fb656c3-kube-api-access-vvzc7\") pod \"metrics-server-6d4548cbfd-x6xkk\" (UID: \"39640cd9-5c53-4a9f-a21d-02db1fb656c3\") " pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:13.968833 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:13.968748 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/39640cd9-5c53-4a9f-a21d-02db1fb656c3-secret-metrics-server-tls\") pod \"metrics-server-6d4548cbfd-x6xkk\" (UID: \"39640cd9-5c53-4a9f-a21d-02db1fb656c3\") " pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:13.968833 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:13.968780 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39640cd9-5c53-4a9f-a21d-02db1fb656c3-client-ca-bundle\") pod \"metrics-server-6d4548cbfd-x6xkk\" (UID: \"39640cd9-5c53-4a9f-a21d-02db1fb656c3\") " pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:13.968833 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:13.968808 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/39640cd9-5c53-4a9f-a21d-02db1fb656c3-metrics-server-audit-profiles\") pod \"metrics-server-6d4548cbfd-x6xkk\" (UID: \"39640cd9-5c53-4a9f-a21d-02db1fb656c3\") " pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:13.969004 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:13.968840 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39640cd9-5c53-4a9f-a21d-02db1fb656c3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d4548cbfd-x6xkk\" (UID: \"39640cd9-5c53-4a9f-a21d-02db1fb656c3\") " pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:13.969004 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:13.968867 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/39640cd9-5c53-4a9f-a21d-02db1fb656c3-audit-log\") pod \"metrics-server-6d4548cbfd-x6xkk\" (UID: \"39640cd9-5c53-4a9f-a21d-02db1fb656c3\") " pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:13.969004 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:13.968938 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/39640cd9-5c53-4a9f-a21d-02db1fb656c3-secret-metrics-server-client-certs\") pod \"metrics-server-6d4548cbfd-x6xkk\" (UID: \"39640cd9-5c53-4a9f-a21d-02db1fb656c3\") " pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:14.069532 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:14.069493 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/39640cd9-5c53-4a9f-a21d-02db1fb656c3-metrics-server-audit-profiles\") pod \"metrics-server-6d4548cbfd-x6xkk\" (UID: \"39640cd9-5c53-4a9f-a21d-02db1fb656c3\") " pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:14.069724 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:14.069557 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39640cd9-5c53-4a9f-a21d-02db1fb656c3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d4548cbfd-x6xkk\" (UID: \"39640cd9-5c53-4a9f-a21d-02db1fb656c3\") " pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:14.069805 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:14.069718 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/39640cd9-5c53-4a9f-a21d-02db1fb656c3-audit-log\") pod \"metrics-server-6d4548cbfd-x6xkk\" (UID: \"39640cd9-5c53-4a9f-a21d-02db1fb656c3\") " pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:14.069805 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:14.069773 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/39640cd9-5c53-4a9f-a21d-02db1fb656c3-secret-metrics-server-client-certs\") pod \"metrics-server-6d4548cbfd-x6xkk\" (UID: \"39640cd9-5c53-4a9f-a21d-02db1fb656c3\") " pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:14.069931 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:14.069813 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvzc7\" (UniqueName: \"kubernetes.io/projected/39640cd9-5c53-4a9f-a21d-02db1fb656c3-kube-api-access-vvzc7\") pod \"metrics-server-6d4548cbfd-x6xkk\" (UID: \"39640cd9-5c53-4a9f-a21d-02db1fb656c3\") " pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:14.070091 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:14.070065 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/39640cd9-5c53-4a9f-a21d-02db1fb656c3-secret-metrics-server-tls\") pod \"metrics-server-6d4548cbfd-x6xkk\" (UID: \"39640cd9-5c53-4a9f-a21d-02db1fb656c3\") " pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:14.070190 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:14.070118 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/39640cd9-5c53-4a9f-a21d-02db1fb656c3-audit-log\") pod \"metrics-server-6d4548cbfd-x6xkk\" (UID: \"39640cd9-5c53-4a9f-a21d-02db1fb656c3\") " pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:14.070190 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:14.070126 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39640cd9-5c53-4a9f-a21d-02db1fb656c3-client-ca-bundle\") pod \"metrics-server-6d4548cbfd-x6xkk\" (UID: \"39640cd9-5c53-4a9f-a21d-02db1fb656c3\") " pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:14.070372 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:14.070346 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39640cd9-5c53-4a9f-a21d-02db1fb656c3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d4548cbfd-x6xkk\" (UID: \"39640cd9-5c53-4a9f-a21d-02db1fb656c3\") " pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:14.070711 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:14.070665 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/39640cd9-5c53-4a9f-a21d-02db1fb656c3-metrics-server-audit-profiles\") pod \"metrics-server-6d4548cbfd-x6xkk\" (UID: \"39640cd9-5c53-4a9f-a21d-02db1fb656c3\") " pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:14.072716 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:14.072675 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/39640cd9-5c53-4a9f-a21d-02db1fb656c3-client-ca-bundle\") pod \"metrics-server-6d4548cbfd-x6xkk\" (UID: \"39640cd9-5c53-4a9f-a21d-02db1fb656c3\") " pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:14.072828 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:14.072806 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/39640cd9-5c53-4a9f-a21d-02db1fb656c3-secret-metrics-server-client-certs\") pod \"metrics-server-6d4548cbfd-x6xkk\" (UID: \"39640cd9-5c53-4a9f-a21d-02db1fb656c3\") " pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:14.072828 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:14.072819 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/39640cd9-5c53-4a9f-a21d-02db1fb656c3-secret-metrics-server-tls\") pod \"metrics-server-6d4548cbfd-x6xkk\" (UID: \"39640cd9-5c53-4a9f-a21d-02db1fb656c3\") " pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:14.078948 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:14.078878 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvzc7\" (UniqueName: \"kubernetes.io/projected/39640cd9-5c53-4a9f-a21d-02db1fb656c3-kube-api-access-vvzc7\") pod \"metrics-server-6d4548cbfd-x6xkk\" (UID: \"39640cd9-5c53-4a9f-a21d-02db1fb656c3\") " pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:14.262534 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:14.262449 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:14.763858 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:14.763836 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm"] Jul 21 15:02:14.783533 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:02:14.783497 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7d6237d_4c22_4602_aa9a_5fc0ac336730.slice/crio-083ccccd5c8ec792f9c46198bca2fee3056f10f5f5b86d84d5f800e8d82bdac5 WatchSource:0}: Error finding container 083ccccd5c8ec792f9c46198bca2fee3056f10f5f5b86d84d5f800e8d82bdac5: Status 404 returned error can't find the container with id 083ccccd5c8ec792f9c46198bca2fee3056f10f5f5b86d84d5f800e8d82bdac5 Jul 21 15:02:14.954847 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:14.954819 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6d4548cbfd-x6xkk"] Jul 21 15:02:14.959802 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:02:14.959760 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39640cd9_5c53_4a9f_a21d_02db1fb656c3.slice/crio-6b15c992314fc8bf824735bc3d164a080176c3ad6536b2e74a9f289cd66231e4 WatchSource:0}: Error finding container 6b15c992314fc8bf824735bc3d164a080176c3ad6536b2e74a9f289cd66231e4: Status 404 returned error can't find the container with id 6b15c992314fc8bf824735bc3d164a080176c3ad6536b2e74a9f289cd66231e4 Jul 21 15:02:15.215962 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:15.215926 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" event={"ID":"e7d6237d-4c22-4602-aa9a-5fc0ac336730","Type":"ContainerStarted","Data":"083ccccd5c8ec792f9c46198bca2fee3056f10f5f5b86d84d5f800e8d82bdac5"} Jul 21 15:02:15.217356 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:15.217326 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rj7km" event={"ID":"4bef143c-d202-45f2-85ea-ae75c3d6812e","Type":"ContainerStarted","Data":"b3fd11ba02c54f8994e6fc4fea296b08749c0781c20a70add6300f1b0fcae0b5"} Jul 21 15:02:15.218466 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:15.218442 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" event={"ID":"39640cd9-5c53-4a9f-a21d-02db1fb656c3","Type":"ContainerStarted","Data":"6b15c992314fc8bf824735bc3d164a080176c3ad6536b2e74a9f289cd66231e4"} Jul 21 15:02:15.219859 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:15.219833 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nf7mq" event={"ID":"ad871b9b-ed50-4cf4-9e2b-8aad7681fa2d","Type":"ContainerStarted","Data":"05275dd7d150006a6d54a337d47ae8b040f400ddc3100607b4f45532b31f750f"} Jul 21 15:02:15.219956 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:15.219932 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:02:15.221652 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:15.221623 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" event={"ID":"58b8eb28-dd6d-4eff-889e-10d2e6014b34","Type":"ContainerStarted","Data":"4e2d8581bf8e5b68727173d4c320e27d1dbdce8978ac3249ef2cc4206481b1e0"} Jul 21 15:02:15.221738 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:15.221682 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" event={"ID":"58b8eb28-dd6d-4eff-889e-10d2e6014b34","Type":"ContainerStarted","Data":"42ea2b65f3620f96e54c9930bf26d5b11151ef1b54d697650ee253bc3a23011b"} Jul 21 15:02:15.223376 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:15.223353 2577 generic.go:356] "Generic (PLEG): container finished" podID="01a930f2-8b11-4609-b3da-e0805e69a026" containerID="2794fdc30530538a4a36fbd469d35227786d6b2c46e3daaad8e3744b26070eac" exitCode=0 Jul 21 15:02:15.223473 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:15.223385 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zfj5v" event={"ID":"01a930f2-8b11-4609-b3da-e0805e69a026","Type":"ContainerDied","Data":"2794fdc30530538a4a36fbd469d35227786d6b2c46e3daaad8e3744b26070eac"} Jul 21 15:02:15.236291 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:15.236247 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rj7km" podStartSLOduration=65.397203687 podStartE2EDuration="1m12.236233096s" totalImagesPullingTime="6.839029409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:01:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:15.23568723 +0000 UTC m=+72.920342838" watchObservedRunningTime="2026-07-21 15:02:15.236233096 +0000 UTC m=+72.920888697" Jul 21 15:02:15.273279 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:15.273213 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nf7mq" podStartSLOduration=65.630625713 podStartE2EDuration="1m12.27318481s" totalImagesPullingTime="6.642559097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:01:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:15.272843721 +0000 UTC m=+72.957499330" watchObservedRunningTime="2026-07-21 15:02:15.27318481 +0000 UTC m=+72.957840419" Jul 21 15:02:16.232263 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:16.232222 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" event={"ID":"58b8eb28-dd6d-4eff-889e-10d2e6014b34","Type":"ContainerStarted","Data":"1dc4f7a1b4aefea2c27fa4701af40a63a9e346e95e3897c05fd4425959d688d8"} Jul 21 15:02:16.234535 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:16.234506 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zfj5v" event={"ID":"01a930f2-8b11-4609-b3da-e0805e69a026","Type":"ContainerStarted","Data":"266f9bf54b4248f531d845424d38f550667b2c6a3eaa43f0961a03cfe6f143a1"} Jul 21 15:02:16.234673 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:16.234561 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zfj5v" event={"ID":"01a930f2-8b11-4609-b3da-e0805e69a026","Type":"ContainerStarted","Data":"bf3a97655947282d670a16ec475b7349b854da2e1f16e814072399463697c4ec"} Jul 21 15:02:16.256039 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:16.255972 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-44kxl" podStartSLOduration=3.138764718 podStartE2EDuration="7.255948744s" totalImagesPullingTime="4.117184026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:16.255350723 +0000 UTC m=+73.940006344" watchObservedRunningTime="2026-07-21 15:02:16.255948744 +0000 UTC m=+73.940604354" Jul 21 15:02:16.278445 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:16.278381 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zfj5v" podStartSLOduration=2.8930829019999997 podStartE2EDuration="7.278356583s" totalImagesPullingTime="4.26115018s" totalInitContainerRuntime="124.123501ms" isStatefulPod=true podCreationTimestamp="2026-07-21 15:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:16.277260591 +0000 UTC m=+73.961916203" watchObservedRunningTime="2026-07-21 15:02:16.278356583 +0000 UTC m=+73.963012191" Jul 21 15:02:17.240051 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:17.240022 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" event={"ID":"e7d6237d-4c22-4602-aa9a-5fc0ac336730","Type":"ContainerStarted","Data":"8de3e6abc6cc421e92014c0ba15c7591fce4f047dc03a499a73868cdcd78d934"} Jul 21 15:02:18.247085 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:18.247044 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" event={"ID":"e7d6237d-4c22-4602-aa9a-5fc0ac336730","Type":"ContainerStarted","Data":"7e7fe07bf92a2b985770019baba8ecf0f8d8cee5d04675ace5360931dda6695a"} Jul 21 15:02:18.247541 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:18.247180 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" event={"ID":"e7d6237d-4c22-4602-aa9a-5fc0ac336730","Type":"ContainerStarted","Data":"46155afe0010be262ba4536c9c6443fbf03713491f1deafa1c989ec5a68f58d4"} Jul 21 15:02:19.253601 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:19.253562 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" event={"ID":"e7d6237d-4c22-4602-aa9a-5fc0ac336730","Type":"ContainerStarted","Data":"ddff027229c1fed658cbc0a4b6a48e44fd94b083618d3235d822598d0e67ea0a"} Jul 21 15:02:19.254070 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:19.253664 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:19.254070 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:19.253708 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" event={"ID":"e7d6237d-4c22-4602-aa9a-5fc0ac336730","Type":"ContainerStarted","Data":"4ed66a0c92a72f1bc136d865bae70685147317f64a481eee447b142ea0ed944d"} Jul 21 15:02:19.254070 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:19.253755 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" event={"ID":"e7d6237d-4c22-4602-aa9a-5fc0ac336730","Type":"ContainerStarted","Data":"3fcfcf81ce2e2dd182e8da01f2bbae6074fa8316410032534fb4d891dc4950f1"} Jul 21 15:02:19.255123 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:19.255100 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" event={"ID":"39640cd9-5c53-4a9f-a21d-02db1fb656c3","Type":"ContainerStarted","Data":"99c7eb92a1165b4fc50627b635114e4477221304ce208b27a56bd27e78985e78"} Jul 21 15:02:19.279965 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:19.279910 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" podStartSLOduration=3.854390583 podStartE2EDuration="7.279876332s" totalImagesPullingTime="3.425485749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:02:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:19.278548163 +0000 UTC m=+76.963203807" watchObservedRunningTime="2026-07-21 15:02:19.279876332 +0000 UTC m=+76.964531938" Jul 21 15:02:19.297512 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:19.297458 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" podStartSLOduration=2.821110007 podStartE2EDuration="6.297439429s" totalImagesPullingTime="3.476329422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:02:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:19.29706724 +0000 UTC m=+76.981722866" watchObservedRunningTime="2026-07-21 15:02:19.297439429 +0000 UTC m=+76.982095038" Jul 21 15:02:25.264551 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:25.264442 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-54ff46bdc5-rt6rm" Jul 21 15:02:34.263016 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:34.262980 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:34.263486 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:34.263043 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:38.868079 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:38.868043 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f759b9bc9-gpb8p"] Jul 21 15:02:38.902270 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:38.902244 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:38.905383 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:38.905359 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 21 15:02:38.905533 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:38.905371 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 21 15:02:38.905533 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:38.905486 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 21 15:02:38.906403 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:38.906376 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 21 15:02:38.906403 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:38.906394 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-59745\"" Jul 21 15:02:38.906575 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:38.906408 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 21 15:02:38.906575 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:38.906555 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 21 15:02:38.906824 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:38.906806 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 21 15:02:38.907306 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:38.907291 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f759b9bc9-gpb8p"] Jul 21 15:02:38.951069 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:38.951042 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5d95b93-a486-41a8-9be2-8258a5302d5e-service-ca\") pod \"console-6f759b9bc9-gpb8p\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:38.951206 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:38.951090 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5d95b93-a486-41a8-9be2-8258a5302d5e-console-config\") pod \"console-6f759b9bc9-gpb8p\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:38.951206 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:38.951132 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5d95b93-a486-41a8-9be2-8258a5302d5e-oauth-serving-cert\") pod \"console-6f759b9bc9-gpb8p\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:38.951206 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:38.951179 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5d95b93-a486-41a8-9be2-8258a5302d5e-console-oauth-config\") pod \"console-6f759b9bc9-gpb8p\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:38.951206 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:38.951202 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8z6b\" (UniqueName: \"kubernetes.io/projected/f5d95b93-a486-41a8-9be2-8258a5302d5e-kube-api-access-k8z6b\") pod \"console-6f759b9bc9-gpb8p\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:38.951361 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:38.951226 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5d95b93-a486-41a8-9be2-8258a5302d5e-console-serving-cert\") pod \"console-6f759b9bc9-gpb8p\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:39.052287 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:39.052264 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5d95b93-a486-41a8-9be2-8258a5302d5e-console-config\") pod \"console-6f759b9bc9-gpb8p\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:39.052420 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:39.052297 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5d95b93-a486-41a8-9be2-8258a5302d5e-oauth-serving-cert\") pod \"console-6f759b9bc9-gpb8p\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:39.052420 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:39.052325 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5d95b93-a486-41a8-9be2-8258a5302d5e-console-oauth-config\") pod \"console-6f759b9bc9-gpb8p\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:39.052420 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:39.052342 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8z6b\" (UniqueName: \"kubernetes.io/projected/f5d95b93-a486-41a8-9be2-8258a5302d5e-kube-api-access-k8z6b\") pod \"console-6f759b9bc9-gpb8p\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:39.052420 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:39.052378 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5d95b93-a486-41a8-9be2-8258a5302d5e-console-serving-cert\") pod \"console-6f759b9bc9-gpb8p\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:39.052619 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:39.052431 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5d95b93-a486-41a8-9be2-8258a5302d5e-service-ca\") pod \"console-6f759b9bc9-gpb8p\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:39.053064 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:39.053042 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5d95b93-a486-41a8-9be2-8258a5302d5e-console-config\") pod \"console-6f759b9bc9-gpb8p\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:39.053164 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:39.053044 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5d95b93-a486-41a8-9be2-8258a5302d5e-oauth-serving-cert\") pod \"console-6f759b9bc9-gpb8p\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:39.053164 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:39.053144 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5d95b93-a486-41a8-9be2-8258a5302d5e-service-ca\") pod \"console-6f759b9bc9-gpb8p\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:39.054774 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:39.054750 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5d95b93-a486-41a8-9be2-8258a5302d5e-console-oauth-config\") pod \"console-6f759b9bc9-gpb8p\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:39.054852 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:39.054808 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5d95b93-a486-41a8-9be2-8258a5302d5e-console-serving-cert\") pod \"console-6f759b9bc9-gpb8p\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:39.060648 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:39.060629 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8z6b\" (UniqueName: \"kubernetes.io/projected/f5d95b93-a486-41a8-9be2-8258a5302d5e-kube-api-access-k8z6b\") pod \"console-6f759b9bc9-gpb8p\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:39.211944 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:39.211862 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:39.333418 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:39.333335 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f759b9bc9-gpb8p"] Jul 21 15:02:39.335787 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:02:39.335766 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5d95b93_a486_41a8_9be2_8258a5302d5e.slice/crio-890915f3031067d9f5d6c14fb2b31bb70170aa40a412f031bc791e95e09a103a WatchSource:0}: Error finding container 890915f3031067d9f5d6c14fb2b31bb70170aa40a412f031bc791e95e09a103a: Status 404 returned error can't find the container with id 890915f3031067d9f5d6c14fb2b31bb70170aa40a412f031bc791e95e09a103a Jul 21 15:02:40.332730 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:40.332694 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f759b9bc9-gpb8p" event={"ID":"f5d95b93-a486-41a8-9be2-8258a5302d5e","Type":"ContainerStarted","Data":"890915f3031067d9f5d6c14fb2b31bb70170aa40a412f031bc791e95e09a103a"} Jul 21 15:02:43.345734 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:43.345703 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f759b9bc9-gpb8p" event={"ID":"f5d95b93-a486-41a8-9be2-8258a5302d5e","Type":"ContainerStarted","Data":"0220bef84b5b103e3672d4b6f69ac719d334ea2c1c951a4da4f9a97e1a09082a"} Jul 21 15:02:43.365029 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:43.364985 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f759b9bc9-gpb8p" podStartSLOduration=2.1498274139999998 podStartE2EDuration="5.364971918s" totalImagesPullingTime="3.215144504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:02:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:43.36443076 +0000 UTC m=+101.049086368" watchObservedRunningTime="2026-07-21 15:02:43.364971918 +0000 UTC m=+101.049627523" Jul 21 15:02:46.236742 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:46.236707 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nf7mq" Jul 21 15:02:49.212740 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:49.212710 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:49.213175 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:49.212768 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:49.217453 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:49.217433 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:49.372168 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:49.372141 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:02:54.268362 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:54.268332 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:54.272010 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:54.271988 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6d4548cbfd-x6xkk" Jul 21 15:02:56.978401 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:02:56.978367 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f759b9bc9-gpb8p"] Jul 21 15:03:21.999932 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:21.999874 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f759b9bc9-gpb8p" podUID="f5d95b93-a486-41a8-9be2-8258a5302d5e" containerName="console" containerID="cri-o://0220bef84b5b103e3672d4b6f69ac719d334ea2c1c951a4da4f9a97e1a09082a" gracePeriod=15 Jul 21 15:03:22.231819 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.231795 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:03:22.285005 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.284942 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5d95b93-a486-41a8-9be2-8258a5302d5e-service-ca\") pod \"f5d95b93-a486-41a8-9be2-8258a5302d5e\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " Jul 21 15:03:22.285005 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.284980 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8z6b\" (UniqueName: \"kubernetes.io/projected/f5d95b93-a486-41a8-9be2-8258a5302d5e-kube-api-access-k8z6b\") pod \"f5d95b93-a486-41a8-9be2-8258a5302d5e\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " Jul 21 15:03:22.285005 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.285029 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5d95b93-a486-41a8-9be2-8258a5302d5e-console-serving-cert\") pod \"f5d95b93-a486-41a8-9be2-8258a5302d5e\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " Jul 21 15:03:22.285241 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.285130 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5d95b93-a486-41a8-9be2-8258a5302d5e-console-config\") pod \"f5d95b93-a486-41a8-9be2-8258a5302d5e\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " Jul 21 15:03:22.285241 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.285164 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5d95b93-a486-41a8-9be2-8258a5302d5e-console-oauth-config\") pod \"f5d95b93-a486-41a8-9be2-8258a5302d5e\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " Jul 21 15:03:22.285241 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.285226 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5d95b93-a486-41a8-9be2-8258a5302d5e-oauth-serving-cert\") pod \"f5d95b93-a486-41a8-9be2-8258a5302d5e\" (UID: \"f5d95b93-a486-41a8-9be2-8258a5302d5e\") " Jul 21 15:03:22.285427 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.285383 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5d95b93-a486-41a8-9be2-8258a5302d5e-service-ca" (OuterVolumeSpecName: "service-ca") pod "f5d95b93-a486-41a8-9be2-8258a5302d5e" (UID: "f5d95b93-a486-41a8-9be2-8258a5302d5e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:03:22.285512 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.285490 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5d95b93-a486-41a8-9be2-8258a5302d5e-console-config" (OuterVolumeSpecName: "console-config") pod "f5d95b93-a486-41a8-9be2-8258a5302d5e" (UID: "f5d95b93-a486-41a8-9be2-8258a5302d5e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:03:22.285737 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.285693 2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f5d95b93-a486-41a8-9be2-8258a5302d5e-service-ca\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:03:22.285737 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.285719 2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f5d95b93-a486-41a8-9be2-8258a5302d5e-console-config\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:03:22.285737 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.285691 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5d95b93-a486-41a8-9be2-8258a5302d5e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f5d95b93-a486-41a8-9be2-8258a5302d5e" (UID: "f5d95b93-a486-41a8-9be2-8258a5302d5e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:03:22.287330 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.287296 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5d95b93-a486-41a8-9be2-8258a5302d5e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f5d95b93-a486-41a8-9be2-8258a5302d5e" (UID: "f5d95b93-a486-41a8-9be2-8258a5302d5e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 15:03:22.287413 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.287349 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5d95b93-a486-41a8-9be2-8258a5302d5e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f5d95b93-a486-41a8-9be2-8258a5302d5e" (UID: "f5d95b93-a486-41a8-9be2-8258a5302d5e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 15:03:22.287413 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.287363 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5d95b93-a486-41a8-9be2-8258a5302d5e-kube-api-access-k8z6b" (OuterVolumeSpecName: "kube-api-access-k8z6b") pod "f5d95b93-a486-41a8-9be2-8258a5302d5e" (UID: "f5d95b93-a486-41a8-9be2-8258a5302d5e"). InnerVolumeSpecName "kube-api-access-k8z6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:03:22.386034 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.386011 2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f5d95b93-a486-41a8-9be2-8258a5302d5e-console-serving-cert\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:03:22.386034 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.386030 2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f5d95b93-a486-41a8-9be2-8258a5302d5e-console-oauth-config\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:03:22.386152 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.386039 2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f5d95b93-a486-41a8-9be2-8258a5302d5e-oauth-serving-cert\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:03:22.386152 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.386047 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8z6b\" (UniqueName: \"kubernetes.io/projected/f5d95b93-a486-41a8-9be2-8258a5302d5e-kube-api-access-k8z6b\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:03:22.493686 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.493657 2577 generic.go:356] "Generic (PLEG): container finished" podID="f5d95b93-a486-41a8-9be2-8258a5302d5e" containerID="0220bef84b5b103e3672d4b6f69ac719d334ea2c1c951a4da4f9a97e1a09082a" exitCode=0 Jul 21 15:03:22.493778 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.493704 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f759b9bc9-gpb8p" Jul 21 15:03:22.493778 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.493710 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f759b9bc9-gpb8p" event={"ID":"f5d95b93-a486-41a8-9be2-8258a5302d5e","Type":"ContainerDied","Data":"0220bef84b5b103e3672d4b6f69ac719d334ea2c1c951a4da4f9a97e1a09082a"} Jul 21 15:03:22.493778 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.493757 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f759b9bc9-gpb8p" event={"ID":"f5d95b93-a486-41a8-9be2-8258a5302d5e","Type":"ContainerDied","Data":"890915f3031067d9f5d6c14fb2b31bb70170aa40a412f031bc791e95e09a103a"} Jul 21 15:03:22.493919 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.493782 2577 scope.go:117] "RemoveContainer" containerID="0220bef84b5b103e3672d4b6f69ac719d334ea2c1c951a4da4f9a97e1a09082a" Jul 21 15:03:22.505440 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.503059 2577 scope.go:117] "RemoveContainer" containerID="0220bef84b5b103e3672d4b6f69ac719d334ea2c1c951a4da4f9a97e1a09082a" Jul 21 15:03:22.505440 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:03:22.503609 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0220bef84b5b103e3672d4b6f69ac719d334ea2c1c951a4da4f9a97e1a09082a\": container with ID starting with 0220bef84b5b103e3672d4b6f69ac719d334ea2c1c951a4da4f9a97e1a09082a not found: ID does not exist" containerID="0220bef84b5b103e3672d4b6f69ac719d334ea2c1c951a4da4f9a97e1a09082a" Jul 21 15:03:22.505440 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.503647 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0220bef84b5b103e3672d4b6f69ac719d334ea2c1c951a4da4f9a97e1a09082a"} err="failed to get container status \"0220bef84b5b103e3672d4b6f69ac719d334ea2c1c951a4da4f9a97e1a09082a\": rpc error: code = NotFound desc = could not find container \"0220bef84b5b103e3672d4b6f69ac719d334ea2c1c951a4da4f9a97e1a09082a\": container with ID starting with 0220bef84b5b103e3672d4b6f69ac719d334ea2c1c951a4da4f9a97e1a09082a not found: ID does not exist" Jul 21 15:03:22.520532 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.520507 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f759b9bc9-gpb8p"] Jul 21 15:03:22.523986 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.523969 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f759b9bc9-gpb8p"] Jul 21 15:03:22.896137 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:22.896107 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5d95b93-a486-41a8-9be2-8258a5302d5e" path="/var/lib/kubelet/pods/f5d95b93-a486-41a8-9be2-8258a5302d5e/volumes" Jul 21 15:03:33.978651 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:33.978603 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5cd947c788-wvg8l"] Jul 21 15:03:33.979201 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:33.979166 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5d95b93-a486-41a8-9be2-8258a5302d5e" containerName="console" Jul 21 15:03:33.979201 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:33.979181 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5d95b93-a486-41a8-9be2-8258a5302d5e" containerName="console" Jul 21 15:03:33.979315 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:33.979239 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5d95b93-a486-41a8-9be2-8258a5302d5e" containerName="console" Jul 21 15:03:33.982498 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:33.982478 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:33.985305 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:33.985284 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 21 15:03:33.985413 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:33.985358 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 21 15:03:33.985730 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:33.985711 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 21 15:03:33.985811 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:33.985728 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 21 15:03:33.986846 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:33.986826 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 21 15:03:33.987039 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:33.987015 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-cskqs\"" Jul 21 15:03:33.991992 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:33.991963 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 21 15:03:33.996850 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:33.996827 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5cd947c788-wvg8l"] Jul 21 15:03:34.063748 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.063711 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/32fe8003-9165-400a-a15f-2278046ca905-federate-client-tls\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.063748 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.063748 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/32fe8003-9165-400a-a15f-2278046ca905-telemeter-client-tls\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.064002 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.063780 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32fe8003-9165-400a-a15f-2278046ca905-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.064002 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.063802 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k447r\" (UniqueName: \"kubernetes.io/projected/32fe8003-9165-400a-a15f-2278046ca905-kube-api-access-k447r\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.064002 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.063856 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32fe8003-9165-400a-a15f-2278046ca905-serving-certs-ca-bundle\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.064002 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.063880 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/32fe8003-9165-400a-a15f-2278046ca905-secret-telemeter-client\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.064002 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.063937 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32fe8003-9165-400a-a15f-2278046ca905-metrics-client-ca\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.064169 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.064005 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32fe8003-9165-400a-a15f-2278046ca905-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.164696 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.164660 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32fe8003-9165-400a-a15f-2278046ca905-serving-certs-ca-bundle\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.164696 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.164701 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/32fe8003-9165-400a-a15f-2278046ca905-secret-telemeter-client\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.164996 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.164737 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32fe8003-9165-400a-a15f-2278046ca905-metrics-client-ca\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.164996 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.164792 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32fe8003-9165-400a-a15f-2278046ca905-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.164996 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.164833 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/32fe8003-9165-400a-a15f-2278046ca905-federate-client-tls\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.164996 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.164859 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/32fe8003-9165-400a-a15f-2278046ca905-telemeter-client-tls\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.164996 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.164888 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32fe8003-9165-400a-a15f-2278046ca905-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.164996 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.164938 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k447r\" (UniqueName: \"kubernetes.io/projected/32fe8003-9165-400a-a15f-2278046ca905-kube-api-access-k447r\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.165722 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.165695 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/32fe8003-9165-400a-a15f-2278046ca905-metrics-client-ca\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.165915 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.165702 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32fe8003-9165-400a-a15f-2278046ca905-serving-certs-ca-bundle\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.166179 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.166155 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/32fe8003-9165-400a-a15f-2278046ca905-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.168963 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.168935 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/32fe8003-9165-400a-a15f-2278046ca905-telemeter-client-tls\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.169059 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.168963 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/32fe8003-9165-400a-a15f-2278046ca905-federate-client-tls\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.169316 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.169292 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/32fe8003-9165-400a-a15f-2278046ca905-secret-telemeter-client\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.169538 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.169520 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/32fe8003-9165-400a-a15f-2278046ca905-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.173295 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.173272 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k447r\" (UniqueName: \"kubernetes.io/projected/32fe8003-9165-400a-a15f-2278046ca905-kube-api-access-k447r\") pod \"telemeter-client-5cd947c788-wvg8l\" (UID: \"32fe8003-9165-400a-a15f-2278046ca905\") " pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.294948 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.294758 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" Jul 21 15:03:34.441859 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.441831 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5cd947c788-wvg8l"] Jul 21 15:03:34.443626 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:03:34.443599 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32fe8003_9165_400a_a15f_2278046ca905.slice/crio-46d36a7ffee5e504b2a660c6cecbdcb424d2eb131b1307f47ea223ff1cb241af WatchSource:0}: Error finding container 46d36a7ffee5e504b2a660c6cecbdcb424d2eb131b1307f47ea223ff1cb241af: Status 404 returned error can't find the container with id 46d36a7ffee5e504b2a660c6cecbdcb424d2eb131b1307f47ea223ff1cb241af Jul 21 15:03:34.542991 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:34.542952 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" event={"ID":"32fe8003-9165-400a-a15f-2278046ca905","Type":"ContainerStarted","Data":"46d36a7ffee5e504b2a660c6cecbdcb424d2eb131b1307f47ea223ff1cb241af"} Jul 21 15:03:37.555638 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:37.555601 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" event={"ID":"32fe8003-9165-400a-a15f-2278046ca905","Type":"ContainerStarted","Data":"7ed249a9a9c1f81349433ab1e2dfd1ddf6822a7708255362f24d7a18e946d2d2"} Jul 21 15:03:38.560870 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:38.560832 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" event={"ID":"32fe8003-9165-400a-a15f-2278046ca905","Type":"ContainerStarted","Data":"2499f89b7402f6d12cb1bcc310be2b88e894fe9ed0caf1150a58e33cec8f4c84"} Jul 21 15:03:38.561265 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:38.560887 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" event={"ID":"32fe8003-9165-400a-a15f-2278046ca905","Type":"ContainerStarted","Data":"94ca757ff800266ed0365b58789158eb5957e634a4f81ee9efc1bc2937dd5aaf"} Jul 21 15:03:38.589297 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:03:38.589235 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5cd947c788-wvg8l" podStartSLOduration=2.223155116 podStartE2EDuration="5.589214664s" totalImagesPullingTime="3.366059548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:03:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:03:38.586915608 +0000 UTC m=+156.271571218" watchObservedRunningTime="2026-07-21 15:03:38.589214664 +0000 UTC m=+156.273870272" Jul 21 15:06:02.728204 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:06:02.728172 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfv5x_b5b08086-eac8-4329-a903-a73b5e8503ce/ovn-acl-logging/0.log" Jul 21 15:06:02.732001 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:06:02.731976 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfv5x_b5b08086-eac8-4329-a903-a73b5e8503ce/ovn-acl-logging/0.log" Jul 21 15:06:02.732409 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:06:02.732379 2577 kubelet.go:1648] "Image garbage collection succeeded" Jul 21 15:07:01.871436 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:01.871357 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4"] Jul 21 15:07:01.874581 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:01.874562 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4" Jul 21 15:07:01.877361 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:01.877336 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 21 15:07:01.877461 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:01.877380 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 21 15:07:01.878350 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:01.878329 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6l54v\"" Jul 21 15:07:01.895657 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:01.895635 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4"] Jul 21 15:07:01.911622 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:01.911595 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzf7z\" (UniqueName: \"kubernetes.io/projected/0037ec26-734b-48ec-969f-99329a3ff1ea-kube-api-access-zzf7z\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4\" (UID: \"0037ec26-734b-48ec-969f-99329a3ff1ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4" Jul 21 15:07:01.911730 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:01.911638 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0037ec26-734b-48ec-969f-99329a3ff1ea-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4\" (UID: \"0037ec26-734b-48ec-969f-99329a3ff1ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4" Jul 21 15:07:01.911730 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:01.911665 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0037ec26-734b-48ec-969f-99329a3ff1ea-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4\" (UID: \"0037ec26-734b-48ec-969f-99329a3ff1ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4" Jul 21 15:07:02.012179 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:02.012139 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0037ec26-734b-48ec-969f-99329a3ff1ea-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4\" (UID: \"0037ec26-734b-48ec-969f-99329a3ff1ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4" Jul 21 15:07:02.012179 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:02.012183 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0037ec26-734b-48ec-969f-99329a3ff1ea-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4\" (UID: \"0037ec26-734b-48ec-969f-99329a3ff1ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4" Jul 21 15:07:02.012356 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:02.012241 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzf7z\" (UniqueName: \"kubernetes.io/projected/0037ec26-734b-48ec-969f-99329a3ff1ea-kube-api-access-zzf7z\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4\" (UID: \"0037ec26-734b-48ec-969f-99329a3ff1ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4" Jul 21 15:07:02.012525 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:02.012506 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0037ec26-734b-48ec-969f-99329a3ff1ea-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4\" (UID: \"0037ec26-734b-48ec-969f-99329a3ff1ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4" Jul 21 15:07:02.012565 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:02.012536 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0037ec26-734b-48ec-969f-99329a3ff1ea-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4\" (UID: \"0037ec26-734b-48ec-969f-99329a3ff1ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4" Jul 21 15:07:02.021830 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:02.021806 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzf7z\" (UniqueName: \"kubernetes.io/projected/0037ec26-734b-48ec-969f-99329a3ff1ea-kube-api-access-zzf7z\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4\" (UID: \"0037ec26-734b-48ec-969f-99329a3ff1ea\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4" Jul 21 15:07:02.183607 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:02.183523 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4" Jul 21 15:07:02.314016 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:02.313990 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4"] Jul 21 15:07:02.316303 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:07:02.316277 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0037ec26_734b_48ec_969f_99329a3ff1ea.slice/crio-0eb3331f527c24789cafd1fc834321190f9b014c03903bad5ad4a0003439ecce WatchSource:0}: Error finding container 0eb3331f527c24789cafd1fc834321190f9b014c03903bad5ad4a0003439ecce: Status 404 returned error can't find the container with id 0eb3331f527c24789cafd1fc834321190f9b014c03903bad5ad4a0003439ecce Jul 21 15:07:02.318277 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:02.318260 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 15:07:03.283550 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:03.283517 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4" event={"ID":"0037ec26-734b-48ec-969f-99329a3ff1ea","Type":"ContainerStarted","Data":"0eb3331f527c24789cafd1fc834321190f9b014c03903bad5ad4a0003439ecce"} Jul 21 15:07:10.311526 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:10.311493 2577 generic.go:356] "Generic (PLEG): container finished" podID="0037ec26-734b-48ec-969f-99329a3ff1ea" containerID="b490e71c2522c4a72694861ed6269dfb361b69beb56ebe4ddb4cb8d59bb8af2d" exitCode=0 Jul 21 15:07:10.311938 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:10.311574 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4" event={"ID":"0037ec26-734b-48ec-969f-99329a3ff1ea","Type":"ContainerDied","Data":"b490e71c2522c4a72694861ed6269dfb361b69beb56ebe4ddb4cb8d59bb8af2d"} Jul 21 15:07:13.325735 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:13.325700 2577 generic.go:356] "Generic (PLEG): container finished" podID="0037ec26-734b-48ec-969f-99329a3ff1ea" containerID="b49c103480df53f0cb96fb50854f25093ee9baff86396500c8be3f9eca1f3712" exitCode=0 Jul 21 15:07:13.326120 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:13.325788 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4" event={"ID":"0037ec26-734b-48ec-969f-99329a3ff1ea","Type":"ContainerDied","Data":"b49c103480df53f0cb96fb50854f25093ee9baff86396500c8be3f9eca1f3712"} Jul 21 15:07:21.362244 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:21.362212 2577 generic.go:356] "Generic (PLEG): container finished" podID="0037ec26-734b-48ec-969f-99329a3ff1ea" containerID="7c3d78803dc9a23113e40edcd854679eb61e64e293d9695a8b8ee000d44b943a" exitCode=0 Jul 21 15:07:21.362680 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:21.362306 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4" event={"ID":"0037ec26-734b-48ec-969f-99329a3ff1ea","Type":"ContainerDied","Data":"7c3d78803dc9a23113e40edcd854679eb61e64e293d9695a8b8ee000d44b943a"} Jul 21 15:07:22.486962 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:22.486939 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4" Jul 21 15:07:22.583936 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:22.583876 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0037ec26-734b-48ec-969f-99329a3ff1ea-bundle\") pod \"0037ec26-734b-48ec-969f-99329a3ff1ea\" (UID: \"0037ec26-734b-48ec-969f-99329a3ff1ea\") " Jul 21 15:07:22.583936 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:22.583944 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzf7z\" (UniqueName: \"kubernetes.io/projected/0037ec26-734b-48ec-969f-99329a3ff1ea-kube-api-access-zzf7z\") pod \"0037ec26-734b-48ec-969f-99329a3ff1ea\" (UID: \"0037ec26-734b-48ec-969f-99329a3ff1ea\") " Jul 21 15:07:22.584156 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:22.583982 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0037ec26-734b-48ec-969f-99329a3ff1ea-util\") pod \"0037ec26-734b-48ec-969f-99329a3ff1ea\" (UID: \"0037ec26-734b-48ec-969f-99329a3ff1ea\") " Jul 21 15:07:22.584577 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:22.584543 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0037ec26-734b-48ec-969f-99329a3ff1ea-bundle" (OuterVolumeSpecName: "bundle") pod "0037ec26-734b-48ec-969f-99329a3ff1ea" (UID: "0037ec26-734b-48ec-969f-99329a3ff1ea"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:07:22.586236 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:22.586210 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0037ec26-734b-48ec-969f-99329a3ff1ea-kube-api-access-zzf7z" (OuterVolumeSpecName: "kube-api-access-zzf7z") pod "0037ec26-734b-48ec-969f-99329a3ff1ea" (UID: "0037ec26-734b-48ec-969f-99329a3ff1ea"). InnerVolumeSpecName "kube-api-access-zzf7z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:07:22.588878 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:22.588855 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0037ec26-734b-48ec-969f-99329a3ff1ea-util" (OuterVolumeSpecName: "util") pod "0037ec26-734b-48ec-969f-99329a3ff1ea" (UID: "0037ec26-734b-48ec-969f-99329a3ff1ea"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:07:22.685620 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:22.685531 2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0037ec26-734b-48ec-969f-99329a3ff1ea-util\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:07:22.685620 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:22.685559 2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0037ec26-734b-48ec-969f-99329a3ff1ea-bundle\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:07:22.685620 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:22.685573 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzf7z\" (UniqueName: \"kubernetes.io/projected/0037ec26-734b-48ec-969f-99329a3ff1ea-kube-api-access-zzf7z\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:07:23.371722 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:23.371686 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4" event={"ID":"0037ec26-734b-48ec-969f-99329a3ff1ea","Type":"ContainerDied","Data":"0eb3331f527c24789cafd1fc834321190f9b014c03903bad5ad4a0003439ecce"} Jul 21 15:07:23.371722 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:23.371712 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540t28b4" Jul 21 15:07:23.371952 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:23.371739 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0eb3331f527c24789cafd1fc834321190f9b014c03903bad5ad4a0003439ecce" Jul 21 15:07:29.926158 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:29.926123 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrl7l"] Jul 21 15:07:29.926537 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:29.926388 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0037ec26-734b-48ec-969f-99329a3ff1ea" containerName="util" Jul 21 15:07:29.926537 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:29.926398 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0037ec26-734b-48ec-969f-99329a3ff1ea" containerName="util" Jul 21 15:07:29.926537 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:29.926415 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0037ec26-734b-48ec-969f-99329a3ff1ea" containerName="extract" Jul 21 15:07:29.926537 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:29.926422 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0037ec26-734b-48ec-969f-99329a3ff1ea" containerName="extract" Jul 21 15:07:29.926537 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:29.926432 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0037ec26-734b-48ec-969f-99329a3ff1ea" containerName="pull" Jul 21 15:07:29.926537 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:29.926438 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0037ec26-734b-48ec-969f-99329a3ff1ea" containerName="pull" Jul 21 15:07:29.926537 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:29.926490 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0037ec26-734b-48ec-969f-99329a3ff1ea" containerName="extract" Jul 21 15:07:29.928422 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:29.928405 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrl7l" Jul 21 15:07:29.930935 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:29.930910 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 21 15:07:29.930935 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:29.930910 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-86r8d\"" Jul 21 15:07:29.931116 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:29.931049 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 21 15:07:29.943337 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:29.943317 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrl7l"] Jul 21 15:07:30.046328 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:30.046298 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2p9dj\" (UniqueName: \"kubernetes.io/projected/7bd0457e-d8ab-4143-91cf-568f5036b084-kube-api-access-2p9dj\") pod \"cert-manager-operator-controller-manager-55c444bf86-jrl7l\" (UID: \"7bd0457e-d8ab-4143-91cf-568f5036b084\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrl7l" Jul 21 15:07:30.046470 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:30.046350 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bd0457e-d8ab-4143-91cf-568f5036b084-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jrl7l\" (UID: \"7bd0457e-d8ab-4143-91cf-568f5036b084\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrl7l" Jul 21 15:07:30.147686 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:30.147649 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2p9dj\" (UniqueName: \"kubernetes.io/projected/7bd0457e-d8ab-4143-91cf-568f5036b084-kube-api-access-2p9dj\") pod \"cert-manager-operator-controller-manager-55c444bf86-jrl7l\" (UID: \"7bd0457e-d8ab-4143-91cf-568f5036b084\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrl7l" Jul 21 15:07:30.147865 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:30.147767 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bd0457e-d8ab-4143-91cf-568f5036b084-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jrl7l\" (UID: \"7bd0457e-d8ab-4143-91cf-568f5036b084\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrl7l" Jul 21 15:07:30.148149 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:30.148132 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7bd0457e-d8ab-4143-91cf-568f5036b084-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jrl7l\" (UID: \"7bd0457e-d8ab-4143-91cf-568f5036b084\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrl7l" Jul 21 15:07:30.157458 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:30.157431 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2p9dj\" (UniqueName: \"kubernetes.io/projected/7bd0457e-d8ab-4143-91cf-568f5036b084-kube-api-access-2p9dj\") pod \"cert-manager-operator-controller-manager-55c444bf86-jrl7l\" (UID: \"7bd0457e-d8ab-4143-91cf-568f5036b084\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrl7l" Jul 21 15:07:30.238150 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:30.238066 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrl7l" Jul 21 15:07:30.370013 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:30.369975 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrl7l"] Jul 21 15:07:30.373091 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:07:30.373058 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bd0457e_d8ab_4143_91cf_568f5036b084.slice/crio-a29b0d93a0359b20330a2ebd37c4d172201f0ca4d6ad8d1bc3ea113a67419001 WatchSource:0}: Error finding container a29b0d93a0359b20330a2ebd37c4d172201f0ca4d6ad8d1bc3ea113a67419001: Status 404 returned error can't find the container with id a29b0d93a0359b20330a2ebd37c4d172201f0ca4d6ad8d1bc3ea113a67419001 Jul 21 15:07:30.398701 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:30.398671 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrl7l" event={"ID":"7bd0457e-d8ab-4143-91cf-568f5036b084","Type":"ContainerStarted","Data":"a29b0d93a0359b20330a2ebd37c4d172201f0ca4d6ad8d1bc3ea113a67419001"} Jul 21 15:07:32.409995 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:32.409953 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrl7l" event={"ID":"7bd0457e-d8ab-4143-91cf-568f5036b084","Type":"ContainerStarted","Data":"e9d8928a153eeb99e6bc881a76f7df6be043e67f1f51be9907db495e52c863e0"} Jul 21 15:07:32.433842 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:32.433790 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jrl7l" podStartSLOduration=1.980109664 podStartE2EDuration="3.433775448s" totalImagesPullingTime="1.453665784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:07:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:07:32.432025471 +0000 UTC m=+390.116681103" watchObservedRunningTime="2026-07-21 15:07:32.433775448 +0000 UTC m=+390.118431055" Jul 21 15:07:39.245264 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:39.245230 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sw8sl"] Jul 21 15:07:39.247422 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:39.247401 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-sw8sl" Jul 21 15:07:39.250070 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:39.250049 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 21 15:07:39.250191 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:39.250173 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-z85cv\"" Jul 21 15:07:39.251130 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:39.251111 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 21 15:07:39.259580 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:39.259561 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sw8sl"] Jul 21 15:07:39.325682 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:39.325645 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc8mb\" (UniqueName: \"kubernetes.io/projected/917a3d89-139f-41b9-a014-637fa6f0ec3e-kube-api-access-pc8mb\") pod \"cert-manager-webhook-6486ffd997-sw8sl\" (UID: \"917a3d89-139f-41b9-a014-637fa6f0ec3e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sw8sl" Jul 21 15:07:39.325825 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:39.325689 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/917a3d89-139f-41b9-a014-637fa6f0ec3e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sw8sl\" (UID: \"917a3d89-139f-41b9-a014-637fa6f0ec3e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sw8sl" Jul 21 15:07:39.426678 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:39.426646 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc8mb\" (UniqueName: \"kubernetes.io/projected/917a3d89-139f-41b9-a014-637fa6f0ec3e-kube-api-access-pc8mb\") pod \"cert-manager-webhook-6486ffd997-sw8sl\" (UID: \"917a3d89-139f-41b9-a014-637fa6f0ec3e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sw8sl" Jul 21 15:07:39.426847 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:39.426691 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/917a3d89-139f-41b9-a014-637fa6f0ec3e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sw8sl\" (UID: \"917a3d89-139f-41b9-a014-637fa6f0ec3e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sw8sl" Jul 21 15:07:39.436053 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:39.436027 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/917a3d89-139f-41b9-a014-637fa6f0ec3e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-sw8sl\" (UID: \"917a3d89-139f-41b9-a014-637fa6f0ec3e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sw8sl" Jul 21 15:07:39.436410 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:39.436388 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc8mb\" (UniqueName: \"kubernetes.io/projected/917a3d89-139f-41b9-a014-637fa6f0ec3e-kube-api-access-pc8mb\") pod \"cert-manager-webhook-6486ffd997-sw8sl\" (UID: \"917a3d89-139f-41b9-a014-637fa6f0ec3e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-sw8sl" Jul 21 15:07:39.556614 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:39.556586 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-sw8sl" Jul 21 15:07:39.680672 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:39.680556 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-sw8sl"] Jul 21 15:07:39.683368 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:07:39.683342 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod917a3d89_139f_41b9_a014_637fa6f0ec3e.slice/crio-7fe5390a789d9dee9f5eed6b17ab651cb8ae809135c122122c5b3c3c30996f4e WatchSource:0}: Error finding container 7fe5390a789d9dee9f5eed6b17ab651cb8ae809135c122122c5b3c3c30996f4e: Status 404 returned error can't find the container with id 7fe5390a789d9dee9f5eed6b17ab651cb8ae809135c122122c5b3c3c30996f4e Jul 21 15:07:40.441393 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:40.441358 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-sw8sl" event={"ID":"917a3d89-139f-41b9-a014-637fa6f0ec3e","Type":"ContainerStarted","Data":"7fe5390a789d9dee9f5eed6b17ab651cb8ae809135c122122c5b3c3c30996f4e"} Jul 21 15:07:44.461247 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:44.461210 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-sw8sl" event={"ID":"917a3d89-139f-41b9-a014-637fa6f0ec3e","Type":"ContainerStarted","Data":"eb212b426accca059ec04ae248deb62245a14309cad41ff5b9e1c3768578b80f"} Jul 21 15:07:44.461654 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:44.461279 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-sw8sl" Jul 21 15:07:44.484791 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:44.484740 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-sw8sl" podStartSLOduration=1.567581529 podStartE2EDuration="5.484726908s" totalImagesPullingTime="3.917145379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:07:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:07:44.48372917 +0000 UTC m=+402.168384802" watchObservedRunningTime="2026-07-21 15:07:44.484726908 +0000 UTC m=+402.169382514" Jul 21 15:07:50.466994 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:07:50.466959 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-sw8sl" Jul 21 15:08:16.319769 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.319733 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-795f7754-jqtxh"] Jul 21 15:08:16.323493 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.323473 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-795f7754-jqtxh" Jul 21 15:08:16.327214 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.327186 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fmf98\"" Jul 21 15:08:16.327322 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.327218 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 21 15:08:16.327593 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.327564 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 21 15:08:16.327593 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.327577 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 21 15:08:16.327712 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.327564 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 21 15:08:16.327712 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.327599 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 21 15:08:16.341507 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.341479 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-795f7754-jqtxh"] Jul 21 15:08:16.404450 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.404424 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9535fb18-11e2-4d08-b0c3-91c9eab60f25-cert\") pod \"lws-controller-manager-795f7754-jqtxh\" (UID: \"9535fb18-11e2-4d08-b0c3-91c9eab60f25\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-jqtxh" Jul 21 15:08:16.404571 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.404472 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9535fb18-11e2-4d08-b0c3-91c9eab60f25-manager-config\") pod \"lws-controller-manager-795f7754-jqtxh\" (UID: \"9535fb18-11e2-4d08-b0c3-91c9eab60f25\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-jqtxh" Jul 21 15:08:16.404627 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.404566 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lq6j\" (UniqueName: \"kubernetes.io/projected/9535fb18-11e2-4d08-b0c3-91c9eab60f25-kube-api-access-7lq6j\") pod \"lws-controller-manager-795f7754-jqtxh\" (UID: \"9535fb18-11e2-4d08-b0c3-91c9eab60f25\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-jqtxh" Jul 21 15:08:16.404627 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.404592 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9535fb18-11e2-4d08-b0c3-91c9eab60f25-metrics-cert\") pod \"lws-controller-manager-795f7754-jqtxh\" (UID: \"9535fb18-11e2-4d08-b0c3-91c9eab60f25\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-jqtxh" Jul 21 15:08:16.505343 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.505313 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lq6j\" (UniqueName: \"kubernetes.io/projected/9535fb18-11e2-4d08-b0c3-91c9eab60f25-kube-api-access-7lq6j\") pod \"lws-controller-manager-795f7754-jqtxh\" (UID: \"9535fb18-11e2-4d08-b0c3-91c9eab60f25\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-jqtxh" Jul 21 15:08:16.505496 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.505351 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9535fb18-11e2-4d08-b0c3-91c9eab60f25-metrics-cert\") pod \"lws-controller-manager-795f7754-jqtxh\" (UID: \"9535fb18-11e2-4d08-b0c3-91c9eab60f25\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-jqtxh" Jul 21 15:08:16.505496 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.505408 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9535fb18-11e2-4d08-b0c3-91c9eab60f25-cert\") pod \"lws-controller-manager-795f7754-jqtxh\" (UID: \"9535fb18-11e2-4d08-b0c3-91c9eab60f25\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-jqtxh" Jul 21 15:08:16.505496 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.505455 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9535fb18-11e2-4d08-b0c3-91c9eab60f25-manager-config\") pod \"lws-controller-manager-795f7754-jqtxh\" (UID: \"9535fb18-11e2-4d08-b0c3-91c9eab60f25\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-jqtxh" Jul 21 15:08:16.506090 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.506067 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9535fb18-11e2-4d08-b0c3-91c9eab60f25-manager-config\") pod \"lws-controller-manager-795f7754-jqtxh\" (UID: \"9535fb18-11e2-4d08-b0c3-91c9eab60f25\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-jqtxh" Jul 21 15:08:16.508017 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.507989 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9535fb18-11e2-4d08-b0c3-91c9eab60f25-cert\") pod \"lws-controller-manager-795f7754-jqtxh\" (UID: \"9535fb18-11e2-4d08-b0c3-91c9eab60f25\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-jqtxh" Jul 21 15:08:16.508117 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.508036 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9535fb18-11e2-4d08-b0c3-91c9eab60f25-metrics-cert\") pod \"lws-controller-manager-795f7754-jqtxh\" (UID: \"9535fb18-11e2-4d08-b0c3-91c9eab60f25\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-jqtxh" Jul 21 15:08:16.514888 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.514864 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lq6j\" (UniqueName: \"kubernetes.io/projected/9535fb18-11e2-4d08-b0c3-91c9eab60f25-kube-api-access-7lq6j\") pod \"lws-controller-manager-795f7754-jqtxh\" (UID: \"9535fb18-11e2-4d08-b0c3-91c9eab60f25\") " pod="openshift-lws-operator/lws-controller-manager-795f7754-jqtxh" Jul 21 15:08:16.633068 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.633003 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-795f7754-jqtxh" Jul 21 15:08:16.772217 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:16.772188 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-795f7754-jqtxh"] Jul 21 15:08:16.774600 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:08:16.774576 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9535fb18_11e2_4d08_b0c3_91c9eab60f25.slice/crio-d4b02e9e66f3fa09456484b095092f292c94683459f78af6b0ead125e6396265 WatchSource:0}: Error finding container d4b02e9e66f3fa09456484b095092f292c94683459f78af6b0ead125e6396265: Status 404 returned error can't find the container with id d4b02e9e66f3fa09456484b095092f292c94683459f78af6b0ead125e6396265 Jul 21 15:08:17.593508 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:17.593471 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-795f7754-jqtxh" event={"ID":"9535fb18-11e2-4d08-b0c3-91c9eab60f25","Type":"ContainerStarted","Data":"d4b02e9e66f3fa09456484b095092f292c94683459f78af6b0ead125e6396265"} Jul 21 15:08:20.608935 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:20.608880 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-795f7754-jqtxh" event={"ID":"9535fb18-11e2-4d08-b0c3-91c9eab60f25","Type":"ContainerStarted","Data":"fb75920b7af496bd210c43a777b3d6a710c6925fb0eb1ab018db5d5ebc83d0f6"} Jul 21 15:08:20.609328 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:20.608997 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-795f7754-jqtxh" Jul 21 15:08:20.631423 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:20.631371 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-795f7754-jqtxh" podStartSLOduration=1.851710446 podStartE2EDuration="4.631358649s" totalImagesPullingTime="2.779648203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:08:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:08:20.630105318 +0000 UTC m=+438.314760926" watchObservedRunningTime="2026-07-21 15:08:20.631358649 +0000 UTC m=+438.316014256" Jul 21 15:08:24.870061 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:24.869984 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf"] Jul 21 15:08:24.873325 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:24.873308 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" Jul 21 15:08:24.875629 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:24.875597 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 21 15:08:24.875755 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:24.875636 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 21 15:08:24.875755 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:24.875661 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-8mxsl\"" Jul 21 15:08:24.875968 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:24.875951 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 21 15:08:24.876202 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:24.876189 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 21 15:08:24.887346 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:24.887322 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf"] Jul 21 15:08:24.970451 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:24.970425 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/76aca68f-a89c-49e4-8758-3db3edd39cfb-manifests\") pod \"opendatahub-operator-controller-manager-7d78549688-wsxtf\" (UID: \"76aca68f-a89c-49e4-8758-3db3edd39cfb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" Jul 21 15:08:24.970590 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:24.970454 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m48pk\" (UniqueName: \"kubernetes.io/projected/76aca68f-a89c-49e4-8758-3db3edd39cfb-kube-api-access-m48pk\") pod \"opendatahub-operator-controller-manager-7d78549688-wsxtf\" (UID: \"76aca68f-a89c-49e4-8758-3db3edd39cfb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" Jul 21 15:08:24.970590 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:24.970474 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/76aca68f-a89c-49e4-8758-3db3edd39cfb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d78549688-wsxtf\" (UID: \"76aca68f-a89c-49e4-8758-3db3edd39cfb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" Jul 21 15:08:24.970590 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:24.970502 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76aca68f-a89c-49e4-8758-3db3edd39cfb-tmp\") pod \"opendatahub-operator-controller-manager-7d78549688-wsxtf\" (UID: \"76aca68f-a89c-49e4-8758-3db3edd39cfb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" Jul 21 15:08:24.970740 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:24.970622 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76aca68f-a89c-49e4-8758-3db3edd39cfb-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d78549688-wsxtf\" (UID: \"76aca68f-a89c-49e4-8758-3db3edd39cfb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" Jul 21 15:08:25.071028 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:25.070999 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76aca68f-a89c-49e4-8758-3db3edd39cfb-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d78549688-wsxtf\" (UID: \"76aca68f-a89c-49e4-8758-3db3edd39cfb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" Jul 21 15:08:25.071151 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:25.071053 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/76aca68f-a89c-49e4-8758-3db3edd39cfb-manifests\") pod \"opendatahub-operator-controller-manager-7d78549688-wsxtf\" (UID: \"76aca68f-a89c-49e4-8758-3db3edd39cfb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" Jul 21 15:08:25.071151 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:25.071082 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m48pk\" (UniqueName: \"kubernetes.io/projected/76aca68f-a89c-49e4-8758-3db3edd39cfb-kube-api-access-m48pk\") pod \"opendatahub-operator-controller-manager-7d78549688-wsxtf\" (UID: \"76aca68f-a89c-49e4-8758-3db3edd39cfb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" Jul 21 15:08:25.071151 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:25.071109 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/76aca68f-a89c-49e4-8758-3db3edd39cfb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d78549688-wsxtf\" (UID: \"76aca68f-a89c-49e4-8758-3db3edd39cfb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" Jul 21 15:08:25.071151 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:25.071145 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76aca68f-a89c-49e4-8758-3db3edd39cfb-tmp\") pod \"opendatahub-operator-controller-manager-7d78549688-wsxtf\" (UID: \"76aca68f-a89c-49e4-8758-3db3edd39cfb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" Jul 21 15:08:25.071558 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:25.071535 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/76aca68f-a89c-49e4-8758-3db3edd39cfb-manifests\") pod \"opendatahub-operator-controller-manager-7d78549688-wsxtf\" (UID: \"76aca68f-a89c-49e4-8758-3db3edd39cfb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" Jul 21 15:08:25.073395 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:25.073367 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76aca68f-a89c-49e4-8758-3db3edd39cfb-tmp\") pod \"opendatahub-operator-controller-manager-7d78549688-wsxtf\" (UID: \"76aca68f-a89c-49e4-8758-3db3edd39cfb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" Jul 21 15:08:25.073530 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:25.073513 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/76aca68f-a89c-49e4-8758-3db3edd39cfb-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d78549688-wsxtf\" (UID: \"76aca68f-a89c-49e4-8758-3db3edd39cfb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" Jul 21 15:08:25.073599 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:25.073583 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/76aca68f-a89c-49e4-8758-3db3edd39cfb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d78549688-wsxtf\" (UID: \"76aca68f-a89c-49e4-8758-3db3edd39cfb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" Jul 21 15:08:25.081722 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:25.081702 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m48pk\" (UniqueName: \"kubernetes.io/projected/76aca68f-a89c-49e4-8758-3db3edd39cfb-kube-api-access-m48pk\") pod \"opendatahub-operator-controller-manager-7d78549688-wsxtf\" (UID: \"76aca68f-a89c-49e4-8758-3db3edd39cfb\") " pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" Jul 21 15:08:25.183744 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:25.183681 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" Jul 21 15:08:25.321322 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:25.321297 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf"] Jul 21 15:08:25.322681 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:08:25.322654 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76aca68f_a89c_49e4_8758_3db3edd39cfb.slice/crio-b5bb35f98611151d803f0d7c9132b34f34b4d11f65394c4f606748d3866c090b WatchSource:0}: Error finding container b5bb35f98611151d803f0d7c9132b34f34b4d11f65394c4f606748d3866c090b: Status 404 returned error can't find the container with id b5bb35f98611151d803f0d7c9132b34f34b4d11f65394c4f606748d3866c090b Jul 21 15:08:25.630457 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:25.630424 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" event={"ID":"76aca68f-a89c-49e4-8758-3db3edd39cfb","Type":"ContainerStarted","Data":"b5bb35f98611151d803f0d7c9132b34f34b4d11f65394c4f606748d3866c090b"} Jul 21 15:08:30.654986 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:30.654948 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" event={"ID":"76aca68f-a89c-49e4-8758-3db3edd39cfb","Type":"ContainerStarted","Data":"a3768e0cc1c4d8d7f1cb4a8d01cdb79376759738968d1220f62985f6da9e063e"} Jul 21 15:08:31.615557 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:31.615527 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-795f7754-jqtxh" Jul 21 15:08:31.660739 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:31.660702 2577 generic.go:356] "Generic (PLEG): container finished" podID="76aca68f-a89c-49e4-8758-3db3edd39cfb" containerID="a3768e0cc1c4d8d7f1cb4a8d01cdb79376759738968d1220f62985f6da9e063e" exitCode=0 Jul 21 15:08:31.661215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:31.660768 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" event={"ID":"76aca68f-a89c-49e4-8758-3db3edd39cfb","Type":"ContainerDied","Data":"a3768e0cc1c4d8d7f1cb4a8d01cdb79376759738968d1220f62985f6da9e063e"} Jul 21 15:08:32.667048 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:32.667005 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" event={"ID":"76aca68f-a89c-49e4-8758-3db3edd39cfb","Type":"ContainerStarted","Data":"542f0f4e75d336fb85b711133b12bead6323cc618a86bd3719b0f72d19dfec22"} Jul 21 15:08:32.667489 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:32.667167 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" Jul 21 15:08:32.691338 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:32.691286 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" podStartSLOduration=2.493361204 podStartE2EDuration="8.691269907s" totalImagesPullingTime="5.165675085s" totalInitContainerRuntime="1.032233618s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:08:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:08:32.689408142 +0000 UTC m=+450.374063783" watchObservedRunningTime="2026-07-21 15:08:32.691269907 +0000 UTC m=+450.375925513" Jul 21 15:08:43.674120 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:43.674090 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d78549688-wsxtf" Jul 21 15:08:56.634946 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:56.634911 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7846d57695-bc64h"] Jul 21 15:08:56.638009 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:56.637994 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7846d57695-bc64h" Jul 21 15:08:56.644093 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:56.644064 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 21 15:08:56.644093 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:56.644085 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 21 15:08:56.644305 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:56.644124 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 21 15:08:56.644872 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:56.644854 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 21 15:08:56.649041 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:56.649026 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-2rh52\"" Jul 21 15:08:56.662338 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:56.662313 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7846d57695-bc64h"] Jul 21 15:08:56.739675 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:56.739631 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c64930c9-55fb-423c-a5c6-5669d95d1fdd-tmp\") pod \"kube-auth-proxy-7846d57695-bc64h\" (UID: \"c64930c9-55fb-423c-a5c6-5669d95d1fdd\") " pod="openshift-ingress/kube-auth-proxy-7846d57695-bc64h" Jul 21 15:08:56.739862 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:56.739687 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c64930c9-55fb-423c-a5c6-5669d95d1fdd-tls-certs\") pod \"kube-auth-proxy-7846d57695-bc64h\" (UID: \"c64930c9-55fb-423c-a5c6-5669d95d1fdd\") " pod="openshift-ingress/kube-auth-proxy-7846d57695-bc64h" Jul 21 15:08:56.739862 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:56.739792 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zb6km\" (UniqueName: \"kubernetes.io/projected/c64930c9-55fb-423c-a5c6-5669d95d1fdd-kube-api-access-zb6km\") pod \"kube-auth-proxy-7846d57695-bc64h\" (UID: \"c64930c9-55fb-423c-a5c6-5669d95d1fdd\") " pod="openshift-ingress/kube-auth-proxy-7846d57695-bc64h" Jul 21 15:08:56.840776 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:56.840743 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c64930c9-55fb-423c-a5c6-5669d95d1fdd-tmp\") pod \"kube-auth-proxy-7846d57695-bc64h\" (UID: \"c64930c9-55fb-423c-a5c6-5669d95d1fdd\") " pod="openshift-ingress/kube-auth-proxy-7846d57695-bc64h" Jul 21 15:08:56.840991 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:56.840789 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c64930c9-55fb-423c-a5c6-5669d95d1fdd-tls-certs\") pod \"kube-auth-proxy-7846d57695-bc64h\" (UID: \"c64930c9-55fb-423c-a5c6-5669d95d1fdd\") " pod="openshift-ingress/kube-auth-proxy-7846d57695-bc64h" Jul 21 15:08:56.840991 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:56.840840 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zb6km\" (UniqueName: \"kubernetes.io/projected/c64930c9-55fb-423c-a5c6-5669d95d1fdd-kube-api-access-zb6km\") pod \"kube-auth-proxy-7846d57695-bc64h\" (UID: \"c64930c9-55fb-423c-a5c6-5669d95d1fdd\") " pod="openshift-ingress/kube-auth-proxy-7846d57695-bc64h" Jul 21 15:08:56.843011 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:56.842990 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c64930c9-55fb-423c-a5c6-5669d95d1fdd-tmp\") pod \"kube-auth-proxy-7846d57695-bc64h\" (UID: \"c64930c9-55fb-423c-a5c6-5669d95d1fdd\") " pod="openshift-ingress/kube-auth-proxy-7846d57695-bc64h" Jul 21 15:08:56.843263 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:56.843243 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c64930c9-55fb-423c-a5c6-5669d95d1fdd-tls-certs\") pod \"kube-auth-proxy-7846d57695-bc64h\" (UID: \"c64930c9-55fb-423c-a5c6-5669d95d1fdd\") " pod="openshift-ingress/kube-auth-proxy-7846d57695-bc64h" Jul 21 15:08:56.849834 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:56.849804 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zb6km\" (UniqueName: \"kubernetes.io/projected/c64930c9-55fb-423c-a5c6-5669d95d1fdd-kube-api-access-zb6km\") pod \"kube-auth-proxy-7846d57695-bc64h\" (UID: \"c64930c9-55fb-423c-a5c6-5669d95d1fdd\") " pod="openshift-ingress/kube-auth-proxy-7846d57695-bc64h" Jul 21 15:08:56.947546 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:56.947464 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7846d57695-bc64h" Jul 21 15:08:57.097139 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:57.097094 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7846d57695-bc64h"] Jul 21 15:08:57.100148 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:08:57.100117 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc64930c9_55fb_423c_a5c6_5669d95d1fdd.slice/crio-ec0538c62cec09b700a757e27029aa04ff672cf65da1e9e091bca6590e7c0af0 WatchSource:0}: Error finding container ec0538c62cec09b700a757e27029aa04ff672cf65da1e9e091bca6590e7c0af0: Status 404 returned error can't find the container with id ec0538c62cec09b700a757e27029aa04ff672cf65da1e9e091bca6590e7c0af0 Jul 21 15:08:57.773955 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:08:57.773911 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7846d57695-bc64h" event={"ID":"c64930c9-55fb-423c-a5c6-5669d95d1fdd","Type":"ContainerStarted","Data":"ec0538c62cec09b700a757e27029aa04ff672cf65da1e9e091bca6590e7c0af0"} Jul 21 15:09:00.788087 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:09:00.788038 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7846d57695-bc64h" event={"ID":"c64930c9-55fb-423c-a5c6-5669d95d1fdd","Type":"ContainerStarted","Data":"2e1583dd05e3f834f7d525c991392fa362b085b405efc72a40a8298e6792c1c2"} Jul 21 15:09:00.814706 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:09:00.814657 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7846d57695-bc64h" podStartSLOduration=1.6640942939999999 podStartE2EDuration="4.814642767s" totalImagesPullingTime="3.150548473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:08:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:09:00.814316333 +0000 UTC m=+478.498971945" watchObservedRunningTime="2026-07-21 15:09:00.814642767 +0000 UTC m=+478.499298373" Jul 21 15:10:40.614214 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:10:40.614180 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tq2hc"] Jul 21 15:10:40.617410 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:10:40.617393 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tq2hc" Jul 21 15:10:40.620311 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:10:40.620289 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 21 15:10:40.620435 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:10:40.620320 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 21 15:10:40.620435 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:10:40.620416 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 21 15:10:40.620596 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:10:40.620580 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9j6kw\"" Jul 21 15:10:40.621376 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:10:40.621334 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 21 15:10:40.630600 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:10:40.630579 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tq2hc"] Jul 21 15:10:40.710284 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:10:40.710250 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/09297dd3-9d79-4480-804c-62c2471f0019-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tq2hc\" (UID: \"09297dd3-9d79-4480-804c-62c2471f0019\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tq2hc" Jul 21 15:10:40.710439 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:10:40.710317 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzkrr\" (UniqueName: \"kubernetes.io/projected/09297dd3-9d79-4480-804c-62c2471f0019-kube-api-access-lzkrr\") pod \"kuadrant-console-plugin-66b5774985-tq2hc\" (UID: \"09297dd3-9d79-4480-804c-62c2471f0019\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tq2hc" Jul 21 15:10:40.710439 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:10:40.710338 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/09297dd3-9d79-4480-804c-62c2471f0019-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tq2hc\" (UID: \"09297dd3-9d79-4480-804c-62c2471f0019\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tq2hc" Jul 21 15:10:40.811630 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:10:40.811603 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/09297dd3-9d79-4480-804c-62c2471f0019-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tq2hc\" (UID: \"09297dd3-9d79-4480-804c-62c2471f0019\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tq2hc" Jul 21 15:10:40.812011 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:10:40.811661 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzkrr\" (UniqueName: \"kubernetes.io/projected/09297dd3-9d79-4480-804c-62c2471f0019-kube-api-access-lzkrr\") pod \"kuadrant-console-plugin-66b5774985-tq2hc\" (UID: \"09297dd3-9d79-4480-804c-62c2471f0019\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tq2hc" Jul 21 15:10:40.812011 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:10:40.811681 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/09297dd3-9d79-4480-804c-62c2471f0019-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tq2hc\" (UID: \"09297dd3-9d79-4480-804c-62c2471f0019\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tq2hc" Jul 21 15:10:40.812268 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:10:40.812247 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/09297dd3-9d79-4480-804c-62c2471f0019-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-tq2hc\" (UID: \"09297dd3-9d79-4480-804c-62c2471f0019\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tq2hc" Jul 21 15:10:40.814057 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:10:40.814036 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/09297dd3-9d79-4480-804c-62c2471f0019-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-tq2hc\" (UID: \"09297dd3-9d79-4480-804c-62c2471f0019\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tq2hc" Jul 21 15:10:40.821383 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:10:40.821362 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzkrr\" (UniqueName: \"kubernetes.io/projected/09297dd3-9d79-4480-804c-62c2471f0019-kube-api-access-lzkrr\") pod \"kuadrant-console-plugin-66b5774985-tq2hc\" (UID: \"09297dd3-9d79-4480-804c-62c2471f0019\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tq2hc" Jul 21 15:10:40.925868 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:10:40.925798 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tq2hc" Jul 21 15:10:41.056480 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:10:41.056457 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-tq2hc"] Jul 21 15:10:41.058378 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:10:41.058352 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09297dd3_9d79_4480_804c_62c2471f0019.slice/crio-2f9060ffa994eca3db5723038e7ab8fafc93c33aad8cfeedd7789843473f4a3d WatchSource:0}: Error finding container 2f9060ffa994eca3db5723038e7ab8fafc93c33aad8cfeedd7789843473f4a3d: Status 404 returned error can't find the container with id 2f9060ffa994eca3db5723038e7ab8fafc93c33aad8cfeedd7789843473f4a3d Jul 21 15:10:41.218807 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:10:41.218726 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tq2hc" event={"ID":"09297dd3-9d79-4480-804c-62c2471f0019","Type":"ContainerStarted","Data":"2f9060ffa994eca3db5723038e7ab8fafc93c33aad8cfeedd7789843473f4a3d"} Jul 21 15:11:03.113242 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:03.113211 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfv5x_b5b08086-eac8-4329-a903-a73b5e8503ce/ovn-acl-logging/0.log" Jul 21 15:11:03.113695 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:03.113666 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfv5x_b5b08086-eac8-4329-a903-a73b5e8503ce/ovn-acl-logging/0.log" Jul 21 15:11:03.331260 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:03.331228 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tq2hc" event={"ID":"09297dd3-9d79-4480-804c-62c2471f0019","Type":"ContainerStarted","Data":"8143b8ef0a0ac6daf18e37a35d7da67a9767a602866b7ea0598535584c555297"} Jul 21 15:11:03.362490 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:03.362437 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-tq2hc" podStartSLOduration=1.2514566120000001 podStartE2EDuration="23.362417408s" totalImagesPullingTime="22.110960796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:10:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:11:03.360414579 +0000 UTC m=+601.045070186" watchObservedRunningTime="2026-07-21 15:11:03.362417408 +0000 UTC m=+601.047073016" Jul 21 15:11:35.325885 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:35.325809 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4l4v2"] Jul 21 15:11:35.362533 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:35.362499 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4l4v2"] Jul 21 15:11:35.362671 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:35.362586 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l4v2" Jul 21 15:11:35.366566 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:35.366542 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 21 15:11:35.378222 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:35.378196 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6898325b-1389-40ad-8a1a-2c63f3e64ce3-config-file\") pod \"limitador-limitador-64c94fd64f-4l4v2\" (UID: \"6898325b-1389-40ad-8a1a-2c63f3e64ce3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4l4v2" Jul 21 15:11:35.378343 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:35.378230 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnqnr\" (UniqueName: \"kubernetes.io/projected/6898325b-1389-40ad-8a1a-2c63f3e64ce3-kube-api-access-jnqnr\") pod \"limitador-limitador-64c94fd64f-4l4v2\" (UID: \"6898325b-1389-40ad-8a1a-2c63f3e64ce3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4l4v2" Jul 21 15:11:35.411807 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:35.411772 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4l4v2"] Jul 21 15:11:35.479236 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:35.479211 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6898325b-1389-40ad-8a1a-2c63f3e64ce3-config-file\") pod \"limitador-limitador-64c94fd64f-4l4v2\" (UID: \"6898325b-1389-40ad-8a1a-2c63f3e64ce3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4l4v2" Jul 21 15:11:35.479365 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:35.479242 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnqnr\" (UniqueName: \"kubernetes.io/projected/6898325b-1389-40ad-8a1a-2c63f3e64ce3-kube-api-access-jnqnr\") pod \"limitador-limitador-64c94fd64f-4l4v2\" (UID: \"6898325b-1389-40ad-8a1a-2c63f3e64ce3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4l4v2" Jul 21 15:11:35.479786 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:35.479768 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6898325b-1389-40ad-8a1a-2c63f3e64ce3-config-file\") pod \"limitador-limitador-64c94fd64f-4l4v2\" (UID: \"6898325b-1389-40ad-8a1a-2c63f3e64ce3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4l4v2" Jul 21 15:11:35.487848 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:35.487819 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnqnr\" (UniqueName: \"kubernetes.io/projected/6898325b-1389-40ad-8a1a-2c63f3e64ce3-kube-api-access-jnqnr\") pod \"limitador-limitador-64c94fd64f-4l4v2\" (UID: \"6898325b-1389-40ad-8a1a-2c63f3e64ce3\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4l4v2" Jul 21 15:11:35.673767 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:35.673705 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l4v2" Jul 21 15:11:35.804705 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:35.804679 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4l4v2"] Jul 21 15:11:35.806056 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:11:35.806025 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6898325b_1389_40ad_8a1a_2c63f3e64ce3.slice/crio-2faf1205eae0850228195cb7ded45d1c95b2c0b9a5587c91a5edbc6dbf566adf WatchSource:0}: Error finding container 2faf1205eae0850228195cb7ded45d1c95b2c0b9a5587c91a5edbc6dbf566adf: Status 404 returned error can't find the container with id 2faf1205eae0850228195cb7ded45d1c95b2c0b9a5587c91a5edbc6dbf566adf Jul 21 15:11:36.195694 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:36.195661 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-lvq7d"] Jul 21 15:11:36.200074 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:36.200054 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lvq7d" Jul 21 15:11:36.203229 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:36.203209 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hkqrt\"" Jul 21 15:11:36.216396 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:36.216374 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-lvq7d"] Jul 21 15:11:36.286138 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:36.286112 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg96p\" (UniqueName: \"kubernetes.io/projected/ca550ddc-c247-4744-a33e-079afb5777be-kube-api-access-mg96p\") pod \"authorino-58cd955675-lvq7d\" (UID: \"ca550ddc-c247-4744-a33e-079afb5777be\") " pod="kuadrant-system/authorino-58cd955675-lvq7d" Jul 21 15:11:36.387088 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:36.387060 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg96p\" (UniqueName: \"kubernetes.io/projected/ca550ddc-c247-4744-a33e-079afb5777be-kube-api-access-mg96p\") pod \"authorino-58cd955675-lvq7d\" (UID: \"ca550ddc-c247-4744-a33e-079afb5777be\") " pod="kuadrant-system/authorino-58cd955675-lvq7d" Jul 21 15:11:36.402246 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:36.402212 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg96p\" (UniqueName: \"kubernetes.io/projected/ca550ddc-c247-4744-a33e-079afb5777be-kube-api-access-mg96p\") pod \"authorino-58cd955675-lvq7d\" (UID: \"ca550ddc-c247-4744-a33e-079afb5777be\") " pod="kuadrant-system/authorino-58cd955675-lvq7d" Jul 21 15:11:36.477537 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:36.477464 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l4v2" event={"ID":"6898325b-1389-40ad-8a1a-2c63f3e64ce3","Type":"ContainerStarted","Data":"2faf1205eae0850228195cb7ded45d1c95b2c0b9a5587c91a5edbc6dbf566adf"} Jul 21 15:11:36.509460 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:36.509434 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lvq7d" Jul 21 15:11:36.685329 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:36.685306 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-lvq7d"] Jul 21 15:11:36.688966 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:11:36.688801 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca550ddc_c247_4744_a33e_079afb5777be.slice/crio-0d9660a62ce6f41ffe2d32733a5ae375334b725cf754862e5e90aad5a77a57e9 WatchSource:0}: Error finding container 0d9660a62ce6f41ffe2d32733a5ae375334b725cf754862e5e90aad5a77a57e9: Status 404 returned error can't find the container with id 0d9660a62ce6f41ffe2d32733a5ae375334b725cf754862e5e90aad5a77a57e9 Jul 21 15:11:37.484538 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:37.484494 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lvq7d" event={"ID":"ca550ddc-c247-4744-a33e-079afb5777be","Type":"ContainerStarted","Data":"0d9660a62ce6f41ffe2d32733a5ae375334b725cf754862e5e90aad5a77a57e9"} Jul 21 15:11:39.497720 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:39.497688 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l4v2" event={"ID":"6898325b-1389-40ad-8a1a-2c63f3e64ce3","Type":"ContainerStarted","Data":"53f6a3e4730e76b55cc58cce8322fe53b53fb0b4d684ac1e76aecfc64e097b70"} Jul 21 15:11:39.498164 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:39.497800 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l4v2" Jul 21 15:11:39.523295 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:39.523247 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l4v2" podStartSLOduration=1.643277055 podStartE2EDuration="4.5232321s" totalImagesPullingTime="2.879955045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:11:39.521552708 +0000 UTC m=+637.206208315" watchObservedRunningTime="2026-07-21 15:11:39.5232321 +0000 UTC m=+637.207887707" Jul 21 15:11:41.041303 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:41.041225 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-lvq7d"] Jul 21 15:11:41.508301 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:41.508271 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lvq7d" event={"ID":"ca550ddc-c247-4744-a33e-079afb5777be","Type":"ContainerStarted","Data":"6bb3be159e7b883773402666d1e1282fd3ff4e083f3bb83d2149d85bb50c5097"} Jul 21 15:11:41.527516 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:41.527473 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-lvq7d" podStartSLOduration=1.6232300240000002 podStartE2EDuration="5.527457569s" totalImagesPullingTime="3.904227545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:11:41.524998256 +0000 UTC m=+639.209653868" watchObservedRunningTime="2026-07-21 15:11:41.527457569 +0000 UTC m=+639.212113177" Jul 21 15:11:42.512439 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:42.512404 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-lvq7d" podUID="ca550ddc-c247-4744-a33e-079afb5777be" containerName="authorino" containerID="cri-o://6bb3be159e7b883773402666d1e1282fd3ff4e083f3bb83d2149d85bb50c5097" gracePeriod=30 Jul 21 15:11:42.762055 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:42.762032 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lvq7d" Jul 21 15:11:42.844773 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:42.844745 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mg96p\" (UniqueName: \"kubernetes.io/projected/ca550ddc-c247-4744-a33e-079afb5777be-kube-api-access-mg96p\") pod \"ca550ddc-c247-4744-a33e-079afb5777be\" (UID: \"ca550ddc-c247-4744-a33e-079afb5777be\") " Jul 21 15:11:42.846797 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:42.846771 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca550ddc-c247-4744-a33e-079afb5777be-kube-api-access-mg96p" (OuterVolumeSpecName: "kube-api-access-mg96p") pod "ca550ddc-c247-4744-a33e-079afb5777be" (UID: "ca550ddc-c247-4744-a33e-079afb5777be"). InnerVolumeSpecName "kube-api-access-mg96p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:11:42.946248 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:42.946221 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mg96p\" (UniqueName: \"kubernetes.io/projected/ca550ddc-c247-4744-a33e-079afb5777be-kube-api-access-mg96p\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:11:43.518533 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:43.518490 2577 generic.go:356] "Generic (PLEG): container finished" podID="ca550ddc-c247-4744-a33e-079afb5777be" containerID="6bb3be159e7b883773402666d1e1282fd3ff4e083f3bb83d2149d85bb50c5097" exitCode=0 Jul 21 15:11:43.519050 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:43.518551 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lvq7d" Jul 21 15:11:43.519050 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:43.518581 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lvq7d" event={"ID":"ca550ddc-c247-4744-a33e-079afb5777be","Type":"ContainerDied","Data":"6bb3be159e7b883773402666d1e1282fd3ff4e083f3bb83d2149d85bb50c5097"} Jul 21 15:11:43.519050 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:43.518635 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lvq7d" event={"ID":"ca550ddc-c247-4744-a33e-079afb5777be","Type":"ContainerDied","Data":"0d9660a62ce6f41ffe2d32733a5ae375334b725cf754862e5e90aad5a77a57e9"} Jul 21 15:11:43.519050 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:43.518659 2577 scope.go:117] "RemoveContainer" containerID="6bb3be159e7b883773402666d1e1282fd3ff4e083f3bb83d2149d85bb50c5097" Jul 21 15:11:43.526947 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:43.526927 2577 scope.go:117] "RemoveContainer" containerID="6bb3be159e7b883773402666d1e1282fd3ff4e083f3bb83d2149d85bb50c5097" Jul 21 15:11:43.527234 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:11:43.527213 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bb3be159e7b883773402666d1e1282fd3ff4e083f3bb83d2149d85bb50c5097\": container with ID starting with 6bb3be159e7b883773402666d1e1282fd3ff4e083f3bb83d2149d85bb50c5097 not found: ID does not exist" containerID="6bb3be159e7b883773402666d1e1282fd3ff4e083f3bb83d2149d85bb50c5097" Jul 21 15:11:43.527292 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:43.527242 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bb3be159e7b883773402666d1e1282fd3ff4e083f3bb83d2149d85bb50c5097"} err="failed to get container status \"6bb3be159e7b883773402666d1e1282fd3ff4e083f3bb83d2149d85bb50c5097\": rpc error: code = NotFound desc = could not find container \"6bb3be159e7b883773402666d1e1282fd3ff4e083f3bb83d2149d85bb50c5097\": container with ID starting with 6bb3be159e7b883773402666d1e1282fd3ff4e083f3bb83d2149d85bb50c5097 not found: ID does not exist" Jul 21 15:11:43.550062 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:43.550029 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-lvq7d"] Jul 21 15:11:43.570679 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:43.570655 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-lvq7d"] Jul 21 15:11:44.897680 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:44.897647 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca550ddc-c247-4744-a33e-079afb5777be" path="/var/lib/kubelet/pods/ca550ddc-c247-4744-a33e-079afb5777be/volumes" Jul 21 15:11:50.504433 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:50.504406 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l4v2" Jul 21 15:11:51.105906 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:51.105858 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4l4v2"] Jul 21 15:11:51.106073 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:51.106037 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l4v2" podUID="6898325b-1389-40ad-8a1a-2c63f3e64ce3" containerName="limitador" containerID="cri-o://53f6a3e4730e76b55cc58cce8322fe53b53fb0b4d684ac1e76aecfc64e097b70" gracePeriod=30 Jul 21 15:11:51.556202 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:51.556170 2577 generic.go:356] "Generic (PLEG): container finished" podID="6898325b-1389-40ad-8a1a-2c63f3e64ce3" containerID="53f6a3e4730e76b55cc58cce8322fe53b53fb0b4d684ac1e76aecfc64e097b70" exitCode=0 Jul 21 15:11:51.556532 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:51.556241 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l4v2" event={"ID":"6898325b-1389-40ad-8a1a-2c63f3e64ce3","Type":"ContainerDied","Data":"53f6a3e4730e76b55cc58cce8322fe53b53fb0b4d684ac1e76aecfc64e097b70"} Jul 21 15:11:51.651887 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:51.651862 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l4v2" Jul 21 15:11:51.718255 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:51.718194 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6898325b-1389-40ad-8a1a-2c63f3e64ce3-config-file\") pod \"6898325b-1389-40ad-8a1a-2c63f3e64ce3\" (UID: \"6898325b-1389-40ad-8a1a-2c63f3e64ce3\") " Jul 21 15:11:51.718368 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:51.718273 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnqnr\" (UniqueName: \"kubernetes.io/projected/6898325b-1389-40ad-8a1a-2c63f3e64ce3-kube-api-access-jnqnr\") pod \"6898325b-1389-40ad-8a1a-2c63f3e64ce3\" (UID: \"6898325b-1389-40ad-8a1a-2c63f3e64ce3\") " Jul 21 15:11:51.718513 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:51.718490 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6898325b-1389-40ad-8a1a-2c63f3e64ce3-config-file" (OuterVolumeSpecName: "config-file") pod "6898325b-1389-40ad-8a1a-2c63f3e64ce3" (UID: "6898325b-1389-40ad-8a1a-2c63f3e64ce3"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:11:51.720231 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:51.720202 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6898325b-1389-40ad-8a1a-2c63f3e64ce3-kube-api-access-jnqnr" (OuterVolumeSpecName: "kube-api-access-jnqnr") pod "6898325b-1389-40ad-8a1a-2c63f3e64ce3" (UID: "6898325b-1389-40ad-8a1a-2c63f3e64ce3"). InnerVolumeSpecName "kube-api-access-jnqnr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:11:51.819063 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:51.819040 2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6898325b-1389-40ad-8a1a-2c63f3e64ce3-config-file\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:11:51.819063 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:51.819059 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnqnr\" (UniqueName: \"kubernetes.io/projected/6898325b-1389-40ad-8a1a-2c63f3e64ce3-kube-api-access-jnqnr\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:11:52.562329 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:52.562291 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l4v2" event={"ID":"6898325b-1389-40ad-8a1a-2c63f3e64ce3","Type":"ContainerDied","Data":"2faf1205eae0850228195cb7ded45d1c95b2c0b9a5587c91a5edbc6dbf566adf"} Jul 21 15:11:52.562761 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:52.562338 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4l4v2" Jul 21 15:11:52.562761 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:52.562365 2577 scope.go:117] "RemoveContainer" containerID="53f6a3e4730e76b55cc58cce8322fe53b53fb0b4d684ac1e76aecfc64e097b70" Jul 21 15:11:52.586828 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:52.586803 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4l4v2"] Jul 21 15:11:52.592141 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:52.592119 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4l4v2"] Jul 21 15:11:52.902865 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:52.902784 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6898325b-1389-40ad-8a1a-2c63f3e64ce3" path="/var/lib/kubelet/pods/6898325b-1389-40ad-8a1a-2c63f3e64ce3/volumes" Jul 21 15:11:53.858680 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:53.858643 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-l82fp"] Jul 21 15:11:53.859168 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:53.859152 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca550ddc-c247-4744-a33e-079afb5777be" containerName="authorino" Jul 21 15:11:53.859240 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:53.859172 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca550ddc-c247-4744-a33e-079afb5777be" containerName="authorino" Jul 21 15:11:53.859240 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:53.859195 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6898325b-1389-40ad-8a1a-2c63f3e64ce3" containerName="limitador" Jul 21 15:11:53.859240 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:53.859204 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6898325b-1389-40ad-8a1a-2c63f3e64ce3" containerName="limitador" Jul 21 15:11:53.859382 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:53.859308 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca550ddc-c247-4744-a33e-079afb5777be" containerName="authorino" Jul 21 15:11:53.859382 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:53.859323 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6898325b-1389-40ad-8a1a-2c63f3e64ce3" containerName="limitador" Jul 21 15:11:53.863559 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:53.863535 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l82fp" Jul 21 15:11:53.867704 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:53.867684 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 21 15:11:53.867870 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:53.867853 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-q7m5v\"" Jul 21 15:11:53.868867 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:53.868848 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 21 15:11:53.868973 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:53.868908 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 21 15:11:53.882290 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:53.882262 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-l82fp"] Jul 21 15:11:53.935549 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:53.935512 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ebbda3e2-6905-46b1-a05b-5144a615cd99-data\") pod \"postgres-69fb4594cf-l82fp\" (UID: \"ebbda3e2-6905-46b1-a05b-5144a615cd99\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l82fp" Jul 21 15:11:53.935721 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:53.935577 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2n8m\" (UniqueName: \"kubernetes.io/projected/ebbda3e2-6905-46b1-a05b-5144a615cd99-kube-api-access-d2n8m\") pod \"postgres-69fb4594cf-l82fp\" (UID: \"ebbda3e2-6905-46b1-a05b-5144a615cd99\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l82fp" Jul 21 15:11:54.036294 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:54.036259 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2n8m\" (UniqueName: \"kubernetes.io/projected/ebbda3e2-6905-46b1-a05b-5144a615cd99-kube-api-access-d2n8m\") pod \"postgres-69fb4594cf-l82fp\" (UID: \"ebbda3e2-6905-46b1-a05b-5144a615cd99\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l82fp" Jul 21 15:11:54.036456 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:54.036325 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ebbda3e2-6905-46b1-a05b-5144a615cd99-data\") pod \"postgres-69fb4594cf-l82fp\" (UID: \"ebbda3e2-6905-46b1-a05b-5144a615cd99\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l82fp" Jul 21 15:11:54.036690 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:54.036673 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ebbda3e2-6905-46b1-a05b-5144a615cd99-data\") pod \"postgres-69fb4594cf-l82fp\" (UID: \"ebbda3e2-6905-46b1-a05b-5144a615cd99\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l82fp" Jul 21 15:11:54.045079 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:54.045048 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2n8m\" (UniqueName: \"kubernetes.io/projected/ebbda3e2-6905-46b1-a05b-5144a615cd99-kube-api-access-d2n8m\") pod \"postgres-69fb4594cf-l82fp\" (UID: \"ebbda3e2-6905-46b1-a05b-5144a615cd99\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-l82fp" Jul 21 15:11:54.173253 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:54.173164 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l82fp" Jul 21 15:11:54.307854 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:54.307829 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-l82fp"] Jul 21 15:11:54.309809 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:11:54.309781 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebbda3e2_6905_46b1_a05b_5144a615cd99.slice/crio-8c9e3bb727699f5a6fecdf0edcbb6dfa0e40954eb58f9ffcf022fe118611ae42 WatchSource:0}: Error finding container 8c9e3bb727699f5a6fecdf0edcbb6dfa0e40954eb58f9ffcf022fe118611ae42: Status 404 returned error can't find the container with id 8c9e3bb727699f5a6fecdf0edcbb6dfa0e40954eb58f9ffcf022fe118611ae42 Jul 21 15:11:54.573046 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:54.573014 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l82fp" event={"ID":"ebbda3e2-6905-46b1-a05b-5144a615cd99","Type":"ContainerStarted","Data":"8c9e3bb727699f5a6fecdf0edcbb6dfa0e40954eb58f9ffcf022fe118611ae42"} Jul 21 15:11:59.601450 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:59.601417 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l82fp" event={"ID":"ebbda3e2-6905-46b1-a05b-5144a615cd99","Type":"ContainerStarted","Data":"26baa4a94e20f0c7d7f0572d6333994d02c61219a20092fcbb6b72c882db7b83"} Jul 21 15:11:59.601815 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:59.601530 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l82fp" Jul 21 15:11:59.630552 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:11:59.630511 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l82fp" podStartSLOduration=1.655939129 podStartE2EDuration="6.630498224s" totalImagesPullingTime="4.974559095s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:11:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:11:59.630322057 +0000 UTC m=+657.314977664" watchObservedRunningTime="2026-07-21 15:11:59.630498224 +0000 UTC m=+657.315153831" Jul 21 15:12:05.633690 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:05.633664 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-l82fp" Jul 21 15:12:06.240908 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.240867 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dldp9"] Jul 21 15:12:06.246045 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.246027 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dldp9" Jul 21 15:12:06.249340 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.249323 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hkqrt\"" Jul 21 15:12:06.252253 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.252216 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dldp9"] Jul 21 15:12:06.344477 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.344443 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bldbp\" (UniqueName: \"kubernetes.io/projected/127c559f-b816-4f32-bf5a-6364d19d8290-kube-api-access-bldbp\") pod \"authorino-5d4b67c446-dldp9\" (UID: \"127c559f-b816-4f32-bf5a-6364d19d8290\") " pod="kuadrant-system/authorino-5d4b67c446-dldp9" Jul 21 15:12:06.445877 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.445829 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bldbp\" (UniqueName: \"kubernetes.io/projected/127c559f-b816-4f32-bf5a-6364d19d8290-kube-api-access-bldbp\") pod \"authorino-5d4b67c446-dldp9\" (UID: \"127c559f-b816-4f32-bf5a-6364d19d8290\") " pod="kuadrant-system/authorino-5d4b67c446-dldp9" Jul 21 15:12:06.463235 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.463204 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bldbp\" (UniqueName: \"kubernetes.io/projected/127c559f-b816-4f32-bf5a-6364d19d8290-kube-api-access-bldbp\") pod \"authorino-5d4b67c446-dldp9\" (UID: \"127c559f-b816-4f32-bf5a-6364d19d8290\") " pod="kuadrant-system/authorino-5d4b67c446-dldp9" Jul 21 15:12:06.539844 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.539764 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dldp9"] Jul 21 15:12:06.540046 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.540033 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dldp9" Jul 21 15:12:06.573234 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.573205 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68d5b54786-z5x5k"] Jul 21 15:12:06.576941 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.576916 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68d5b54786-z5x5k" Jul 21 15:12:06.587137 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.587110 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68d5b54786-z5x5k"] Jul 21 15:12:06.647252 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.647217 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwlzv\" (UniqueName: \"kubernetes.io/projected/2617da7f-1614-48fb-a6b6-4c4b3cd74636-kube-api-access-lwlzv\") pod \"authorino-68d5b54786-z5x5k\" (UID: \"2617da7f-1614-48fb-a6b6-4c4b3cd74636\") " pod="kuadrant-system/authorino-68d5b54786-z5x5k" Jul 21 15:12:06.674751 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.674698 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dldp9"] Jul 21 15:12:06.677121 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:12:06.677090 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod127c559f_b816_4f32_bf5a_6364d19d8290.slice/crio-f88816b8a576cfcc2ac7a6ee1956b2353ef192352bdc00e2e04d1193c65704bd WatchSource:0}: Error finding container f88816b8a576cfcc2ac7a6ee1956b2353ef192352bdc00e2e04d1193c65704bd: Status 404 returned error can't find the container with id f88816b8a576cfcc2ac7a6ee1956b2353ef192352bdc00e2e04d1193c65704bd Jul 21 15:12:06.678867 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.678847 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 15:12:06.744302 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.744266 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68d5b54786-z5x5k"] Jul 21 15:12:06.744548 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:12:06.744526 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-lwlzv], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-68d5b54786-z5x5k" podUID="2617da7f-1614-48fb-a6b6-4c4b3cd74636" Jul 21 15:12:06.747659 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.747643 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwlzv\" (UniqueName: \"kubernetes.io/projected/2617da7f-1614-48fb-a6b6-4c4b3cd74636-kube-api-access-lwlzv\") pod \"authorino-68d5b54786-z5x5k\" (UID: \"2617da7f-1614-48fb-a6b6-4c4b3cd74636\") " pod="kuadrant-system/authorino-68d5b54786-z5x5k" Jul 21 15:12:06.756887 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.756863 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwlzv\" (UniqueName: \"kubernetes.io/projected/2617da7f-1614-48fb-a6b6-4c4b3cd74636-kube-api-access-lwlzv\") pod \"authorino-68d5b54786-z5x5k\" (UID: \"2617da7f-1614-48fb-a6b6-4c4b3cd74636\") " pod="kuadrant-system/authorino-68d5b54786-z5x5k" Jul 21 15:12:06.773303 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.773274 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-765d5b97f8-99s2m"] Jul 21 15:12:06.776805 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.776790 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-765d5b97f8-99s2m" Jul 21 15:12:06.779454 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.779434 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 21 15:12:06.787119 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.787098 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-765d5b97f8-99s2m"] Jul 21 15:12:06.848731 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.848702 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6d050f90-dc78-4b61-afb3-82221d6fd133-tls-cert\") pod \"authorino-765d5b97f8-99s2m\" (UID: \"6d050f90-dc78-4b61-afb3-82221d6fd133\") " pod="kuadrant-system/authorino-765d5b97f8-99s2m" Jul 21 15:12:06.848947 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.848762 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zb6n\" (UniqueName: \"kubernetes.io/projected/6d050f90-dc78-4b61-afb3-82221d6fd133-kube-api-access-5zb6n\") pod \"authorino-765d5b97f8-99s2m\" (UID: \"6d050f90-dc78-4b61-afb3-82221d6fd133\") " pod="kuadrant-system/authorino-765d5b97f8-99s2m" Jul 21 15:12:06.949887 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.949856 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zb6n\" (UniqueName: \"kubernetes.io/projected/6d050f90-dc78-4b61-afb3-82221d6fd133-kube-api-access-5zb6n\") pod \"authorino-765d5b97f8-99s2m\" (UID: \"6d050f90-dc78-4b61-afb3-82221d6fd133\") " pod="kuadrant-system/authorino-765d5b97f8-99s2m" Jul 21 15:12:06.950061 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.949946 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6d050f90-dc78-4b61-afb3-82221d6fd133-tls-cert\") pod \"authorino-765d5b97f8-99s2m\" (UID: \"6d050f90-dc78-4b61-afb3-82221d6fd133\") " pod="kuadrant-system/authorino-765d5b97f8-99s2m" Jul 21 15:12:06.952313 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.952272 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6d050f90-dc78-4b61-afb3-82221d6fd133-tls-cert\") pod \"authorino-765d5b97f8-99s2m\" (UID: \"6d050f90-dc78-4b61-afb3-82221d6fd133\") " pod="kuadrant-system/authorino-765d5b97f8-99s2m" Jul 21 15:12:06.958931 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:06.958911 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zb6n\" (UniqueName: \"kubernetes.io/projected/6d050f90-dc78-4b61-afb3-82221d6fd133-kube-api-access-5zb6n\") pod \"authorino-765d5b97f8-99s2m\" (UID: \"6d050f90-dc78-4b61-afb3-82221d6fd133\") " pod="kuadrant-system/authorino-765d5b97f8-99s2m" Jul 21 15:12:07.086376 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:07.086340 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-765d5b97f8-99s2m" Jul 21 15:12:07.222522 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:07.222497 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-765d5b97f8-99s2m"] Jul 21 15:12:07.224766 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:12:07.224741 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d050f90_dc78_4b61_afb3_82221d6fd133.slice/crio-071d75d931bc7bdf195f6046731b8beac643699d1ac02d729405abfb7780f9bc WatchSource:0}: Error finding container 071d75d931bc7bdf195f6046731b8beac643699d1ac02d729405abfb7780f9bc: Status 404 returned error can't find the container with id 071d75d931bc7bdf195f6046731b8beac643699d1ac02d729405abfb7780f9bc Jul 21 15:12:07.636476 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:07.636440 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-765d5b97f8-99s2m" event={"ID":"6d050f90-dc78-4b61-afb3-82221d6fd133","Type":"ContainerStarted","Data":"071d75d931bc7bdf195f6046731b8beac643699d1ac02d729405abfb7780f9bc"} Jul 21 15:12:07.637879 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:07.637858 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68d5b54786-z5x5k" Jul 21 15:12:07.638034 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:07.637925 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dldp9" event={"ID":"127c559f-b816-4f32-bf5a-6364d19d8290","Type":"ContainerStarted","Data":"d0e55b3c551987a104be847bc132a5a03988c08572314666bb09138b3ff04f6c"} Jul 21 15:12:07.638034 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:07.637935 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-dldp9" podUID="127c559f-b816-4f32-bf5a-6364d19d8290" containerName="authorino" containerID="cri-o://d0e55b3c551987a104be847bc132a5a03988c08572314666bb09138b3ff04f6c" gracePeriod=30 Jul 21 15:12:07.638034 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:07.637960 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dldp9" event={"ID":"127c559f-b816-4f32-bf5a-6364d19d8290","Type":"ContainerStarted","Data":"f88816b8a576cfcc2ac7a6ee1956b2353ef192352bdc00e2e04d1193c65704bd"} Jul 21 15:12:07.661118 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:07.656691 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-dldp9" podStartSLOduration=1.091384972 podStartE2EDuration="1.656672563s" totalImagesPullingTime="565.287591ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:12:07.655660542 +0000 UTC m=+665.340316175" watchObservedRunningTime="2026-07-21 15:12:07.656672563 +0000 UTC m=+665.341328170" Jul 21 15:12:07.664987 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:07.664961 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68d5b54786-z5x5k" Jul 21 15:12:07.756403 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:07.756375 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwlzv\" (UniqueName: \"kubernetes.io/projected/2617da7f-1614-48fb-a6b6-4c4b3cd74636-kube-api-access-lwlzv\") pod \"2617da7f-1614-48fb-a6b6-4c4b3cd74636\" (UID: \"2617da7f-1614-48fb-a6b6-4c4b3cd74636\") " Jul 21 15:12:07.758425 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:07.758390 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2617da7f-1614-48fb-a6b6-4c4b3cd74636-kube-api-access-lwlzv" (OuterVolumeSpecName: "kube-api-access-lwlzv") pod "2617da7f-1614-48fb-a6b6-4c4b3cd74636" (UID: "2617da7f-1614-48fb-a6b6-4c4b3cd74636"). InnerVolumeSpecName "kube-api-access-lwlzv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:12:07.857192 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:07.857155 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwlzv\" (UniqueName: \"kubernetes.io/projected/2617da7f-1614-48fb-a6b6-4c4b3cd74636-kube-api-access-lwlzv\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:12:07.918660 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:07.918632 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dldp9" Jul 21 15:12:08.058350 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:08.058326 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bldbp\" (UniqueName: \"kubernetes.io/projected/127c559f-b816-4f32-bf5a-6364d19d8290-kube-api-access-bldbp\") pod \"127c559f-b816-4f32-bf5a-6364d19d8290\" (UID: \"127c559f-b816-4f32-bf5a-6364d19d8290\") " Jul 21 15:12:08.060204 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:08.060181 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/127c559f-b816-4f32-bf5a-6364d19d8290-kube-api-access-bldbp" (OuterVolumeSpecName: "kube-api-access-bldbp") pod "127c559f-b816-4f32-bf5a-6364d19d8290" (UID: "127c559f-b816-4f32-bf5a-6364d19d8290"). InnerVolumeSpecName "kube-api-access-bldbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:12:08.159324 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:08.159242 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bldbp\" (UniqueName: \"kubernetes.io/projected/127c559f-b816-4f32-bf5a-6364d19d8290-kube-api-access-bldbp\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:12:08.643596 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:08.643559 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-765d5b97f8-99s2m" event={"ID":"6d050f90-dc78-4b61-afb3-82221d6fd133","Type":"ContainerStarted","Data":"4f509064969fc3794529d80e8f8e62b1387539be7c4eadb4490fb19c89599dd8"} Jul 21 15:12:08.644706 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:08.644678 2577 generic.go:356] "Generic (PLEG): container finished" podID="127c559f-b816-4f32-bf5a-6364d19d8290" containerID="d0e55b3c551987a104be847bc132a5a03988c08572314666bb09138b3ff04f6c" exitCode=0 Jul 21 15:12:08.644706 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:08.644707 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dldp9" Jul 21 15:12:08.644864 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:08.644740 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dldp9" event={"ID":"127c559f-b816-4f32-bf5a-6364d19d8290","Type":"ContainerDied","Data":"d0e55b3c551987a104be847bc132a5a03988c08572314666bb09138b3ff04f6c"} Jul 21 15:12:08.644864 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:08.644769 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dldp9" event={"ID":"127c559f-b816-4f32-bf5a-6364d19d8290","Type":"ContainerDied","Data":"f88816b8a576cfcc2ac7a6ee1956b2353ef192352bdc00e2e04d1193c65704bd"} Jul 21 15:12:08.644864 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:08.644785 2577 scope.go:117] "RemoveContainer" containerID="d0e55b3c551987a104be847bc132a5a03988c08572314666bb09138b3ff04f6c" Jul 21 15:12:08.645062 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:08.644877 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68d5b54786-z5x5k" Jul 21 15:12:08.653441 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:08.653411 2577 scope.go:117] "RemoveContainer" containerID="d0e55b3c551987a104be847bc132a5a03988c08572314666bb09138b3ff04f6c" Jul 21 15:12:08.653721 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:12:08.653697 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0e55b3c551987a104be847bc132a5a03988c08572314666bb09138b3ff04f6c\": container with ID starting with d0e55b3c551987a104be847bc132a5a03988c08572314666bb09138b3ff04f6c not found: ID does not exist" containerID="d0e55b3c551987a104be847bc132a5a03988c08572314666bb09138b3ff04f6c" Jul 21 15:12:08.653783 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:08.653730 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0e55b3c551987a104be847bc132a5a03988c08572314666bb09138b3ff04f6c"} err="failed to get container status \"d0e55b3c551987a104be847bc132a5a03988c08572314666bb09138b3ff04f6c\": rpc error: code = NotFound desc = could not find container \"d0e55b3c551987a104be847bc132a5a03988c08572314666bb09138b3ff04f6c\": container with ID starting with d0e55b3c551987a104be847bc132a5a03988c08572314666bb09138b3ff04f6c not found: ID does not exist" Jul 21 15:12:08.666512 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:08.666472 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-765d5b97f8-99s2m" podStartSLOduration=1.8724408750000001 podStartE2EDuration="2.666460351s" totalImagesPullingTime="794.019476ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:12:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:12:08.664359972 +0000 UTC m=+666.349015579" watchObservedRunningTime="2026-07-21 15:12:08.666460351 +0000 UTC m=+666.351115956" Jul 21 15:12:08.697862 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:08.697826 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-68d5b54786-z5x5k"] Jul 21 15:12:08.706753 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:08.706727 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-68d5b54786-z5x5k"] Jul 21 15:12:08.722392 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:08.722316 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dldp9"] Jul 21 15:12:08.728284 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:08.728258 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dldp9"] Jul 21 15:12:08.897366 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:08.897333 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="127c559f-b816-4f32-bf5a-6364d19d8290" path="/var/lib/kubelet/pods/127c559f-b816-4f32-bf5a-6364d19d8290/volumes" Jul 21 15:12:08.897653 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:12:08.897640 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2617da7f-1614-48fb-a6b6-4c4b3cd74636" path="/var/lib/kubelet/pods/2617da7f-1614-48fb-a6b6-4c4b3cd74636/volumes" Jul 21 15:13:12.013064 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.013033 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v"] Jul 21 15:13:12.013453 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.013360 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="127c559f-b816-4f32-bf5a-6364d19d8290" containerName="authorino" Jul 21 15:13:12.013453 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.013371 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="127c559f-b816-4f32-bf5a-6364d19d8290" containerName="authorino" Jul 21 15:13:12.013453 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.013442 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="127c559f-b816-4f32-bf5a-6364d19d8290" containerName="authorino" Jul 21 15:13:12.017470 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.017454 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:12.025442 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.025416 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 21 15:13:12.025592 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.025551 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 21 15:13:12.025592 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.025575 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mpz6c\"" Jul 21 15:13:12.025716 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.025613 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 21 15:13:12.040605 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.040574 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v"] Jul 21 15:13:12.190278 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.190245 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3f50b17-e194-4358-8449-8eeb026478c0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v\" (UID: \"b3f50b17-e194-4358-8449-8eeb026478c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:12.190450 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.190309 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3f50b17-e194-4358-8449-8eeb026478c0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v\" (UID: \"b3f50b17-e194-4358-8449-8eeb026478c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:12.190450 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.190326 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stkw9\" (UniqueName: \"kubernetes.io/projected/b3f50b17-e194-4358-8449-8eeb026478c0-kube-api-access-stkw9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v\" (UID: \"b3f50b17-e194-4358-8449-8eeb026478c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:12.190450 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.190343 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3f50b17-e194-4358-8449-8eeb026478c0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v\" (UID: \"b3f50b17-e194-4358-8449-8eeb026478c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:12.190450 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.190357 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3f50b17-e194-4358-8449-8eeb026478c0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v\" (UID: \"b3f50b17-e194-4358-8449-8eeb026478c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:12.190450 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.190373 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3f50b17-e194-4358-8449-8eeb026478c0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v\" (UID: \"b3f50b17-e194-4358-8449-8eeb026478c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:12.291286 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.291203 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3f50b17-e194-4358-8449-8eeb026478c0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v\" (UID: \"b3f50b17-e194-4358-8449-8eeb026478c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:12.291286 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.291241 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stkw9\" (UniqueName: \"kubernetes.io/projected/b3f50b17-e194-4358-8449-8eeb026478c0-kube-api-access-stkw9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v\" (UID: \"b3f50b17-e194-4358-8449-8eeb026478c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:12.291286 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.291267 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3f50b17-e194-4358-8449-8eeb026478c0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v\" (UID: \"b3f50b17-e194-4358-8449-8eeb026478c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:12.291624 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.291292 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3f50b17-e194-4358-8449-8eeb026478c0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v\" (UID: \"b3f50b17-e194-4358-8449-8eeb026478c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:12.291624 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.291318 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3f50b17-e194-4358-8449-8eeb026478c0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v\" (UID: \"b3f50b17-e194-4358-8449-8eeb026478c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:12.291624 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.291522 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3f50b17-e194-4358-8449-8eeb026478c0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v\" (UID: \"b3f50b17-e194-4358-8449-8eeb026478c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:12.291761 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.291656 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3f50b17-e194-4358-8449-8eeb026478c0-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v\" (UID: \"b3f50b17-e194-4358-8449-8eeb026478c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:12.291761 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.291699 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3f50b17-e194-4358-8449-8eeb026478c0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v\" (UID: \"b3f50b17-e194-4358-8449-8eeb026478c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:12.291885 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.291865 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3f50b17-e194-4358-8449-8eeb026478c0-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v\" (UID: \"b3f50b17-e194-4358-8449-8eeb026478c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:12.293611 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.293594 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3f50b17-e194-4358-8449-8eeb026478c0-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v\" (UID: \"b3f50b17-e194-4358-8449-8eeb026478c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:12.293790 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.293773 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3f50b17-e194-4358-8449-8eeb026478c0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v\" (UID: \"b3f50b17-e194-4358-8449-8eeb026478c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:12.299922 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.299888 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stkw9\" (UniqueName: \"kubernetes.io/projected/b3f50b17-e194-4358-8449-8eeb026478c0-kube-api-access-stkw9\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v\" (UID: \"b3f50b17-e194-4358-8449-8eeb026478c0\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:12.332964 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.332930 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:12.474481 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.474455 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v"] Jul 21 15:13:12.476466 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:13:12.476437 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3f50b17_e194_4358_8449_8eeb026478c0.slice/crio-ea9bbbc731bdba56f80a80c8eca85da659392c494f1d34c9d52c012aad4dd5f3 WatchSource:0}: Error finding container ea9bbbc731bdba56f80a80c8eca85da659392c494f1d34c9d52c012aad4dd5f3: Status 404 returned error can't find the container with id ea9bbbc731bdba56f80a80c8eca85da659392c494f1d34c9d52c012aad4dd5f3 Jul 21 15:13:12.922783 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:12.922750 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" event={"ID":"b3f50b17-e194-4358-8449-8eeb026478c0","Type":"ContainerStarted","Data":"ea9bbbc731bdba56f80a80c8eca85da659392c494f1d34c9d52c012aad4dd5f3"} Jul 21 15:13:15.937333 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:15.937297 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" event={"ID":"b3f50b17-e194-4358-8449-8eeb026478c0","Type":"ContainerStarted","Data":"4e994a42e3047cee10865a8057e0a7f8d8e92ed30ce45be27109f3f7322a8231"} Jul 21 15:13:15.957547 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:15.957493 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" podStartSLOduration=2.277423287 podStartE2EDuration="4.957475705s" totalImagesPullingTime="2.680052418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:13:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:13:15.955527473 +0000 UTC m=+733.640183104" watchObservedRunningTime="2026-07-21 15:13:15.957475705 +0000 UTC m=+733.642131311" Jul 21 15:13:22.333871 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:22.333828 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:22.334338 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:22.333909 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:22.346119 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:22.346095 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:22.980253 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:22.980218 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v" Jul 21 15:13:45.138425 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.138389 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22"] Jul 21 15:13:45.141792 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.141773 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:45.145856 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.145835 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 21 15:13:45.152354 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.152329 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22"] Jul 21 15:13:45.275251 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.275213 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3449a04-b2f2-4420-9565-122b76a36fd5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22\" (UID: \"f3449a04-b2f2-4420-9565-122b76a36fd5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:45.275251 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.275256 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3449a04-b2f2-4420-9565-122b76a36fd5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22\" (UID: \"f3449a04-b2f2-4420-9565-122b76a36fd5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:45.275471 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.275280 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3449a04-b2f2-4420-9565-122b76a36fd5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22\" (UID: \"f3449a04-b2f2-4420-9565-122b76a36fd5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:45.275471 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.275360 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3449a04-b2f2-4420-9565-122b76a36fd5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22\" (UID: \"f3449a04-b2f2-4420-9565-122b76a36fd5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:45.275471 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.275426 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3449a04-b2f2-4420-9565-122b76a36fd5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22\" (UID: \"f3449a04-b2f2-4420-9565-122b76a36fd5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:45.275471 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.275467 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czpkj\" (UniqueName: \"kubernetes.io/projected/f3449a04-b2f2-4420-9565-122b76a36fd5-kube-api-access-czpkj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22\" (UID: \"f3449a04-b2f2-4420-9565-122b76a36fd5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:45.376650 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.376611 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3449a04-b2f2-4420-9565-122b76a36fd5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22\" (UID: \"f3449a04-b2f2-4420-9565-122b76a36fd5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:45.376832 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.376667 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czpkj\" (UniqueName: \"kubernetes.io/projected/f3449a04-b2f2-4420-9565-122b76a36fd5-kube-api-access-czpkj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22\" (UID: \"f3449a04-b2f2-4420-9565-122b76a36fd5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:45.376832 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.376693 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3449a04-b2f2-4420-9565-122b76a36fd5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22\" (UID: \"f3449a04-b2f2-4420-9565-122b76a36fd5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:45.376832 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.376715 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3449a04-b2f2-4420-9565-122b76a36fd5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22\" (UID: \"f3449a04-b2f2-4420-9565-122b76a36fd5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:45.376832 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.376729 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3449a04-b2f2-4420-9565-122b76a36fd5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22\" (UID: \"f3449a04-b2f2-4420-9565-122b76a36fd5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:45.376832 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.376755 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3449a04-b2f2-4420-9565-122b76a36fd5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22\" (UID: \"f3449a04-b2f2-4420-9565-122b76a36fd5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:45.377143 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.377118 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f3449a04-b2f2-4420-9565-122b76a36fd5-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22\" (UID: \"f3449a04-b2f2-4420-9565-122b76a36fd5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:45.377229 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.377206 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f3449a04-b2f2-4420-9565-122b76a36fd5-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22\" (UID: \"f3449a04-b2f2-4420-9565-122b76a36fd5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:45.377229 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.377221 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f3449a04-b2f2-4420-9565-122b76a36fd5-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22\" (UID: \"f3449a04-b2f2-4420-9565-122b76a36fd5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:45.379087 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.379066 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f3449a04-b2f2-4420-9565-122b76a36fd5-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22\" (UID: \"f3449a04-b2f2-4420-9565-122b76a36fd5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:45.379224 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.379208 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3449a04-b2f2-4420-9565-122b76a36fd5-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22\" (UID: \"f3449a04-b2f2-4420-9565-122b76a36fd5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:45.386522 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.386493 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-czpkj\" (UniqueName: \"kubernetes.io/projected/f3449a04-b2f2-4420-9565-122b76a36fd5-kube-api-access-czpkj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22\" (UID: \"f3449a04-b2f2-4420-9565-122b76a36fd5\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:45.452114 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.452026 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:45.592541 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:45.592511 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22"] Jul 21 15:13:45.593063 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:13:45.593034 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3449a04_b2f2_4420_9565_122b76a36fd5.slice/crio-2c74a6643afa9f2e43ce3b527a70b0cb924b3d362e8a417b3407f340a2097a36 WatchSource:0}: Error finding container 2c74a6643afa9f2e43ce3b527a70b0cb924b3d362e8a417b3407f340a2097a36: Status 404 returned error can't find the container with id 2c74a6643afa9f2e43ce3b527a70b0cb924b3d362e8a417b3407f340a2097a36 Jul 21 15:13:46.074621 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:46.074589 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" event={"ID":"f3449a04-b2f2-4420-9565-122b76a36fd5","Type":"ContainerStarted","Data":"2c74a6643afa9f2e43ce3b527a70b0cb924b3d362e8a417b3407f340a2097a36"} Jul 21 15:13:52.103068 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:52.103031 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" event={"ID":"f3449a04-b2f2-4420-9565-122b76a36fd5","Type":"ContainerStarted","Data":"025cf00677024331c37891c2db25b9596b8140a5a4c25bea76fa3c6df775a7ee"} Jul 21 15:13:52.120252 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:52.120201 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" podStartSLOduration=0.957322258 podStartE2EDuration="7.120183326s" totalImagesPullingTime="6.162861068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:13:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:13:52.119418045 +0000 UTC m=+769.804073666" watchObservedRunningTime="2026-07-21 15:13:52.120183326 +0000 UTC m=+769.804838933" Jul 21 15:13:55.452719 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:55.452685 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:55.453224 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:55.452742 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:55.464993 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:55.464968 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:13:56.132232 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:13:56.132205 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22" Jul 21 15:15:15.815457 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:15.815418 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-757d96bb9f-pp2jl"] Jul 21 15:15:15.818762 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:15.818742 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-757d96bb9f-pp2jl" Jul 21 15:15:15.827969 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:15.827943 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-757d96bb9f-pp2jl"] Jul 21 15:15:15.935643 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:15.935596 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gckjs\" (UniqueName: \"kubernetes.io/projected/e5d6b7eb-5ef4-4dbc-bd24-873354ab9bb7-kube-api-access-gckjs\") pod \"authorino-757d96bb9f-pp2jl\" (UID: \"e5d6b7eb-5ef4-4dbc-bd24-873354ab9bb7\") " pod="kuadrant-system/authorino-757d96bb9f-pp2jl" Jul 21 15:15:15.935842 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:15.935736 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5d6b7eb-5ef4-4dbc-bd24-873354ab9bb7-tls-cert\") pod \"authorino-757d96bb9f-pp2jl\" (UID: \"e5d6b7eb-5ef4-4dbc-bd24-873354ab9bb7\") " pod="kuadrant-system/authorino-757d96bb9f-pp2jl" Jul 21 15:15:16.036661 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:16.036620 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5d6b7eb-5ef4-4dbc-bd24-873354ab9bb7-tls-cert\") pod \"authorino-757d96bb9f-pp2jl\" (UID: \"e5d6b7eb-5ef4-4dbc-bd24-873354ab9bb7\") " pod="kuadrant-system/authorino-757d96bb9f-pp2jl" Jul 21 15:15:16.036833 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:16.036718 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gckjs\" (UniqueName: \"kubernetes.io/projected/e5d6b7eb-5ef4-4dbc-bd24-873354ab9bb7-kube-api-access-gckjs\") pod \"authorino-757d96bb9f-pp2jl\" (UID: \"e5d6b7eb-5ef4-4dbc-bd24-873354ab9bb7\") " pod="kuadrant-system/authorino-757d96bb9f-pp2jl" Jul 21 15:15:16.038990 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:16.038958 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5d6b7eb-5ef4-4dbc-bd24-873354ab9bb7-tls-cert\") pod \"authorino-757d96bb9f-pp2jl\" (UID: \"e5d6b7eb-5ef4-4dbc-bd24-873354ab9bb7\") " pod="kuadrant-system/authorino-757d96bb9f-pp2jl" Jul 21 15:15:16.045443 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:16.045410 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gckjs\" (UniqueName: \"kubernetes.io/projected/e5d6b7eb-5ef4-4dbc-bd24-873354ab9bb7-kube-api-access-gckjs\") pod \"authorino-757d96bb9f-pp2jl\" (UID: \"e5d6b7eb-5ef4-4dbc-bd24-873354ab9bb7\") " pod="kuadrant-system/authorino-757d96bb9f-pp2jl" Jul 21 15:15:16.128337 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:16.128241 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-757d96bb9f-pp2jl" Jul 21 15:15:16.267283 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:16.267256 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-757d96bb9f-pp2jl"] Jul 21 15:15:16.269226 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:15:16.269189 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5d6b7eb_5ef4_4dbc_bd24_873354ab9bb7.slice/crio-633833a6a9746d682d7d9767fbf8a126b4b96d9fc633699a50a73a04c81b80c0 WatchSource:0}: Error finding container 633833a6a9746d682d7d9767fbf8a126b4b96d9fc633699a50a73a04c81b80c0: Status 404 returned error can't find the container with id 633833a6a9746d682d7d9767fbf8a126b4b96d9fc633699a50a73a04c81b80c0 Jul 21 15:15:16.488934 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:16.488828 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-757d96bb9f-pp2jl" event={"ID":"e5d6b7eb-5ef4-4dbc-bd24-873354ab9bb7","Type":"ContainerStarted","Data":"633833a6a9746d682d7d9767fbf8a126b4b96d9fc633699a50a73a04c81b80c0"} Jul 21 15:15:17.495498 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:17.495457 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-757d96bb9f-pp2jl" event={"ID":"e5d6b7eb-5ef4-4dbc-bd24-873354ab9bb7","Type":"ContainerStarted","Data":"8ad8019effb0d1c1969fcabe509eccfd3505f7a90bc3295854db77ee692b041d"} Jul 21 15:15:17.519185 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:17.519107 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-757d96bb9f-pp2jl" podStartSLOduration=1.945215154 podStartE2EDuration="2.519084093s" totalImagesPullingTime="573.868939ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:15:17.517587147 +0000 UTC m=+855.202242757" watchObservedRunningTime="2026-07-21 15:15:17.519084093 +0000 UTC m=+855.203739695" Jul 21 15:15:17.608059 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:17.608016 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-765d5b97f8-99s2m"] Jul 21 15:15:17.608264 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:17.608219 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-765d5b97f8-99s2m" podUID="6d050f90-dc78-4b61-afb3-82221d6fd133" containerName="authorino" containerID="cri-o://4f509064969fc3794529d80e8f8e62b1387539be7c4eadb4490fb19c89599dd8" gracePeriod=30 Jul 21 15:15:17.874034 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:17.874002 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-765d5b97f8-99s2m" Jul 21 15:15:17.955798 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:17.955754 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zb6n\" (UniqueName: \"kubernetes.io/projected/6d050f90-dc78-4b61-afb3-82221d6fd133-kube-api-access-5zb6n\") pod \"6d050f90-dc78-4b61-afb3-82221d6fd133\" (UID: \"6d050f90-dc78-4b61-afb3-82221d6fd133\") " Jul 21 15:15:17.955988 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:17.955929 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6d050f90-dc78-4b61-afb3-82221d6fd133-tls-cert\") pod \"6d050f90-dc78-4b61-afb3-82221d6fd133\" (UID: \"6d050f90-dc78-4b61-afb3-82221d6fd133\") " Jul 21 15:15:17.957822 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:17.957792 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d050f90-dc78-4b61-afb3-82221d6fd133-kube-api-access-5zb6n" (OuterVolumeSpecName: "kube-api-access-5zb6n") pod "6d050f90-dc78-4b61-afb3-82221d6fd133" (UID: "6d050f90-dc78-4b61-afb3-82221d6fd133"). InnerVolumeSpecName "kube-api-access-5zb6n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:15:17.966398 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:17.966120 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d050f90-dc78-4b61-afb3-82221d6fd133-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6d050f90-dc78-4b61-afb3-82221d6fd133" (UID: "6d050f90-dc78-4b61-afb3-82221d6fd133"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 15:15:18.056778 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:18.056743 2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6d050f90-dc78-4b61-afb3-82221d6fd133-tls-cert\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:15:18.056778 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:18.056773 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zb6n\" (UniqueName: \"kubernetes.io/projected/6d050f90-dc78-4b61-afb3-82221d6fd133-kube-api-access-5zb6n\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:15:18.501700 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:18.501666 2577 generic.go:356] "Generic (PLEG): container finished" podID="6d050f90-dc78-4b61-afb3-82221d6fd133" containerID="4f509064969fc3794529d80e8f8e62b1387539be7c4eadb4490fb19c89599dd8" exitCode=0 Jul 21 15:15:18.502175 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:18.501710 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-765d5b97f8-99s2m" Jul 21 15:15:18.502175 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:18.501750 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-765d5b97f8-99s2m" event={"ID":"6d050f90-dc78-4b61-afb3-82221d6fd133","Type":"ContainerDied","Data":"4f509064969fc3794529d80e8f8e62b1387539be7c4eadb4490fb19c89599dd8"} Jul 21 15:15:18.502175 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:18.501788 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-765d5b97f8-99s2m" event={"ID":"6d050f90-dc78-4b61-afb3-82221d6fd133","Type":"ContainerDied","Data":"071d75d931bc7bdf195f6046731b8beac643699d1ac02d729405abfb7780f9bc"} Jul 21 15:15:18.502175 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:18.501810 2577 scope.go:117] "RemoveContainer" containerID="4f509064969fc3794529d80e8f8e62b1387539be7c4eadb4490fb19c89599dd8" Jul 21 15:15:18.511298 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:18.511280 2577 scope.go:117] "RemoveContainer" containerID="4f509064969fc3794529d80e8f8e62b1387539be7c4eadb4490fb19c89599dd8" Jul 21 15:15:18.511573 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:15:18.511554 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f509064969fc3794529d80e8f8e62b1387539be7c4eadb4490fb19c89599dd8\": container with ID starting with 4f509064969fc3794529d80e8f8e62b1387539be7c4eadb4490fb19c89599dd8 not found: ID does not exist" containerID="4f509064969fc3794529d80e8f8e62b1387539be7c4eadb4490fb19c89599dd8" Jul 21 15:15:18.511636 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:18.511581 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f509064969fc3794529d80e8f8e62b1387539be7c4eadb4490fb19c89599dd8"} err="failed to get container status \"4f509064969fc3794529d80e8f8e62b1387539be7c4eadb4490fb19c89599dd8\": rpc error: code = NotFound desc = could not find container \"4f509064969fc3794529d80e8f8e62b1387539be7c4eadb4490fb19c89599dd8\": container with ID starting with 4f509064969fc3794529d80e8f8e62b1387539be7c4eadb4490fb19c89599dd8 not found: ID does not exist" Jul 21 15:15:18.524347 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:18.524319 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-765d5b97f8-99s2m"] Jul 21 15:15:18.528463 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:18.528438 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-765d5b97f8-99s2m"] Jul 21 15:15:18.898662 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:15:18.898628 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d050f90-dc78-4b61-afb3-82221d6fd133" path="/var/lib/kubelet/pods/6d050f90-dc78-4b61-afb3-82221d6fd133/volumes" Jul 21 15:16:03.141597 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:16:03.141511 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfv5x_b5b08086-eac8-4329-a903-a73b5e8503ce/ovn-acl-logging/0.log" Jul 21 15:16:03.143019 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:16:03.142980 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfv5x_b5b08086-eac8-4329-a903-a73b5e8503ce/ovn-acl-logging/0.log" Jul 21 15:21:03.171191 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:21:03.171101 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfv5x_b5b08086-eac8-4329-a903-a73b5e8503ce/ovn-acl-logging/0.log" Jul 21 15:21:03.173964 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:21:03.173939 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfv5x_b5b08086-eac8-4329-a903-a73b5e8503ce/ovn-acl-logging/0.log" Jul 21 15:25:41.648184 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.648153 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s"] Jul 21 15:25:41.648683 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.648503 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d050f90-dc78-4b61-afb3-82221d6fd133" containerName="authorino" Jul 21 15:25:41.648683 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.648514 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d050f90-dc78-4b61-afb3-82221d6fd133" containerName="authorino" Jul 21 15:25:41.648683 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.648591 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d050f90-dc78-4b61-afb3-82221d6fd133" containerName="authorino" Jul 21 15:25:41.651182 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.651165 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:41.654013 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.653993 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-2c038283-kserve-self-signed-certs\"" Jul 21 15:25:41.671917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.671870 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s"] Jul 21 15:25:41.799200 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.799143 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-home\") pod \"e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:41.799200 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.799212 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-dshm\") pod \"e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:41.799420 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.799263 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b66f5e3f-384a-466d-959a-202a80dc3cef-tls-certs\") pod \"e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:41.799420 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.799301 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lxp7\" (UniqueName: \"kubernetes.io/projected/b66f5e3f-384a-466d-959a-202a80dc3cef-kube-api-access-2lxp7\") pod \"e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:41.799420 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.799338 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-model-cache\") pod \"e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:41.799420 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.799362 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-tmp-dir\") pod \"e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:41.900635 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.900557 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-home\") pod \"e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:41.900635 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.900614 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-dshm\") pod \"e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:41.900808 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.900640 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b66f5e3f-384a-466d-959a-202a80dc3cef-tls-certs\") pod \"e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:41.900808 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.900668 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lxp7\" (UniqueName: \"kubernetes.io/projected/b66f5e3f-384a-466d-959a-202a80dc3cef-kube-api-access-2lxp7\") pod \"e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:41.900808 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.900700 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-model-cache\") pod \"e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:41.900808 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.900723 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-tmp-dir\") pod \"e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:41.901049 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.901022 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-home\") pod \"e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:41.901178 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.901133 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-tmp-dir\") pod \"e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:41.901268 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.901174 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-model-cache\") pod \"e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:41.903057 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.903036 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-dshm\") pod \"e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:41.903162 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.903148 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b66f5e3f-384a-466d-959a-202a80dc3cef-tls-certs\") pod \"e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:41.909919 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.909869 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lxp7\" (UniqueName: \"kubernetes.io/projected/b66f5e3f-384a-466d-959a-202a80dc3cef-kube-api-access-2lxp7\") pod \"e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:41.960798 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:41.960761 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:42.093466 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:42.093441 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s"] Jul 21 15:25:42.095107 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:25:42.095079 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb66f5e3f_384a_466d_959a_202a80dc3cef.slice/crio-2792e7aa5c64e151fca2a8dae1d1830b50e65bda14cb8897f9027946b53906fb WatchSource:0}: Error finding container 2792e7aa5c64e151fca2a8dae1d1830b50e65bda14cb8897f9027946b53906fb: Status 404 returned error can't find the container with id 2792e7aa5c64e151fca2a8dae1d1830b50e65bda14cb8897f9027946b53906fb Jul 21 15:25:42.336997 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:42.336967 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" event={"ID":"b66f5e3f-384a-466d-959a-202a80dc3cef","Type":"ContainerStarted","Data":"52f0a7d5077a88279fe6268635e4f869db01424e00bfe41cdbb96080e6825ea2"} Jul 21 15:25:42.337169 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:42.337010 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" event={"ID":"b66f5e3f-384a-466d-959a-202a80dc3cef","Type":"ContainerStarted","Data":"2792e7aa5c64e151fca2a8dae1d1830b50e65bda14cb8897f9027946b53906fb"} Jul 21 15:25:42.357131 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:42.357082 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" podStartSLOduration=1.357068175 podStartE2EDuration="1.357068175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:25:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:25:42.355114378 +0000 UTC m=+1480.039769998" watchObservedRunningTime="2026-07-21 15:25:42.357068175 +0000 UTC m=+1480.041723781" Jul 21 15:25:51.961605 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:51.961510 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:51.961605 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:51.961570 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:51.974187 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:51.974159 2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:25:52.398249 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:25:52.398211 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:26:03.197970 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:03.197943 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfv5x_b5b08086-eac8-4329-a903-a73b5e8503ce/ovn-acl-logging/0.log" Jul 21 15:26:03.201367 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:03.201345 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfv5x_b5b08086-eac8-4329-a903-a73b5e8503ce/ovn-acl-logging/0.log" Jul 21 15:26:16.638127 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:16.638095 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s"] Jul 21 15:26:31.658950 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:31.658857 2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" podUID="b66f5e3f-384a-466d-959a-202a80dc3cef" containerName="main" containerID="cri-o://52f0a7d5077a88279fe6268635e4f869db01424e00bfe41cdbb96080e6825ea2" gracePeriod=45 Jul 21 15:26:31.909962 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:31.909870 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:26:32.016983 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.016950 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-home\") pod \"b66f5e3f-384a-466d-959a-202a80dc3cef\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " Jul 21 15:26:32.017166 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.017007 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-model-cache\") pod \"b66f5e3f-384a-466d-959a-202a80dc3cef\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " Jul 21 15:26:32.017166 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.017042 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-tmp-dir\") pod \"b66f5e3f-384a-466d-959a-202a80dc3cef\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " Jul 21 15:26:32.017166 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.017060 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-dshm\") pod \"b66f5e3f-384a-466d-959a-202a80dc3cef\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " Jul 21 15:26:32.017166 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.017082 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lxp7\" (UniqueName: \"kubernetes.io/projected/b66f5e3f-384a-466d-959a-202a80dc3cef-kube-api-access-2lxp7\") pod \"b66f5e3f-384a-466d-959a-202a80dc3cef\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " Jul 21 15:26:32.017381 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.017194 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b66f5e3f-384a-466d-959a-202a80dc3cef-tls-certs\") pod \"b66f5e3f-384a-466d-959a-202a80dc3cef\" (UID: \"b66f5e3f-384a-466d-959a-202a80dc3cef\") " Jul 21 15:26:32.017381 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.017271 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-home" (OuterVolumeSpecName: "home") pod "b66f5e3f-384a-466d-959a-202a80dc3cef" (UID: "b66f5e3f-384a-466d-959a-202a80dc3cef"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:26:32.017381 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.017280 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-model-cache" (OuterVolumeSpecName: "model-cache") pod "b66f5e3f-384a-466d-959a-202a80dc3cef" (UID: "b66f5e3f-384a-466d-959a-202a80dc3cef"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:26:32.017381 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.017326 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b66f5e3f-384a-466d-959a-202a80dc3cef" (UID: "b66f5e3f-384a-466d-959a-202a80dc3cef"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:26:32.017566 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.017453 2577 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-home\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:26:32.017566 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.017464 2577 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-model-cache\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:26:32.017566 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.017473 2577 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-tmp-dir\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:26:32.019470 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.019442 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b66f5e3f-384a-466d-959a-202a80dc3cef-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b66f5e3f-384a-466d-959a-202a80dc3cef" (UID: "b66f5e3f-384a-466d-959a-202a80dc3cef"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 15:26:32.019470 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.019463 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b66f5e3f-384a-466d-959a-202a80dc3cef-kube-api-access-2lxp7" (OuterVolumeSpecName: "kube-api-access-2lxp7") pod "b66f5e3f-384a-466d-959a-202a80dc3cef" (UID: "b66f5e3f-384a-466d-959a-202a80dc3cef"). InnerVolumeSpecName "kube-api-access-2lxp7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:26:32.019613 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.019480 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-dshm" (OuterVolumeSpecName: "dshm") pod "b66f5e3f-384a-466d-959a-202a80dc3cef" (UID: "b66f5e3f-384a-466d-959a-202a80dc3cef"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:26:32.118811 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.118783 2577 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b66f5e3f-384a-466d-959a-202a80dc3cef-tls-certs\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:26:32.118811 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.118806 2577 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b66f5e3f-384a-466d-959a-202a80dc3cef-dshm\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:26:32.118811 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.118816 2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lxp7\" (UniqueName: \"kubernetes.io/projected/b66f5e3f-384a-466d-959a-202a80dc3cef-kube-api-access-2lxp7\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:26:32.569703 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.569668 2577 generic.go:356] "Generic (PLEG): container finished" podID="b66f5e3f-384a-466d-959a-202a80dc3cef" containerID="52f0a7d5077a88279fe6268635e4f869db01424e00bfe41cdbb96080e6825ea2" exitCode=0 Jul 21 15:26:32.569872 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.569712 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" Jul 21 15:26:32.569872 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.569717 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" event={"ID":"b66f5e3f-384a-466d-959a-202a80dc3cef","Type":"ContainerDied","Data":"52f0a7d5077a88279fe6268635e4f869db01424e00bfe41cdbb96080e6825ea2"} Jul 21 15:26:32.569872 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.569755 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s" event={"ID":"b66f5e3f-384a-466d-959a-202a80dc3cef","Type":"ContainerDied","Data":"2792e7aa5c64e151fca2a8dae1d1830b50e65bda14cb8897f9027946b53906fb"} Jul 21 15:26:32.569872 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.569784 2577 scope.go:117] "RemoveContainer" containerID="52f0a7d5077a88279fe6268635e4f869db01424e00bfe41cdbb96080e6825ea2" Jul 21 15:26:32.581030 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.581012 2577 scope.go:117] "RemoveContainer" containerID="52f0a7d5077a88279fe6268635e4f869db01424e00bfe41cdbb96080e6825ea2" Jul 21 15:26:32.581328 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:26:32.581305 2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52f0a7d5077a88279fe6268635e4f869db01424e00bfe41cdbb96080e6825ea2\": container with ID starting with 52f0a7d5077a88279fe6268635e4f869db01424e00bfe41cdbb96080e6825ea2 not found: ID does not exist" containerID="52f0a7d5077a88279fe6268635e4f869db01424e00bfe41cdbb96080e6825ea2" Jul 21 15:26:32.581398 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.581341 2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52f0a7d5077a88279fe6268635e4f869db01424e00bfe41cdbb96080e6825ea2"} err="failed to get container status \"52f0a7d5077a88279fe6268635e4f869db01424e00bfe41cdbb96080e6825ea2\": rpc error: code = NotFound desc = could not find container \"52f0a7d5077a88279fe6268635e4f869db01424e00bfe41cdbb96080e6825ea2\": container with ID starting with 52f0a7d5077a88279fe6268635e4f869db01424e00bfe41cdbb96080e6825ea2 not found: ID does not exist" Jul 21 15:26:32.594779 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.594753 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s"] Jul 21 15:26:32.598429 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.598402 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-2c038283-kserve-546b4b99cf-rhx9s"] Jul 21 15:26:32.903329 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:26:32.903234 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b66f5e3f-384a-466d-959a-202a80dc3cef" path="/var/lib/kubelet/pods/b66f5e3f-384a-466d-959a-202a80dc3cef/volumes" Jul 21 15:30:00.139611 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:00.139531 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2f780905-29744130-4cpdm"] Jul 21 15:30:00.142419 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:00.139870 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b66f5e3f-384a-466d-959a-202a80dc3cef" containerName="main" Jul 21 15:30:00.142419 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:00.139881 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b66f5e3f-384a-466d-959a-202a80dc3cef" containerName="main" Jul 21 15:30:00.142419 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:00.139962 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b66f5e3f-384a-466d-959a-202a80dc3cef" containerName="main" Jul 21 15:30:00.143215 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:00.143201 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2f780905-29744130-4cpdm" Jul 21 15:30:00.146857 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:00.146831 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744130-rp74j"] Jul 21 15:30:00.149212 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:00.149190 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ccbkt\"" Jul 21 15:30:00.150028 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:00.149801 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744130-rp74j" Jul 21 15:30:00.153791 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:00.153775 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2f780905-29744130-4cpdm" Jul 21 15:30:00.158564 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:00.158504 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2f780905-29744130-4cpdm"] Jul 21 15:30:00.161908 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:00.161873 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744130-rp74j" Jul 21 15:30:00.171457 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:00.168493 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744130-rp74j"] Jul 21 15:30:00.301941 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:00.301911 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2f780905-29744130-4cpdm"] Jul 21 15:30:00.308559 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:00.308539 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 15:30:00.326092 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:00.326075 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29744130-rp74j"] Jul 21 15:30:00.327769 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:30:00.327742 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc9f3d70_aeb3_46cd_be14_4c3735da368e.slice/crio-82b3399734f58755b020243bd7957dbf8b698a52f4cd8fb17f8c2e6ad9d9f604 WatchSource:0}: Error finding container 82b3399734f58755b020243bd7957dbf8b698a52f4cd8fb17f8c2e6ad9d9f604: Status 404 returned error can't find the container with id 82b3399734f58755b020243bd7957dbf8b698a52f4cd8fb17f8c2e6ad9d9f604 Jul 21 15:30:00.521312 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:00.521230 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744130-rp74j" event={"ID":"dc9f3d70-aeb3-46cd-be14-4c3735da368e","Type":"ContainerStarted","Data":"82b3399734f58755b020243bd7957dbf8b698a52f4cd8fb17f8c2e6ad9d9f604"} Jul 21 15:30:00.522434 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:00.522408 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2f780905-29744130-4cpdm" event={"ID":"70db0f09-cfcf-476f-a8db-c9121d4f13dc","Type":"ContainerStarted","Data":"cf9c1960284584461659801100ceab920b0628454db61dbdd847230bcb94b0bc"} Jul 21 15:30:03.540778 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:03.540741 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744130-rp74j" event={"ID":"dc9f3d70-aeb3-46cd-be14-4c3735da368e","Type":"ContainerStarted","Data":"3ac5687b2d19c9751e22ec1a62015bfd5b72829e90842daa15edc455f340e490"} Jul 21 15:30:03.542117 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:03.542091 2577 generic.go:356] "Generic (PLEG): container finished" podID="70db0f09-cfcf-476f-a8db-c9121d4f13dc" containerID="0c2a03e92be4f0b80e36fd406bf6b0a22f48289617723d98c0a58d385f3f5062" exitCode=7 Jul 21 15:30:03.542216 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:03.542124 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2f780905-29744130-4cpdm" event={"ID":"70db0f09-cfcf-476f-a8db-c9121d4f13dc","Type":"ContainerDied","Data":"0c2a03e92be4f0b80e36fd406bf6b0a22f48289617723d98c0a58d385f3f5062"} Jul 21 15:30:03.542274 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:03.542263 2577 scope.go:117] "RemoveContainer" containerID="0c2a03e92be4f0b80e36fd406bf6b0a22f48289617723d98c0a58d385f3f5062" Jul 21 15:30:03.559920 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:03.559865 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744130-rp74j" podStartSLOduration=1.014375643 podStartE2EDuration="3.559852456s" totalImagesPullingTime="2.545476813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:30:03.558378958 +0000 UTC m=+1741.243034578" watchObservedRunningTime="2026-07-21 15:30:03.559852456 +0000 UTC m=+1741.244508062" Jul 21 15:30:04.548221 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:04.548136 2577 generic.go:356] "Generic (PLEG): container finished" podID="70db0f09-cfcf-476f-a8db-c9121d4f13dc" containerID="8d5ee9d859c5ae4a109921c4060fec6e6a72c63ed829a4f57acd877dccd6aff8" exitCode=7 Jul 21 15:30:04.548659 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:04.548228 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2f780905-29744130-4cpdm" event={"ID":"70db0f09-cfcf-476f-a8db-c9121d4f13dc","Type":"ContainerDied","Data":"8d5ee9d859c5ae4a109921c4060fec6e6a72c63ed829a4f57acd877dccd6aff8"} Jul 21 15:30:04.548659 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:04.548291 2577 scope.go:117] "RemoveContainer" containerID="0c2a03e92be4f0b80e36fd406bf6b0a22f48289617723d98c0a58d385f3f5062" Jul 21 15:30:04.548659 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:04.548429 2577 scope.go:117] "RemoveContainer" containerID="8d5ee9d859c5ae4a109921c4060fec6e6a72c63ed829a4f57acd877dccd6aff8" Jul 21 15:30:04.548806 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:30:04.548684 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ait-2f780905-29744130-4cpdm_odh-ai-gateway-infra(70db0f09-cfcf-476f-a8db-c9121d4f13dc)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2f780905-29744130-4cpdm" podUID="70db0f09-cfcf-476f-a8db-c9121d4f13dc" Jul 21 15:30:04.549677 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:04.549653 2577 generic.go:356] "Generic (PLEG): container finished" podID="dc9f3d70-aeb3-46cd-be14-4c3735da368e" containerID="3ac5687b2d19c9751e22ec1a62015bfd5b72829e90842daa15edc455f340e490" exitCode=0 Jul 21 15:30:04.549766 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:04.549719 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744130-rp74j" event={"ID":"dc9f3d70-aeb3-46cd-be14-4c3735da368e","Type":"ContainerDied","Data":"3ac5687b2d19c9751e22ec1a62015bfd5b72829e90842daa15edc455f340e490"} Jul 21 15:30:05.555633 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:05.555605 2577 scope.go:117] "RemoveContainer" containerID="8d5ee9d859c5ae4a109921c4060fec6e6a72c63ed829a4f57acd877dccd6aff8" Jul 21 15:30:05.556110 ip-10-0-133-162 kubenswrapper[2577]: E0721 15:30:05.555810 2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ait-2f780905-29744130-4cpdm_odh-ai-gateway-infra(70db0f09-cfcf-476f-a8db-c9121d4f13dc)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2f780905-29744130-4cpdm" podUID="70db0f09-cfcf-476f-a8db-c9121d4f13dc" Jul 21 15:30:05.681809 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:05.681780 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744130-rp74j" Jul 21 15:30:06.560828 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:06.560799 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744130-rp74j" Jul 21 15:30:06.561192 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:06.560844 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29744130-rp74j" event={"ID":"dc9f3d70-aeb3-46cd-be14-4c3735da368e","Type":"ContainerDied","Data":"82b3399734f58755b020243bd7957dbf8b698a52f4cd8fb17f8c2e6ad9d9f604"} Jul 21 15:30:06.561192 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:06.560887 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82b3399734f58755b020243bd7957dbf8b698a52f4cd8fb17f8c2e6ad9d9f604" Jul 21 15:30:18.892843 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:18.892806 2577 scope.go:117] "RemoveContainer" containerID="8d5ee9d859c5ae4a109921c4060fec6e6a72c63ed829a4f57acd877dccd6aff8" Jul 21 15:30:19.619422 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:19.619385 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2f780905-29744130-4cpdm" event={"ID":"70db0f09-cfcf-476f-a8db-c9121d4f13dc","Type":"ContainerStarted","Data":"51448e60daeedc8ab110bfb513aa999ad37b7f608c21e0365f6b02feb8e44a6a"} Jul 21 15:30:19.647375 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:19.647319 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2f780905-29744130-4cpdm" podStartSLOduration=17.084929665 podStartE2EDuration="19.647303612s" totalImagesPullingTime="2.562373947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:30:19.646962896 +0000 UTC m=+1757.331618501" watchObservedRunningTime="2026-07-21 15:30:19.647303612 +0000 UTC m=+1757.331959274" Jul 21 15:30:20.625875 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:20.625843 2577 generic.go:356] "Generic (PLEG): container finished" podID="70db0f09-cfcf-476f-a8db-c9121d4f13dc" containerID="51448e60daeedc8ab110bfb513aa999ad37b7f608c21e0365f6b02feb8e44a6a" exitCode=0 Jul 21 15:30:20.626257 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:20.625936 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2f780905-29744130-4cpdm" event={"ID":"70db0f09-cfcf-476f-a8db-c9121d4f13dc","Type":"ContainerDied","Data":"51448e60daeedc8ab110bfb513aa999ad37b7f608c21e0365f6b02feb8e44a6a"} Jul 21 15:30:20.626257 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:20.625998 2577 scope.go:117] "RemoveContainer" containerID="8d5ee9d859c5ae4a109921c4060fec6e6a72c63ed829a4f57acd877dccd6aff8" Jul 21 15:30:20.656984 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:20.656956 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2f780905-29744130-4cpdm"] Jul 21 15:30:21.775666 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:21.775642 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2f780905-29744130-4cpdm" Jul 21 15:30:22.638266 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:22.638230 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2f780905-29744130-4cpdm" event={"ID":"70db0f09-cfcf-476f-a8db-c9121d4f13dc","Type":"ContainerDied","Data":"cf9c1960284584461659801100ceab920b0628454db61dbdd847230bcb94b0bc"} Jul 21 15:30:22.638266 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:22.638263 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2f780905-29744130-4cpdm" Jul 21 15:30:22.638508 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:22.638275 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf9c1960284584461659801100ceab920b0628454db61dbdd847230bcb94b0bc" Jul 21 15:30:22.683910 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:22.683869 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2f780905-29744130-4cpdm"] Jul 21 15:30:22.689825 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:22.689806 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-2f780905-29744130-4cpdm"] Jul 21 15:30:22.897127 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:22.897057 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70db0f09-cfcf-476f-a8db-c9121d4f13dc" path="/var/lib/kubelet/pods/70db0f09-cfcf-476f-a8db-c9121d4f13dc/volumes" Jul 21 15:30:24.574012 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:24.573978 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f780905-h6ndb"] Jul 21 15:30:24.574485 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:24.574466 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70db0f09-cfcf-476f-a8db-c9121d4f13dc" containerName="cleanup" Jul 21 15:30:24.574569 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:24.574488 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="70db0f09-cfcf-476f-a8db-c9121d4f13dc" containerName="cleanup" Jul 21 15:30:24.574569 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:24.574504 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70db0f09-cfcf-476f-a8db-c9121d4f13dc" containerName="cleanup" Jul 21 15:30:24.574569 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:24.574513 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="70db0f09-cfcf-476f-a8db-c9121d4f13dc" containerName="cleanup" Jul 21 15:30:24.574569 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:24.574534 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc9f3d70-aeb3-46cd-be14-4c3735da368e" containerName="cleanup" Jul 21 15:30:24.574569 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:24.574543 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc9f3d70-aeb3-46cd-be14-4c3735da368e" containerName="cleanup" Jul 21 15:30:24.574569 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:24.574555 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70db0f09-cfcf-476f-a8db-c9121d4f13dc" containerName="cleanup" Jul 21 15:30:24.574569 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:24.574563 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="70db0f09-cfcf-476f-a8db-c9121d4f13dc" containerName="cleanup" Jul 21 15:30:24.574877 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:24.574652 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="70db0f09-cfcf-476f-a8db-c9121d4f13dc" containerName="cleanup" Jul 21 15:30:24.574877 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:24.574664 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="70db0f09-cfcf-476f-a8db-c9121d4f13dc" containerName="cleanup" Jul 21 15:30:24.574877 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:24.574674 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc9f3d70-aeb3-46cd-be14-4c3735da368e" containerName="cleanup" Jul 21 15:30:24.574877 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:24.574684 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="70db0f09-cfcf-476f-a8db-c9121d4f13dc" containerName="cleanup" Jul 21 15:30:24.577654 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:24.577635 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f780905-h6ndb" Jul 21 15:30:24.580503 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:24.580485 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ccbkt\"" Jul 21 15:30:24.588106 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:24.588085 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f780905-h6ndb"] Jul 21 15:30:24.710986 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:24.710955 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ca5c40d-d324-421b-8ebc-90b59ff386ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2f780905-h6ndb\" (UID: \"5ca5c40d-d324-421b-8ebc-90b59ff386ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f780905-h6ndb" Jul 21 15:30:24.811800 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:24.811769 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ca5c40d-d324-421b-8ebc-90b59ff386ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2f780905-h6ndb\" (UID: \"5ca5c40d-d324-421b-8ebc-90b59ff386ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f780905-h6ndb" Jul 21 15:30:24.812354 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:24.812336 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ca5c40d-d324-421b-8ebc-90b59ff386ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-2f780905-h6ndb\" (UID: \"5ca5c40d-d324-421b-8ebc-90b59ff386ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f780905-h6ndb" Jul 21 15:30:24.887948 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:24.887856 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f780905-h6ndb" Jul 21 15:30:25.016942 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:25.016823 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f780905-h6ndb"] Jul 21 15:30:25.019508 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:30:25.019478 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ca5c40d_d324_421b_8ebc_90b59ff386ae.slice/crio-2b7b510717e6cf4baaf645d474bb037aafa58f66474130985a9b290dcd5b4df0 WatchSource:0}: Error finding container 2b7b510717e6cf4baaf645d474bb037aafa58f66474130985a9b290dcd5b4df0: Status 404 returned error can't find the container with id 2b7b510717e6cf4baaf645d474bb037aafa58f66474130985a9b290dcd5b4df0 Jul 21 15:30:25.653221 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:25.653183 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f780905-h6ndb" event={"ID":"5ca5c40d-d324-421b-8ebc-90b59ff386ae","Type":"ContainerStarted","Data":"708c176632b904bcc9698edbbcac3f9416f91028c5d9e8aafa47cfae9a511f6e"} Jul 21 15:30:25.653599 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:25.653244 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f780905-h6ndb" event={"ID":"5ca5c40d-d324-421b-8ebc-90b59ff386ae","Type":"ContainerStarted","Data":"2b7b510717e6cf4baaf645d474bb037aafa58f66474130985a9b290dcd5b4df0"} Jul 21 15:30:25.681297 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:25.681247 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f780905-h6ndb" podStartSLOduration=1.681230032 podStartE2EDuration="1.681230032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:30:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:30:25.678832741 +0000 UTC m=+1763.363488440" watchObservedRunningTime="2026-07-21 15:30:25.681230032 +0000 UTC m=+1763.365885638" Jul 21 15:30:26.659775 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:26.659740 2577 generic.go:356] "Generic (PLEG): container finished" podID="5ca5c40d-d324-421b-8ebc-90b59ff386ae" containerID="708c176632b904bcc9698edbbcac3f9416f91028c5d9e8aafa47cfae9a511f6e" exitCode=0 Jul 21 15:30:26.660155 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:26.659830 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f780905-h6ndb" event={"ID":"5ca5c40d-d324-421b-8ebc-90b59ff386ae","Type":"ContainerDied","Data":"708c176632b904bcc9698edbbcac3f9416f91028c5d9e8aafa47cfae9a511f6e"} Jul 21 15:30:27.786560 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:27.786539 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f780905-h6ndb" Jul 21 15:30:27.938841 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:27.938767 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ca5c40d-d324-421b-8ebc-90b59ff386ae-maas-api-service-ca\") pod \"5ca5c40d-d324-421b-8ebc-90b59ff386ae\" (UID: \"5ca5c40d-d324-421b-8ebc-90b59ff386ae\") " Jul 21 15:30:27.939135 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:27.939115 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ca5c40d-d324-421b-8ebc-90b59ff386ae-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5ca5c40d-d324-421b-8ebc-90b59ff386ae" (UID: "5ca5c40d-d324-421b-8ebc-90b59ff386ae"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:30:28.040188 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:28.040159 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ca5c40d-d324-421b-8ebc-90b59ff386ae-maas-api-service-ca\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:30:28.669534 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:28.669501 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f780905-h6ndb" event={"ID":"5ca5c40d-d324-421b-8ebc-90b59ff386ae","Type":"ContainerDied","Data":"2b7b510717e6cf4baaf645d474bb037aafa58f66474130985a9b290dcd5b4df0"} Jul 21 15:30:28.669534 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:28.669534 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f780905-h6ndb" Jul 21 15:30:28.669724 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:28.669557 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b7b510717e6cf4baaf645d474bb037aafa58f66474130985a9b290dcd5b4df0" Jul 21 15:30:39.660105 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:39.660069 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f780905-h6ndb"] Jul 21 15:30:39.662726 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:39.662699 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-2f780905-h6ndb"] Jul 21 15:30:40.897339 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:30:40.897305 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ca5c40d-d324-421b-8ebc-90b59ff386ae" path="/var/lib/kubelet/pods/5ca5c40d-d324-421b-8ebc-90b59ff386ae/volumes" Jul 21 15:31:03.226259 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:03.226230 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfv5x_b5b08086-eac8-4329-a903-a73b5e8503ce/ovn-acl-logging/0.log" Jul 21 15:31:03.230753 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:03.230728 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfv5x_b5b08086-eac8-4329-a903-a73b5e8503ce/ovn-acl-logging/0.log" Jul 21 15:31:08.401929 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:08.401873 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3972e309-4m2jk"] Jul 21 15:31:08.402634 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:08.402607 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ca5c40d-d324-421b-8ebc-90b59ff386ae" containerName="revoke-keys" Jul 21 15:31:08.402634 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:08.402633 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ca5c40d-d324-421b-8ebc-90b59ff386ae" containerName="revoke-keys" Jul 21 15:31:08.402844 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:08.402830 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ca5c40d-d324-421b-8ebc-90b59ff386ae" containerName="revoke-keys" Jul 21 15:31:08.406520 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:08.406497 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3972e309-4m2jk" Jul 21 15:31:08.409572 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:08.409554 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ccbkt\"" Jul 21 15:31:08.412071 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:08.412047 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3972e309-4m2jk"] Jul 21 15:31:08.470398 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:08.470364 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97f571f2-9e3b-49a0-a5b5-49dfe88eff68-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3972e309-4m2jk\" (UID: \"97f571f2-9e3b-49a0-a5b5-49dfe88eff68\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3972e309-4m2jk" Jul 21 15:31:08.571596 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:08.571566 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97f571f2-9e3b-49a0-a5b5-49dfe88eff68-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3972e309-4m2jk\" (UID: \"97f571f2-9e3b-49a0-a5b5-49dfe88eff68\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3972e309-4m2jk" Jul 21 15:31:08.572180 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:08.572164 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97f571f2-9e3b-49a0-a5b5-49dfe88eff68-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-3972e309-4m2jk\" (UID: \"97f571f2-9e3b-49a0-a5b5-49dfe88eff68\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3972e309-4m2jk" Jul 21 15:31:08.719030 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:08.718972 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3972e309-4m2jk" Jul 21 15:31:08.847108 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:08.847083 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3972e309-4m2jk"] Jul 21 15:31:08.849334 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:31:08.849303 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97f571f2_9e3b_49a0_a5b5_49dfe88eff68.slice/crio-8710e0def65dec120cb83288591d8794a1dc5722be8700ce8960de91756f7eee WatchSource:0}: Error finding container 8710e0def65dec120cb83288591d8794a1dc5722be8700ce8960de91756f7eee: Status 404 returned error can't find the container with id 8710e0def65dec120cb83288591d8794a1dc5722be8700ce8960de91756f7eee Jul 21 15:31:09.860348 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:09.860318 2577 generic.go:356] "Generic (PLEG): container finished" podID="97f571f2-9e3b-49a0-a5b5-49dfe88eff68" containerID="4a8b1ffafadc224ffc43d1b53005ecacdc524bfaf1aebda3e236742d392c7a9a" exitCode=0 Jul 21 15:31:09.860730 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:09.860363 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3972e309-4m2jk" event={"ID":"97f571f2-9e3b-49a0-a5b5-49dfe88eff68","Type":"ContainerDied","Data":"4a8b1ffafadc224ffc43d1b53005ecacdc524bfaf1aebda3e236742d392c7a9a"} Jul 21 15:31:09.860730 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:09.860413 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3972e309-4m2jk" event={"ID":"97f571f2-9e3b-49a0-a5b5-49dfe88eff68","Type":"ContainerStarted","Data":"8710e0def65dec120cb83288591d8794a1dc5722be8700ce8960de91756f7eee"} Jul 21 15:31:10.994228 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:10.994205 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3972e309-4m2jk" Jul 21 15:31:11.091495 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:11.091463 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97f571f2-9e3b-49a0-a5b5-49dfe88eff68-maas-api-service-ca\") pod \"97f571f2-9e3b-49a0-a5b5-49dfe88eff68\" (UID: \"97f571f2-9e3b-49a0-a5b5-49dfe88eff68\") " Jul 21 15:31:11.091801 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:11.091778 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97f571f2-9e3b-49a0-a5b5-49dfe88eff68-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "97f571f2-9e3b-49a0-a5b5-49dfe88eff68" (UID: "97f571f2-9e3b-49a0-a5b5-49dfe88eff68"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:31:11.192447 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:11.192370 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/97f571f2-9e3b-49a0-a5b5-49dfe88eff68-maas-api-service-ca\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:31:11.870918 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:11.870875 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3972e309-4m2jk" Jul 21 15:31:11.871093 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:11.870874 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3972e309-4m2jk" event={"ID":"97f571f2-9e3b-49a0-a5b5-49dfe88eff68","Type":"ContainerDied","Data":"8710e0def65dec120cb83288591d8794a1dc5722be8700ce8960de91756f7eee"} Jul 21 15:31:11.871093 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:11.871021 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8710e0def65dec120cb83288591d8794a1dc5722be8700ce8960de91756f7eee" Jul 21 15:31:23.470291 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:23.470258 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3972e309-4m2jk"] Jul 21 15:31:23.473182 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:23.473156 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-3972e309-4m2jk"] Jul 21 15:31:24.897712 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:24.897678 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97f571f2-9e3b-49a0-a5b5-49dfe88eff68" path="/var/lib/kubelet/pods/97f571f2-9e3b-49a0-a5b5-49dfe88eff68/volumes" Jul 21 15:31:52.274292 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:52.274255 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb3fc6d5-dj6v5"] Jul 21 15:31:52.274745 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:52.274580 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97f571f2-9e3b-49a0-a5b5-49dfe88eff68" containerName="revoke-keys" Jul 21 15:31:52.274745 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:52.274590 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="97f571f2-9e3b-49a0-a5b5-49dfe88eff68" containerName="revoke-keys" Jul 21 15:31:52.274745 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:52.274653 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="97f571f2-9e3b-49a0-a5b5-49dfe88eff68" containerName="revoke-keys" Jul 21 15:31:52.277769 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:52.277748 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb3fc6d5-dj6v5" Jul 21 15:31:52.280372 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:52.280349 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ccbkt\"" Jul 21 15:31:52.287103 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:52.287078 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb3fc6d5-dj6v5"] Jul 21 15:31:52.331634 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:52.331605 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73dfd9dd-1fa7-465b-a022-9724727ad9d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-cb3fc6d5-dj6v5\" (UID: \"73dfd9dd-1fa7-465b-a022-9724727ad9d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb3fc6d5-dj6v5" Jul 21 15:31:52.432015 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:52.431990 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73dfd9dd-1fa7-465b-a022-9724727ad9d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-cb3fc6d5-dj6v5\" (UID: \"73dfd9dd-1fa7-465b-a022-9724727ad9d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb3fc6d5-dj6v5" Jul 21 15:31:52.432554 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:52.432538 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73dfd9dd-1fa7-465b-a022-9724727ad9d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-cb3fc6d5-dj6v5\" (UID: \"73dfd9dd-1fa7-465b-a022-9724727ad9d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb3fc6d5-dj6v5" Jul 21 15:31:52.588409 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:52.588387 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb3fc6d5-dj6v5" Jul 21 15:31:52.718221 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:52.718193 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb3fc6d5-dj6v5"] Jul 21 15:31:52.721202 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:31:52.721174 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73dfd9dd_1fa7_465b_a022_9724727ad9d0.slice/crio-690f5cdf70b2b7ab1cadf2b87abe7bc1c8f7f85013b21074bdb185f162cfe56b WatchSource:0}: Error finding container 690f5cdf70b2b7ab1cadf2b87abe7bc1c8f7f85013b21074bdb185f162cfe56b: Status 404 returned error can't find the container with id 690f5cdf70b2b7ab1cadf2b87abe7bc1c8f7f85013b21074bdb185f162cfe56b Jul 21 15:31:53.063460 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:53.063428 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb3fc6d5-dj6v5" event={"ID":"73dfd9dd-1fa7-465b-a022-9724727ad9d0","Type":"ContainerStarted","Data":"27b7e01bcfa9609a09ab14255b3020e9349e443117c5ed5edd8278cbecca0d40"} Jul 21 15:31:53.063615 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:53.063479 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb3fc6d5-dj6v5" event={"ID":"73dfd9dd-1fa7-465b-a022-9724727ad9d0","Type":"ContainerStarted","Data":"690f5cdf70b2b7ab1cadf2b87abe7bc1c8f7f85013b21074bdb185f162cfe56b"} Jul 21 15:31:53.082874 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:53.082750 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb3fc6d5-dj6v5" podStartSLOduration=1.082730667 podStartE2EDuration="1.082730667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:31:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:31:53.08228336 +0000 UTC m=+1850.766938967" watchObservedRunningTime="2026-07-21 15:31:53.082730667 +0000 UTC m=+1850.767386274" Jul 21 15:31:54.071801 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:54.071757 2577 generic.go:356] "Generic (PLEG): container finished" podID="73dfd9dd-1fa7-465b-a022-9724727ad9d0" containerID="27b7e01bcfa9609a09ab14255b3020e9349e443117c5ed5edd8278cbecca0d40" exitCode=0 Jul 21 15:31:54.072300 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:54.071825 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb3fc6d5-dj6v5" event={"ID":"73dfd9dd-1fa7-465b-a022-9724727ad9d0","Type":"ContainerDied","Data":"27b7e01bcfa9609a09ab14255b3020e9349e443117c5ed5edd8278cbecca0d40"} Jul 21 15:31:55.202587 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:55.202560 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb3fc6d5-dj6v5" Jul 21 15:31:55.257213 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:55.257187 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73dfd9dd-1fa7-465b-a022-9724727ad9d0-maas-api-service-ca\") pod \"73dfd9dd-1fa7-465b-a022-9724727ad9d0\" (UID: \"73dfd9dd-1fa7-465b-a022-9724727ad9d0\") " Jul 21 15:31:55.257506 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:55.257485 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73dfd9dd-1fa7-465b-a022-9724727ad9d0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "73dfd9dd-1fa7-465b-a022-9724727ad9d0" (UID: "73dfd9dd-1fa7-465b-a022-9724727ad9d0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:31:55.358778 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:55.358720 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73dfd9dd-1fa7-465b-a022-9724727ad9d0-maas-api-service-ca\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:31:56.082194 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:56.082167 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb3fc6d5-dj6v5" Jul 21 15:31:56.082351 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:56.082218 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb3fc6d5-dj6v5" event={"ID":"73dfd9dd-1fa7-465b-a022-9724727ad9d0","Type":"ContainerDied","Data":"690f5cdf70b2b7ab1cadf2b87abe7bc1c8f7f85013b21074bdb185f162cfe56b"} Jul 21 15:31:56.082351 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:31:56.082275 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="690f5cdf70b2b7ab1cadf2b87abe7bc1c8f7f85013b21074bdb185f162cfe56b" Jul 21 15:32:07.360921 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:07.360873 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb3fc6d5-dj6v5"] Jul 21 15:32:07.365019 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:07.364993 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-cb3fc6d5-dj6v5"] Jul 21 15:32:08.898343 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:08.898311 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73dfd9dd-1fa7-465b-a022-9724727ad9d0" path="/var/lib/kubelet/pods/73dfd9dd-1fa7-465b-a022-9724727ad9d0/volumes" Jul 21 15:32:37.663917 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:37.663828 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-abfd2548-jkh6h"] Jul 21 15:32:37.664348 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:37.664168 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73dfd9dd-1fa7-465b-a022-9724727ad9d0" containerName="revoke-keys" Jul 21 15:32:37.664348 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:37.664179 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="73dfd9dd-1fa7-465b-a022-9724727ad9d0" containerName="revoke-keys" Jul 21 15:32:37.664348 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:37.664256 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="73dfd9dd-1fa7-465b-a022-9724727ad9d0" containerName="revoke-keys" Jul 21 15:32:37.667105 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:37.667087 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-abfd2548-jkh6h" Jul 21 15:32:37.669874 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:37.669852 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ccbkt\"" Jul 21 15:32:37.675250 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:37.675226 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-abfd2548-jkh6h"] Jul 21 15:32:37.700551 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:37.700526 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e08d3e6e-51db-4d1c-af23-07296cdb8e6a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-abfd2548-jkh6h\" (UID: \"e08d3e6e-51db-4d1c-af23-07296cdb8e6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-abfd2548-jkh6h" Jul 21 15:32:37.801842 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:37.801815 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e08d3e6e-51db-4d1c-af23-07296cdb8e6a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-abfd2548-jkh6h\" (UID: \"e08d3e6e-51db-4d1c-af23-07296cdb8e6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-abfd2548-jkh6h" Jul 21 15:32:37.802404 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:37.802385 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e08d3e6e-51db-4d1c-af23-07296cdb8e6a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-abfd2548-jkh6h\" (UID: \"e08d3e6e-51db-4d1c-af23-07296cdb8e6a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-abfd2548-jkh6h" Jul 21 15:32:37.978965 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:37.978907 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-abfd2548-jkh6h" Jul 21 15:32:38.312185 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:38.312158 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-abfd2548-jkh6h"] Jul 21 15:32:38.314538 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:32:38.314513 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode08d3e6e_51db_4d1c_af23_07296cdb8e6a.slice/crio-7eee2d5677647365aa88ed6840f66f7a917fea0966790052a33776fa23dc335e WatchSource:0}: Error finding container 7eee2d5677647365aa88ed6840f66f7a917fea0966790052a33776fa23dc335e: Status 404 returned error can't find the container with id 7eee2d5677647365aa88ed6840f66f7a917fea0966790052a33776fa23dc335e Jul 21 15:32:39.278473 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:39.278434 2577 generic.go:356] "Generic (PLEG): container finished" podID="e08d3e6e-51db-4d1c-af23-07296cdb8e6a" containerID="7a8917a9213a9397c7fab1aea4dedf32726c199347cf9a2f8b89f04f9b93eb24" exitCode=0 Jul 21 15:32:39.278473 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:39.278472 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-abfd2548-jkh6h" event={"ID":"e08d3e6e-51db-4d1c-af23-07296cdb8e6a","Type":"ContainerDied","Data":"7a8917a9213a9397c7fab1aea4dedf32726c199347cf9a2f8b89f04f9b93eb24"} Jul 21 15:32:39.278858 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:39.278515 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-abfd2548-jkh6h" event={"ID":"e08d3e6e-51db-4d1c-af23-07296cdb8e6a","Type":"ContainerStarted","Data":"7eee2d5677647365aa88ed6840f66f7a917fea0966790052a33776fa23dc335e"} Jul 21 15:32:40.405618 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:40.405594 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-abfd2548-jkh6h" Jul 21 15:32:40.424556 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:40.424523 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e08d3e6e-51db-4d1c-af23-07296cdb8e6a-maas-api-service-ca\") pod \"e08d3e6e-51db-4d1c-af23-07296cdb8e6a\" (UID: \"e08d3e6e-51db-4d1c-af23-07296cdb8e6a\") " Jul 21 15:32:40.424934 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:40.424909 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e08d3e6e-51db-4d1c-af23-07296cdb8e6a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e08d3e6e-51db-4d1c-af23-07296cdb8e6a" (UID: "e08d3e6e-51db-4d1c-af23-07296cdb8e6a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:32:40.525574 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:40.525551 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e08d3e6e-51db-4d1c-af23-07296cdb8e6a-maas-api-service-ca\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:32:41.290550 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:41.290468 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-abfd2548-jkh6h" Jul 21 15:32:41.290550 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:41.290511 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-abfd2548-jkh6h" event={"ID":"e08d3e6e-51db-4d1c-af23-07296cdb8e6a","Type":"ContainerDied","Data":"7eee2d5677647365aa88ed6840f66f7a917fea0966790052a33776fa23dc335e"} Jul 21 15:32:41.290743 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:41.290571 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7eee2d5677647365aa88ed6840f66f7a917fea0966790052a33776fa23dc335e" Jul 21 15:32:52.749565 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:52.749525 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-abfd2548-jkh6h"] Jul 21 15:32:52.752367 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:52.752342 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-abfd2548-jkh6h"] Jul 21 15:32:52.897886 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:32:52.897850 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e08d3e6e-51db-4d1c-af23-07296cdb8e6a" path="/var/lib/kubelet/pods/e08d3e6e-51db-4d1c-af23-07296cdb8e6a/volumes" Jul 21 15:34:43.798299 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:43.798264 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9365ce5e-bn5th"] Jul 21 15:34:43.798839 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:43.798583 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e08d3e6e-51db-4d1c-af23-07296cdb8e6a" containerName="revoke-keys" Jul 21 15:34:43.798839 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:43.798594 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e08d3e6e-51db-4d1c-af23-07296cdb8e6a" containerName="revoke-keys" Jul 21 15:34:43.798839 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:43.798657 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e08d3e6e-51db-4d1c-af23-07296cdb8e6a" containerName="revoke-keys" Jul 21 15:34:43.801123 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:43.801108 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9365ce5e-bn5th" Jul 21 15:34:43.803673 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:43.803647 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-ccbkt\"" Jul 21 15:34:43.810376 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:43.810354 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9365ce5e-bn5th"] Jul 21 15:34:43.836869 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:43.836841 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd6642c-5e40-4437-82a0-8d334651f9ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9365ce5e-bn5th\" (UID: \"0bd6642c-5e40-4437-82a0-8d334651f9ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9365ce5e-bn5th" Jul 21 15:34:43.937625 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:43.937600 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd6642c-5e40-4437-82a0-8d334651f9ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9365ce5e-bn5th\" (UID: \"0bd6642c-5e40-4437-82a0-8d334651f9ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9365ce5e-bn5th" Jul 21 15:34:43.938267 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:43.938248 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd6642c-5e40-4437-82a0-8d334651f9ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9365ce5e-bn5th\" (UID: \"0bd6642c-5e40-4437-82a0-8d334651f9ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9365ce5e-bn5th" Jul 21 15:34:44.112057 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:44.112034 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9365ce5e-bn5th" Jul 21 15:34:44.237492 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:44.237466 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9365ce5e-bn5th"] Jul 21 15:34:44.239567 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:34:44.239541 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bd6642c_5e40_4437_82a0_8d334651f9ca.slice/crio-3ccca976462057a3c025bf08ad54571aee06d5f56d6c9e36aaf68a5d9bca9a59 WatchSource:0}: Error finding container 3ccca976462057a3c025bf08ad54571aee06d5f56d6c9e36aaf68a5d9bca9a59: Status 404 returned error can't find the container with id 3ccca976462057a3c025bf08ad54571aee06d5f56d6c9e36aaf68a5d9bca9a59 Jul 21 15:34:44.879815 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:44.879781 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9365ce5e-bn5th" event={"ID":"0bd6642c-5e40-4437-82a0-8d334651f9ca","Type":"ContainerStarted","Data":"e889b9eee5d19c3cd7ea5f021425cece8e8058b2ec1af1e927c9ca004bea4765"} Jul 21 15:34:44.880302 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:44.879838 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9365ce5e-bn5th" event={"ID":"0bd6642c-5e40-4437-82a0-8d334651f9ca","Type":"ContainerStarted","Data":"3ccca976462057a3c025bf08ad54571aee06d5f56d6c9e36aaf68a5d9bca9a59"} Jul 21 15:34:44.898985 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:44.898929 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9365ce5e-bn5th" podStartSLOduration=1.898910274 podStartE2EDuration="1.898910274s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:34:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:34:44.89664496 +0000 UTC m=+2022.581300567" watchObservedRunningTime="2026-07-21 15:34:44.898910274 +0000 UTC m=+2022.583565872" Jul 21 15:34:45.887166 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:45.887129 2577 generic.go:356] "Generic (PLEG): container finished" podID="0bd6642c-5e40-4437-82a0-8d334651f9ca" containerID="e889b9eee5d19c3cd7ea5f021425cece8e8058b2ec1af1e927c9ca004bea4765" exitCode=0 Jul 21 15:34:45.887565 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:45.887221 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9365ce5e-bn5th" event={"ID":"0bd6642c-5e40-4437-82a0-8d334651f9ca","Type":"ContainerDied","Data":"e889b9eee5d19c3cd7ea5f021425cece8e8058b2ec1af1e927c9ca004bea4765"} Jul 21 15:34:47.019962 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:47.019934 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9365ce5e-bn5th" Jul 21 15:34:47.062786 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:47.062759 2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd6642c-5e40-4437-82a0-8d334651f9ca-maas-api-service-ca\") pod \"0bd6642c-5e40-4437-82a0-8d334651f9ca\" (UID: \"0bd6642c-5e40-4437-82a0-8d334651f9ca\") " Jul 21 15:34:47.063131 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:47.063108 2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bd6642c-5e40-4437-82a0-8d334651f9ca-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0bd6642c-5e40-4437-82a0-8d334651f9ca" (UID: "0bd6642c-5e40-4437-82a0-8d334651f9ca"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:34:47.164315 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:47.164244 2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd6642c-5e40-4437-82a0-8d334651f9ca-maas-api-service-ca\") on node \"ip-10-0-133-162.ec2.internal\" DevicePath \"\"" Jul 21 15:34:47.898002 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:47.897966 2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9365ce5e-bn5th" Jul 21 15:34:47.898002 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:47.897996 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9365ce5e-bn5th" event={"ID":"0bd6642c-5e40-4437-82a0-8d334651f9ca","Type":"ContainerDied","Data":"3ccca976462057a3c025bf08ad54571aee06d5f56d6c9e36aaf68a5d9bca9a59"} Jul 21 15:34:47.898195 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:47.898033 2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ccca976462057a3c025bf08ad54571aee06d5f56d6c9e36aaf68a5d9bca9a59" Jul 21 15:34:58.876533 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:58.876497 2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9365ce5e-bn5th"] Jul 21 15:34:58.878526 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:58.878503 2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9365ce5e-bn5th"] Jul 21 15:34:58.898064 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:34:58.898035 2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bd6642c-5e40-4437-82a0-8d334651f9ca" path="/var/lib/kubelet/pods/0bd6642c-5e40-4437-82a0-8d334651f9ca/volumes" Jul 21 15:35:18.805369 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:18.805339 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-757d96bb9f-pp2jl_e5d6b7eb-5ef4-4dbc-bd24-873354ab9bb7/authorino/0.log" Jul 21 15:35:25.163683 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:25.163612 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d78549688-wsxtf_76aca68f-a89c-49e4-8758-3db3edd39cfb/copy-manifests/0.log" Jul 21 15:35:25.175961 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:25.175940 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d78549688-wsxtf_76aca68f-a89c-49e4-8758-3db3edd39cfb/manager/0.log" Jul 21 15:35:25.748750 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:25.748722 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29744130-rp74j_dc9f3d70-aeb3-46cd-be14-4c3735da368e/cleanup/0.log" Jul 21 15:35:25.876179 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:25.876152 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-l82fp_ebbda3e2-6905-46b1-a05b-5144a615cd99/postgres/0.log" Jul 21 15:35:27.156374 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:27.156346 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-757d96bb9f-pp2jl_e5d6b7eb-5ef4-4dbc-bd24-873354ab9bb7/authorino/0.log" Jul 21 15:35:27.488804 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:27.488729 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-tq2hc_09297dd3-9d79-4480-804c-62c2471f0019/kuadrant-console-plugin/0.log" Jul 21 15:35:28.527483 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:28.527455 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7846d57695-bc64h_c64930c9-55fb-423c-a5c6-5669d95d1fdd/kube-auth-proxy/0.log" Jul 21 15:35:29.441977 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:29.441952 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-g4s7v_b3f50b17-e194-4358-8449-8eeb026478c0/main/0.log" Jul 21 15:35:29.778953 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:29.778865 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f4dw22_f3449a04-b2f2-4420-9565-122b76a36fd5/main/0.log" Jul 21 15:35:35.434017 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:35.433987 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w2v9j/must-gather-rllvp"] Jul 21 15:35:35.434478 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:35.434355 2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bd6642c-5e40-4437-82a0-8d334651f9ca" containerName="revoke-keys" Jul 21 15:35:35.434478 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:35.434367 2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bd6642c-5e40-4437-82a0-8d334651f9ca" containerName="revoke-keys" Jul 21 15:35:35.434478 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:35.434431 2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bd6642c-5e40-4437-82a0-8d334651f9ca" containerName="revoke-keys" Jul 21 15:35:35.440051 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:35.438792 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w2v9j/must-gather-rllvp" Jul 21 15:35:35.442039 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:35.442013 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w2v9j\"/\"kube-root-ca.crt\"" Jul 21 15:35:35.442166 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:35.442013 2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-w2v9j\"/\"openshift-service-ca.crt\"" Jul 21 15:35:35.448149 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:35.448127 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w2v9j/must-gather-rllvp"] Jul 21 15:35:35.478108 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:35.478081 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/efe35a96-3a66-441a-b674-c5d388977ee8-must-gather-output\") pod \"must-gather-rllvp\" (UID: \"efe35a96-3a66-441a-b674-c5d388977ee8\") " pod="openshift-must-gather-w2v9j/must-gather-rllvp" Jul 21 15:35:35.478246 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:35.478226 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2swp\" (UniqueName: \"kubernetes.io/projected/efe35a96-3a66-441a-b674-c5d388977ee8-kube-api-access-l2swp\") pod \"must-gather-rllvp\" (UID: \"efe35a96-3a66-441a-b674-c5d388977ee8\") " pod="openshift-must-gather-w2v9j/must-gather-rllvp" Jul 21 15:35:35.579504 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:35.579474 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2swp\" (UniqueName: \"kubernetes.io/projected/efe35a96-3a66-441a-b674-c5d388977ee8-kube-api-access-l2swp\") pod \"must-gather-rllvp\" (UID: \"efe35a96-3a66-441a-b674-c5d388977ee8\") " pod="openshift-must-gather-w2v9j/must-gather-rllvp" Jul 21 15:35:35.579624 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:35.579522 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/efe35a96-3a66-441a-b674-c5d388977ee8-must-gather-output\") pod \"must-gather-rllvp\" (UID: \"efe35a96-3a66-441a-b674-c5d388977ee8\") " pod="openshift-must-gather-w2v9j/must-gather-rllvp" Jul 21 15:35:35.579834 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:35.579818 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/efe35a96-3a66-441a-b674-c5d388977ee8-must-gather-output\") pod \"must-gather-rllvp\" (UID: \"efe35a96-3a66-441a-b674-c5d388977ee8\") " pod="openshift-must-gather-w2v9j/must-gather-rllvp" Jul 21 15:35:35.587298 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:35.587270 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2swp\" (UniqueName: \"kubernetes.io/projected/efe35a96-3a66-441a-b674-c5d388977ee8-kube-api-access-l2swp\") pod \"must-gather-rllvp\" (UID: \"efe35a96-3a66-441a-b674-c5d388977ee8\") " pod="openshift-must-gather-w2v9j/must-gather-rllvp" Jul 21 15:35:35.750878 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:35.750806 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w2v9j/must-gather-rllvp" Jul 21 15:35:35.879551 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:35.879525 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w2v9j/must-gather-rllvp"] Jul 21 15:35:35.881524 ip-10-0-133-162 kubenswrapper[2577]: W0721 15:35:35.881499 2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podefe35a96_3a66_441a_b674_c5d388977ee8.slice/crio-b996da747a2491b14d47dde4be85ca409952054c5025933b63862103a632a731 WatchSource:0}: Error finding container b996da747a2491b14d47dde4be85ca409952054c5025933b63862103a632a731: Status 404 returned error can't find the container with id b996da747a2491b14d47dde4be85ca409952054c5025933b63862103a632a731 Jul 21 15:35:35.883370 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:35.883350 2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 15:35:36.134071 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:36.134034 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w2v9j/must-gather-rllvp" event={"ID":"efe35a96-3a66-441a-b674-c5d388977ee8","Type":"ContainerStarted","Data":"b996da747a2491b14d47dde4be85ca409952054c5025933b63862103a632a731"} Jul 21 15:35:38.149738 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:38.149695 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w2v9j/must-gather-rllvp" event={"ID":"efe35a96-3a66-441a-b674-c5d388977ee8","Type":"ContainerStarted","Data":"8b1c000d4988c1be84292195706bda3a8bac471851a93c4f7a8581ab34bffef3"} Jul 21 15:35:38.150266 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:38.149751 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w2v9j/must-gather-rllvp" event={"ID":"efe35a96-3a66-441a-b674-c5d388977ee8","Type":"ContainerStarted","Data":"6088062b924c418f441eb307ad0776f20547cf9dbafa0ae96925fe022f7533d3"} Jul 21 15:35:38.173267 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:38.172215 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w2v9j/must-gather-rllvp" podStartSLOduration=1.995589205 podStartE2EDuration="3.172193784s" totalImagesPullingTime="1.176604579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:35:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:35:38.170211009 +0000 UTC m=+2075.854866616" watchObservedRunningTime="2026-07-21 15:35:38.172193784 +0000 UTC m=+2075.856849392" Jul 21 15:35:38.732180 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:38.732144 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rj7km_4bef143c-d202-45f2-85ea-ae75c3d6812e/global-pull-secret-syncer/0.log" Jul 21 15:35:38.845535 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:38.845502 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-t22z2_e5d5637f-5cd7-4b29-bb1c-c8b5c45786c2/konnectivity-agent/0.log" Jul 21 15:35:38.896737 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:38.896708 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-162.ec2.internal_e0a7da5646d11ae196ceeecffb05398c/haproxy/0.log" Jul 21 15:35:44.228040 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:44.227296 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-757d96bb9f-pp2jl_e5d6b7eb-5ef4-4dbc-bd24-873354ab9bb7/authorino/0.log" Jul 21 15:35:44.325262 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:44.325226 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-tq2hc_09297dd3-9d79-4480-804c-62c2471f0019/kuadrant-console-plugin/0.log" Jul 21 15:35:46.338178 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:46.338145 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-44kxl_58b8eb28-dd6d-4eff-889e-10d2e6014b34/kube-state-metrics/0.log" Jul 21 15:35:46.362340 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:46.362307 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-44kxl_58b8eb28-dd6d-4eff-889e-10d2e6014b34/kube-rbac-proxy-main/0.log" Jul 21 15:35:46.387571 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:46.387482 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-44kxl_58b8eb28-dd6d-4eff-889e-10d2e6014b34/kube-rbac-proxy-self/0.log" Jul 21 15:35:46.426774 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:46.426746 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6d4548cbfd-x6xkk_39640cd9-5c53-4a9f-a21d-02db1fb656c3/metrics-server/0.log" Jul 21 15:35:46.665389 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:46.665196 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zfj5v_01a930f2-8b11-4609-b3da-e0805e69a026/node-exporter/0.log" Jul 21 15:35:46.690393 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:46.690364 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zfj5v_01a930f2-8b11-4609-b3da-e0805e69a026/kube-rbac-proxy/0.log" Jul 21 15:35:46.713690 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:46.713663 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zfj5v_01a930f2-8b11-4609-b3da-e0805e69a026/init-textfile/0.log" Jul 21 15:35:47.020752 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:47.020666 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-4fm68_ab631f36-e043-4fb6-9dbb-21f324fe34f5/prometheus-operator/0.log" Jul 21 15:35:47.044449 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:47.044416 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-4fm68_ab631f36-e043-4fb6-9dbb-21f324fe34f5/kube-rbac-proxy/0.log" Jul 21 15:35:47.074992 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:47.074947 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-4hq2c_95837223-713f-47b0-b113-33ebe75ccde9/prometheus-operator-admission-webhook/0.log" Jul 21 15:35:47.108776 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:47.108735 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cd947c788-wvg8l_32fe8003-9165-400a-a15f-2278046ca905/telemeter-client/0.log" Jul 21 15:35:47.131057 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:47.131027 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cd947c788-wvg8l_32fe8003-9165-400a-a15f-2278046ca905/reload/0.log" Jul 21 15:35:47.153626 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:47.153595 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5cd947c788-wvg8l_32fe8003-9165-400a-a15f-2278046ca905/kube-rbac-proxy/0.log" Jul 21 15:35:47.188863 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:47.188826 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54ff46bdc5-rt6rm_e7d6237d-4c22-4602-aa9a-5fc0ac336730/thanos-query/0.log" Jul 21 15:35:47.214883 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:47.214852 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54ff46bdc5-rt6rm_e7d6237d-4c22-4602-aa9a-5fc0ac336730/kube-rbac-proxy-web/0.log" Jul 21 15:35:47.240139 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:47.240107 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54ff46bdc5-rt6rm_e7d6237d-4c22-4602-aa9a-5fc0ac336730/kube-rbac-proxy/0.log" Jul 21 15:35:47.264298 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:47.264267 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54ff46bdc5-rt6rm_e7d6237d-4c22-4602-aa9a-5fc0ac336730/prom-label-proxy/0.log" Jul 21 15:35:47.288331 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:47.288242 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54ff46bdc5-rt6rm_e7d6237d-4c22-4602-aa9a-5fc0ac336730/kube-rbac-proxy-rules/0.log" Jul 21 15:35:47.310771 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:47.310743 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-54ff46bdc5-rt6rm_e7d6237d-4c22-4602-aa9a-5fc0ac336730/kube-rbac-proxy-metrics/0.log" Jul 21 15:35:48.528479 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:48.528449 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-tqdxd_edc3b8ca-971a-4928-b123-0fa5a06281b2/networking-console-plugin/0.log" Jul 21 15:35:48.763478 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:48.763441 2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w"] Jul 21 15:35:48.768700 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:48.768675 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w" Jul 21 15:35:48.771757 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:48.771558 2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-w2v9j\"/\"default-dockercfg-sbt7v\"" Jul 21 15:35:48.779242 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:48.778040 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w"] Jul 21 15:35:48.916748 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:48.916712 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3f1b5bf-fdd3-416c-bc9b-81781087fe77-sys\") pod \"perf-node-gather-daemonset-h2v9w\" (UID: \"e3f1b5bf-fdd3-416c-bc9b-81781087fe77\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w" Jul 21 15:35:48.917071 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:48.917046 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3f1b5bf-fdd3-416c-bc9b-81781087fe77-lib-modules\") pod \"perf-node-gather-daemonset-h2v9w\" (UID: \"e3f1b5bf-fdd3-416c-bc9b-81781087fe77\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w" Jul 21 15:35:48.917273 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:48.917256 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e3f1b5bf-fdd3-416c-bc9b-81781087fe77-podres\") pod \"perf-node-gather-daemonset-h2v9w\" (UID: \"e3f1b5bf-fdd3-416c-bc9b-81781087fe77\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w" Jul 21 15:35:48.917412 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:48.917397 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk675\" (UniqueName: \"kubernetes.io/projected/e3f1b5bf-fdd3-416c-bc9b-81781087fe77-kube-api-access-vk675\") pod \"perf-node-gather-daemonset-h2v9w\" (UID: \"e3f1b5bf-fdd3-416c-bc9b-81781087fe77\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w" Jul 21 15:35:48.917550 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:48.917534 2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e3f1b5bf-fdd3-416c-bc9b-81781087fe77-proc\") pod \"perf-node-gather-daemonset-h2v9w\" (UID: \"e3f1b5bf-fdd3-416c-bc9b-81781087fe77\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w" Jul 21 15:35:49.018333 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:49.018288 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e3f1b5bf-fdd3-416c-bc9b-81781087fe77-podres\") pod \"perf-node-gather-daemonset-h2v9w\" (UID: \"e3f1b5bf-fdd3-416c-bc9b-81781087fe77\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w" Jul 21 15:35:49.018520 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:49.018360 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk675\" (UniqueName: \"kubernetes.io/projected/e3f1b5bf-fdd3-416c-bc9b-81781087fe77-kube-api-access-vk675\") pod \"perf-node-gather-daemonset-h2v9w\" (UID: \"e3f1b5bf-fdd3-416c-bc9b-81781087fe77\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w" Jul 21 15:35:49.018520 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:49.018403 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e3f1b5bf-fdd3-416c-bc9b-81781087fe77-proc\") pod \"perf-node-gather-daemonset-h2v9w\" (UID: \"e3f1b5bf-fdd3-416c-bc9b-81781087fe77\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w" Jul 21 15:35:49.018520 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:49.018447 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3f1b5bf-fdd3-416c-bc9b-81781087fe77-sys\") pod \"perf-node-gather-daemonset-h2v9w\" (UID: \"e3f1b5bf-fdd3-416c-bc9b-81781087fe77\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w" Jul 21 15:35:49.018520 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:49.018479 2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3f1b5bf-fdd3-416c-bc9b-81781087fe77-lib-modules\") pod \"perf-node-gather-daemonset-h2v9w\" (UID: \"e3f1b5bf-fdd3-416c-bc9b-81781087fe77\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w" Jul 21 15:35:49.018767 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:49.018674 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e3f1b5bf-fdd3-416c-bc9b-81781087fe77-lib-modules\") pod \"perf-node-gather-daemonset-h2v9w\" (UID: \"e3f1b5bf-fdd3-416c-bc9b-81781087fe77\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w" Jul 21 15:35:49.018823 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:49.018765 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e3f1b5bf-fdd3-416c-bc9b-81781087fe77-podres\") pod \"perf-node-gather-daemonset-h2v9w\" (UID: \"e3f1b5bf-fdd3-416c-bc9b-81781087fe77\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w" Jul 21 15:35:49.019267 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:49.019171 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e3f1b5bf-fdd3-416c-bc9b-81781087fe77-proc\") pod \"perf-node-gather-daemonset-h2v9w\" (UID: \"e3f1b5bf-fdd3-416c-bc9b-81781087fe77\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w" Jul 21 15:35:49.019267 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:49.019232 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e3f1b5bf-fdd3-416c-bc9b-81781087fe77-sys\") pod \"perf-node-gather-daemonset-h2v9w\" (UID: \"e3f1b5bf-fdd3-416c-bc9b-81781087fe77\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w" Jul 21 15:35:49.028714 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:49.028683 2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk675\" (UniqueName: \"kubernetes.io/projected/e3f1b5bf-fdd3-416c-bc9b-81781087fe77-kube-api-access-vk675\") pod \"perf-node-gather-daemonset-h2v9w\" (UID: \"e3f1b5bf-fdd3-416c-bc9b-81781087fe77\") " pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w" Jul 21 15:35:49.084304 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:49.084268 2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w" Jul 21 15:35:49.284627 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:49.284564 2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w"] Jul 21 15:35:50.265476 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:50.265432 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w" event={"ID":"e3f1b5bf-fdd3-416c-bc9b-81781087fe77","Type":"ContainerStarted","Data":"9e2412f6f5cc1364c518a0f0b32045a33edaff48e0baf7e2c1573a21657a5498"} Jul 21 15:35:50.266064 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:50.265502 2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w" event={"ID":"e3f1b5bf-fdd3-416c-bc9b-81781087fe77","Type":"ContainerStarted","Data":"f4df7ff31c7ce721c84432fff9fb6365c630f5d8751546d5bfe30e3d50d37643"} Jul 21 15:35:50.266064 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:50.265568 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w" Jul 21 15:35:51.540916 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:51.540872 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lns5j_6eaa6b6f-8079-4df1-b17c-3e6078ec6db1/dns/0.log" Jul 21 15:35:51.562300 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:51.562272 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lns5j_6eaa6b6f-8079-4df1-b17c-3e6078ec6db1/kube-rbac-proxy/0.log" Jul 21 15:35:51.634421 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:51.634395 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z5vz5_ec99e5c6-a468-4067-a9f9-120ab64e1a1f/dns-node-resolver/0.log" Jul 21 15:35:52.189235 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:52.189191 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8hjhr_6970a7ea-4844-421f-8399-44aff10ce67d/node-ca/0.log" Jul 21 15:35:53.310783 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:53.310748 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7846d57695-bc64h_c64930c9-55fb-423c-a5c6-5669d95d1fdd/kube-auth-proxy/0.log" Jul 21 15:35:54.111725 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:54.111695 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5pps2_653ea0e6-eb3d-47af-921b-2926185c6d84/serve-healthcheck-canary/0.log" Jul 21 15:35:54.741356 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:54.741324 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9vh8s_441bba4c-a860-4ba2-a6e2-5de8b038472c/kube-rbac-proxy/0.log" Jul 21 15:35:54.764928 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:54.764882 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9vh8s_441bba4c-a860-4ba2-a6e2-5de8b038472c/exporter/0.log" Jul 21 15:35:54.792830 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:54.792804 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9vh8s_441bba4c-a860-4ba2-a6e2-5de8b038472c/extractor/0.log" Jul 21 15:35:56.282193 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:56.282160 2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w" Jul 21 15:35:56.303049 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:56.302970 2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-w2v9j/perf-node-gather-daemonset-h2v9w" podStartSLOduration=8.302948909 podStartE2EDuration="8.302948909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:35:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:35:50.283356384 +0000 UTC m=+2087.968011992" watchObservedRunningTime="2026-07-21 15:35:56.302948909 +0000 UTC m=+2093.987604518" Jul 21 15:35:57.454127 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:57.454093 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d78549688-wsxtf_76aca68f-a89c-49e4-8758-3db3edd39cfb/manager/0.log" Jul 21 15:35:57.476736 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:57.476707 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d78549688-wsxtf_76aca68f-a89c-49e4-8758-3db3edd39cfb/copy-manifests/0.log" Jul 21 15:35:58.881944 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:58.881909 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-795f7754-jqtxh_9535fb18-11e2-4d08-b0c3-91c9eab60f25/manager/0.log" Jul 21 15:35:59.403721 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:35:59.403696 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7846d57695-bc64h_c64930c9-55fb-423c-a5c6-5669d95d1fdd/kube-auth-proxy/0.log" Jul 21 15:36:00.767345 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:36:00.767318 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7846d57695-bc64h_c64930c9-55fb-423c-a5c6-5669d95d1fdd/kube-auth-proxy/0.log" Jul 21 15:36:03.278994 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:36:03.278957 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfv5x_b5b08086-eac8-4329-a903-a73b5e8503ce/ovn-acl-logging/0.log" Jul 21 15:36:03.285070 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:36:03.285033 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mfv5x_b5b08086-eac8-4329-a903-a73b5e8503ce/ovn-acl-logging/0.log" Jul 21 15:36:05.625412 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:36:05.625323 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-plxr5_0dbb0449-f6cd-4fbe-ab4a-02e54935dc53/kube-multus-additional-cni-plugins/0.log" Jul 21 15:36:05.649052 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:36:05.648984 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-plxr5_0dbb0449-f6cd-4fbe-ab4a-02e54935dc53/egress-router-binary-copy/0.log" Jul 21 15:36:05.674340 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:36:05.674300 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-plxr5_0dbb0449-f6cd-4fbe-ab4a-02e54935dc53/cni-plugins/0.log" Jul 21 15:36:05.701817 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:36:05.701790 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-plxr5_0dbb0449-f6cd-4fbe-ab4a-02e54935dc53/bond-cni-plugin/0.log" Jul 21 15:36:05.726793 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:36:05.726758 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-plxr5_0dbb0449-f6cd-4fbe-ab4a-02e54935dc53/routeoverride-cni/0.log" Jul 21 15:36:05.751498 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:36:05.751465 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-plxr5_0dbb0449-f6cd-4fbe-ab4a-02e54935dc53/whereabouts-cni-bincopy/0.log" Jul 21 15:36:05.772735 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:36:05.772708 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-plxr5_0dbb0449-f6cd-4fbe-ab4a-02e54935dc53/whereabouts-cni/0.log" Jul 21 15:36:05.810013 ip-10-0-133-162 kubenswrapper[2577]: I0721 15:36:05.809983 2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-gjxv9_d4e65841-4011-4525-ba59-2effd740f791/kube-multus/0.log"