Jul 08 18:45:39.960654 ip-10-0-135-240 systemd[1]: Starting Kubernetes Kubelet... Jul 08 18:45:40.524095 ip-10-0-135-240 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 18:45:40.524095 ip-10-0-135-240 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 18:45:40.524095 ip-10-0-135-240 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 18:45:40.524095 ip-10-0-135-240 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 18:45:40.524095 ip-10-0-135-240 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 18:45:40.524095 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.492629 2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 18:45:40.524095 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499658 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:45:40.524095 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499672 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:45:40.524095 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499677 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:45:40.524095 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499680 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:45:40.524095 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499683 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:45:40.524095 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499687 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:45:40.524095 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499690 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:45:40.524095 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499698 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:45:40.525550 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499701 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:45:40.525550 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499704 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:45:40.525550 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499707 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:45:40.525550 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499710 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:45:40.525550 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499712 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:45:40.525550 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499717 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:45:40.525550 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499721 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:45:40.525550 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499724 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:45:40.525550 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499727 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:45:40.525550 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499730 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:45:40.525550 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499733 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:45:40.525550 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499736 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:45:40.525550 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499739 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:45:40.525550 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499742 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:45:40.525550 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499745 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:45:40.525550 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499747 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:45:40.525550 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499750 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:45:40.525550 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499752 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:45:40.525550 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499755 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:45:40.526098 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499758 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:45:40.526098 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499761 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:45:40.526098 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499763 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:45:40.526098 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499766 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:45:40.526098 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499769 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:45:40.526098 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499771 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:45:40.526098 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499775 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:45:40.526098 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499780 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:45:40.526098 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499785 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:45:40.526098 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499788 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:45:40.526098 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499791 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:45:40.526098 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499795 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:45:40.526098 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499798 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:45:40.526098 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499801 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:45:40.526098 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499805 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:45:40.526098 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499807 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:45:40.526098 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499810 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:45:40.526098 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499812 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:45:40.526098 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499815 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:45:40.526754 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499817 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:45:40.526754 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499820 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:45:40.526754 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499823 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:45:40.526754 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499825 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:45:40.526754 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499828 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:45:40.526754 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499830 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:45:40.526754 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499833 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:45:40.526754 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499835 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:45:40.526754 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499838 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:45:40.526754 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499840 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:45:40.526754 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499843 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:45:40.526754 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499845 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:45:40.526754 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499848 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:45:40.526754 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499851 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:45:40.526754 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499854 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:45:40.526754 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499858 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:45:40.526754 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499861 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:45:40.526754 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499864 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:45:40.526754 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499866 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:45:40.526754 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499869 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:45:40.527638 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499871 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:45:40.527638 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499874 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:45:40.527638 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499876 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:45:40.527638 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499879 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:45:40.527638 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499881 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:45:40.527638 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499885 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:45:40.527638 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499888 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:45:40.527638 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499890 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:45:40.527638 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499892 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:45:40.527638 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499895 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:45:40.527638 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499897 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:45:40.527638 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499900 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:45:40.527638 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499902 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:45:40.527638 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499905 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:45:40.527638 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499907 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:45:40.527638 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499910 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:45:40.527638 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499912 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:45:40.527638 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499915 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:45:40.527638 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499917 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:45:40.527638 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499920 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:45:40.630459 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499923 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:45:40.630459 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499926 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:45:40.630459 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499929 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:45:40.630459 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499931 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:45:40.630459 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499934 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:45:40.630459 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499936 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:45:40.630459 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499939 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:45:40.630459 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499941 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:45:40.630459 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499944 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:45:40.630459 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499946 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:45:40.630459 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499948 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:45:40.630459 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499951 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:45:40.630459 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.499953 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:45:40.630459 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502454 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:45:40.630459 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502462 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:45:40.630459 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502466 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:45:40.630459 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502469 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:45:40.630459 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502473 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:45:40.630459 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502477 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:45:40.630459 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502480 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:45:40.603176 ip-10-0-135-240 systemd[1]: Started Kubernetes Kubelet. Jul 08 18:45:40.631442 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502482 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:45:40.631442 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502485 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:45:40.631442 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502488 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:45:40.631442 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502490 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:45:40.631442 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502493 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:45:40.631442 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502496 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:45:40.631442 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502499 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:45:40.631442 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502502 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:45:40.631442 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502505 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:45:40.631442 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502507 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:45:40.631442 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502510 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:45:40.631442 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502513 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:45:40.631442 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502515 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:45:40.631442 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502518 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:45:40.631442 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502521 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:45:40.631442 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502524 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:45:40.631442 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502527 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:45:40.631442 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502529 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:45:40.631442 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502532 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:45:40.631442 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502535 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:45:40.632560 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502537 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:45:40.632560 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502540 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:45:40.632560 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502542 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:45:40.632560 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502545 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:45:40.632560 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502547 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:45:40.632560 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502550 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:45:40.632560 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502552 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:45:40.632560 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502555 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:45:40.632560 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502558 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:45:40.632560 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502560 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:45:40.632560 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502563 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:45:40.632560 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502566 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:45:40.632560 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502569 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:45:40.632560 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502572 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:45:40.632560 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502575 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:45:40.632560 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502577 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:45:40.632560 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502580 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:45:40.632560 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502582 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:45:40.632560 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502585 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:45:40.633819 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502588 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:45:40.633819 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502591 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:45:40.633819 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502595 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:45:40.633819 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502599 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:45:40.633819 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502603 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:45:40.633819 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502606 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:45:40.633819 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502610 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:45:40.633819 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502613 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:45:40.633819 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502616 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:45:40.633819 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502618 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:45:40.633819 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502621 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:45:40.633819 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502624 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:45:40.633819 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502627 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:45:40.633819 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502629 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:45:40.633819 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502632 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:45:40.633819 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502634 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:45:40.633819 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502637 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:45:40.633819 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502639 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:45:40.633819 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502642 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:45:40.634679 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502644 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:45:40.634679 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502647 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:45:40.634679 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502651 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:45:40.634679 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502654 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:45:40.634679 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502659 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:45:40.634679 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502661 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:45:40.634679 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502667 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:45:40.634679 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502670 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:45:40.634679 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502674 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:45:40.634679 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502676 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:45:40.634679 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502679 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:45:40.634679 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502681 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:45:40.634679 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502684 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:45:40.634679 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502686 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:45:40.634679 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502689 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:45:40.634679 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502691 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:45:40.634679 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502694 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:45:40.634679 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502696 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:45:40.634679 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502699 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:45:40.635730 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502702 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:45:40.635730 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502704 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:45:40.635730 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502707 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:45:40.635730 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502709 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:45:40.635730 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502712 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:45:40.635730 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502715 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:45:40.635730 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502717 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:45:40.635730 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502720 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:45:40.635730 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502722 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:45:40.635730 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502725 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:45:40.635730 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502727 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:45:40.635730 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502730 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:45:40.635730 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502732 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:45:40.635730 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502735 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:45:40.635730 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.502738 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:45:40.635730 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503130 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:45:40.635730 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503134 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:45:40.635730 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503138 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:45:40.635730 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503141 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:45:40.635730 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503144 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:45:40.636413 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503148 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:45:40.636413 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503152 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:45:40.636413 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503155 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:45:40.636413 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503158 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:45:40.636413 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503160 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:45:40.636413 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503163 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:45:40.636413 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503165 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:45:40.636413 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503168 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:45:40.636413 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503170 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:45:40.636413 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503173 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:45:40.636413 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503175 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:45:40.636413 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503178 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:45:40.636413 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503180 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:45:40.636413 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503183 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:45:40.636413 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503185 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:45:40.636413 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503188 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:45:40.636413 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503190 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:45:40.636413 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503194 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:45:40.636413 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503197 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:45:40.636413 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503199 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:45:40.637101 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503202 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:45:40.637101 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503204 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:45:40.637101 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503207 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:45:40.637101 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503209 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:45:40.637101 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503211 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:45:40.637101 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503214 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:45:40.637101 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503216 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:45:40.637101 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503219 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:45:40.637101 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503221 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:45:40.637101 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503225 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:45:40.637101 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503228 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:45:40.637101 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503230 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:45:40.637101 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503233 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:45:40.637101 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503236 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:45:40.637101 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503238 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:45:40.637101 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503241 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:45:40.637101 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503244 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:45:40.637101 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503246 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:45:40.637101 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503248 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:45:40.637101 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503250 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:45:40.637740 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503254 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:45:40.637740 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503258 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:45:40.637740 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503260 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:45:40.637740 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503262 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:45:40.637740 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503265 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:45:40.637740 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503267 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:45:40.637740 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503270 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:45:40.637740 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503272 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:45:40.637740 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503274 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:45:40.637740 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503278 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:45:40.637740 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503280 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:45:40.637740 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503283 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:45:40.637740 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503287 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:45:40.637740 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503291 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:45:40.637740 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503294 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:45:40.637740 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503297 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:45:40.637740 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503299 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:45:40.637740 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503302 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:45:40.637740 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503305 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:45:40.638372 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503308 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:45:40.638372 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503311 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:45:40.638372 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503315 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:45:40.638372 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503317 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:45:40.638372 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503320 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:45:40.638372 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503322 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:45:40.638372 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503325 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:45:40.638372 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503327 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:45:40.638372 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503330 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:45:40.638372 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503332 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:45:40.638372 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503335 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:45:40.638372 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503337 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:45:40.638372 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503339 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:45:40.638372 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503342 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:45:40.638372 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503344 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:45:40.638372 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503347 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:45:40.638372 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503349 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:45:40.638372 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503351 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:45:40.638372 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503354 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:45:40.638372 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503357 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:45:40.638972 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503360 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:45:40.638972 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503362 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:45:40.638972 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503367 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:45:40.638972 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503369 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:45:40.638972 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503372 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:45:40.638972 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503374 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:45:40.638972 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503377 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:45:40.638972 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503379 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:45:40.638972 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503382 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:45:40.638972 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503384 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:45:40.638972 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503387 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:45:40.638972 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503389 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:45:40.638972 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503391 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:45:40.638972 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503409 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:45:40.638972 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.503414 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:45:40.638972 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503486 2552 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 18:45:40.638972 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503500 2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 18:45:40.638972 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503510 2552 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 18:45:40.638972 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503516 2552 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 18:45:40.638972 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503523 2552 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 18:45:40.638972 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503528 2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503533 2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503538 2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503541 2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503544 2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503547 2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503550 2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503553 2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503556 2552 flags.go:64] FLAG: --cgroup-root="" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503559 2552 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503562 2552 flags.go:64] FLAG: --client-ca-file="" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503564 2552 flags.go:64] FLAG: --cloud-provider="external" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503567 2552 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503571 2552 flags.go:64] FLAG: --cluster-domain="" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503575 2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503579 2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503582 2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503585 2552 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503588 2552 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503591 2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503595 2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503598 2552 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503601 2552 flags.go:64] FLAG: --contention-profiling="false" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503603 2552 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 18:45:40.639697 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503606 2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503609 2552 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503613 2552 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503618 2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503621 2552 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503623 2552 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503626 2552 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503629 2552 flags.go:64] FLAG: --enable-server="true" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503632 2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503637 2552 flags.go:64] FLAG: --event-burst="100" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503640 2552 flags.go:64] FLAG: --event-qps="50" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503643 2552 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503646 2552 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503649 2552 flags.go:64] FLAG: --eviction-hard="" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503653 2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503655 2552 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503658 2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503661 2552 flags.go:64] FLAG: --eviction-soft="" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503664 2552 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503666 2552 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503669 2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503672 2552 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503676 2552 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503679 2552 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503682 2552 flags.go:64] FLAG: --feature-gates="" Jul 08 18:45:40.640599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503686 2552 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503689 2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503692 2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503696 2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503699 2552 flags.go:64] FLAG: --healthz-port="10248" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503702 2552 flags.go:64] FLAG: --help="false" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503704 2552 flags.go:64] FLAG: --hostname-override="ip-10-0-135-240.ec2.internal" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503707 2552 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503710 2552 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503715 2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503718 2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503722 2552 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503725 2552 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503728 2552 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503730 2552 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503733 2552 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503736 2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503739 2552 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503742 2552 flags.go:64] FLAG: --kube-reserved="" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503745 2552 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503747 2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503750 2552 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503753 2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503755 2552 flags.go:64] FLAG: --lock-file="" Jul 08 18:45:40.641920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503758 2552 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503761 2552 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503764 2552 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503769 2552 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503772 2552 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503775 2552 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503778 2552 flags.go:64] FLAG: --logging-format="text" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503781 2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503785 2552 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503788 2552 flags.go:64] FLAG: --manifest-url="" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503791 2552 flags.go:64] FLAG: --manifest-url-header="" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503795 2552 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503798 2552 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503801 2552 flags.go:64] FLAG: --max-pods="110" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503804 2552 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503807 2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503810 2552 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503815 2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503817 2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503820 2552 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503823 2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503830 2552 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503833 2552 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503836 2552 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 18:45:40.642778 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503839 2552 flags.go:64] FLAG: --pod-cidr="" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503842 2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503847 2552 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503849 2552 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503852 2552 flags.go:64] FLAG: --pods-per-core="0" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503855 2552 flags.go:64] FLAG: --port="10250" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503858 2552 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503861 2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09ae92c2d72a43b08" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503864 2552 flags.go:64] FLAG: --qos-reserved="" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503867 2552 flags.go:64] FLAG: --read-only-port="10255" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503870 2552 flags.go:64] FLAG: --register-node="true" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503872 2552 flags.go:64] FLAG: --register-with-taints="" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503876 2552 flags.go:64] FLAG: --registry-burst="10" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503879 2552 flags.go:64] FLAG: --registry-qps="5" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503883 2552 flags.go:64] FLAG: --reserved-cpus="" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503886 2552 flags.go:64] FLAG: --reserved-memory="" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503889 2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503892 2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503895 2552 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503898 2552 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503900 2552 flags.go:64] FLAG: --runonce="false" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503903 2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503906 2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503909 2552 flags.go:64] FLAG: --seccomp-default="false" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503912 2552 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 18:45:40.643628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503915 2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503918 2552 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503922 2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503925 2552 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503927 2552 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503930 2552 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503933 2552 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503935 2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503938 2552 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503942 2552 flags.go:64] FLAG: --system-cgroups="" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503944 2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503949 2552 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503952 2552 flags.go:64] FLAG: --tls-cert-file="" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503955 2552 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503959 2552 flags.go:64] FLAG: --tls-min-version="" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503962 2552 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503964 2552 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503967 2552 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503970 2552 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503973 2552 flags.go:64] FLAG: --v="2" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503976 2552 flags.go:64] FLAG: --version="false" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503981 2552 flags.go:64] FLAG: --vmodule="" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503986 2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.503989 2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504109 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:45:40.646961 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504113 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:45:40.647997 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504116 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:45:40.647997 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504120 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:45:40.647997 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504123 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:45:40.647997 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504126 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:45:40.647997 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504129 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:45:40.647997 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504131 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:45:40.647997 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504135 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:45:40.647997 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504138 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:45:40.647997 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504140 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:45:40.647997 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504142 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:45:40.647997 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504145 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:45:40.647997 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504147 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:45:40.647997 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504150 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:45:40.647997 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504152 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:45:40.647997 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504155 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:45:40.647997 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504157 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:45:40.647997 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504160 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:45:40.647997 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504162 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:45:40.647997 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504165 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:45:41.960604 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504167 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:45:41.960604 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504170 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:45:41.960604 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504172 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:45:41.960604 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504174 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:45:41.960604 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504177 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:45:41.960604 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504179 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:45:41.960604 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504182 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:45:41.960604 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504184 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:45:41.960604 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504188 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:45:41.960604 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504191 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:45:41.960604 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504193 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:45:41.960604 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504197 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:45:41.960604 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504201 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:45:41.960604 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504204 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:45:41.960604 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504206 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:45:41.960604 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504209 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:45:41.960604 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504212 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:45:41.960604 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504215 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:45:41.960604 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504217 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:45:41.986902 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504221 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:45:41.986902 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504224 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:45:41.986902 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504226 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:45:41.986902 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504229 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:45:41.986902 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504231 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:45:41.986902 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504234 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:45:41.986902 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504236 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:45:41.986902 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504239 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:45:41.986902 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504242 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:45:41.986902 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504244 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:45:41.986902 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504246 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:45:41.986902 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504249 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:45:41.986902 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504252 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:45:41.986902 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504254 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:45:41.986902 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504257 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:45:41.986902 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504259 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:45:41.986902 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504262 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:45:41.986902 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504264 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:45:41.986902 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504267 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:45:41.986902 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504269 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:45:41.987815 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504271 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:45:41.987815 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504275 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:45:41.987815 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504278 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:45:41.987815 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504280 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:45:41.987815 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504283 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:45:41.987815 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504285 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:45:41.987815 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504288 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:45:41.987815 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504290 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:45:41.987815 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504293 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:45:41.987815 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504295 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:45:41.987815 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504298 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:45:41.987815 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504300 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:45:41.987815 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504305 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:45:41.987815 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504309 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:45:41.987815 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504311 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:45:41.987815 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504314 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:45:41.987815 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504316 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:45:41.987815 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504319 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:45:41.987815 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504322 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:45:41.987815 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504324 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:45:41.988820 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504327 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:45:41.988820 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504329 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:45:41.988820 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504331 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:45:41.988820 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504334 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:45:41.988820 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504337 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:45:41.988820 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504339 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:45:41.988820 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504342 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:45:41.988820 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504344 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:45:41.988820 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504346 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:45:41.988820 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504349 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:45:41.988820 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504351 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:45:41.988820 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504354 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:45:41.988820 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504356 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:45:41.988820 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504360 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:45:41.988820 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504363 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:45:41.988820 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504365 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:45:41.988820 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504367 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:45:41.988820 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504370 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:45:41.988820 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.504372 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:45:41.989581 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.504377 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 18:45:41.989581 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.526520 2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 18:45:41.989581 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.526536 2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 18:45:41.989581 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.527410 2552 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 18:45:41.989581 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.527418 2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 18:45:41.989581 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527477 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:45:41.989581 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527482 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:45:41.989581 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527485 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:45:41.989581 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527489 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:45:41.989581 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527492 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:45:41.989581 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527495 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:45:41.989581 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527498 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:45:41.989581 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527501 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:45:41.989581 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527504 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:45:41.989581 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527507 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:45:41.990391 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527510 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:45:41.990391 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527512 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:45:41.990391 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527522 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:45:41.990391 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527525 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:45:41.990391 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527528 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:45:41.990391 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527531 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:45:41.990391 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527534 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:45:41.990391 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527536 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:45:41.990391 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527539 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:45:41.990391 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527541 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:45:41.990391 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527544 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:45:41.990391 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527548 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:45:41.990391 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527551 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:45:41.990391 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527554 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:45:41.990391 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527556 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:45:41.990391 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527559 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:45:41.990391 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527562 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:45:41.990391 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527564 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:45:41.990391 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527567 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:45:41.990391 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527569 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:45:41.991007 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527572 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:45:41.991007 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527575 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:45:41.991007 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527578 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:45:41.991007 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527582 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:45:41.991007 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527585 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:45:41.991007 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527588 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:45:41.991007 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527591 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:45:41.991007 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527593 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:45:41.991007 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527595 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:45:41.991007 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527598 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:45:41.991007 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527601 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:45:41.991007 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527604 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:45:41.991007 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527607 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:45:41.991007 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527609 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:45:41.991007 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527612 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:45:41.991007 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527620 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:45:41.991007 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527623 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:45:41.991007 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527625 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:45:41.991007 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527628 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:45:41.991618 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527630 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:45:41.991618 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527632 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:45:41.991618 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527635 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:45:41.991618 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527637 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:45:41.991618 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527639 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:45:41.991618 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527642 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:45:41.991618 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527645 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:45:41.991618 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527647 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:45:41.991618 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527650 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:45:41.991618 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527653 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:45:41.991618 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527655 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:45:41.991618 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527658 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:45:41.991618 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527660 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:45:41.991618 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527663 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:45:41.991618 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527666 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:45:41.991618 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527669 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:45:41.991618 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527671 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:45:41.991618 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527674 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:45:41.991618 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527676 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:45:41.992224 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527680 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:45:41.992224 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527683 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:45:41.992224 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527686 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:45:41.992224 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527689 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:45:41.992224 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527691 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:45:41.992224 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527694 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:45:41.992224 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527697 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:45:41.992224 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527699 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:45:41.992224 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527702 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:45:41.992224 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527704 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:45:41.992224 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527712 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:45:41.992224 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527715 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:45:41.992224 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527717 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:45:41.992224 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527720 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:45:41.992224 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527722 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:45:41.992224 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527725 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:45:41.992224 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527728 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:45:41.992224 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527730 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:45:41.992224 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527733 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:45:41.992762 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527735 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:45:41.992762 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527738 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:45:41.992762 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527740 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:45:41.992762 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527743 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:45:41.992762 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527745 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:45:41.992762 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527748 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:45:41.992762 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527750 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:45:41.992762 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527753 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:45:41.992762 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527755 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:45:41.992762 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527758 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:45:41.992762 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527760 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:45:41.992762 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527763 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:45:41.992762 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.527768 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 18:45:41.992762 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527927 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 18:45:41.992762 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527932 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 18:45:41.993187 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527935 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 18:45:41.993187 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527938 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 18:45:41.993187 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527941 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 18:45:41.993187 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527943 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 18:45:41.993187 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527946 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 18:45:41.993187 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527949 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 18:45:41.993187 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527951 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 18:45:41.993187 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527954 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 18:45:41.993187 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527956 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 18:45:41.993187 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527964 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 18:45:41.993187 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527967 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 18:45:41.993187 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527970 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 18:45:41.993187 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527972 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 18:45:41.993187 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527974 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 18:45:41.993187 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527977 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 18:45:41.993187 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527979 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 18:45:41.993187 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527982 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 18:45:41.993187 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527984 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 18:45:41.993187 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527986 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 18:45:41.993187 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527989 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 08 18:45:41.993781 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527992 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 18:45:41.993781 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527994 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 18:45:41.993781 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527996 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 18:45:41.993781 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.527999 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 18:45:41.993781 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528001 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 18:45:41.993781 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528004 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 18:45:41.993781 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528007 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 18:45:41.993781 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528009 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 18:45:41.993781 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528012 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 18:45:41.993781 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528014 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 18:45:41.993781 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528016 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 18:45:41.993781 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528019 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 18:45:41.993781 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528021 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 18:45:41.993781 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528024 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 18:45:41.993781 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528026 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 18:45:41.993781 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528030 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 18:45:41.993781 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528033 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 18:45:41.993781 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528036 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 18:45:41.993781 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528038 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 18:45:41.993781 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528041 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 18:45:41.994347 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528043 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 18:45:41.994347 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528046 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 18:45:41.994347 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528055 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 18:45:41.994347 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528058 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 18:45:41.994347 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528060 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 18:45:41.994347 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528062 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 18:45:41.994347 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528065 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 18:45:41.994347 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528068 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 18:45:41.994347 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528070 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 18:45:41.994347 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528072 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 18:45:41.994347 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528075 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 18:45:41.994347 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528077 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 18:45:41.994347 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528080 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 18:45:41.994347 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528083 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 18:45:41.994347 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528085 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 18:45:41.994347 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528087 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 18:45:41.994347 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528090 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 18:45:41.994347 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528092 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 18:45:41.994347 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528095 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 18:45:41.994347 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528097 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 18:45:41.994926 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528099 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 18:45:41.994926 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528102 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 18:45:41.994926 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528104 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 18:45:41.994926 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528107 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 18:45:41.994926 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528111 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 18:45:41.994926 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528115 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 18:45:41.994926 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528117 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 18:45:41.994926 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528119 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 18:45:41.994926 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528122 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 18:45:41.994926 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528125 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 18:45:41.994926 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528127 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 18:45:41.994926 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528129 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 18:45:41.994926 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528132 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 18:45:41.994926 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528134 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 18:45:41.994926 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528136 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 18:45:41.994926 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528145 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 18:45:41.994926 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528147 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 18:45:41.994926 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528150 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 18:45:41.994926 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528152 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 18:45:41.995472 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528154 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 18:45:41.995472 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528157 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 18:45:41.995472 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528159 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 18:45:41.995472 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528162 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 18:45:41.995472 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528167 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 18:45:41.995472 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528171 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 18:45:41.995472 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528173 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 18:45:41.995472 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528177 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 18:45:41.995472 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528180 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 18:45:41.995472 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528183 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 18:45:41.995472 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528187 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 18:45:41.995472 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528189 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 18:45:41.995472 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528192 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 18:45:41.995472 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528195 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 18:45:41.995472 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528198 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 18:45:41.995472 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528200 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 18:45:41.995472 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528203 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 18:45:41.995472 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:40.528205 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 18:45:41.995988 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.528210 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 18:45:41.995988 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.528311 2552 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 18:45:41.995988 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.530552 2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 18:45:41.995988 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.531972 2552 server.go:1019] "Starting client certificate rotation" Jul 08 18:45:41.995988 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.532070 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 18:45:41.995988 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.534393 2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 18:45:41.995988 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.544443 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 18:45:41.995988 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.546722 2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 18:45:41.995988 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.554058 2552 log.go:25] "Validated CRI v1 runtime API" Jul 08 18:45:41.995988 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.559657 2552 log.go:25] "Validated CRI v1 image API" Jul 08 18:45:41.995988 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.561704 2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 18:45:41.995988 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.564853 2552 fs.go:135] Filesystem UUIDs: map[43d36903-b7f8-4cd3-82d8-58ffc9194b19:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 af588ba3-bc01-47d2-b76f-6b3b156e493e:/dev/nvme0n1p3] Jul 08 18:45:41.996347 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.564867 2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 18:45:41.996447 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.570144 2552 manager.go:216] Machine: {Timestamp:2026-07-08 18:45:40.568834923 +0000 UTC m=+0.473111782 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3181974 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec234cd1b8dfc59dac4700f60ec9d13c SystemUUID:ec234cd1-b8df-c59d-ac47-00f60ec9d13c BootID:9de3aa32-57ce-4991-a7ef-96159c7841b1 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:33:26:9a:3a:cd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:33:26:9a:3a:cd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:fb:17:f2:36:58 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 18:45:41.996447 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.570246 2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 18:45:41.996447 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.570317 2552 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 18:45:41.996447 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.578817 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 18:45:41.996447 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.584021 2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 18:45:41.996447 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.584052 2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-240.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 18:45:41.996447 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.585412 2552 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.585423 2552 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.585430 2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.585440 2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.586950 2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.589810 2552 state_mem.go:36] "Initialized new in-memory state store" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.589921 2552 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.589949 2552 kubelet.go:486] "Attempting to sync node with API server" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.589958 2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.589969 2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.589978 2552 kubelet.go:398] "Adding apiserver pod source" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.589986 2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.590306 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.590321 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.592635 2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.594601 2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.594637 2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.595838 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.595857 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.595865 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.595872 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.595885 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.595890 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.595898 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.595903 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.595910 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.595915 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.595928 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.595933 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.595957 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.595962 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.601231 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r872n" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.602101 2552 server.go:1268] "Started kubelet" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.602896 2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.603000 2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.603151 2552 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.605357 2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.605690 2552 server.go:310] "Adding debug handlers to kubelet server" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:40.608156 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.608181 2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-240.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 18:45:41.996694 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:40.608196 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-240.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:40.610472 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-240.ec2.internal.18c064da2995e4cf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-240.ec2.internal,UID:ip-10-0-135-240.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-240.ec2.internal,},FirstTimestamp:2026-07-08 18:45:40.602053839 +0000 UTC m=+0.506330700,LastTimestamp:2026-07-08 18:45:40.602053839 +0000 UTC m=+0.506330700,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-240.ec2.internal,}" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.611624 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-r872n" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:40.616066 2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.616838 2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.616862 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:40.617033 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.617761 2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.617761 2552 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.617798 2552 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.617871 2552 reconstruct.go:97] "Volume reconstruction finished" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.617881 2552 reconciler.go:29] "Reconciler: start to sync state" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.618005 2552 factory.go:55] Registering systemd factory Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.618184 2552 factory.go:223] Registration of the systemd container factory successfully Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.618391 2552 factory.go:153] Registering CRI-O factory Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.618418 2552 factory.go:223] Registration of the crio container factory successfully Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.618494 2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.618512 2552 factory.go:103] Registering Raw factory Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.618527 2552 manager.go:1196] Started watching for new ooms in manager Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.618952 2552 manager.go:349] Starting recovery of all containers Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.628517 2552 manager.go:354] Recovery completed Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.635012 2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.637003 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:40.637965 2552 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-240.ec2.internal\" not found" node="ip-10-0-135-240.ec2.internal" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.639246 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.639272 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.639290 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.639788 2552 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.639799 2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.639803 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.639817 2552 state_mem.go:36] "Initialized new in-memory state store" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.640983 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.641008 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.641027 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.648498 2552 policy_none.go:49] "None policy: Start" Jul 08 18:45:41.997834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.648515 2552 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.648528 2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.650326 2552 policy_none.go:47] "Start" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.701904 2552 manager.go:337] "Starting Device Plugin manager" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:40.701930 2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.701939 2552 server.go:87] "Starting device plugin registration server" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.702140 2552 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.702152 2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.702249 2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.702338 2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:40.702348 2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:40.702780 2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:40.702833 2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-240.ec2.internal\" not found" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:41.946316 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:41.947276 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:41.947307 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:41.947320 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:41.947346 2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-240.ec2.internal" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:41.954091 2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-240.ec2.internal" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:41.954107 2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-240.ec2.internal\": node \"ip-10-0-135-240.ec2.internal\" not found" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:41.979703 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:41.983389 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:41.984534 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:41.984575 2552 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:41.984597 2552 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:41.984634 2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 18:45:41.999058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:41.987179 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:45:42.143724 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:42.080173 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Jul 08 18:45:42.143724 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.085308 2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal"] Jul 08 18:45:42.143724 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.085386 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:45:42.143724 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.086852 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:45:42.143724 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.086875 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:45:42.143724 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.086885 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:45:42.143724 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.088142 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:45:42.143724 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.088254 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" Jul 08 18:45:42.143724 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.088279 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:45:42.143724 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.088803 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:45:42.143724 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.088808 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:45:42.143724 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.088825 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:45:42.143724 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.088830 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:45:42.143724 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.088835 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:45:42.143724 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.088839 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:45:42.143724 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.096447 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" Jul 08 18:45:42.143724 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.096470 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 18:45:42.143724 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.097099 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientMemory" Jul 08 18:45:42.143724 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.097133 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 18:45:42.143724 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.097144 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeHasSufficientPID" Jul 08 18:45:42.143724 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:42.111622 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-240.ec2.internal\" not found" node="ip-10-0-135-240.ec2.internal" Jul 08 18:45:42.143724 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:42.117106 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-240.ec2.internal\" not found" node="ip-10-0-135-240.ec2.internal" Jul 08 18:45:42.252569 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.163431 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7a8689016a7f8195ba0457e3c7b1972e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"7a8689016a7f8195ba0457e3c7b1972e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" Jul 08 18:45:42.252569 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.163452 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a8689016a7f8195ba0457e3c7b1972e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"7a8689016a7f8195ba0457e3c7b1972e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" Jul 08 18:45:42.252569 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.163469 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b12c154aed0715acfb2aca1c887480a-config\") pod \"kube-apiserver-proxy-ip-10-0-135-240.ec2.internal\" (UID: \"3b12c154aed0715acfb2aca1c887480a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" Jul 08 18:45:42.252569 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:42.180337 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Jul 08 18:45:42.385926 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.263740 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7a8689016a7f8195ba0457e3c7b1972e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"7a8689016a7f8195ba0457e3c7b1972e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" Jul 08 18:45:42.385926 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.263760 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a8689016a7f8195ba0457e3c7b1972e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"7a8689016a7f8195ba0457e3c7b1972e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" Jul 08 18:45:42.385926 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.263776 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b12c154aed0715acfb2aca1c887480a-config\") pod \"kube-apiserver-proxy-ip-10-0-135-240.ec2.internal\" (UID: \"3b12c154aed0715acfb2aca1c887480a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" Jul 08 18:45:42.385926 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.263814 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b12c154aed0715acfb2aca1c887480a-config\") pod \"kube-apiserver-proxy-ip-10-0-135-240.ec2.internal\" (UID: \"3b12c154aed0715acfb2aca1c887480a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" Jul 08 18:45:42.385926 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.263838 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7a8689016a7f8195ba0457e3c7b1972e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"7a8689016a7f8195ba0457e3c7b1972e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" Jul 08 18:45:42.385926 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.263851 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a8689016a7f8195ba0457e3c7b1972e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal\" (UID: \"7a8689016a7f8195ba0457e3c7b1972e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" Jul 08 18:45:42.385926 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:42.280848 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Jul 08 18:45:42.385926 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:42.381302 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Jul 08 18:45:42.535605 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.415455 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" Jul 08 18:45:42.535605 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.420221 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" Jul 08 18:45:42.535605 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:42.481388 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Jul 08 18:45:42.695753 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:42.581796 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Jul 08 18:45:42.695753 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.675155 2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 18:45:42.695753 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.675270 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 18:45:42.695753 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.675304 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 18:45:42.695753 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:42.682449 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-240.ec2.internal\" not found" Jul 08 18:45:42.699447 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.699256 2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.708452 2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.734540 2552 apiserver.go:52] "Watching apiserver" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.748469 2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.749222 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-8qr2f","openshift-dns/node-resolver-vltc2","openshift-multus/multus-additional-cni-plugins-9qxxv","openshift-multus/multus-rqb8d","openshift-network-diagnostics/network-check-target-hh4t4","openshift-network-operator/iptables-alerter-rjfrp","kube-system/konnectivity-agent-q62zb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb","openshift-cluster-node-tuning-operator/tuned-7dk5j","openshift-image-registry/node-ca-5kll8","openshift-multus/network-metrics-daemon-qwpjz","openshift-ovn-kubernetes/ovnkube-node-z5c8p"] Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.750829 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.751848 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rjfrp" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.753130 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.754383 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:42.754432 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qwpjz" podUID="5f414ab9-ae98-4c7e-9edc-962d4bc015d9" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.754696 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8h6vb\"" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.754703 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.754791 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.754804 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.754908 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-k5xft\"" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.754985 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.755106 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.755237 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.755256 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.755592 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:42.755636 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qr2f" podUID="b70588ff-d41a-450a-a622-d06fd0318b56" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.756788 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vltc2" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.758532 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.759170 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-tmwpx\"" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.759372 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.759511 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 18:45:42.840766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.759744 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:42.759780 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hh4t4" podUID="12465724-278f-4b3a-b9d2-88970e1b8d66" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.760785 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.761248 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.763212 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q62zb" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.763959 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.763966 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4l8nw\"" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.763987 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.764050 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-62hzz\"" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.764064 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.764072 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.764322 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.764353 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5kll8" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.764424 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.765013 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 18:40:41 +0000 UTC" deadline="2028-01-25 22:57:37.422340875 +0000 UTC" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.765041 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13588h11m54.657301892s" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.765206 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.765606 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.767576 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-etc-systemd\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.767595 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-system-cni-dir\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.767627 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-cnibin\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.767640 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-etc-kubernetes\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.767663 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q55k\" (UniqueName: \"kubernetes.io/projected/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-kube-api-access-5q55k\") pod \"network-metrics-daemon-qwpjz\" (UID: \"5f414ab9-ae98-4c7e-9edc-962d4bc015d9\") " pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:45:42.841690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.767705 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-var-lib-kubelet\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.842599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.767722 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/498a2710-8c76-47ef-9e2c-e6c9ceeb59db-registration-dir\") pod \"aws-ebs-csi-driver-node-5j2sb\" (UID: \"498a2710-8c76-47ef-9e2c-e6c9ceeb59db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:42.842599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.767750 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-etc-modprobe-d\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.842599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.767787 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-tmp\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.842599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.767821 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/498a2710-8c76-47ef-9e2c-e6c9ceeb59db-sys-fs\") pod \"aws-ebs-csi-driver-node-5j2sb\" (UID: \"498a2710-8c76-47ef-9e2c-e6c9ceeb59db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:42.842599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.767845 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-cni-binary-copy\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.842599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.767865 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhmbc\" (UniqueName: \"kubernetes.io/projected/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-kube-api-access-xhmbc\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.842599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.767880 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld27d\" (UniqueName: \"kubernetes.io/projected/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-kube-api-access-ld27d\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.842599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.767909 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/498a2710-8c76-47ef-9e2c-e6c9ceeb59db-device-dir\") pod \"aws-ebs-csi-driver-node-5j2sb\" (UID: \"498a2710-8c76-47ef-9e2c-e6c9ceeb59db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:42.842599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.767948 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b70588ff-d41a-450a-a622-d06fd0318b56-dbus\") pod \"global-pull-secret-syncer-8qr2f\" (UID: \"b70588ff-d41a-450a-a622-d06fd0318b56\") " pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:42.842599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.767973 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9466f79e-04ce-4d16-8de0-2e66e513a1b8-hosts-file\") pod \"node-resolver-vltc2\" (UID: \"9466f79e-04ce-4d16-8de0-2e66e513a1b8\") " pod="openshift-dns/node-resolver-vltc2" Jul 08 18:45:42.842599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768014 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-etc-sysctl-conf\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.842599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768037 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-system-cni-dir\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.842599 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768064 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2dad08be-2638-441c-842b-02e30a159a77-host-slash\") pod \"iptables-alerter-rjfrp\" (UID: \"2dad08be-2638-441c-842b-02e30a159a77\") " pod="openshift-network-operator/iptables-alerter-rjfrp" Jul 08 18:45:42.843080 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768078 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9z75\" (UniqueName: \"kubernetes.io/projected/2dad08be-2638-441c-842b-02e30a159a77-kube-api-access-x9z75\") pod \"iptables-alerter-rjfrp\" (UID: \"2dad08be-2638-441c-842b-02e30a159a77\") " pod="openshift-network-operator/iptables-alerter-rjfrp" Jul 08 18:45:42.843080 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768095 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-sys\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.843080 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768152 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b70588ff-d41a-450a-a622-d06fd0318b56-kubelet-config\") pod \"global-pull-secret-syncer-8qr2f\" (UID: \"b70588ff-d41a-450a-a622-d06fd0318b56\") " pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:42.843080 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768169 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret\") pod \"global-pull-secret-syncer-8qr2f\" (UID: \"b70588ff-d41a-450a-a622-d06fd0318b56\") " pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:42.843080 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768185 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.843080 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768199 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-host-run-multus-certs\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.843080 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768215 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2dad08be-2638-441c-842b-02e30a159a77-iptables-alerter-script\") pod \"iptables-alerter-rjfrp\" (UID: \"2dad08be-2638-441c-842b-02e30a159a77\") " pod="openshift-network-operator/iptables-alerter-rjfrp" Jul 08 18:45:42.843080 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768231 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-run\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.843080 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768246 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/498a2710-8c76-47ef-9e2c-e6c9ceeb59db-etc-selinux\") pod \"aws-ebs-csi-driver-node-5j2sb\" (UID: \"498a2710-8c76-47ef-9e2c-e6c9ceeb59db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:42.843080 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768272 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9466f79e-04ce-4d16-8de0-2e66e513a1b8-tmp-dir\") pod \"node-resolver-vltc2\" (UID: \"9466f79e-04ce-4d16-8de0-2e66e513a1b8\") " pod="openshift-dns/node-resolver-vltc2" Jul 08 18:45:42.843080 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768708 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-multus-cni-dir\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.843080 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768736 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 18:45:42.843080 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768782 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 18:45:42.843080 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768802 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 18:45:42.843080 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768825 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 18:45:42.843080 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768850 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8rg6t\"" Jul 08 18:45:42.843080 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768878 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 18:45:42.843746 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768951 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 18:45:42.843746 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768738 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-host-run-k8s-cni-cncf-io\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.843746 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.768956 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:45:42.843746 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.769633 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-etc-tuned\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.843746 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.769680 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpzfb\" (UniqueName: \"kubernetes.io/projected/498a2710-8c76-47ef-9e2c-e6c9ceeb59db-kube-api-access-mpzfb\") pod \"aws-ebs-csi-driver-node-5j2sb\" (UID: \"498a2710-8c76-47ef-9e2c-e6c9ceeb59db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:42.843746 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.769719 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-os-release\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.843746 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.769754 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-hostroot\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.843746 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.769876 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-etc-sysconfig\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.843746 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.769905 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-lib-modules\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.843746 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.769967 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-multus-daemon-config\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.843746 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.770166 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-cnibin\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.843746 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.770285 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 18:45:42.843746 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.770362 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nkrbf\"" Jul 08 18:45:42.843746 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.770453 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lm64s\"" Jul 08 18:45:42.843746 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.770593 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-etc-sysctl-d\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.843746 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.770613 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 18:45:42.843746 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.770662 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbb6j\" (UniqueName: \"kubernetes.io/projected/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-kube-api-access-cbb6j\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.843746 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.770712 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 18:45:42.844379 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.770757 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnqrs\" (UniqueName: \"kubernetes.io/projected/9466f79e-04ce-4d16-8de0-2e66e513a1b8-kube-api-access-lnqrs\") pod \"node-resolver-vltc2\" (UID: \"9466f79e-04ce-4d16-8de0-2e66e513a1b8\") " pod="openshift-dns/node-resolver-vltc2" Jul 08 18:45:42.844379 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.770805 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-os-release\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.844379 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.770876 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lph9l\"" Jul 08 18:45:42.844379 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.770925 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.844379 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.770976 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-cni-binary-copy\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.844379 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.771019 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-multus-conf-dir\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.844379 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.771072 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs\") pod \"network-metrics-daemon-qwpjz\" (UID: \"5f414ab9-ae98-4c7e-9edc-962d4bc015d9\") " pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:45:42.844379 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.771108 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-etc-kubernetes\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.844379 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.771172 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nfgp\" (UniqueName: \"kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp\") pod \"network-check-target-hh4t4\" (UID: \"12465724-278f-4b3a-b9d2-88970e1b8d66\") " pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:45:42.844379 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.771203 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/498a2710-8c76-47ef-9e2c-e6c9ceeb59db-socket-dir\") pod \"aws-ebs-csi-driver-node-5j2sb\" (UID: \"498a2710-8c76-47ef-9e2c-e6c9ceeb59db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:42.844379 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.771228 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-host-var-lib-kubelet\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.844379 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.771282 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/834d498e-ff9e-42cd-af1d-fcf31aeffdb6-agent-certs\") pod \"konnectivity-agent-q62zb\" (UID: \"834d498e-ff9e-42cd-af1d-fcf31aeffdb6\") " pod="kube-system/konnectivity-agent-q62zb" Jul 08 18:45:42.844379 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.771318 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-host\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.844379 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.771355 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-multus-socket-dir-parent\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.844936 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.771380 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/498a2710-8c76-47ef-9e2c-e6c9ceeb59db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5j2sb\" (UID: \"498a2710-8c76-47ef-9e2c-e6c9ceeb59db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:42.844936 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.771477 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.844936 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.771572 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-host-run-netns\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.844936 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.771627 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/834d498e-ff9e-42cd-af1d-fcf31aeffdb6-konnectivity-ca\") pod \"konnectivity-agent-q62zb\" (UID: \"834d498e-ff9e-42cd-af1d-fcf31aeffdb6\") " pod="kube-system/konnectivity-agent-q62zb" Jul 08 18:45:42.844936 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.771656 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-host-var-lib-cni-bin\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.844936 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.771673 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-host-var-lib-cni-multus\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.844936 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.772174 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 18:45:42.844936 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.772909 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 18:45:42.844936 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.777459 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 18:45:42.844936 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.777515 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal"] Jul 08 18:45:42.844936 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.777521 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" Jul 08 18:45:42.844936 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.780275 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 18:45:42.844936 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.786649 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 18:45:42.844936 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.786787 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal"] Jul 08 18:45:42.844936 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.817132 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-f48l7" Jul 08 18:45:42.844936 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.826286 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-f48l7" Jul 08 18:45:42.950657 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.862942 2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 18:45:42.950657 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872135 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-etc-systemd\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.950657 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872158 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-system-cni-dir\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.950657 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872173 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-cnibin\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.950657 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872186 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-etc-kubernetes\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.950657 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872225 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-systemd-units\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:42.950657 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872248 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-system-cni-dir\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.950657 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872252 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q55k\" (UniqueName: \"kubernetes.io/projected/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-kube-api-access-5q55k\") pod \"network-metrics-daemon-qwpjz\" (UID: \"5f414ab9-ae98-4c7e-9edc-962d4bc015d9\") " pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:45:42.950657 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872252 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-cnibin\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.950657 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872263 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-etc-kubernetes\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.950657 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872302 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-var-lib-kubelet\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.950657 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872307 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-etc-systemd\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.950657 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872341 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/498a2710-8c76-47ef-9e2c-e6c9ceeb59db-registration-dir\") pod \"aws-ebs-csi-driver-node-5j2sb\" (UID: \"498a2710-8c76-47ef-9e2c-e6c9ceeb59db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:42.950657 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872394 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-var-lib-kubelet\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.950657 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872400 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-host-cni-bin\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:42.951597 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872449 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/498a2710-8c76-47ef-9e2c-e6c9ceeb59db-registration-dir\") pod \"aws-ebs-csi-driver-node-5j2sb\" (UID: \"498a2710-8c76-47ef-9e2c-e6c9ceeb59db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:42.951597 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872515 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-host-cni-netd\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:42.951597 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872547 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8cdb1905-6cff-40ae-845c-afca4715c0a8-env-overrides\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:42.951597 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872579 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-etc-modprobe-d\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.951597 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872608 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-tmp\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.951597 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872629 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/498a2710-8c76-47ef-9e2c-e6c9ceeb59db-sys-fs\") pod \"aws-ebs-csi-driver-node-5j2sb\" (UID: \"498a2710-8c76-47ef-9e2c-e6c9ceeb59db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:42.951597 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872655 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-cni-binary-copy\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.951597 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872679 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhmbc\" (UniqueName: \"kubernetes.io/projected/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-kube-api-access-xhmbc\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.951597 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872705 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld27d\" (UniqueName: \"kubernetes.io/projected/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-kube-api-access-ld27d\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.951597 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872726 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/498a2710-8c76-47ef-9e2c-e6c9ceeb59db-sys-fs\") pod \"aws-ebs-csi-driver-node-5j2sb\" (UID: \"498a2710-8c76-47ef-9e2c-e6c9ceeb59db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:42.951597 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872730 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-etc-modprobe-d\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.951597 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872733 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-node-log\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:42.951597 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872780 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/498a2710-8c76-47ef-9e2c-e6c9ceeb59db-device-dir\") pod \"aws-ebs-csi-driver-node-5j2sb\" (UID: \"498a2710-8c76-47ef-9e2c-e6c9ceeb59db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:42.951597 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872803 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b70588ff-d41a-450a-a622-d06fd0318b56-dbus\") pod \"global-pull-secret-syncer-8qr2f\" (UID: \"b70588ff-d41a-450a-a622-d06fd0318b56\") " pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:42.952134 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872824 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9466f79e-04ce-4d16-8de0-2e66e513a1b8-hosts-file\") pod \"node-resolver-vltc2\" (UID: \"9466f79e-04ce-4d16-8de0-2e66e513a1b8\") " pod="openshift-dns/node-resolver-vltc2" Jul 08 18:45:42.952134 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872868 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-run-ovn\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:42.952134 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872894 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cdb1905-6cff-40ae-845c-afca4715c0a8-ovn-node-metrics-cert\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:42.952134 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872938 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-etc-sysctl-conf\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.952134 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872965 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-system-cni-dir\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.952134 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872995 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-etc-openvswitch\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:42.952134 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873004 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/498a2710-8c76-47ef-9e2c-e6c9ceeb59db-device-dir\") pod \"aws-ebs-csi-driver-node-5j2sb\" (UID: \"498a2710-8c76-47ef-9e2c-e6c9ceeb59db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:42.952134 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.872966 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b70588ff-d41a-450a-a622-d06fd0318b56-dbus\") pod \"global-pull-secret-syncer-8qr2f\" (UID: \"b70588ff-d41a-450a-a622-d06fd0318b56\") " pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:42.952134 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873020 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2dad08be-2638-441c-842b-02e30a159a77-host-slash\") pod \"iptables-alerter-rjfrp\" (UID: \"2dad08be-2638-441c-842b-02e30a159a77\") " pod="openshift-network-operator/iptables-alerter-rjfrp" Jul 08 18:45:42.952134 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873004 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9466f79e-04ce-4d16-8de0-2e66e513a1b8-hosts-file\") pod \"node-resolver-vltc2\" (UID: \"9466f79e-04ce-4d16-8de0-2e66e513a1b8\") " pod="openshift-dns/node-resolver-vltc2" Jul 08 18:45:42.952134 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873016 2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 18:45:42.952134 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873058 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-system-cni-dir\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.952134 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873058 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9z75\" (UniqueName: \"kubernetes.io/projected/2dad08be-2638-441c-842b-02e30a159a77-kube-api-access-x9z75\") pod \"iptables-alerter-rjfrp\" (UID: \"2dad08be-2638-441c-842b-02e30a159a77\") " pod="openshift-network-operator/iptables-alerter-rjfrp" Jul 08 18:45:42.952134 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873090 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2dad08be-2638-441c-842b-02e30a159a77-host-slash\") pod \"iptables-alerter-rjfrp\" (UID: \"2dad08be-2638-441c-842b-02e30a159a77\") " pod="openshift-network-operator/iptables-alerter-rjfrp" Jul 08 18:45:42.952134 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873098 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-etc-sysctl-conf\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.952894 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873212 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-sys\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.952894 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873252 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b70588ff-d41a-450a-a622-d06fd0318b56-kubelet-config\") pod \"global-pull-secret-syncer-8qr2f\" (UID: \"b70588ff-d41a-450a-a622-d06fd0318b56\") " pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:42.952894 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873252 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-cni-binary-copy\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.952894 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873270 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret\") pod \"global-pull-secret-syncer-8qr2f\" (UID: \"b70588ff-d41a-450a-a622-d06fd0318b56\") " pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:42.952894 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873287 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-sys\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.952894 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873295 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.952894 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873335 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-host-run-multus-certs\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.952894 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873361 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b70588ff-d41a-450a-a622-d06fd0318b56-kubelet-config\") pod \"global-pull-secret-syncer-8qr2f\" (UID: \"b70588ff-d41a-450a-a622-d06fd0318b56\") " pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:42.952894 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873383 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:42.952894 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:42.873392 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:42.952894 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873420 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2dad08be-2638-441c-842b-02e30a159a77-iptables-alerter-script\") pod \"iptables-alerter-rjfrp\" (UID: \"2dad08be-2638-441c-842b-02e30a159a77\") " pod="openshift-network-operator/iptables-alerter-rjfrp" Jul 08 18:45:42.952894 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873420 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-host-run-multus-certs\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.952894 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873482 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-run\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.952894 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873486 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.952894 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873513 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/498a2710-8c76-47ef-9e2c-e6c9ceeb59db-etc-selinux\") pod \"aws-ebs-csi-driver-node-5j2sb\" (UID: \"498a2710-8c76-47ef-9e2c-e6c9ceeb59db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:42.953523 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:42.873586 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret podName:b70588ff-d41a-450a-a622-d06fd0318b56 nodeName:}" failed. No retries permitted until 2026-07-08 18:45:43.373544731 +0000 UTC m=+2.134100736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret") pod "global-pull-secret-syncer-8qr2f" (UID: "b70588ff-d41a-450a-a622-d06fd0318b56") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:42.953523 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873615 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9466f79e-04ce-4d16-8de0-2e66e513a1b8-tmp-dir\") pod \"node-resolver-vltc2\" (UID: \"9466f79e-04ce-4d16-8de0-2e66e513a1b8\") " pod="openshift-dns/node-resolver-vltc2" Jul 08 18:45:42.953523 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873628 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-run\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.953523 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873655 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-multus-cni-dir\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.953523 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873690 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/498a2710-8c76-47ef-9e2c-e6c9ceeb59db-etc-selinux\") pod \"aws-ebs-csi-driver-node-5j2sb\" (UID: \"498a2710-8c76-47ef-9e2c-e6c9ceeb59db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:42.953523 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873730 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-multus-cni-dir\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.953523 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873766 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-host-run-k8s-cni-cncf-io\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.953523 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873834 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-run-systemd\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:42.953523 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873856 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-host-run-k8s-cni-cncf-io\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.953523 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873902 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-var-lib-openvswitch\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:42.953523 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873932 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9466f79e-04ce-4d16-8de0-2e66e513a1b8-tmp-dir\") pod \"node-resolver-vltc2\" (UID: \"9466f79e-04ce-4d16-8de0-2e66e513a1b8\") " pod="openshift-dns/node-resolver-vltc2" Jul 08 18:45:42.953523 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873936 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-etc-tuned\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.953523 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.873969 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2dad08be-2638-441c-842b-02e30a159a77-iptables-alerter-script\") pod \"iptables-alerter-rjfrp\" (UID: \"2dad08be-2638-441c-842b-02e30a159a77\") " pod="openshift-network-operator/iptables-alerter-rjfrp" Jul 08 18:45:42.953523 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874015 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpzfb\" (UniqueName: \"kubernetes.io/projected/498a2710-8c76-47ef-9e2c-e6c9ceeb59db-kube-api-access-mpzfb\") pod \"aws-ebs-csi-driver-node-5j2sb\" (UID: \"498a2710-8c76-47ef-9e2c-e6c9ceeb59db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:42.954226 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874056 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-os-release\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.954226 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874081 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-hostroot\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.954226 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874108 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8cdb1905-6cff-40ae-845c-afca4715c0a8-ovnkube-config\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:42.954226 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874151 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-hostroot\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.954226 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874163 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8cdb1905-6cff-40ae-845c-afca4715c0a8-ovnkube-script-lib\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:42.954226 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874189 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c53b63f5-f85d-4d79-9b48-acc1ba69c016-host\") pod \"node-ca-5kll8\" (UID: \"c53b63f5-f85d-4d79-9b48-acc1ba69c016\") " pod="openshift-image-registry/node-ca-5kll8" Jul 08 18:45:42.954226 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874191 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-os-release\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.954226 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874240 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-etc-sysconfig\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.954226 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874269 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-lib-modules\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.954226 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874293 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-multus-daemon-config\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.954226 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874307 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-etc-sysconfig\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.954226 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874319 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-run-openvswitch\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:42.954226 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874360 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-log-socket\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:42.954226 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874386 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-cnibin\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.954226 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874388 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-lib-modules\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.955008 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874409 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-etc-sysctl-d\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.955008 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874434 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbb6j\" (UniqueName: \"kubernetes.io/projected/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-kube-api-access-cbb6j\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.955008 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874454 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-cnibin\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.955008 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874456 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnqrs\" (UniqueName: \"kubernetes.io/projected/9466f79e-04ce-4d16-8de0-2e66e513a1b8-kube-api-access-lnqrs\") pod \"node-resolver-vltc2\" (UID: \"9466f79e-04ce-4d16-8de0-2e66e513a1b8\") " pod="openshift-dns/node-resolver-vltc2" Jul 08 18:45:42.955008 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874496 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-os-release\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.955008 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874575 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.955008 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874605 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-cni-binary-copy\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.955008 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874629 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-multus-conf-dir\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.955008 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874654 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-host-slash\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:42.955008 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874683 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs\") pod \"network-metrics-daemon-qwpjz\" (UID: \"5f414ab9-ae98-4c7e-9edc-962d4bc015d9\") " pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:45:42.955008 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874703 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-etc-sysctl-d\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.955008 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874709 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-etc-kubernetes\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.955008 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874770 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-os-release\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.955008 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874764 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nfgp\" (UniqueName: \"kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp\") pod \"network-check-target-hh4t4\" (UID: \"12465724-278f-4b3a-b9d2-88970e1b8d66\") " pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:45:42.956058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874811 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xjgl\" (UniqueName: \"kubernetes.io/projected/8cdb1905-6cff-40ae-845c-afca4715c0a8-kube-api-access-2xjgl\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:42.956058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874834 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-multus-conf-dir\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.956058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874835 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-multus-daemon-config\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.956058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874858 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c53b63f5-f85d-4d79-9b48-acc1ba69c016-serviceca\") pod \"node-ca-5kll8\" (UID: \"c53b63f5-f85d-4d79-9b48-acc1ba69c016\") " pod="openshift-image-registry/node-ca-5kll8" Jul 08 18:45:42.956058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874913 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/498a2710-8c76-47ef-9e2c-e6c9ceeb59db-socket-dir\") pod \"aws-ebs-csi-driver-node-5j2sb\" (UID: \"498a2710-8c76-47ef-9e2c-e6c9ceeb59db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:42.956058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874939 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-host-var-lib-kubelet\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.956058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.874962 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/834d498e-ff9e-42cd-af1d-fcf31aeffdb6-agent-certs\") pod \"konnectivity-agent-q62zb\" (UID: \"834d498e-ff9e-42cd-af1d-fcf31aeffdb6\") " pod="kube-system/konnectivity-agent-q62zb" Jul 08 18:45:42.956058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.875026 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-host\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.956058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.875103 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-host-var-lib-kubelet\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.956058 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:42.875143 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:42.956058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.875196 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/498a2710-8c76-47ef-9e2c-e6c9ceeb59db-socket-dir\") pod \"aws-ebs-csi-driver-node-5j2sb\" (UID: \"498a2710-8c76-47ef-9e2c-e6c9ceeb59db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:42.956058 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:42.875206 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs podName:5f414ab9-ae98-4c7e-9edc-962d4bc015d9 nodeName:}" failed. No retries permitted until 2026-07-08 18:45:43.37518547 +0000 UTC m=+2.135741489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs") pod "network-metrics-daemon-qwpjz" (UID: "5f414ab9-ae98-4c7e-9edc-962d4bc015d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:42.956058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.875260 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-multus-socket-dir-parent\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.956058 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.875264 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-etc-kubernetes\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.956561 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.875284 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-host-run-netns\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:42.956561 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.875307 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/498a2710-8c76-47ef-9e2c-e6c9ceeb59db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5j2sb\" (UID: \"498a2710-8c76-47ef-9e2c-e6c9ceeb59db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:42.956561 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.875314 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-host\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.956561 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.875335 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.956561 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.875339 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-cni-binary-copy\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.956561 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.875349 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.956561 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.875357 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-host-run-netns\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.956561 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.875377 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-multus-socket-dir-parent\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.956561 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.875412 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/498a2710-8c76-47ef-9e2c-e6c9ceeb59db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5j2sb\" (UID: \"498a2710-8c76-47ef-9e2c-e6c9ceeb59db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:42.956561 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.875416 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:42.956561 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.875478 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hldjh\" (UniqueName: \"kubernetes.io/projected/c53b63f5-f85d-4d79-9b48-acc1ba69c016-kube-api-access-hldjh\") pod \"node-ca-5kll8\" (UID: \"c53b63f5-f85d-4d79-9b48-acc1ba69c016\") " pod="openshift-image-registry/node-ca-5kll8" Jul 08 18:45:42.956561 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.875527 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/834d498e-ff9e-42cd-af1d-fcf31aeffdb6-konnectivity-ca\") pod \"konnectivity-agent-q62zb\" (UID: \"834d498e-ff9e-42cd-af1d-fcf31aeffdb6\") " pod="kube-system/konnectivity-agent-q62zb" Jul 08 18:45:42.956561 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.875550 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-host-var-lib-cni-bin\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.956561 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.875876 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.957500 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.875971 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-host-var-lib-cni-bin\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.957500 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.876000 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-host-run-netns\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.957500 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.876012 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-host-var-lib-cni-multus\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.957500 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.876045 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-host-kubelet\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:42.957500 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.876089 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-host-var-lib-cni-multus\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.957500 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.876321 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-tmp\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.957500 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.876333 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-etc-tuned\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.957500 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.877439 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/834d498e-ff9e-42cd-af1d-fcf31aeffdb6-agent-certs\") pod \"konnectivity-agent-q62zb\" (UID: \"834d498e-ff9e-42cd-af1d-fcf31aeffdb6\") " pod="kube-system/konnectivity-agent-q62zb" Jul 08 18:45:42.957500 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.881047 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/834d498e-ff9e-42cd-af1d-fcf31aeffdb6-konnectivity-ca\") pod \"konnectivity-agent-q62zb\" (UID: \"834d498e-ff9e-42cd-af1d-fcf31aeffdb6\") " pod="kube-system/konnectivity-agent-q62zb" Jul 08 18:45:42.957500 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.886881 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q55k\" (UniqueName: \"kubernetes.io/projected/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-kube-api-access-5q55k\") pod \"network-metrics-daemon-qwpjz\" (UID: \"5f414ab9-ae98-4c7e-9edc-962d4bc015d9\") " pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:45:42.957500 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:42.889515 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:45:42.957500 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:42.889532 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:45:42.957500 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:42.889540 2552 projected.go:196] Error preparing data for projected volume kube-api-access-8nfgp for pod openshift-network-diagnostics/network-check-target-hh4t4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:42.957500 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:42.889581 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp podName:12465724-278f-4b3a-b9d2-88970e1b8d66 nodeName:}" failed. No retries permitted until 2026-07-08 18:45:43.389569528 +0000 UTC m=+2.150125545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8nfgp" (UniqueName: "kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp") pod "network-check-target-hh4t4" (UID: "12465724-278f-4b3a-b9d2-88970e1b8d66") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:42.958483 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.891289 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld27d\" (UniqueName: \"kubernetes.io/projected/aa0c7a77-7519-470b-b3ac-5fea0abdf1dd-kube-api-access-ld27d\") pod \"multus-rqb8d\" (UID: \"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd\") " pod="openshift-multus/multus-rqb8d" Jul 08 18:45:42.958483 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.891893 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhmbc\" (UniqueName: \"kubernetes.io/projected/bcaef550-9f6a-424b-a5b1-cfa8db9dce25-kube-api-access-xhmbc\") pod \"multus-additional-cni-plugins-9qxxv\" (UID: \"bcaef550-9f6a-424b-a5b1-cfa8db9dce25\") " pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:42.958483 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.893946 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9z75\" (UniqueName: \"kubernetes.io/projected/2dad08be-2638-441c-842b-02e30a159a77-kube-api-access-x9z75\") pod \"iptables-alerter-rjfrp\" (UID: \"2dad08be-2638-441c-842b-02e30a159a77\") " pod="openshift-network-operator/iptables-alerter-rjfrp" Jul 08 18:45:42.958483 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.896034 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnqrs\" (UniqueName: \"kubernetes.io/projected/9466f79e-04ce-4d16-8de0-2e66e513a1b8-kube-api-access-lnqrs\") pod \"node-resolver-vltc2\" (UID: \"9466f79e-04ce-4d16-8de0-2e66e513a1b8\") " pod="openshift-dns/node-resolver-vltc2" Jul 08 18:45:42.958483 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.896331 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbb6j\" (UniqueName: \"kubernetes.io/projected/3d2ae0f0-57f3-487c-87c3-b3dffd120b02-kube-api-access-cbb6j\") pod \"tuned-7dk5j\" (UID: \"3d2ae0f0-57f3-487c-87c3-b3dffd120b02\") " pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:42.958483 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.896401 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpzfb\" (UniqueName: \"kubernetes.io/projected/498a2710-8c76-47ef-9e2c-e6c9ceeb59db-kube-api-access-mpzfb\") pod \"aws-ebs-csi-driver-node-5j2sb\" (UID: \"498a2710-8c76-47ef-9e2c-e6c9ceeb59db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:42.958483 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.908479 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q62zb" Jul 08 18:45:42.958483 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.936736 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" Jul 08 18:45:43.046872 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977291 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.046872 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977330 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-run-systemd\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.046872 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977366 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-var-lib-openvswitch\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.046872 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977387 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8cdb1905-6cff-40ae-845c-afca4715c0a8-ovnkube-config\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.046872 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977404 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8cdb1905-6cff-40ae-845c-afca4715c0a8-ovnkube-script-lib\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.046872 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977418 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c53b63f5-f85d-4d79-9b48-acc1ba69c016-host\") pod \"node-ca-5kll8\" (UID: \"c53b63f5-f85d-4d79-9b48-acc1ba69c016\") " pod="openshift-image-registry/node-ca-5kll8" Jul 08 18:45:43.046872 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977424 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-var-lib-openvswitch\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.046872 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977424 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.046872 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977433 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-run-openvswitch\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.046872 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977466 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-run-openvswitch\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.046872 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977485 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c53b63f5-f85d-4d79-9b48-acc1ba69c016-host\") pod \"node-ca-5kll8\" (UID: \"c53b63f5-f85d-4d79-9b48-acc1ba69c016\") " pod="openshift-image-registry/node-ca-5kll8" Jul 08 18:45:43.046872 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977488 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-log-socket\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.046872 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977518 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-log-socket\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.046872 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977503 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-run-systemd\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.048708 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977573 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-host-slash\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.048708 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977612 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xjgl\" (UniqueName: \"kubernetes.io/projected/8cdb1905-6cff-40ae-845c-afca4715c0a8-kube-api-access-2xjgl\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.048708 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977648 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c53b63f5-f85d-4d79-9b48-acc1ba69c016-serviceca\") pod \"node-ca-5kll8\" (UID: \"c53b63f5-f85d-4d79-9b48-acc1ba69c016\") " pod="openshift-image-registry/node-ca-5kll8" Jul 08 18:45:43.048708 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977675 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-host-run-netns\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.048708 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977687 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-host-slash\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.048708 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977702 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.048708 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977779 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hldjh\" (UniqueName: \"kubernetes.io/projected/c53b63f5-f85d-4d79-9b48-acc1ba69c016-kube-api-access-hldjh\") pod \"node-ca-5kll8\" (UID: \"c53b63f5-f85d-4d79-9b48-acc1ba69c016\") " pod="openshift-image-registry/node-ca-5kll8" Jul 08 18:45:43.048708 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977807 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-host-kubelet\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.048708 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977825 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-systemd-units\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.048708 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977843 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-host-cni-bin\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.048708 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977884 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-host-cni-bin\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.048708 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.977911 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-host-run-netns\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.048708 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.978017 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-host-kubelet\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.048708 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.978048 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8cdb1905-6cff-40ae-845c-afca4715c0a8-ovnkube-script-lib\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.048708 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.978053 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-systemd-units\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.049384 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.978077 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.049384 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.978147 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-host-cni-netd\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.049384 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.978165 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8cdb1905-6cff-40ae-845c-afca4715c0a8-env-overrides\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.049384 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.978177 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-host-cni-netd\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.049384 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.978300 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c53b63f5-f85d-4d79-9b48-acc1ba69c016-serviceca\") pod \"node-ca-5kll8\" (UID: \"c53b63f5-f85d-4d79-9b48-acc1ba69c016\") " pod="openshift-image-registry/node-ca-5kll8" Jul 08 18:45:43.049384 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.978345 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-node-log\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.049384 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.978374 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-run-ovn\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.049384 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.978402 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cdb1905-6cff-40ae-845c-afca4715c0a8-ovn-node-metrics-cert\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.049384 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.978432 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-run-ovn\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.049384 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.978437 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-node-log\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.049384 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.978433 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-etc-openvswitch\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.049384 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.978470 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8cdb1905-6cff-40ae-845c-afca4715c0a8-etc-openvswitch\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.049384 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.978517 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8cdb1905-6cff-40ae-845c-afca4715c0a8-env-overrides\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.049384 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.978542 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8cdb1905-6cff-40ae-845c-afca4715c0a8-ovnkube-config\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.049384 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.980469 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8cdb1905-6cff-40ae-845c-afca4715c0a8-ovn-node-metrics-cert\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.052156 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.989262 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xjgl\" (UniqueName: \"kubernetes.io/projected/8cdb1905-6cff-40ae-845c-afca4715c0a8-kube-api-access-2xjgl\") pod \"ovnkube-node-z5c8p\" (UID: \"8cdb1905-6cff-40ae-845c-afca4715c0a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.052156 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:42.989734 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hldjh\" (UniqueName: \"kubernetes.io/projected/c53b63f5-f85d-4d79-9b48-acc1ba69c016-kube-api-access-hldjh\") pod \"node-ca-5kll8\" (UID: \"c53b63f5-f85d-4d79-9b48-acc1ba69c016\") " pod="openshift-image-registry/node-ca-5kll8" Jul 08 18:45:43.052156 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:43.042245 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b12c154aed0715acfb2aca1c887480a.slice/crio-9ba8dea852ca97b537b6af07564e3a6807cebed350a17f5fc66df763e51eddea WatchSource:0}: Error finding container 9ba8dea852ca97b537b6af07564e3a6807cebed350a17f5fc66df763e51eddea: Status 404 returned error can't find the container with id 9ba8dea852ca97b537b6af07564e3a6807cebed350a17f5fc66df763e51eddea Jul 08 18:45:43.129513 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:43.068518 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:45:43.129513 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:43.094501 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rqb8d" Jul 08 18:45:43.129513 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:43.101874 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rjfrp" Jul 08 18:45:43.129513 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:43.104844 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa0c7a77_7519_470b_b3ac_5fea0abdf1dd.slice/crio-f0012ac47f4c167711f046c6d88f15f883e73a932d485d0ab8dd42e0ad773e0c WatchSource:0}: Error finding container f0012ac47f4c167711f046c6d88f15f883e73a932d485d0ab8dd42e0ad773e0c: Status 404 returned error can't find the container with id f0012ac47f4c167711f046c6d88f15f883e73a932d485d0ab8dd42e0ad773e0c Jul 08 18:45:43.129513 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:43.118996 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" Jul 08 18:45:43.213558 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:43.145939 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vltc2" Jul 08 18:45:43.213558 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:43.160307 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9466f79e_04ce_4d16_8de0_2e66e513a1b8.slice/crio-162bc68a91ee5da0c1c777fd71720c5d22432bc09d742f12aebaf97f0a6a310d WatchSource:0}: Error finding container 162bc68a91ee5da0c1c777fd71720c5d22432bc09d742f12aebaf97f0a6a310d: Status 404 returned error can't find the container with id 162bc68a91ee5da0c1c777fd71720c5d22432bc09d742f12aebaf97f0a6a310d Jul 08 18:45:43.213558 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:43.171373 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9qxxv" Jul 08 18:45:43.213558 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:43.178011 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcaef550_9f6a_424b_a5b1_cfa8db9dce25.slice/crio-6d422aaed39673a3815f8f95bc93731089e03139d950344c92230f32d6c5d332 WatchSource:0}: Error finding container 6d422aaed39673a3815f8f95bc93731089e03139d950344c92230f32d6c5d332: Status 404 returned error can't find the container with id 6d422aaed39673a3815f8f95bc93731089e03139d950344c92230f32d6c5d332 Jul 08 18:45:43.255470 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:43.255439 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5kll8" Jul 08 18:45:43.260772 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:43.260758 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:45:43.265210 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:43.265184 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc53b63f5_f85d_4d79_9b48_acc1ba69c016.slice/crio-fa77ad35ed8de6476f9c3206f5b927c0bbd24d4a450baddcdc7159386fff4d31 WatchSource:0}: Error finding container fa77ad35ed8de6476f9c3206f5b927c0bbd24d4a450baddcdc7159386fff4d31: Status 404 returned error can't find the container with id fa77ad35ed8de6476f9c3206f5b927c0bbd24d4a450baddcdc7159386fff4d31 Jul 08 18:45:43.268025 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:43.268008 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cdb1905_6cff_40ae_845c_afca4715c0a8.slice/crio-741d4eb180beeae2db852c2b2c7580c29e81df02d527f87d30e23c420484a36d WatchSource:0}: Error finding container 741d4eb180beeae2db852c2b2c7580c29e81df02d527f87d30e23c420484a36d: Status 404 returned error can't find the container with id 741d4eb180beeae2db852c2b2c7580c29e81df02d527f87d30e23c420484a36d Jul 08 18:45:43.353522 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:43.353498 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod834d498e_ff9e_42cd_af1d_fcf31aeffdb6.slice/crio-564215391f8f4cda2eed951e1e324395baf830cacefa39c9fadec95d361fbe5a WatchSource:0}: Error finding container 564215391f8f4cda2eed951e1e324395baf830cacefa39c9fadec95d361fbe5a: Status 404 returned error can't find the container with id 564215391f8f4cda2eed951e1e324395baf830cacefa39c9fadec95d361fbe5a Jul 08 18:45:43.381297 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:43.381244 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret\") pod \"global-pull-secret-syncer-8qr2f\" (UID: \"b70588ff-d41a-450a-a622-d06fd0318b56\") " pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:43.381420 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:43.381293 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs\") pod \"network-metrics-daemon-qwpjz\" (UID: \"5f414ab9-ae98-4c7e-9edc-962d4bc015d9\") " pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:45:43.381420 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:43.381401 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:43.381523 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:43.381439 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:43.381523 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:43.381453 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret podName:b70588ff-d41a-450a-a622-d06fd0318b56 nodeName:}" failed. No retries permitted until 2026-07-08 18:45:44.381438935 +0000 UTC m=+3.141994939 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret") pod "global-pull-secret-syncer-8qr2f" (UID: "b70588ff-d41a-450a-a622-d06fd0318b56") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:43.381523 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:43.381488 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs podName:5f414ab9-ae98-4c7e-9edc-962d4bc015d9 nodeName:}" failed. No retries permitted until 2026-07-08 18:45:44.381471282 +0000 UTC m=+3.142027300 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs") pod "network-metrics-daemon-qwpjz" (UID: "5f414ab9-ae98-4c7e-9edc-962d4bc015d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:43.418368 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:45:43.418341 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d2ae0f0_57f3_487c_87c3_b3dffd120b02.slice/crio-729f52c22037373d81af15e00e9a018204f59e8e59f24048ea04e0d608e48863 WatchSource:0}: Error finding container 729f52c22037373d81af15e00e9a018204f59e8e59f24048ea04e0d608e48863: Status 404 returned error can't find the container with id 729f52c22037373d81af15e00e9a018204f59e8e59f24048ea04e0d608e48863 Jul 08 18:45:43.482337 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:43.482314 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nfgp\" (UniqueName: \"kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp\") pod \"network-check-target-hh4t4\" (UID: \"12465724-278f-4b3a-b9d2-88970e1b8d66\") " pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:45:43.482443 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:43.482414 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:45:43.482443 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:43.482426 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:45:43.482443 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:43.482434 2552 projected.go:196] Error preparing data for projected volume kube-api-access-8nfgp for pod openshift-network-diagnostics/network-check-target-hh4t4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:43.482558 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:43.482477 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp podName:12465724-278f-4b3a-b9d2-88970e1b8d66 nodeName:}" failed. No retries permitted until 2026-07-08 18:45:44.482463215 +0000 UTC m=+3.243019222 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8nfgp" (UniqueName: "kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp") pod "network-check-target-hh4t4" (UID: "12465724-278f-4b3a-b9d2-88970e1b8d66") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:43.828774 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:43.828660 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 18:40:42 +0000 UTC" deadline="2027-12-14 09:24:00.12820848 +0000 UTC" Jul 08 18:45:43.828774 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:43.828725 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12566h38m16.299487454s" Jul 08 18:45:43.988870 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:43.988004 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:45:43.988870 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:43.988455 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:45:43.988870 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:43.988552 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qwpjz" podUID="5f414ab9-ae98-4c7e-9edc-962d4bc015d9" Jul 08 18:45:43.988870 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:43.988737 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:43.988870 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:43.988812 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qr2f" podUID="b70588ff-d41a-450a-a622-d06fd0318b56" Jul 08 18:45:43.989762 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:43.989393 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hh4t4" podUID="12465724-278f-4b3a-b9d2-88970e1b8d66" Jul 08 18:45:44.002919 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:44.002814 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q62zb" event={"ID":"834d498e-ff9e-42cd-af1d-fcf31aeffdb6","Type":"ContainerStarted","Data":"564215391f8f4cda2eed951e1e324395baf830cacefa39c9fadec95d361fbe5a"} Jul 08 18:45:44.012097 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:44.012064 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" event={"ID":"8cdb1905-6cff-40ae-845c-afca4715c0a8","Type":"ContainerStarted","Data":"741d4eb180beeae2db852c2b2c7580c29e81df02d527f87d30e23c420484a36d"} Jul 08 18:45:44.037956 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:44.037925 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5kll8" event={"ID":"c53b63f5-f85d-4d79-9b48-acc1ba69c016","Type":"ContainerStarted","Data":"fa77ad35ed8de6476f9c3206f5b927c0bbd24d4a450baddcdc7159386fff4d31"} Jul 08 18:45:44.041635 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:44.041606 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vltc2" event={"ID":"9466f79e-04ce-4d16-8de0-2e66e513a1b8","Type":"ContainerStarted","Data":"162bc68a91ee5da0c1c777fd71720c5d22432bc09d742f12aebaf97f0a6a310d"} Jul 08 18:45:44.045142 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:44.045103 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" event={"ID":"498a2710-8c76-47ef-9e2c-e6c9ceeb59db","Type":"ContainerStarted","Data":"a33ac802b99dc8c89222232431164e67fd2dbcf75961a433e8001ed13da693a5"} Jul 08 18:45:44.059087 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:44.059035 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" event={"ID":"3b12c154aed0715acfb2aca1c887480a","Type":"ContainerStarted","Data":"9ba8dea852ca97b537b6af07564e3a6807cebed350a17f5fc66df763e51eddea"} Jul 08 18:45:44.080008 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:44.079897 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" event={"ID":"3d2ae0f0-57f3-487c-87c3-b3dffd120b02","Type":"ContainerStarted","Data":"729f52c22037373d81af15e00e9a018204f59e8e59f24048ea04e0d608e48863"} Jul 08 18:45:44.110214 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:44.110138 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qxxv" event={"ID":"bcaef550-9f6a-424b-a5b1-cfa8db9dce25","Type":"ContainerStarted","Data":"6d422aaed39673a3815f8f95bc93731089e03139d950344c92230f32d6c5d332"} Jul 08 18:45:44.120718 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:44.120649 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rjfrp" event={"ID":"2dad08be-2638-441c-842b-02e30a159a77","Type":"ContainerStarted","Data":"2e29ef46c2d925914334047272ab72777cfe4c07e8cb1708c3e041076be95118"} Jul 08 18:45:44.124137 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:44.124044 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" event={"ID":"7a8689016a7f8195ba0457e3c7b1972e","Type":"ContainerStarted","Data":"e43e1a88b01959760f42ac4bce7e604ef286347fdfb0f17239eb44550aed67dd"} Jul 08 18:45:44.131386 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:44.131315 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rqb8d" event={"ID":"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd","Type":"ContainerStarted","Data":"f0012ac47f4c167711f046c6d88f15f883e73a932d485d0ab8dd42e0ad773e0c"} Jul 08 18:45:44.201952 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:44.201667 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:45:44.258944 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:44.258917 2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 18:45:44.392140 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:44.392048 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs\") pod \"network-metrics-daemon-qwpjz\" (UID: \"5f414ab9-ae98-4c7e-9edc-962d4bc015d9\") " pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:45:44.392299 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:44.392148 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret\") pod \"global-pull-secret-syncer-8qr2f\" (UID: \"b70588ff-d41a-450a-a622-d06fd0318b56\") " pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:44.392364 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:44.392310 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:44.392416 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:44.392406 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret podName:b70588ff-d41a-450a-a622-d06fd0318b56 nodeName:}" failed. No retries permitted until 2026-07-08 18:45:46.392385467 +0000 UTC m=+5.152941485 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret") pod "global-pull-secret-syncer-8qr2f" (UID: "b70588ff-d41a-450a-a622-d06fd0318b56") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:44.392806 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:44.392784 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:44.392896 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:44.392841 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs podName:5f414ab9-ae98-4c7e-9edc-962d4bc015d9 nodeName:}" failed. No retries permitted until 2026-07-08 18:45:46.392825406 +0000 UTC m=+5.153381413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs") pod "network-metrics-daemon-qwpjz" (UID: "5f414ab9-ae98-4c7e-9edc-962d4bc015d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:44.492688 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:44.492656 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nfgp\" (UniqueName: \"kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp\") pod \"network-check-target-hh4t4\" (UID: \"12465724-278f-4b3a-b9d2-88970e1b8d66\") " pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:45:44.492937 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:44.492880 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:45:44.492937 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:44.492905 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:45:44.492937 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:44.492924 2552 projected.go:196] Error preparing data for projected volume kube-api-access-8nfgp for pod openshift-network-diagnostics/network-check-target-hh4t4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:44.493101 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:44.492984 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp podName:12465724-278f-4b3a-b9d2-88970e1b8d66 nodeName:}" failed. No retries permitted until 2026-07-08 18:45:46.492967564 +0000 UTC m=+5.253523583 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8nfgp" (UniqueName: "kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp") pod "network-check-target-hh4t4" (UID: "12465724-278f-4b3a-b9d2-88970e1b8d66") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:44.829027 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:44.828940 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 18:40:42 +0000 UTC" deadline="2028-03-28 20:21:23.243259636 +0000 UTC" Jul 08 18:45:44.829027 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:44.828976 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15097h35m38.414287483s" Jul 08 18:45:45.986323 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:45.986295 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:45.986748 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:45.986421 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qr2f" podUID="b70588ff-d41a-450a-a622-d06fd0318b56" Jul 08 18:45:45.987192 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:45.986825 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:45:45.987192 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:45.986914 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hh4t4" podUID="12465724-278f-4b3a-b9d2-88970e1b8d66" Jul 08 18:45:45.987192 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:45.986964 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:45:45.987192 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:45.987060 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qwpjz" podUID="5f414ab9-ae98-4c7e-9edc-962d4bc015d9" Jul 08 18:45:46.407390 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:46.407315 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret\") pod \"global-pull-secret-syncer-8qr2f\" (UID: \"b70588ff-d41a-450a-a622-d06fd0318b56\") " pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:46.407390 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:46.407381 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs\") pod \"network-metrics-daemon-qwpjz\" (UID: \"5f414ab9-ae98-4c7e-9edc-962d4bc015d9\") " pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:45:46.411188 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:46.411162 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:46.411294 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:46.411282 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret podName:b70588ff-d41a-450a-a622-d06fd0318b56 nodeName:}" failed. No retries permitted until 2026-07-08 18:45:50.411251346 +0000 UTC m=+9.171807362 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret") pod "global-pull-secret-syncer-8qr2f" (UID: "b70588ff-d41a-450a-a622-d06fd0318b56") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:46.413161 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:46.411505 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:46.413161 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:46.411577 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs podName:5f414ab9-ae98-4c7e-9edc-962d4bc015d9 nodeName:}" failed. No retries permitted until 2026-07-08 18:45:50.411555196 +0000 UTC m=+9.172111214 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs") pod "network-metrics-daemon-qwpjz" (UID: "5f414ab9-ae98-4c7e-9edc-962d4bc015d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:46.508111 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:46.508066 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nfgp\" (UniqueName: \"kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp\") pod \"network-check-target-hh4t4\" (UID: \"12465724-278f-4b3a-b9d2-88970e1b8d66\") " pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:45:46.508318 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:46.508287 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:45:46.508318 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:46.508321 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:45:46.508493 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:46.508337 2552 projected.go:196] Error preparing data for projected volume kube-api-access-8nfgp for pod openshift-network-diagnostics/network-check-target-hh4t4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:46.508493 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:46.508400 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp podName:12465724-278f-4b3a-b9d2-88970e1b8d66 nodeName:}" failed. No retries permitted until 2026-07-08 18:45:50.5083809 +0000 UTC m=+9.268936909 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8nfgp" (UniqueName: "kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp") pod "network-check-target-hh4t4" (UID: "12465724-278f-4b3a-b9d2-88970e1b8d66") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:47.985284 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:47.985215 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:45:47.985761 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:47.985366 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hh4t4" podUID="12465724-278f-4b3a-b9d2-88970e1b8d66" Jul 08 18:45:47.985761 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:47.985222 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:45:47.985761 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:47.985422 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:47.985761 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:47.985518 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qwpjz" podUID="5f414ab9-ae98-4c7e-9edc-962d4bc015d9" Jul 08 18:45:47.985761 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:47.985593 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qr2f" podUID="b70588ff-d41a-450a-a622-d06fd0318b56" Jul 08 18:45:49.985681 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:49.985649 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:45:49.985681 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:49.985682 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:45:49.986221 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:49.985649 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:49.986221 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:49.985800 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qwpjz" podUID="5f414ab9-ae98-4c7e-9edc-962d4bc015d9" Jul 08 18:45:49.986221 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:49.985881 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qr2f" podUID="b70588ff-d41a-450a-a622-d06fd0318b56" Jul 08 18:45:49.986221 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:49.985958 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hh4t4" podUID="12465724-278f-4b3a-b9d2-88970e1b8d66" Jul 08 18:45:50.443397 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:50.443320 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs\") pod \"network-metrics-daemon-qwpjz\" (UID: \"5f414ab9-ae98-4c7e-9edc-962d4bc015d9\") " pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:45:50.443541 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:50.443410 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret\") pod \"global-pull-secret-syncer-8qr2f\" (UID: \"b70588ff-d41a-450a-a622-d06fd0318b56\") " pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:50.443587 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:50.443539 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:50.443636 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:50.443603 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret podName:b70588ff-d41a-450a-a622-d06fd0318b56 nodeName:}" failed. No retries permitted until 2026-07-08 18:45:58.443582081 +0000 UTC m=+17.204138088 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret") pod "global-pull-secret-syncer-8qr2f" (UID: "b70588ff-d41a-450a-a622-d06fd0318b56") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:50.444088 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:50.444005 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:50.444088 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:50.444059 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs podName:5f414ab9-ae98-4c7e-9edc-962d4bc015d9 nodeName:}" failed. No retries permitted until 2026-07-08 18:45:58.444040533 +0000 UTC m=+17.204596541 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs") pod "network-metrics-daemon-qwpjz" (UID: "5f414ab9-ae98-4c7e-9edc-962d4bc015d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:50.544584 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:50.544548 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nfgp\" (UniqueName: \"kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp\") pod \"network-check-target-hh4t4\" (UID: \"12465724-278f-4b3a-b9d2-88970e1b8d66\") " pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:45:50.544814 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:50.544785 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:45:50.544943 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:50.544819 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:45:50.544943 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:50.544835 2552 projected.go:196] Error preparing data for projected volume kube-api-access-8nfgp for pod openshift-network-diagnostics/network-check-target-hh4t4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:50.544943 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:50.544906 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp podName:12465724-278f-4b3a-b9d2-88970e1b8d66 nodeName:}" failed. No retries permitted until 2026-07-08 18:45:58.544887964 +0000 UTC m=+17.305443986 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8nfgp" (UniqueName: "kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp") pod "network-check-target-hh4t4" (UID: "12465724-278f-4b3a-b9d2-88970e1b8d66") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:51.986533 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:51.986479 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:45:51.986977 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:51.986601 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qwpjz" podUID="5f414ab9-ae98-4c7e-9edc-962d4bc015d9" Jul 08 18:45:51.986977 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:51.986689 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:51.986977 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:51.986773 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qr2f" podUID="b70588ff-d41a-450a-a622-d06fd0318b56" Jul 08 18:45:51.987202 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:51.987185 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:45:51.987315 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:51.987280 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hh4t4" podUID="12465724-278f-4b3a-b9d2-88970e1b8d66" Jul 08 18:45:53.985667 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:53.985631 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:45:53.986049 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:53.985638 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:53.986049 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:53.985779 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qwpjz" podUID="5f414ab9-ae98-4c7e-9edc-962d4bc015d9" Jul 08 18:45:53.986049 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:53.985883 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qr2f" podUID="b70588ff-d41a-450a-a622-d06fd0318b56" Jul 08 18:45:53.986049 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:53.985947 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:45:53.986049 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:53.986023 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hh4t4" podUID="12465724-278f-4b3a-b9d2-88970e1b8d66" Jul 08 18:45:55.985408 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:55.985375 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:45:55.985408 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:55.985406 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:45:55.985923 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:55.985375 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:55.985923 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:55.985507 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qwpjz" podUID="5f414ab9-ae98-4c7e-9edc-962d4bc015d9" Jul 08 18:45:55.985923 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:55.985604 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qr2f" podUID="b70588ff-d41a-450a-a622-d06fd0318b56" Jul 08 18:45:55.985923 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:55.985678 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hh4t4" podUID="12465724-278f-4b3a-b9d2-88970e1b8d66" Jul 08 18:45:57.984973 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:57.984933 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:45:57.985452 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:57.984934 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:57.985452 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:57.985062 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hh4t4" podUID="12465724-278f-4b3a-b9d2-88970e1b8d66" Jul 08 18:45:57.985452 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:57.985083 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:45:57.985452 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:57.985226 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qr2f" podUID="b70588ff-d41a-450a-a622-d06fd0318b56" Jul 08 18:45:57.985452 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:57.985319 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qwpjz" podUID="5f414ab9-ae98-4c7e-9edc-962d4bc015d9" Jul 08 18:45:58.503607 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:58.503576 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret\") pod \"global-pull-secret-syncer-8qr2f\" (UID: \"b70588ff-d41a-450a-a622-d06fd0318b56\") " pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:58.503827 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:58.503637 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs\") pod \"network-metrics-daemon-qwpjz\" (UID: \"5f414ab9-ae98-4c7e-9edc-962d4bc015d9\") " pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:45:58.503827 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:58.503744 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:58.503827 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:58.503765 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:58.503952 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:58.503836 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret podName:b70588ff-d41a-450a-a622-d06fd0318b56 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:14.503810243 +0000 UTC m=+33.264366249 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret") pod "global-pull-secret-syncer-8qr2f" (UID: "b70588ff-d41a-450a-a622-d06fd0318b56") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:45:58.503952 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:58.503864 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs podName:5f414ab9-ae98-4c7e-9edc-962d4bc015d9 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:14.503853594 +0000 UTC m=+33.264409598 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs") pod "network-metrics-daemon-qwpjz" (UID: "5f414ab9-ae98-4c7e-9edc-962d4bc015d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:45:58.604851 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:58.604812 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nfgp\" (UniqueName: \"kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp\") pod \"network-check-target-hh4t4\" (UID: \"12465724-278f-4b3a-b9d2-88970e1b8d66\") " pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:45:58.605012 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:58.604967 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:45:58.605012 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:58.604986 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:45:58.605012 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:58.605000 2552 projected.go:196] Error preparing data for projected volume kube-api-access-8nfgp for pod openshift-network-diagnostics/network-check-target-hh4t4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:58.605192 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:58.605062 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp podName:12465724-278f-4b3a-b9d2-88970e1b8d66 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:14.605045696 +0000 UTC m=+33.365601704 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8nfgp" (UniqueName: "kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp") pod "network-check-target-hh4t4" (UID: "12465724-278f-4b3a-b9d2-88970e1b8d66") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:45:59.985727 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:59.985691 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:45:59.986215 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:59.985691 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:45:59.986215 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:59.985832 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qwpjz" podUID="5f414ab9-ae98-4c7e-9edc-962d4bc015d9" Jul 08 18:45:59.986215 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:59.985881 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hh4t4" podUID="12465724-278f-4b3a-b9d2-88970e1b8d66" Jul 08 18:45:59.986215 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:45:59.985691 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:45:59.986215 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:45:59.985975 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qr2f" podUID="b70588ff-d41a-450a-a622-d06fd0318b56" Jul 08 18:46:01.986183 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:01.986154 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:46:01.986645 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:01.986254 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:46:01.986645 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:01.986259 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qr2f" podUID="b70588ff-d41a-450a-a622-d06fd0318b56" Jul 08 18:46:01.986645 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:01.986288 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:46:01.986645 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:01.986369 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hh4t4" podUID="12465724-278f-4b3a-b9d2-88970e1b8d66" Jul 08 18:46:01.986645 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:01.986477 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qwpjz" podUID="5f414ab9-ae98-4c7e-9edc-962d4bc015d9" Jul 08 18:46:03.985677 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:03.985392 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:46:03.986352 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:03.985401 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:46:03.986352 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:03.985760 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qr2f" podUID="b70588ff-d41a-450a-a622-d06fd0318b56" Jul 08 18:46:03.986352 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:03.985864 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qwpjz" podUID="5f414ab9-ae98-4c7e-9edc-962d4bc015d9" Jul 08 18:46:03.986352 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:03.985460 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:46:03.986352 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:03.985985 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hh4t4" podUID="12465724-278f-4b3a-b9d2-88970e1b8d66" Jul 08 18:46:04.180829 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.180797 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" event={"ID":"8cdb1905-6cff-40ae-845c-afca4715c0a8","Type":"ContainerStarted","Data":"9a99d63331d425d39711df873d3b11c654e3f9ac7e0a2e8f4fe608492926bd0f"} Jul 08 18:46:04.180996 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.180890 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" event={"ID":"8cdb1905-6cff-40ae-845c-afca4715c0a8","Type":"ContainerStarted","Data":"ee42a61d372003a7f9ee737ba419af518642c38553b63bb8eb8b5d32226d5bdc"} Jul 08 18:46:04.180996 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.180942 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" event={"ID":"8cdb1905-6cff-40ae-845c-afca4715c0a8","Type":"ContainerStarted","Data":"f1b728e19e74029fc7b36054c4d683cc74d57ae770ab096c9b3de9d05860c282"} Jul 08 18:46:04.180996 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.180988 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" event={"ID":"8cdb1905-6cff-40ae-845c-afca4715c0a8","Type":"ContainerStarted","Data":"f35c96e9b101d1154b5a337bb4a5c7b566a602a7568b84bed5cf477b52bd147c"} Jul 08 18:46:04.181211 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.181032 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" event={"ID":"8cdb1905-6cff-40ae-845c-afca4715c0a8","Type":"ContainerStarted","Data":"800b161e72271fb12b799c30b0da44e509e2f4d57d5e4f06c073746dab316e23"} Jul 08 18:46:04.181211 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.181084 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" event={"ID":"8cdb1905-6cff-40ae-845c-afca4715c0a8","Type":"ContainerStarted","Data":"d1b8889f73ab3222833e9d0820606c0e48785c50819b04e01acbadec97733021"} Jul 08 18:46:04.182401 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.182375 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5kll8" event={"ID":"c53b63f5-f85d-4d79-9b48-acc1ba69c016","Type":"ContainerStarted","Data":"fde13426f00dd479621defabd9f9c69db7dad4cb4548109d6f88d0f5afb8df86"} Jul 08 18:46:04.183950 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.183929 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vltc2" event={"ID":"9466f79e-04ce-4d16-8de0-2e66e513a1b8","Type":"ContainerStarted","Data":"75081278e4d34a350e9d68effcde1c4aba0966237b9968ace90a28a637e572d7"} Jul 08 18:46:04.185356 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.185335 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" event={"ID":"498a2710-8c76-47ef-9e2c-e6c9ceeb59db","Type":"ContainerStarted","Data":"83e3429ae72d9b1fcb05b14d509f36fa1bfc92d3af1439f63d47319f4f660b4d"} Jul 08 18:46:04.186680 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.186662 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" event={"ID":"3b12c154aed0715acfb2aca1c887480a","Type":"ContainerStarted","Data":"515cc99256407b70ddd9fb91a959b8d6d07fdc51f41fbd1912e6c0474d7a5470"} Jul 08 18:46:04.188047 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.188029 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" event={"ID":"3d2ae0f0-57f3-487c-87c3-b3dffd120b02","Type":"ContainerStarted","Data":"a8284bfc8df8b04a2d08abb321284c2e5b107651d6777f8fa5378403e759b3fc"} Jul 08 18:46:04.189618 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.189596 2552 generic.go:356] "Generic (PLEG): container finished" podID="bcaef550-9f6a-424b-a5b1-cfa8db9dce25" containerID="9a6018d2ec6613267afdacfe7263e10edd2e987d293ea6ed54b55e2710fb4799" exitCode=0 Jul 08 18:46:04.189714 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.189684 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qxxv" event={"ID":"bcaef550-9f6a-424b-a5b1-cfa8db9dce25","Type":"ContainerDied","Data":"9a6018d2ec6613267afdacfe7263e10edd2e987d293ea6ed54b55e2710fb4799"} Jul 08 18:46:04.191321 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.191296 2552 generic.go:356] "Generic (PLEG): container finished" podID="7a8689016a7f8195ba0457e3c7b1972e" containerID="3b971f95673bcc3a26c640389cda3cd40d7fdd0b74a42731c7a990c5b8b36f17" exitCode=0 Jul 08 18:46:04.191429 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.191325 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" event={"ID":"7a8689016a7f8195ba0457e3c7b1972e","Type":"ContainerDied","Data":"3b971f95673bcc3a26c640389cda3cd40d7fdd0b74a42731c7a990c5b8b36f17"} Jul 08 18:46:04.192944 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.192855 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rqb8d" event={"ID":"aa0c7a77-7519-470b-b3ac-5fea0abdf1dd","Type":"ContainerStarted","Data":"d68c8134efa8355b44fb3e0580cec04bfd9488e7401417ed575ef25a20c98810"} Jul 08 18:46:04.195457 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.195361 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q62zb" event={"ID":"834d498e-ff9e-42cd-af1d-fcf31aeffdb6","Type":"ContainerStarted","Data":"a2ea94dd8a73a4f972b1bfb9b56ffb2b654a3143b3c69fffff52e9030b315a00"} Jul 08 18:46:04.198215 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.198179 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5kll8" podStartSLOduration=2.408568607 podStartE2EDuration="22.198168071s" totalImagesPullingTime="19.789599464s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:45:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:04.19789934 +0000 UTC m=+22.958455365" watchObservedRunningTime="2026-07-08 18:46:04.198168071 +0000 UTC m=+22.958724097" Jul 08 18:46:04.211944 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.211911 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-240.ec2.internal" podStartSLOduration=22.211902774 podStartE2EDuration="22.211902774s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:45:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:04.21155776 +0000 UTC m=+22.972113785" watchObservedRunningTime="2026-07-08 18:46:04.211902774 +0000 UTC m=+22.972458800" Jul 08 18:46:04.229221 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.229187 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rqb8d" podStartSLOduration=3.150729927 podStartE2EDuration="23.229179481s" totalImagesPullingTime="20.078449554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:04.228816924 +0000 UTC m=+22.989372951" watchObservedRunningTime="2026-07-08 18:46:04.229179481 +0000 UTC m=+22.989735507" Jul 08 18:46:04.271525 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.271484 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vltc2" podStartSLOduration=2.34522232 podStartE2EDuration="22.271466584s" totalImagesPullingTime="19.926244264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:45:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:04.271154278 +0000 UTC m=+23.031710304" watchObservedRunningTime="2026-07-08 18:46:04.271466584 +0000 UTC m=+23.032022610" Jul 08 18:46:04.315690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.315301 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-q62zb" podStartSLOduration=2.636175646 podStartE2EDuration="22.315280237s" totalImagesPullingTime="19.679104591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:45:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:04.296884844 +0000 UTC m=+23.057440870" watchObservedRunningTime="2026-07-08 18:46:04.315280237 +0000 UTC m=+23.075836264" Jul 08 18:46:04.315690 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:04.315445 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7dk5j" podStartSLOduration=2.723200717 podStartE2EDuration="22.315439634s" totalImagesPullingTime="19.592238917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:45:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:04.314997616 +0000 UTC m=+23.075553634" watchObservedRunningTime="2026-07-08 18:46:04.315439634 +0000 UTC m=+23.075995659" Jul 08 18:46:05.185477 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:05.185448 2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 18:46:05.199670 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:05.199642 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rjfrp" event={"ID":"2dad08be-2638-441c-842b-02e30a159a77","Type":"ContainerStarted","Data":"d432fa0759c95a58838776146c0a59355eadf10b0315b1a4984a880a9a61a7fa"} Jul 08 18:46:05.201893 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:05.201862 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" event={"ID":"7a8689016a7f8195ba0457e3c7b1972e","Type":"ContainerStarted","Data":"77e0544ceb1ef051fa450d0142d291bd4813539c906c3689295385baec987839"} Jul 08 18:46:05.204268 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:05.204247 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" event={"ID":"498a2710-8c76-47ef-9e2c-e6c9ceeb59db","Type":"ContainerStarted","Data":"282bc3e98b466ab05304b7dafee8d322c17504dda1f0760b96c245bdf2f0b4ab"} Jul 08 18:46:05.215761 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:05.215721 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rjfrp" podStartSLOduration=4.267920113 podStartE2EDuration="24.215708587s" totalImagesPullingTime="19.947788474s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:05.215388944 +0000 UTC m=+23.975944970" watchObservedRunningTime="2026-07-08 18:46:05.215708587 +0000 UTC m=+23.976264648" Jul 08 18:46:05.859658 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:05.859551 2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T18:46:05.185474035Z","UUID":"062c68c9-1f81-4e3b-b6ce-27383162f5d2","Handler":null,"Name":"","Endpoint":""} Jul 08 18:46:05.861327 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:05.861302 2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 18:46:05.861430 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:05.861347 2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 18:46:05.985641 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:05.985610 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:46:05.985789 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:05.985609 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:46:05.985789 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:05.985743 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qr2f" podUID="b70588ff-d41a-450a-a622-d06fd0318b56" Jul 08 18:46:05.985905 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:05.985609 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:46:05.985905 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:05.985790 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hh4t4" podUID="12465724-278f-4b3a-b9d2-88970e1b8d66" Jul 08 18:46:05.985993 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:05.985921 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qwpjz" podUID="5f414ab9-ae98-4c7e-9edc-962d4bc015d9" Jul 08 18:46:06.210238 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:06.210083 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" event={"ID":"8cdb1905-6cff-40ae-845c-afca4715c0a8","Type":"ContainerStarted","Data":"0d12967f21cab156ab5952fa0643aecd98ab1c12444da42a6fb5948c50c2e39f"} Jul 08 18:46:07.215311 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:07.215075 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" event={"ID":"498a2710-8c76-47ef-9e2c-e6c9ceeb59db","Type":"ContainerStarted","Data":"8f2196c8d54c8e8418005f273e760ea958833a7064f48dfc9d13db22c42cf11e"} Jul 08 18:46:07.232366 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:07.232322 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-240.ec2.internal" podStartSLOduration=25.232308861 podStartE2EDuration="25.232308861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:45:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:05.232256302 +0000 UTC m=+23.992812328" watchObservedRunningTime="2026-07-08 18:46:07.232308861 +0000 UTC m=+25.992864887" Jul 08 18:46:07.232674 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:07.232655 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5j2sb" podStartSLOduration=3.730173299 podStartE2EDuration="26.232650315s" totalImagesPullingTime="22.502477016s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:45:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:07.232211459 +0000 UTC m=+25.992767484" watchObservedRunningTime="2026-07-08 18:46:07.232650315 +0000 UTC m=+25.993206340" Jul 08 18:46:07.985507 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:07.985112 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:46:07.985507 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:07.985245 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:46:07.985507 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:07.985134 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:46:07.985507 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:07.985245 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qwpjz" podUID="5f414ab9-ae98-4c7e-9edc-962d4bc015d9" Jul 08 18:46:07.985507 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:07.985353 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hh4t4" podUID="12465724-278f-4b3a-b9d2-88970e1b8d66" Jul 08 18:46:07.985507 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:07.985443 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qr2f" podUID="b70588ff-d41a-450a-a622-d06fd0318b56" Jul 08 18:46:08.094303 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:08.094270 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-q62zb" Jul 08 18:46:08.094863 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:08.094831 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-q62zb" Jul 08 18:46:08.217557 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:08.217530 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-q62zb" Jul 08 18:46:08.218163 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:08.218085 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-q62zb" Jul 08 18:46:09.223657 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:09.223461 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" event={"ID":"8cdb1905-6cff-40ae-845c-afca4715c0a8","Type":"ContainerStarted","Data":"a2043b22bc299f561e419174209d74238683cf2d63746d61a06fc8ae6985f98b"} Jul 08 18:46:09.224332 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:09.223794 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:46:09.224332 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:09.223870 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:46:09.224332 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:09.223921 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:46:09.239260 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:09.239239 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:46:09.239416 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:09.239406 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:46:09.254258 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:09.254203 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" podStartSLOduration=7.432285838 podStartE2EDuration="27.254181294s" totalImagesPullingTime="19.821895456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:45:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:09.253627341 +0000 UTC m=+28.014183366" watchObservedRunningTime="2026-07-08 18:46:09.254181294 +0000 UTC m=+28.014737323" Jul 08 18:46:09.985784 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:09.985744 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:46:09.985987 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:09.985744 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:46:09.985987 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:09.985859 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qwpjz" podUID="5f414ab9-ae98-4c7e-9edc-962d4bc015d9" Jul 08 18:46:09.985987 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:09.985744 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:46:09.985987 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:09.985926 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hh4t4" podUID="12465724-278f-4b3a-b9d2-88970e1b8d66" Jul 08 18:46:09.986303 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:09.985988 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qr2f" podUID="b70588ff-d41a-450a-a622-d06fd0318b56" Jul 08 18:46:10.230080 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:10.230046 2552 generic.go:356] "Generic (PLEG): container finished" podID="bcaef550-9f6a-424b-a5b1-cfa8db9dce25" containerID="d60a3b8a081f60d4f1bd6a44f15b8c2cffe800b92647a2d2a3339c3367eddf0d" exitCode=0 Jul 08 18:46:10.230639 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:10.230108 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qxxv" event={"ID":"bcaef550-9f6a-424b-a5b1-cfa8db9dce25","Type":"ContainerDied","Data":"d60a3b8a081f60d4f1bd6a44f15b8c2cffe800b92647a2d2a3339c3367eddf0d"} Jul 08 18:46:11.237429 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:11.237283 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hh4t4"] Jul 08 18:46:11.237748 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:11.237489 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:46:11.237748 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:11.237565 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hh4t4" podUID="12465724-278f-4b3a-b9d2-88970e1b8d66" Jul 08 18:46:11.240351 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:11.240328 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qwpjz"] Jul 08 18:46:11.240483 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:11.240410 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:46:11.240545 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:11.240499 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qwpjz" podUID="5f414ab9-ae98-4c7e-9edc-962d4bc015d9" Jul 08 18:46:11.240881 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:11.240858 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8qr2f"] Jul 08 18:46:11.241007 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:11.240944 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:46:11.241073 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:11.241040 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qr2f" podUID="b70588ff-d41a-450a-a622-d06fd0318b56" Jul 08 18:46:12.236393 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:12.236352 2552 generic.go:356] "Generic (PLEG): container finished" podID="bcaef550-9f6a-424b-a5b1-cfa8db9dce25" containerID="22cd316aee9359d51276c03636ca962f31618593effbb7a8da99fad5a48f4e7d" exitCode=0 Jul 08 18:46:12.236550 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:12.236401 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qxxv" event={"ID":"bcaef550-9f6a-424b-a5b1-cfa8db9dce25","Type":"ContainerDied","Data":"22cd316aee9359d51276c03636ca962f31618593effbb7a8da99fad5a48f4e7d"} Jul 08 18:46:12.985252 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:12.985222 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:46:12.985252 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:12.985250 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:46:12.985885 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:12.985221 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:46:12.985885 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:12.985349 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qwpjz" podUID="5f414ab9-ae98-4c7e-9edc-962d4bc015d9" Jul 08 18:46:12.985885 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:12.985400 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qr2f" podUID="b70588ff-d41a-450a-a622-d06fd0318b56" Jul 08 18:46:12.985885 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:12.985466 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hh4t4" podUID="12465724-278f-4b3a-b9d2-88970e1b8d66" Jul 08 18:46:13.240963 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:13.240938 2552 generic.go:356] "Generic (PLEG): container finished" podID="bcaef550-9f6a-424b-a5b1-cfa8db9dce25" containerID="a4a2aae580cbc31e2fd67dd3dab0ca195403d9867bd172ce98650d62ec067153" exitCode=0 Jul 08 18:46:13.241084 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:13.240988 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qxxv" event={"ID":"bcaef550-9f6a-424b-a5b1-cfa8db9dce25","Type":"ContainerDied","Data":"a4a2aae580cbc31e2fd67dd3dab0ca195403d9867bd172ce98650d62ec067153"} Jul 08 18:46:14.523662 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:14.523618 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs\") pod \"network-metrics-daemon-qwpjz\" (UID: \"5f414ab9-ae98-4c7e-9edc-962d4bc015d9\") " pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:46:14.524274 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:14.523714 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret\") pod \"global-pull-secret-syncer-8qr2f\" (UID: \"b70588ff-d41a-450a-a622-d06fd0318b56\") " pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:46:14.524274 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:14.523797 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:46:14.524274 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:14.523818 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 18:46:14.524274 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:14.523884 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs podName:5f414ab9-ae98-4c7e-9edc-962d4bc015d9 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:46.523861659 +0000 UTC m=+65.284417664 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs") pod "network-metrics-daemon-qwpjz" (UID: "5f414ab9-ae98-4c7e-9edc-962d4bc015d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 18:46:14.524274 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:14.523904 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret podName:b70588ff-d41a-450a-a622-d06fd0318b56 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:46.523894567 +0000 UTC m=+65.284450571 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret") pod "global-pull-secret-syncer-8qr2f" (UID: "b70588ff-d41a-450a-a622-d06fd0318b56") : object "kube-system"/"original-pull-secret" not registered Jul 08 18:46:14.625018 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:14.624985 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nfgp\" (UniqueName: \"kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp\") pod \"network-check-target-hh4t4\" (UID: \"12465724-278f-4b3a-b9d2-88970e1b8d66\") " pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:46:14.625215 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:14.625115 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 18:46:14.625215 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:14.625154 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 18:46:14.625215 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:14.625165 2552 projected.go:196] Error preparing data for projected volume kube-api-access-8nfgp for pod openshift-network-diagnostics/network-check-target-hh4t4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:46:14.625399 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:14.625227 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp podName:12465724-278f-4b3a-b9d2-88970e1b8d66 nodeName:}" failed. No retries permitted until 2026-07-08 18:46:46.625211572 +0000 UTC m=+65.385767578 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8nfgp" (UniqueName: "kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp") pod "network-check-target-hh4t4" (UID: "12465724-278f-4b3a-b9d2-88970e1b8d66") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 18:46:14.984900 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:14.984871 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:46:14.984900 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:14.984885 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:46:14.985158 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:14.984880 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:46:14.985158 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:14.984967 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qr2f" podUID="b70588ff-d41a-450a-a622-d06fd0318b56" Jul 08 18:46:14.985158 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:14.985036 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qwpjz" podUID="5f414ab9-ae98-4c7e-9edc-962d4bc015d9" Jul 08 18:46:14.985158 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:14.985147 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hh4t4" podUID="12465724-278f-4b3a-b9d2-88970e1b8d66" Jul 08 18:46:16.985789 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:16.985690 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:46:16.986250 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:16.985690 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:46:16.986250 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:16.985833 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8qr2f" podUID="b70588ff-d41a-450a-a622-d06fd0318b56" Jul 08 18:46:16.986250 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:16.985690 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:46:16.986250 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:16.985932 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qwpjz" podUID="5f414ab9-ae98-4c7e-9edc-962d4bc015d9" Jul 08 18:46:16.986250 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:16.985953 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hh4t4" podUID="12465724-278f-4b3a-b9d2-88970e1b8d66" Jul 08 18:46:17.017672 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.017644 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-240.ec2.internal" event="NodeReady" Jul 08 18:46:17.017830 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.017786 2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 18:46:17.123307 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.123270 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-twvqc"] Jul 08 18:46:17.126020 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.125949 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ptx78"] Jul 08 18:46:17.126175 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.126074 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-twvqc" Jul 08 18:46:17.128060 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.127865 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ptx78" Jul 08 18:46:17.130667 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:17.130633 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"dns-default-twvqc\" is forbidden: User \"system:node:ip-10-0-135-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-dns\": no relationship found between node 'ip-10-0-135-240.ec2.internal' and this object" podUID="cc500c34-5a22-4da9-ab09-308d99e6f06f" pod="openshift-dns/dns-default-twvqc" Jul 08 18:46:17.130796 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:17.130684 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"dns-default-metrics-tls\" is forbidden: User \"system:node:ip-10-0-135-240.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-dns\": no relationship found between node 'ip-10-0-135-240.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" type="*v1.Secret" Jul 08 18:46:17.130796 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:17.130727 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"dns-default\" is forbidden: User \"system:node:ip-10-0-135-240.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-dns\": no relationship found between node 'ip-10-0-135-240.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-dns\"/\"dns-default\"" type="*v1.ConfigMap" Jul 08 18:46:17.130796 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:17.130756 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"dns-dockercfg-k5jtp\" is forbidden: User \"system:node:ip-10-0-135-240.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-dns\": no relationship found between node 'ip-10-0-135-240.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k5jtp\"" type="*v1.Secret" Jul 08 18:46:17.133612 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.133588 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 18:46:17.133738 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.133595 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 18:46:17.138075 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.138057 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 18:46:17.138197 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.138166 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2cgrn\"" Jul 08 18:46:17.148796 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.148763 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ptx78"] Jul 08 18:46:17.154572 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.154508 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-twvqc"] Jul 08 18:46:17.245530 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.245453 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc500c34-5a22-4da9-ab09-308d99e6f06f-tmp-dir\") pod \"dns-default-twvqc\" (UID: \"cc500c34-5a22-4da9-ab09-308d99e6f06f\") " pod="openshift-dns/dns-default-twvqc" Jul 08 18:46:17.245530 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.245489 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42mmd\" (UniqueName: \"kubernetes.io/projected/273128b2-e74b-44e4-b4c9-bd9a060bf075-kube-api-access-42mmd\") pod \"ingress-canary-ptx78\" (UID: \"273128b2-e74b-44e4-b4c9-bd9a060bf075\") " pod="openshift-ingress-canary/ingress-canary-ptx78" Jul 08 18:46:17.245530 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.245523 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc500c34-5a22-4da9-ab09-308d99e6f06f-config-volume\") pod \"dns-default-twvqc\" (UID: \"cc500c34-5a22-4da9-ab09-308d99e6f06f\") " pod="openshift-dns/dns-default-twvqc" Jul 08 18:46:17.245788 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.245593 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/273128b2-e74b-44e4-b4c9-bd9a060bf075-cert\") pod \"ingress-canary-ptx78\" (UID: \"273128b2-e74b-44e4-b4c9-bd9a060bf075\") " pod="openshift-ingress-canary/ingress-canary-ptx78" Jul 08 18:46:17.245788 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.245642 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx42n\" (UniqueName: \"kubernetes.io/projected/cc500c34-5a22-4da9-ab09-308d99e6f06f-kube-api-access-vx42n\") pod \"dns-default-twvqc\" (UID: \"cc500c34-5a22-4da9-ab09-308d99e6f06f\") " pod="openshift-dns/dns-default-twvqc" Jul 08 18:46:17.245788 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.245691 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc500c34-5a22-4da9-ab09-308d99e6f06f-metrics-tls\") pod \"dns-default-twvqc\" (UID: \"cc500c34-5a22-4da9-ab09-308d99e6f06f\") " pod="openshift-dns/dns-default-twvqc" Jul 08 18:46:17.346488 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.346449 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc500c34-5a22-4da9-ab09-308d99e6f06f-tmp-dir\") pod \"dns-default-twvqc\" (UID: \"cc500c34-5a22-4da9-ab09-308d99e6f06f\") " pod="openshift-dns/dns-default-twvqc" Jul 08 18:46:17.346488 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.346489 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42mmd\" (UniqueName: \"kubernetes.io/projected/273128b2-e74b-44e4-b4c9-bd9a060bf075-kube-api-access-42mmd\") pod \"ingress-canary-ptx78\" (UID: \"273128b2-e74b-44e4-b4c9-bd9a060bf075\") " pod="openshift-ingress-canary/ingress-canary-ptx78" Jul 08 18:46:17.346725 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.346522 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc500c34-5a22-4da9-ab09-308d99e6f06f-config-volume\") pod \"dns-default-twvqc\" (UID: \"cc500c34-5a22-4da9-ab09-308d99e6f06f\") " pod="openshift-dns/dns-default-twvqc" Jul 08 18:46:17.346725 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.346636 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/273128b2-e74b-44e4-b4c9-bd9a060bf075-cert\") pod \"ingress-canary-ptx78\" (UID: \"273128b2-e74b-44e4-b4c9-bd9a060bf075\") " pod="openshift-ingress-canary/ingress-canary-ptx78" Jul 08 18:46:17.346725 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.346690 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx42n\" (UniqueName: \"kubernetes.io/projected/cc500c34-5a22-4da9-ab09-308d99e6f06f-kube-api-access-vx42n\") pod \"dns-default-twvqc\" (UID: \"cc500c34-5a22-4da9-ab09-308d99e6f06f\") " pod="openshift-dns/dns-default-twvqc" Jul 08 18:46:17.346869 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.346816 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc500c34-5a22-4da9-ab09-308d99e6f06f-metrics-tls\") pod \"dns-default-twvqc\" (UID: \"cc500c34-5a22-4da9-ab09-308d99e6f06f\") " pod="openshift-dns/dns-default-twvqc" Jul 08 18:46:17.346912 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.346803 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc500c34-5a22-4da9-ab09-308d99e6f06f-tmp-dir\") pod \"dns-default-twvqc\" (UID: \"cc500c34-5a22-4da9-ab09-308d99e6f06f\") " pod="openshift-dns/dns-default-twvqc" Jul 08 18:46:17.351087 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.351056 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/273128b2-e74b-44e4-b4c9-bd9a060bf075-cert\") pod \"ingress-canary-ptx78\" (UID: \"273128b2-e74b-44e4-b4c9-bd9a060bf075\") " pod="openshift-ingress-canary/ingress-canary-ptx78" Jul 08 18:46:17.356086 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.356065 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42mmd\" (UniqueName: \"kubernetes.io/projected/273128b2-e74b-44e4-b4c9-bd9a060bf075-kube-api-access-42mmd\") pod \"ingress-canary-ptx78\" (UID: \"273128b2-e74b-44e4-b4c9-bd9a060bf075\") " pod="openshift-ingress-canary/ingress-canary-ptx78" Jul 08 18:46:17.357398 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.357379 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx42n\" (UniqueName: \"kubernetes.io/projected/cc500c34-5a22-4da9-ab09-308d99e6f06f-kube-api-access-vx42n\") pod \"dns-default-twvqc\" (UID: \"cc500c34-5a22-4da9-ab09-308d99e6f06f\") " pod="openshift-dns/dns-default-twvqc" Jul 08 18:46:17.444575 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.444552 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ptx78" Jul 08 18:46:17.589485 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.589456 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ptx78"] Jul 08 18:46:17.593435 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:46:17.593412 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod273128b2_e74b_44e4_b4c9_bd9a060bf075.slice/crio-9f715947dadaa4289a4340b1822838177c53a1b585fe2b57453803134235c9f1 WatchSource:0}: Error finding container 9f715947dadaa4289a4340b1822838177c53a1b585fe2b57453803134235c9f1: Status 404 returned error can't find the container with id 9f715947dadaa4289a4340b1822838177c53a1b585fe2b57453803134235c9f1 Jul 08 18:46:17.980432 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.980401 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k5jtp\"" Jul 08 18:46:17.986883 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:17.986860 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 18:46:17.987265 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:17.986937 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:46:17.987265 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:17.987021 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc500c34-5a22-4da9-ab09-308d99e6f06f-metrics-tls podName:cc500c34-5a22-4da9-ab09-308d99e6f06f nodeName:}" failed. No retries permitted until 2026-07-08 18:46:18.486997818 +0000 UTC m=+37.247553825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc500c34-5a22-4da9-ab09-308d99e6f06f-metrics-tls") pod "dns-default-twvqc" (UID: "cc500c34-5a22-4da9-ab09-308d99e6f06f") : secret "dns-default-metrics-tls" not found Jul 08 18:46:18.257225 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:18.257143 2552 generic.go:356] "Generic (PLEG): container finished" podID="bcaef550-9f6a-424b-a5b1-cfa8db9dce25" containerID="0b729d94b48c42b78ee07890cf01b05ffd9f099ccd6e6c26a0a41e52211fd998" exitCode=0 Jul 08 18:46:18.257225 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:18.257218 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qxxv" event={"ID":"bcaef550-9f6a-424b-a5b1-cfa8db9dce25","Type":"ContainerDied","Data":"0b729d94b48c42b78ee07890cf01b05ffd9f099ccd6e6c26a0a41e52211fd998"} Jul 08 18:46:18.258992 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:18.258548 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ptx78" event={"ID":"273128b2-e74b-44e4-b4c9-bd9a060bf075","Type":"ContainerStarted","Data":"9f715947dadaa4289a4340b1822838177c53a1b585fe2b57453803134235c9f1"} Jul 08 18:46:18.346724 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:18.346690 2552 configmap.go:193] Couldn't get configMap openshift-dns/dns-default: failed to sync configmap cache: timed out waiting for the condition Jul 08 18:46:18.346843 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:18.346789 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/cc500c34-5a22-4da9-ab09-308d99e6f06f-config-volume podName:cc500c34-5a22-4da9-ab09-308d99e6f06f nodeName:}" failed. No retries permitted until 2026-07-08 18:46:18.846764026 +0000 UTC m=+37.607320046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config-volume" (UniqueName: "kubernetes.io/configmap/cc500c34-5a22-4da9-ab09-308d99e6f06f-config-volume") pod "dns-default-twvqc" (UID: "cc500c34-5a22-4da9-ab09-308d99e6f06f") : failed to sync configmap cache: timed out waiting for the condition Jul 08 18:46:18.556474 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:18.556388 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc500c34-5a22-4da9-ab09-308d99e6f06f-metrics-tls\") pod \"dns-default-twvqc\" (UID: \"cc500c34-5a22-4da9-ab09-308d99e6f06f\") " pod="openshift-dns/dns-default-twvqc" Jul 08 18:46:18.556639 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:18.556534 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:46:18.556639 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:18.556613 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc500c34-5a22-4da9-ab09-308d99e6f06f-metrics-tls podName:cc500c34-5a22-4da9-ab09-308d99e6f06f nodeName:}" failed. No retries permitted until 2026-07-08 18:46:19.556593821 +0000 UTC m=+38.317149833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc500c34-5a22-4da9-ab09-308d99e6f06f-metrics-tls") pod "dns-default-twvqc" (UID: "cc500c34-5a22-4da9-ab09-308d99e6f06f") : secret "dns-default-metrics-tls" not found Jul 08 18:46:18.683098 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:18.683067 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 18:46:18.858931 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:18.858901 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc500c34-5a22-4da9-ab09-308d99e6f06f-config-volume\") pod \"dns-default-twvqc\" (UID: \"cc500c34-5a22-4da9-ab09-308d99e6f06f\") " pod="openshift-dns/dns-default-twvqc" Jul 08 18:46:18.859629 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:18.859602 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc500c34-5a22-4da9-ab09-308d99e6f06f-config-volume\") pod \"dns-default-twvqc\" (UID: \"cc500c34-5a22-4da9-ab09-308d99e6f06f\") " pod="openshift-dns/dns-default-twvqc" Jul 08 18:46:18.985667 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:18.985633 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:46:18.985812 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:18.985686 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:46:18.985812 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:18.985633 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:46:18.996183 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:18.996164 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 18:46:18.996522 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:18.996483 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zrdnt\"" Jul 08 18:46:18.996635 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:18.996612 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5bv4l\"" Jul 08 18:46:18.997241 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:18.997223 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 18:46:18.997595 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:18.997575 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 18:46:18.997595 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:18.997594 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 18:46:19.264811 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:19.264740 2552 generic.go:356] "Generic (PLEG): container finished" podID="bcaef550-9f6a-424b-a5b1-cfa8db9dce25" containerID="8620e56ba5ea247835c3e7857e8c9f155047e4b90e6c1857df794c0fb8b60198" exitCode=0 Jul 08 18:46:19.264811 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:19.264777 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qxxv" event={"ID":"bcaef550-9f6a-424b-a5b1-cfa8db9dce25","Type":"ContainerDied","Data":"8620e56ba5ea247835c3e7857e8c9f155047e4b90e6c1857df794c0fb8b60198"} Jul 08 18:46:19.564609 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:19.564565 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc500c34-5a22-4da9-ab09-308d99e6f06f-metrics-tls\") pod \"dns-default-twvqc\" (UID: \"cc500c34-5a22-4da9-ab09-308d99e6f06f\") " pod="openshift-dns/dns-default-twvqc" Jul 08 18:46:19.564783 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:19.564711 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:46:19.564837 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:19.564786 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc500c34-5a22-4da9-ab09-308d99e6f06f-metrics-tls podName:cc500c34-5a22-4da9-ab09-308d99e6f06f nodeName:}" failed. No retries permitted until 2026-07-08 18:46:21.564769664 +0000 UTC m=+40.325325668 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc500c34-5a22-4da9-ab09-308d99e6f06f-metrics-tls") pod "dns-default-twvqc" (UID: "cc500c34-5a22-4da9-ab09-308d99e6f06f") : secret "dns-default-metrics-tls" not found Jul 08 18:46:20.268392 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:20.268296 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ptx78" event={"ID":"273128b2-e74b-44e4-b4c9-bd9a060bf075","Type":"ContainerStarted","Data":"a0f161dcf3873f66015a8be46c9f64d44002502ae16cec3fcdfc4938b6b7008b"} Jul 08 18:46:20.273476 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:20.273441 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9qxxv" event={"ID":"bcaef550-9f6a-424b-a5b1-cfa8db9dce25","Type":"ContainerStarted","Data":"a809e30675c6850fe6675e02772300c6e06d7137776a411cd42e2731788d51bb"} Jul 08 18:46:20.285300 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:20.285251 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ptx78" podStartSLOduration=1.101233731 podStartE2EDuration="3.285236706s" totalImagesPullingTime="2.184002975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:20.284903609 +0000 UTC m=+39.045459635" watchObservedRunningTime="2026-07-08 18:46:20.285236706 +0000 UTC m=+39.045792731" Jul 08 18:46:20.306806 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:20.306760 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9qxxv" podStartSLOduration=7.680125611 podStartE2EDuration="38.306744273s" totalImagesPullingTime="30.626618662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:45:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:20.305551861 +0000 UTC m=+39.066107886" watchObservedRunningTime="2026-07-08 18:46:20.306744273 +0000 UTC m=+39.067300293" Jul 08 18:46:21.581531 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:21.581497 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc500c34-5a22-4da9-ab09-308d99e6f06f-metrics-tls\") pod \"dns-default-twvqc\" (UID: \"cc500c34-5a22-4da9-ab09-308d99e6f06f\") " pod="openshift-dns/dns-default-twvqc" Jul 08 18:46:21.581923 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:21.581595 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:46:21.581923 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:21.581647 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc500c34-5a22-4da9-ab09-308d99e6f06f-metrics-tls podName:cc500c34-5a22-4da9-ab09-308d99e6f06f nodeName:}" failed. No retries permitted until 2026-07-08 18:46:25.581633122 +0000 UTC m=+44.342189126 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc500c34-5a22-4da9-ab09-308d99e6f06f-metrics-tls") pod "dns-default-twvqc" (UID: "cc500c34-5a22-4da9-ab09-308d99e6f06f") : secret "dns-default-metrics-tls" not found Jul 08 18:46:22.764372 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:22.764339 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-dbxmn"] Jul 08 18:46:22.804949 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:22.804914 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-dbxmn"] Jul 08 18:46:22.805100 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:22.805010 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dbxmn" Jul 08 18:46:22.807418 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:22.807390 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4sn4t\"" Jul 08 18:46:22.807543 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:22.807390 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 08 18:46:22.808343 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:22.808327 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 08 18:46:22.831965 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:22.831940 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6mqzt"] Jul 08 18:46:22.852765 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:22.852738 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6mqzt"] Jul 08 18:46:22.852896 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:22.852847 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:22.855522 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:22.855496 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 18:46:22.855522 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:22.855520 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 18:46:22.857056 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:22.857040 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 18:46:22.857346 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:22.857334 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 18:46:22.857396 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:22.857366 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4nhln\"" Jul 08 18:46:22.991990 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:22.991948 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/601dee8f-636a-440b-9cf3-e07f18e171ca-crio-socket\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:22.991990 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:22.991977 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t4z9\" (UniqueName: \"kubernetes.io/projected/601dee8f-636a-440b-9cf3-e07f18e171ca-kube-api-access-5t4z9\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:22.992222 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:22.992002 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/601dee8f-636a-440b-9cf3-e07f18e171ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:22.992222 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:22.992022 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqqfc\" (UniqueName: \"kubernetes.io/projected/82cd28ad-c832-42b7-96d2-b25a09b6ca5f-kube-api-access-hqqfc\") pod \"migrator-d57d58cc9-dbxmn\" (UID: \"82cd28ad-c832-42b7-96d2-b25a09b6ca5f\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dbxmn" Jul 08 18:46:22.992222 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:22.992097 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/601dee8f-636a-440b-9cf3-e07f18e171ca-data-volume\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:22.992222 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:22.992141 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/601dee8f-636a-440b-9cf3-e07f18e171ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:23.092837 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:23.092805 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/601dee8f-636a-440b-9cf3-e07f18e171ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:23.093024 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:23.092845 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqqfc\" (UniqueName: \"kubernetes.io/projected/82cd28ad-c832-42b7-96d2-b25a09b6ca5f-kube-api-access-hqqfc\") pod \"migrator-d57d58cc9-dbxmn\" (UID: \"82cd28ad-c832-42b7-96d2-b25a09b6ca5f\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dbxmn" Jul 08 18:46:23.093024 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:23.092874 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/601dee8f-636a-440b-9cf3-e07f18e171ca-data-volume\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:23.093024 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:23.092891 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/601dee8f-636a-440b-9cf3-e07f18e171ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:23.093024 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:23.092973 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/601dee8f-636a-440b-9cf3-e07f18e171ca-crio-socket\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:23.093263 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:23.093056 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:46:23.093263 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:23.093077 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t4z9\" (UniqueName: \"kubernetes.io/projected/601dee8f-636a-440b-9cf3-e07f18e171ca-kube-api-access-5t4z9\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:23.093263 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:23.093141 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:46:23.093263 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:23.093161 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/601dee8f-636a-440b-9cf3-e07f18e171ca-insights-runtime-extractor-tls podName:601dee8f-636a-440b-9cf3-e07f18e171ca nodeName:}" failed. No retries permitted until 2026-07-08 18:46:23.593108103 +0000 UTC m=+42.353664108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/601dee8f-636a-440b-9cf3-e07f18e171ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6mqzt" (UID: "601dee8f-636a-440b-9cf3-e07f18e171ca") : secret "insights-runtime-extractor-tls" not found Jul 08 18:46:23.093263 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:23.093191 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/601dee8f-636a-440b-9cf3-e07f18e171ca-kube-rbac-proxy-cm podName:601dee8f-636a-440b-9cf3-e07f18e171ca nodeName:}" failed. No retries permitted until 2026-07-08 18:46:23.593178921 +0000 UTC m=+42.353734925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/601dee8f-636a-440b-9cf3-e07f18e171ca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6mqzt" (UID: "601dee8f-636a-440b-9cf3-e07f18e171ca") : configmap "kube-rbac-proxy" not found Jul 08 18:46:23.093263 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:23.093144 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/601dee8f-636a-440b-9cf3-e07f18e171ca-crio-socket\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:23.093263 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:23.093243 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/601dee8f-636a-440b-9cf3-e07f18e171ca-data-volume\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:23.107055 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:23.107026 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqqfc\" (UniqueName: \"kubernetes.io/projected/82cd28ad-c832-42b7-96d2-b25a09b6ca5f-kube-api-access-hqqfc\") pod \"migrator-d57d58cc9-dbxmn\" (UID: \"82cd28ad-c832-42b7-96d2-b25a09b6ca5f\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dbxmn" Jul 08 18:46:23.107193 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:23.107149 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t4z9\" (UniqueName: \"kubernetes.io/projected/601dee8f-636a-440b-9cf3-e07f18e171ca-kube-api-access-5t4z9\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:23.115545 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:23.115526 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dbxmn" Jul 08 18:46:23.276663 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:23.276634 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-dbxmn"] Jul 08 18:46:23.279809 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:46:23.279781 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82cd28ad_c832_42b7_96d2_b25a09b6ca5f.slice/crio-a2edb9ece416737ee2761fcad317ff299e53a58cd266898ef5c4add556ef622d WatchSource:0}: Error finding container a2edb9ece416737ee2761fcad317ff299e53a58cd266898ef5c4add556ef622d: Status 404 returned error can't find the container with id a2edb9ece416737ee2761fcad317ff299e53a58cd266898ef5c4add556ef622d Jul 08 18:46:23.600340 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:23.600303 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/601dee8f-636a-440b-9cf3-e07f18e171ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:23.600517 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:23.600357 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/601dee8f-636a-440b-9cf3-e07f18e171ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:23.600517 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:23.600452 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:46:23.600631 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:23.600520 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/601dee8f-636a-440b-9cf3-e07f18e171ca-kube-rbac-proxy-cm podName:601dee8f-636a-440b-9cf3-e07f18e171ca nodeName:}" failed. No retries permitted until 2026-07-08 18:46:24.600502313 +0000 UTC m=+43.361058330 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/601dee8f-636a-440b-9cf3-e07f18e171ca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6mqzt" (UID: "601dee8f-636a-440b-9cf3-e07f18e171ca") : configmap "kube-rbac-proxy" not found Jul 08 18:46:23.600631 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:23.600453 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:46:23.600631 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:23.600594 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/601dee8f-636a-440b-9cf3-e07f18e171ca-insights-runtime-extractor-tls podName:601dee8f-636a-440b-9cf3-e07f18e171ca nodeName:}" failed. No retries permitted until 2026-07-08 18:46:24.600579493 +0000 UTC m=+43.361135517 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/601dee8f-636a-440b-9cf3-e07f18e171ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6mqzt" (UID: "601dee8f-636a-440b-9cf3-e07f18e171ca") : secret "insights-runtime-extractor-tls" not found Jul 08 18:46:24.283975 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:24.283939 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dbxmn" event={"ID":"82cd28ad-c832-42b7-96d2-b25a09b6ca5f","Type":"ContainerStarted","Data":"a2edb9ece416737ee2761fcad317ff299e53a58cd266898ef5c4add556ef622d"} Jul 08 18:46:24.609674 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:24.609636 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/601dee8f-636a-440b-9cf3-e07f18e171ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:24.609886 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:24.609692 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/601dee8f-636a-440b-9cf3-e07f18e171ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:24.609886 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:24.609787 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:46:24.609886 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:24.609852 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/601dee8f-636a-440b-9cf3-e07f18e171ca-kube-rbac-proxy-cm podName:601dee8f-636a-440b-9cf3-e07f18e171ca nodeName:}" failed. No retries permitted until 2026-07-08 18:46:26.609835108 +0000 UTC m=+45.370391111 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/601dee8f-636a-440b-9cf3-e07f18e171ca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6mqzt" (UID: "601dee8f-636a-440b-9cf3-e07f18e171ca") : configmap "kube-rbac-proxy" not found Jul 08 18:46:24.609886 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:24.609787 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:46:24.610056 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:24.609906 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/601dee8f-636a-440b-9cf3-e07f18e171ca-insights-runtime-extractor-tls podName:601dee8f-636a-440b-9cf3-e07f18e171ca nodeName:}" failed. No retries permitted until 2026-07-08 18:46:26.609893278 +0000 UTC m=+45.370449510 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/601dee8f-636a-440b-9cf3-e07f18e171ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6mqzt" (UID: "601dee8f-636a-440b-9cf3-e07f18e171ca") : secret "insights-runtime-extractor-tls" not found Jul 08 18:46:25.627976 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:25.627940 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc500c34-5a22-4da9-ab09-308d99e6f06f-metrics-tls\") pod \"dns-default-twvqc\" (UID: \"cc500c34-5a22-4da9-ab09-308d99e6f06f\") " pod="openshift-dns/dns-default-twvqc" Jul 08 18:46:25.628343 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:25.628054 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:46:25.628343 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:25.628107 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc500c34-5a22-4da9-ab09-308d99e6f06f-metrics-tls podName:cc500c34-5a22-4da9-ab09-308d99e6f06f nodeName:}" failed. No retries permitted until 2026-07-08 18:46:33.628093851 +0000 UTC m=+52.388649854 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc500c34-5a22-4da9-ab09-308d99e6f06f-metrics-tls") pod "dns-default-twvqc" (UID: "cc500c34-5a22-4da9-ab09-308d99e6f06f") : secret "dns-default-metrics-tls" not found Jul 08 18:46:25.799313 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:25.799288 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vltc2_9466f79e-04ce-4d16-8de0-2e66e513a1b8/dns-node-resolver/0.log" Jul 08 18:46:26.290127 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:26.290082 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dbxmn" event={"ID":"82cd28ad-c832-42b7-96d2-b25a09b6ca5f","Type":"ContainerStarted","Data":"20282d5a7c8988f6bb3223ce14127008f954457ca24eb32176b05f888c191e49"} Jul 08 18:46:26.290274 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:26.290148 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dbxmn" event={"ID":"82cd28ad-c832-42b7-96d2-b25a09b6ca5f","Type":"ContainerStarted","Data":"b84f034b7ed6fd5eecd51a536d794adf80fc238a11c695e3b65a7d2abac02c51"} Jul 08 18:46:26.310339 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:26.310091 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-dbxmn" podStartSLOduration=2.337963229 podStartE2EDuration="4.310073911s" totalImagesPullingTime="1.972110682s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:46:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:26.30963369 +0000 UTC m=+45.070189730" watchObservedRunningTime="2026-07-08 18:46:26.310073911 +0000 UTC m=+45.070629938" Jul 08 18:46:26.403319 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:26.403293 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5kll8_c53b63f5-f85d-4d79-9b48-acc1ba69c016/node-ca/0.log" Jul 08 18:46:26.632892 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:26.632856 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/601dee8f-636a-440b-9cf3-e07f18e171ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:26.633316 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:26.632962 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/601dee8f-636a-440b-9cf3-e07f18e171ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:26.633316 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:26.632979 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:46:26.633316 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:26.633044 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/601dee8f-636a-440b-9cf3-e07f18e171ca-kube-rbac-proxy-cm podName:601dee8f-636a-440b-9cf3-e07f18e171ca nodeName:}" failed. No retries permitted until 2026-07-08 18:46:30.63302856 +0000 UTC m=+49.393584563 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/601dee8f-636a-440b-9cf3-e07f18e171ca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6mqzt" (UID: "601dee8f-636a-440b-9cf3-e07f18e171ca") : configmap "kube-rbac-proxy" not found Jul 08 18:46:26.633316 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:26.633064 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:46:26.633316 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:26.633115 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/601dee8f-636a-440b-9cf3-e07f18e171ca-insights-runtime-extractor-tls podName:601dee8f-636a-440b-9cf3-e07f18e171ca nodeName:}" failed. No retries permitted until 2026-07-08 18:46:30.633098997 +0000 UTC m=+49.393655016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/601dee8f-636a-440b-9cf3-e07f18e171ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6mqzt" (UID: "601dee8f-636a-440b-9cf3-e07f18e171ca") : secret "insights-runtime-extractor-tls" not found Jul 08 18:46:27.404465 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:27.404435 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ptx78_273128b2-e74b-44e4-b4c9-bd9a060bf075/serve-healthcheck-canary/0.log" Jul 08 18:46:27.802509 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:27.802438 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-dbxmn_82cd28ad-c832-42b7-96d2-b25a09b6ca5f/migrator/0.log" Jul 08 18:46:28.004213 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:28.004187 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-dbxmn_82cd28ad-c832-42b7-96d2-b25a09b6ca5f/graceful-termination/0.log" Jul 08 18:46:30.658868 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:30.658837 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/601dee8f-636a-440b-9cf3-e07f18e171ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:30.659254 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:30.658880 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/601dee8f-636a-440b-9cf3-e07f18e171ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:30.659254 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:30.658976 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 18:46:30.659254 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:30.658994 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:46:30.659254 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:30.659041 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/601dee8f-636a-440b-9cf3-e07f18e171ca-insights-runtime-extractor-tls podName:601dee8f-636a-440b-9cf3-e07f18e171ca nodeName:}" failed. No retries permitted until 2026-07-08 18:46:38.659024618 +0000 UTC m=+57.419580631 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/601dee8f-636a-440b-9cf3-e07f18e171ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6mqzt" (UID: "601dee8f-636a-440b-9cf3-e07f18e171ca") : secret "insights-runtime-extractor-tls" not found Jul 08 18:46:30.659254 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:30.659057 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/601dee8f-636a-440b-9cf3-e07f18e171ca-kube-rbac-proxy-cm podName:601dee8f-636a-440b-9cf3-e07f18e171ca nodeName:}" failed. No retries permitted until 2026-07-08 18:46:38.659049064 +0000 UTC m=+57.419605068 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/601dee8f-636a-440b-9cf3-e07f18e171ca-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6mqzt" (UID: "601dee8f-636a-440b-9cf3-e07f18e171ca") : configmap "kube-rbac-proxy" not found Jul 08 18:46:33.678999 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:33.678965 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc500c34-5a22-4da9-ab09-308d99e6f06f-metrics-tls\") pod \"dns-default-twvqc\" (UID: \"cc500c34-5a22-4da9-ab09-308d99e6f06f\") " pod="openshift-dns/dns-default-twvqc" Jul 08 18:46:33.679377 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:33.679112 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 18:46:33.679377 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:33.679192 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc500c34-5a22-4da9-ab09-308d99e6f06f-metrics-tls podName:cc500c34-5a22-4da9-ab09-308d99e6f06f nodeName:}" failed. No retries permitted until 2026-07-08 18:46:49.679175105 +0000 UTC m=+68.439731125 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc500c34-5a22-4da9-ab09-308d99e6f06f-metrics-tls") pod "dns-default-twvqc" (UID: "cc500c34-5a22-4da9-ab09-308d99e6f06f") : secret "dns-default-metrics-tls" not found Jul 08 18:46:38.718800 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:38.718763 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/601dee8f-636a-440b-9cf3-e07f18e171ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:38.719357 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:38.718847 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/601dee8f-636a-440b-9cf3-e07f18e171ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:38.719357 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:38.718954 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 18:46:38.719357 ip-10-0-135-240 kubenswrapper[2552]: E0708 18:46:38.719035 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/601dee8f-636a-440b-9cf3-e07f18e171ca-insights-runtime-extractor-tls podName:601dee8f-636a-440b-9cf3-e07f18e171ca nodeName:}" failed. No retries permitted until 2026-07-08 18:46:54.7190194 +0000 UTC m=+73.479575407 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/601dee8f-636a-440b-9cf3-e07f18e171ca-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6mqzt" (UID: "601dee8f-636a-440b-9cf3-e07f18e171ca") : secret "insights-runtime-extractor-tls" not found Jul 08 18:46:38.719357 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:38.719313 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/601dee8f-636a-440b-9cf3-e07f18e171ca-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:41.243266 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:41.243240 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z5c8p" Jul 08 18:46:46.576439 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:46.576396 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs\") pod \"network-metrics-daemon-qwpjz\" (UID: \"5f414ab9-ae98-4c7e-9edc-962d4bc015d9\") " pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:46:46.576902 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:46.576490 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret\") pod \"global-pull-secret-syncer-8qr2f\" (UID: \"b70588ff-d41a-450a-a622-d06fd0318b56\") " pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:46:46.579143 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:46.579103 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 18:46:46.579202 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:46.579169 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 18:46:46.589333 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:46.589302 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b70588ff-d41a-450a-a622-d06fd0318b56-original-pull-secret\") pod \"global-pull-secret-syncer-8qr2f\" (UID: \"b70588ff-d41a-450a-a622-d06fd0318b56\") " pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:46:46.589333 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:46.589325 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f414ab9-ae98-4c7e-9edc-962d4bc015d9-metrics-certs\") pod \"network-metrics-daemon-qwpjz\" (UID: \"5f414ab9-ae98-4c7e-9edc-962d4bc015d9\") " pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:46:46.597991 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:46.597971 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5bv4l\"" Jul 08 18:46:46.605874 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:46.605846 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qwpjz" Jul 08 18:46:46.608085 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:46.608056 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8qr2f" Jul 08 18:46:46.677845 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:46.677657 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nfgp\" (UniqueName: \"kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp\") pod \"network-check-target-hh4t4\" (UID: \"12465724-278f-4b3a-b9d2-88970e1b8d66\") " pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:46:46.680853 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:46.680828 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 18:46:46.690837 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:46.690809 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 18:46:46.701673 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:46.701646 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nfgp\" (UniqueName: \"kubernetes.io/projected/12465724-278f-4b3a-b9d2-88970e1b8d66-kube-api-access-8nfgp\") pod \"network-check-target-hh4t4\" (UID: \"12465724-278f-4b3a-b9d2-88970e1b8d66\") " pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:46:46.748207 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:46.748164 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8qr2f"] Jul 08 18:46:46.750759 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:46:46.750732 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb70588ff_d41a_450a_a622_d06fd0318b56.slice/crio-5978c25ee7a6ca19b1bd068c6ab885377c43ef9baff3ed15a72448c88cae10d2 WatchSource:0}: Error finding container 5978c25ee7a6ca19b1bd068c6ab885377c43ef9baff3ed15a72448c88cae10d2: Status 404 returned error can't find the container with id 5978c25ee7a6ca19b1bd068c6ab885377c43ef9baff3ed15a72448c88cae10d2 Jul 08 18:46:46.753836 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:46.753810 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qwpjz"] Jul 08 18:46:46.756361 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:46:46.756340 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f414ab9_ae98_4c7e_9edc_962d4bc015d9.slice/crio-ef19fe167f9c19be0b3a6e41a88563a19141d0f88c4609e6635beeb86f821255 WatchSource:0}: Error finding container ef19fe167f9c19be0b3a6e41a88563a19141d0f88c4609e6635beeb86f821255: Status 404 returned error can't find the container with id ef19fe167f9c19be0b3a6e41a88563a19141d0f88c4609e6635beeb86f821255 Jul 08 18:46:46.904945 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:46.904865 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zrdnt\"" Jul 08 18:46:46.912477 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:46.912443 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:46:47.035214 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:47.035182 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hh4t4"] Jul 08 18:46:47.037988 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:46:47.037958 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12465724_278f_4b3a_b9d2_88970e1b8d66.slice/crio-44e4b5c29e44eaf237cdba66c4d128c10f8668cd04fc85627be28808273e128a WatchSource:0}: Error finding container 44e4b5c29e44eaf237cdba66c4d128c10f8668cd04fc85627be28808273e128a: Status 404 returned error can't find the container with id 44e4b5c29e44eaf237cdba66c4d128c10f8668cd04fc85627be28808273e128a Jul 08 18:46:47.341479 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:47.341369 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8qr2f" event={"ID":"b70588ff-d41a-450a-a622-d06fd0318b56","Type":"ContainerStarted","Data":"5978c25ee7a6ca19b1bd068c6ab885377c43ef9baff3ed15a72448c88cae10d2"} Jul 08 18:46:47.342899 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:47.342870 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hh4t4" event={"ID":"12465724-278f-4b3a-b9d2-88970e1b8d66","Type":"ContainerStarted","Data":"44e4b5c29e44eaf237cdba66c4d128c10f8668cd04fc85627be28808273e128a"} Jul 08 18:46:47.344188 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:47.344167 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qwpjz" event={"ID":"5f414ab9-ae98-4c7e-9edc-962d4bc015d9","Type":"ContainerStarted","Data":"ef19fe167f9c19be0b3a6e41a88563a19141d0f88c4609e6635beeb86f821255"} Jul 08 18:46:48.349834 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:48.349768 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qwpjz" event={"ID":"5f414ab9-ae98-4c7e-9edc-962d4bc015d9","Type":"ContainerStarted","Data":"7e10d68a939c8383608f0c8a36856d613765fd5c4d6a3fe645c5502e5b45d38a"} Jul 08 18:46:48.350283 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:48.349840 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qwpjz" event={"ID":"5f414ab9-ae98-4c7e-9edc-962d4bc015d9","Type":"ContainerStarted","Data":"b42bf8f3f39476319ff61eceeeda0870fafcd06f52f550910798c4e3edfddb35"} Jul 08 18:46:48.367106 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:48.367056 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qwpjz" podStartSLOduration=66.54394159 podStartE2EDuration="1m7.367037423s" totalImagesPullingTime="823.095833ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:45:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:48.366290278 +0000 UTC m=+67.126846305" watchObservedRunningTime="2026-07-08 18:46:48.367037423 +0000 UTC m=+67.127593450" Jul 08 18:46:49.700883 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:49.700843 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc500c34-5a22-4da9-ab09-308d99e6f06f-metrics-tls\") pod \"dns-default-twvqc\" (UID: \"cc500c34-5a22-4da9-ab09-308d99e6f06f\") " pod="openshift-dns/dns-default-twvqc" Jul 08 18:46:49.703651 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:49.703624 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc500c34-5a22-4da9-ab09-308d99e6f06f-metrics-tls\") pod \"dns-default-twvqc\" (UID: \"cc500c34-5a22-4da9-ab09-308d99e6f06f\") " pod="openshift-dns/dns-default-twvqc" Jul 08 18:46:49.841244 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:49.841215 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-k5jtp\"" Jul 08 18:46:49.849445 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:49.849418 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-twvqc" Jul 08 18:46:50.131142 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.131090 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddbb59fbb-j4kkn"] Jul 08 18:46:50.152638 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.152601 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm"] Jul 08 18:46:50.152811 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.152759 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddbb59fbb-j4kkn" Jul 08 18:46:50.156290 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.156260 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 08 18:46:50.156429 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.156301 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 08 18:46:50.156429 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.156309 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 08 18:46:50.156429 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.156323 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-47sns\"" Jul 08 18:46:50.156429 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.156396 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 08 18:46:50.166346 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.166321 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddbb59fbb-j4kkn"] Jul 08 18:46:50.166454 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.166427 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" Jul 08 18:46:50.168698 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.168672 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm"] Jul 08 18:46:50.168826 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.168801 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 08 18:46:50.168826 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.168810 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 08 18:46:50.169266 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.169215 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 08 18:46:50.173184 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.173164 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 08 18:46:50.203992 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.203966 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv7fh\" (UniqueName: \"kubernetes.io/projected/53bf376a-7d84-4a33-abea-cc634b00ce55-kube-api-access-kv7fh\") pod \"managed-serviceaccount-addon-agent-6ddbb59fbb-j4kkn\" (UID: \"53bf376a-7d84-4a33-abea-cc634b00ce55\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddbb59fbb-j4kkn" Jul 08 18:46:50.204142 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.203999 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/53bf376a-7d84-4a33-abea-cc634b00ce55-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6ddbb59fbb-j4kkn\" (UID: \"53bf376a-7d84-4a33-abea-cc634b00ce55\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddbb59fbb-j4kkn" Jul 08 18:46:50.204142 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.204021 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe-hub\") pod \"cluster-proxy-proxy-agent-664c4fc6bf-wkztm\" (UID: \"2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" Jul 08 18:46:50.204142 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.204082 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96vt4\" (UniqueName: \"kubernetes.io/projected/2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe-kube-api-access-96vt4\") pod \"cluster-proxy-proxy-agent-664c4fc6bf-wkztm\" (UID: \"2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" Jul 08 18:46:50.204142 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.204134 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe-ca\") pod \"cluster-proxy-proxy-agent-664c4fc6bf-wkztm\" (UID: \"2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" Jul 08 18:46:50.204295 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.204168 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe-additional-service-ca\") pod \"cluster-proxy-proxy-agent-664c4fc6bf-wkztm\" (UID: \"2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" Jul 08 18:46:50.204295 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.204194 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-664c4fc6bf-wkztm\" (UID: \"2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" Jul 08 18:46:50.204295 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.204216 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-664c4fc6bf-wkztm\" (UID: \"2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" Jul 08 18:46:50.305098 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.305074 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv7fh\" (UniqueName: \"kubernetes.io/projected/53bf376a-7d84-4a33-abea-cc634b00ce55-kube-api-access-kv7fh\") pod \"managed-serviceaccount-addon-agent-6ddbb59fbb-j4kkn\" (UID: \"53bf376a-7d84-4a33-abea-cc634b00ce55\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddbb59fbb-j4kkn" Jul 08 18:46:50.305098 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.305105 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/53bf376a-7d84-4a33-abea-cc634b00ce55-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6ddbb59fbb-j4kkn\" (UID: \"53bf376a-7d84-4a33-abea-cc634b00ce55\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddbb59fbb-j4kkn" Jul 08 18:46:50.305331 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.305136 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe-hub\") pod \"cluster-proxy-proxy-agent-664c4fc6bf-wkztm\" (UID: \"2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" Jul 08 18:46:50.305394 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.305321 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96vt4\" (UniqueName: \"kubernetes.io/projected/2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe-kube-api-access-96vt4\") pod \"cluster-proxy-proxy-agent-664c4fc6bf-wkztm\" (UID: \"2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" Jul 08 18:46:50.305394 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.305378 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe-ca\") pod \"cluster-proxy-proxy-agent-664c4fc6bf-wkztm\" (UID: \"2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" Jul 08 18:46:50.305496 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.305411 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe-additional-service-ca\") pod \"cluster-proxy-proxy-agent-664c4fc6bf-wkztm\" (UID: \"2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" Jul 08 18:46:50.305496 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.305452 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-664c4fc6bf-wkztm\" (UID: \"2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" Jul 08 18:46:50.305702 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.305667 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-664c4fc6bf-wkztm\" (UID: \"2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" Jul 08 18:46:50.306350 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.306319 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe-additional-service-ca\") pod \"cluster-proxy-proxy-agent-664c4fc6bf-wkztm\" (UID: \"2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" Jul 08 18:46:50.307813 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.307785 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe-ca\") pod \"cluster-proxy-proxy-agent-664c4fc6bf-wkztm\" (UID: \"2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" Jul 08 18:46:50.308089 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.308071 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe-hub\") pod \"cluster-proxy-proxy-agent-664c4fc6bf-wkztm\" (UID: \"2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" Jul 08 18:46:50.308202 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.308108 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/53bf376a-7d84-4a33-abea-cc634b00ce55-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6ddbb59fbb-j4kkn\" (UID: \"53bf376a-7d84-4a33-abea-cc634b00ce55\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddbb59fbb-j4kkn" Jul 08 18:46:50.308257 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.308210 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-664c4fc6bf-wkztm\" (UID: \"2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" Jul 08 18:46:50.308454 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.308432 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-664c4fc6bf-wkztm\" (UID: \"2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" Jul 08 18:46:50.327706 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.327683 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96vt4\" (UniqueName: \"kubernetes.io/projected/2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe-kube-api-access-96vt4\") pod \"cluster-proxy-proxy-agent-664c4fc6bf-wkztm\" (UID: \"2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" Jul 08 18:46:50.327884 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.327865 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv7fh\" (UniqueName: \"kubernetes.io/projected/53bf376a-7d84-4a33-abea-cc634b00ce55-kube-api-access-kv7fh\") pod \"managed-serviceaccount-addon-agent-6ddbb59fbb-j4kkn\" (UID: \"53bf376a-7d84-4a33-abea-cc634b00ce55\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddbb59fbb-j4kkn" Jul 08 18:46:50.472639 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.472565 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddbb59fbb-j4kkn" Jul 08 18:46:50.484766 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:50.484738 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" Jul 08 18:46:51.958022 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:51.957983 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-twvqc"] Jul 08 18:46:51.963004 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:46:51.962969 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc500c34_5a22_4da9_ab09_308d99e6f06f.slice/crio-2914370902a0cb2e50f44bb1cf17d02fa90f4a02c57ddf8190664ee67625f114 WatchSource:0}: Error finding container 2914370902a0cb2e50f44bb1cf17d02fa90f4a02c57ddf8190664ee67625f114: Status 404 returned error can't find the container with id 2914370902a0cb2e50f44bb1cf17d02fa90f4a02c57ddf8190664ee67625f114 Jul 08 18:46:51.966192 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:51.966083 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm"] Jul 08 18:46:51.970594 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:46:51.970564 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2cbd4ea0_59b6_417d_bcb1_5be5934f5bfe.slice/crio-a50a188472fd43f34ad8596a6f799ca381b11b75d62e25c15ac4029dd3bcb111 WatchSource:0}: Error finding container a50a188472fd43f34ad8596a6f799ca381b11b75d62e25c15ac4029dd3bcb111: Status 404 returned error can't find the container with id a50a188472fd43f34ad8596a6f799ca381b11b75d62e25c15ac4029dd3bcb111 Jul 08 18:46:51.989888 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:51.989745 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddbb59fbb-j4kkn"] Jul 08 18:46:51.991329 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:46:51.991302 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53bf376a_7d84_4a33_abea_cc634b00ce55.slice/crio-04bbc8c8d580e1eacfab7cec711c6f88a1c94f00dc66e2d14777bf3bcde663ef WatchSource:0}: Error finding container 04bbc8c8d580e1eacfab7cec711c6f88a1c94f00dc66e2d14777bf3bcde663ef: Status 404 returned error can't find the container with id 04bbc8c8d580e1eacfab7cec711c6f88a1c94f00dc66e2d14777bf3bcde663ef Jul 08 18:46:52.365966 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:52.365928 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8qr2f" event={"ID":"b70588ff-d41a-450a-a622-d06fd0318b56","Type":"ContainerStarted","Data":"f46dc6463b312998561a535962783f2ac1a2fe1b5de0407cc5a906a87b2a10c5"} Jul 08 18:46:52.367079 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:52.367055 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-twvqc" event={"ID":"cc500c34-5a22-4da9-ab09-308d99e6f06f","Type":"ContainerStarted","Data":"2914370902a0cb2e50f44bb1cf17d02fa90f4a02c57ddf8190664ee67625f114"} Jul 08 18:46:52.368075 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:52.368053 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddbb59fbb-j4kkn" event={"ID":"53bf376a-7d84-4a33-abea-cc634b00ce55","Type":"ContainerStarted","Data":"04bbc8c8d580e1eacfab7cec711c6f88a1c94f00dc66e2d14777bf3bcde663ef"} Jul 08 18:46:52.369496 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:52.369475 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hh4t4" event={"ID":"12465724-278f-4b3a-b9d2-88970e1b8d66","Type":"ContainerStarted","Data":"27eb4d3abcc467bb8a019cff9f389b44df595bc6b346c38f201eff4865e08d7b"} Jul 08 18:46:52.369590 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:52.369532 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:46:52.370611 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:52.370592 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" event={"ID":"2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe","Type":"ContainerStarted","Data":"a50a188472fd43f34ad8596a6f799ca381b11b75d62e25c15ac4029dd3bcb111"} Jul 08 18:46:52.380500 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:52.380453 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8qr2f" podStartSLOduration=65.324637492 podStartE2EDuration="1m10.380440895s" totalImagesPullingTime="5.055803403s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:45:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:52.380296335 +0000 UTC m=+71.140852361" watchObservedRunningTime="2026-07-08 18:46:52.380440895 +0000 UTC m=+71.140996899" Jul 08 18:46:52.396375 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:52.396321 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hh4t4" podStartSLOduration=65.637980698 podStartE2EDuration="1m10.396305049s" totalImagesPullingTime="4.758324351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:45:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:52.395537109 +0000 UTC m=+71.156093135" watchObservedRunningTime="2026-07-08 18:46:52.396305049 +0000 UTC m=+71.156861079" Jul 08 18:46:54.741634 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:54.741524 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/601dee8f-636a-440b-9cf3-e07f18e171ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:54.744495 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:54.744465 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/601dee8f-636a-440b-9cf3-e07f18e171ca-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6mqzt\" (UID: \"601dee8f-636a-440b-9cf3-e07f18e171ca\") " pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:54.964446 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:54.964411 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4nhln\"" Jul 08 18:46:54.972872 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:54.972850 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6mqzt" Jul 08 18:46:56.391904 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:56.391823 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-twvqc" event={"ID":"cc500c34-5a22-4da9-ab09-308d99e6f06f","Type":"ContainerStarted","Data":"f57eff17deb43423a1c31fdfe0d0df2c208a859422b56dcc8be841e71e2cd496"} Jul 08 18:46:56.394686 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:56.394633 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddbb59fbb-j4kkn" event={"ID":"53bf376a-7d84-4a33-abea-cc634b00ce55","Type":"ContainerStarted","Data":"7d8712009562888f58587b23079c8bbdda74ddb0adba90135417238634c3cacf"} Jul 08 18:46:56.398608 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:56.398377 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" event={"ID":"2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe","Type":"ContainerStarted","Data":"952c1a914d5bf5be6e84119fc9f9927526830599c7788d12fb48af74c32c394c"} Jul 08 18:46:56.410401 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:56.410048 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6mqzt"] Jul 08 18:46:56.417576 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:56.417111 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6ddbb59fbb-j4kkn" podStartSLOduration=2.160659695 podStartE2EDuration="6.417085758s" totalImagesPullingTime="4.256426063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:56.416362699 +0000 UTC m=+75.176918727" watchObservedRunningTime="2026-07-08 18:46:56.417085758 +0000 UTC m=+75.177641853" Jul 08 18:46:57.408354 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:57.408311 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" event={"ID":"2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe","Type":"ContainerStarted","Data":"83b262610ad5f8b7249e4afae396ec2a29995093c525e876b2831cee0cbaea80"} Jul 08 18:46:57.408831 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:57.408368 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" event={"ID":"2cbd4ea0-59b6-417d-bcb1-5be5934f5bfe","Type":"ContainerStarted","Data":"f9c758eff4fab6dce3c170a35703da89562d563ae77e5f49e48e922b2436a654"} Jul 08 18:46:57.410172 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:57.410137 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mqzt" event={"ID":"601dee8f-636a-440b-9cf3-e07f18e171ca","Type":"ContainerStarted","Data":"09a4a656c2c13e5545ababfc00a44b78d197beb338771138994c575c5e3d01e3"} Jul 08 18:46:57.413595 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:57.413567 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-twvqc" event={"ID":"cc500c34-5a22-4da9-ab09-308d99e6f06f","Type":"ContainerStarted","Data":"38147870c7e5986d5dd3c90e5c40692af57bc409ec0f08f2edc89c8fc8869027"} Jul 08 18:46:57.431530 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:57.431275 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-664c4fc6bf-wkztm" podStartSLOduration=3.132740116 podStartE2EDuration="7.431253573s" totalImagesPullingTime="4.298513457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:46:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:57.430932025 +0000 UTC m=+76.191488048" watchObservedRunningTime="2026-07-08 18:46:57.431253573 +0000 UTC m=+76.191809597" Jul 08 18:46:57.453368 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:57.453235 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-twvqc" podStartSLOduration=36.176770283 podStartE2EDuration="40.453214728s" totalImagesPullingTime="4.276444445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:46:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:46:57.451652875 +0000 UTC m=+76.212208946" watchObservedRunningTime="2026-07-08 18:46:57.453214728 +0000 UTC m=+76.213770753" Jul 08 18:46:58.417485 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:46:58.417451 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-twvqc" Jul 08 18:47:00.425941 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:00.425907 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mqzt" event={"ID":"601dee8f-636a-440b-9cf3-e07f18e171ca","Type":"ContainerStarted","Data":"42c9076fee6f55a1f57477fe53de1382c3c449d3f9ecfe3e40c5d62760650ec5"} Jul 08 18:47:01.430865 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:01.430831 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mqzt" event={"ID":"601dee8f-636a-440b-9cf3-e07f18e171ca","Type":"ContainerStarted","Data":"eb63cc300de938e8912f3e6b535026781e4417497aca9f2943de293907020fc3"} Jul 08 18:47:04.442873 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:04.442838 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6mqzt" event={"ID":"601dee8f-636a-440b-9cf3-e07f18e171ca","Type":"ContainerStarted","Data":"99e7cf5f99f109857e353360963d44d5518b6b3133487a706bd43cb5d5b957a9"} Jul 08 18:47:04.463647 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:04.463591 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6mqzt" podStartSLOduration=35.339891608 podStartE2EDuration="42.463575065s" totalImagesPullingTime="7.123683457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 18:46:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:47:04.463109607 +0000 UTC m=+83.223665670" watchObservedRunningTime="2026-07-08 18:47:04.463575065 +0000 UTC m=+83.224131094" Jul 08 18:47:08.424142 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:08.424086 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-twvqc" Jul 08 18:47:12.899549 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:12.899518 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dlhsm"] Jul 08 18:47:12.903876 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:12.903854 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:12.906822 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:12.906797 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 18:47:12.907044 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:12.907022 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 18:47:12.907725 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:12.907712 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 18:47:12.907775 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:12.907739 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 18:47:12.908542 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:12.908522 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-q7zvb\"" Jul 08 18:47:12.909096 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:12.909069 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 18:47:12.912457 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:12.909360 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 18:47:12.960755 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:12.960724 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:12.960755 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:12.960760 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-node-exporter-accelerators-collector-config\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:12.960951 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:12.960781 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vxxs\" (UniqueName: \"kubernetes.io/projected/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-kube-api-access-8vxxs\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:12.960951 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:12.960801 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-sys\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:12.960951 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:12.960817 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-node-exporter-tls\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:12.960951 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:12.960832 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-node-exporter-wtmp\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:12.960951 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:12.960859 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-node-exporter-textfile\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:12.960951 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:12.960883 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-metrics-client-ca\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:12.960951 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:12.960899 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-root\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:13.061466 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:13.061434 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vxxs\" (UniqueName: \"kubernetes.io/projected/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-kube-api-access-8vxxs\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:13.061610 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:13.061475 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-sys\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:13.061610 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:13.061498 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-node-exporter-tls\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:13.061610 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:13.061521 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-node-exporter-wtmp\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:13.061610 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:13.061559 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-sys\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:13.061818 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:13.061635 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-node-exporter-textfile\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:13.061818 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:13.061656 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-node-exporter-wtmp\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:13.061818 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:13.061696 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-metrics-client-ca\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:13.061818 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:13.061728 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-root\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:13.061818 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:13.061764 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:13.061818 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:13.061797 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-node-exporter-accelerators-collector-config\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:13.062173 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:13.061840 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-root\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:13.062173 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:13.062044 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-node-exporter-textfile\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:13.062435 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:13.062415 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-metrics-client-ca\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:13.062480 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:13.062445 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-node-exporter-accelerators-collector-config\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:13.064027 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:13.064005 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:13.064102 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:13.064033 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-node-exporter-tls\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:13.079177 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:13.079147 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vxxs\" (UniqueName: \"kubernetes.io/projected/0848f447-fbb1-4fca-82f3-bba8fc13fc5c-kube-api-access-8vxxs\") pod \"node-exporter-dlhsm\" (UID: \"0848f447-fbb1-4fca-82f3-bba8fc13fc5c\") " pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:13.215899 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:13.215824 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dlhsm" Jul 08 18:47:13.225998 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:47:13.225972 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0848f447_fbb1_4fca_82f3_bba8fc13fc5c.slice/crio-2c545ba986fff8337d4afc61c709949ccef8cb8253d81af15382a6f57fbd8462 WatchSource:0}: Error finding container 2c545ba986fff8337d4afc61c709949ccef8cb8253d81af15382a6f57fbd8462: Status 404 returned error can't find the container with id 2c545ba986fff8337d4afc61c709949ccef8cb8253d81af15382a6f57fbd8462 Jul 08 18:47:13.474062 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:13.473973 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dlhsm" event={"ID":"0848f447-fbb1-4fca-82f3-bba8fc13fc5c","Type":"ContainerStarted","Data":"2c545ba986fff8337d4afc61c709949ccef8cb8253d81af15382a6f57fbd8462"} Jul 08 18:47:14.479347 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:14.479315 2552 generic.go:356] "Generic (PLEG): container finished" podID="0848f447-fbb1-4fca-82f3-bba8fc13fc5c" containerID="4a6fe764a8acd86dfcc53a8fa11b7b71b118d593f7a49996bfcf507289669333" exitCode=0 Jul 08 18:47:14.479735 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:14.479391 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dlhsm" event={"ID":"0848f447-fbb1-4fca-82f3-bba8fc13fc5c","Type":"ContainerDied","Data":"4a6fe764a8acd86dfcc53a8fa11b7b71b118d593f7a49996bfcf507289669333"} Jul 08 18:47:15.485349 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:15.485312 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dlhsm" event={"ID":"0848f447-fbb1-4fca-82f3-bba8fc13fc5c","Type":"ContainerStarted","Data":"8d99d4bf0923cc9ce85f28451af93b9df2ae0856b8ba625226f6da6ce8de5a95"} Jul 08 18:47:15.485756 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:15.485365 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dlhsm" event={"ID":"0848f447-fbb1-4fca-82f3-bba8fc13fc5c","Type":"ContainerStarted","Data":"38df3e2b19c4ca5f0fc1fc694e6a6149ee1e2adae90febe450a11d1175a91a45"} Jul 08 18:47:15.506805 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:15.506744 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dlhsm" podStartSLOduration=2.345193826 podStartE2EDuration="3.506720347s" totalImagesPullingTime="1.094866938s" totalInitContainerRuntime="66.659583ms" isStatefulPod=true podCreationTimestamp="2026-07-08 18:47:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:47:15.505237988 +0000 UTC m=+94.265794016" watchObservedRunningTime="2026-07-08 18:47:15.506720347 +0000 UTC m=+94.267276375" Jul 08 18:47:19.189787 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.189747 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 18:47:19.195973 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.195952 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.199048 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.199026 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 08 18:47:19.199974 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.199957 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 08 18:47:19.200178 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.200165 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 08 18:47:19.200768 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.200754 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 08 18:47:19.200853 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.200833 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 08 18:47:19.201060 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.201042 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 08 18:47:19.201589 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.201569 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 08 18:47:19.201687 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.201669 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 08 18:47:19.202383 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.202180 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 08 18:47:19.202664 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.202649 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 08 18:47:19.202745 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.202696 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-10j5pl8h6g8tq\"" Jul 08 18:47:19.206784 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.206766 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tmd6h\"" Jul 08 18:47:19.206981 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.206967 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 08 18:47:19.208296 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.208277 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 08 18:47:19.211585 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.211568 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 08 18:47:19.211663 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.211616 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 08 18:47:19.212485 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.212472 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 08 18:47:19.239365 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.239330 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 18:47:19.308799 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.308770 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.308799 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.308802 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.309015 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.308821 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.309015 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.308842 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.309015 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.308867 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.309015 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.308890 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.309015 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.308911 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.309015 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.308934 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.309015 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.308956 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.309015 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.308990 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.309015 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.309013 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.309435 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.309029 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7cwl\" (UniqueName: \"kubernetes.io/projected/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-kube-api-access-c7cwl\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.309435 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.309054 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-config-out\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.309435 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.309111 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.309435 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.309171 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-config\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.309435 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.309195 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.309435 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.309228 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.309435 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.309251 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.309435 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.309280 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-web-config\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.309435 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.309300 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.410356 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.410323 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.410356 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.410359 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.410621 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.410379 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7cwl\" (UniqueName: \"kubernetes.io/projected/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-kube-api-access-c7cwl\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.410621 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.410402 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-config-out\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.410621 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.410427 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.410621 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.410452 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-config\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.410621 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.410472 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.410621 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.410503 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.410621 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.410525 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.410621 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.410545 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-web-config\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.410621 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.410566 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.410621 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.410620 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.411087 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.410651 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.411087 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.410674 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.411087 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.410698 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.411087 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.410723 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.411087 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.410747 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.411087 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.410776 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.411087 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.410808 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.411087 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.410835 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.411500 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.411468 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.411552 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.411470 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.412520 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.412190 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.412520 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.412210 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.412719 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.412609 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.413916 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.413310 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.413916 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.413861 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.414328 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.414305 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.414476 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.414363 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.414940 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.414919 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.415314 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.415267 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.415314 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.415304 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-config\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.415937 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.415700 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.415937 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.415888 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.416164 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.416135 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.416475 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.416454 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-config-out\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.416552 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.416474 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-web-config\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.416681 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.416602 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.417002 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.416987 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.418594 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.418575 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7cwl\" (UniqueName: \"kubernetes.io/projected/b7f9bc31-1077-4b34-ac32-9bd2235fa14d-kube-api-access-c7cwl\") pod \"prometheus-k8s-0\" (UID: \"b7f9bc31-1077-4b34-ac32-9bd2235fa14d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.504840 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.504765 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:47:19.640928 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:19.640899 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 08 18:47:19.643432 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:47:19.643401 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7f9bc31_1077_4b34_ac32_9bd2235fa14d.slice/crio-5b3116daa8406e4c1ed4d58c01bf6aadbe3a0ec9a75b68331699c7b952bf8eb2 WatchSource:0}: Error finding container 5b3116daa8406e4c1ed4d58c01bf6aadbe3a0ec9a75b68331699c7b952bf8eb2: Status 404 returned error can't find the container with id 5b3116daa8406e4c1ed4d58c01bf6aadbe3a0ec9a75b68331699c7b952bf8eb2 Jul 08 18:47:20.504403 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:20.504361 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7f9bc31-1077-4b34-ac32-9bd2235fa14d","Type":"ContainerStarted","Data":"5b3116daa8406e4c1ed4d58c01bf6aadbe3a0ec9a75b68331699c7b952bf8eb2"} Jul 08 18:47:21.509278 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:21.509243 2552 generic.go:356] "Generic (PLEG): container finished" podID="b7f9bc31-1077-4b34-ac32-9bd2235fa14d" containerID="af68f6ad3a43bb94f423b2f2f9154f418da4461962c13c97dc5ea42b88ba68ce" exitCode=0 Jul 08 18:47:21.509669 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:21.509302 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7f9bc31-1077-4b34-ac32-9bd2235fa14d","Type":"ContainerDied","Data":"af68f6ad3a43bb94f423b2f2f9154f418da4461962c13c97dc5ea42b88ba68ce"} Jul 08 18:47:23.379220 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:23.379184 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hh4t4" Jul 08 18:47:25.526501 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:25.526469 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7f9bc31-1077-4b34-ac32-9bd2235fa14d","Type":"ContainerStarted","Data":"474ba83cbe1d96139a0d097257bef6ce3b20e0097a258cd3534d2a0b151162d6"} Jul 08 18:47:26.532971 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:26.532932 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7f9bc31-1077-4b34-ac32-9bd2235fa14d","Type":"ContainerStarted","Data":"87f6b9abb357a4ff4ece37a2661ab0179b4a8667f6be0fe4daa5f5fa609f49cf"} Jul 08 18:47:28.543256 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:28.543230 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7f9bc31-1077-4b34-ac32-9bd2235fa14d","Type":"ContainerStarted","Data":"10c974d46747a3fa09c0f72160a281205af2457a9dd07e9fb09c18394205ee4d"} Jul 08 18:47:28.543555 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:28.543308 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7f9bc31-1077-4b34-ac32-9bd2235fa14d","Type":"ContainerStarted","Data":"cf31fe893afeef3803aa71208b92d46dc7406c047bb13212c6bdf2025121929b"} Jul 08 18:47:28.543555 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:28.543355 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7f9bc31-1077-4b34-ac32-9bd2235fa14d","Type":"ContainerStarted","Data":"9b40f59d384204898fa71769711fe9e90458bb0605cb1e43115130ac4481a2cf"} Jul 08 18:47:29.549615 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:29.549580 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b7f9bc31-1077-4b34-ac32-9bd2235fa14d","Type":"ContainerStarted","Data":"3dc8f9dbc4818168b7457946fce92b791283826a1426f17eecc0199d327ade97"} Jul 08 18:47:29.581562 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:29.581498 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.923910437 podStartE2EDuration="10.581474431s" totalImagesPullingTime="7.637879003s" totalInitContainerRuntime="19.684991ms" isStatefulPod=false podCreationTimestamp="2026-07-08 18:47:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:47:29.579165765 +0000 UTC m=+108.339721789" watchObservedRunningTime="2026-07-08 18:47:29.581474431 +0000 UTC m=+108.342030458" Jul 08 18:47:34.505186 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:47:34.505147 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:48:19.505700 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:48:19.505659 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:48:19.523997 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:48:19.523971 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:48:19.732256 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:48:19.732229 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 08 18:50:41.781803 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:50:41.781765 2552 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 18:51:09.176188 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.176152 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2"] Jul 08 18:51:09.179329 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.179312 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" Jul 08 18:51:09.187754 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.187718 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 18:51:09.187928 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.187730 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4vdkb\"" Jul 08 18:51:09.187928 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.187736 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 18:51:09.187928 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.187813 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 18:51:09.188509 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.188488 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 18:51:09.204464 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.204434 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2"] Jul 08 18:51:09.289139 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.289086 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/19920a04-89c6-40ab-8227-af6ae679c178-manifests\") pod \"opendatahub-operator-controller-manager-6bb8746f75-dbnm2\" (UID: \"19920a04-89c6-40ab-8227-af6ae679c178\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" Jul 08 18:51:09.289369 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.289158 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/19920a04-89c6-40ab-8227-af6ae679c178-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bb8746f75-dbnm2\" (UID: \"19920a04-89c6-40ab-8227-af6ae679c178\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" Jul 08 18:51:09.289369 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.289235 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19920a04-89c6-40ab-8227-af6ae679c178-tmp\") pod \"opendatahub-operator-controller-manager-6bb8746f75-dbnm2\" (UID: \"19920a04-89c6-40ab-8227-af6ae679c178\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" Jul 08 18:51:09.289369 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.289278 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/19920a04-89c6-40ab-8227-af6ae679c178-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bb8746f75-dbnm2\" (UID: \"19920a04-89c6-40ab-8227-af6ae679c178\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" Jul 08 18:51:09.289369 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.289303 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzt6m\" (UniqueName: \"kubernetes.io/projected/19920a04-89c6-40ab-8227-af6ae679c178-kube-api-access-lzt6m\") pod \"opendatahub-operator-controller-manager-6bb8746f75-dbnm2\" (UID: \"19920a04-89c6-40ab-8227-af6ae679c178\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" Jul 08 18:51:09.389584 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.389549 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/19920a04-89c6-40ab-8227-af6ae679c178-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bb8746f75-dbnm2\" (UID: \"19920a04-89c6-40ab-8227-af6ae679c178\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" Jul 08 18:51:09.389718 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.389588 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzt6m\" (UniqueName: \"kubernetes.io/projected/19920a04-89c6-40ab-8227-af6ae679c178-kube-api-access-lzt6m\") pod \"opendatahub-operator-controller-manager-6bb8746f75-dbnm2\" (UID: \"19920a04-89c6-40ab-8227-af6ae679c178\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" Jul 08 18:51:09.389718 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.389633 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/19920a04-89c6-40ab-8227-af6ae679c178-manifests\") pod \"opendatahub-operator-controller-manager-6bb8746f75-dbnm2\" (UID: \"19920a04-89c6-40ab-8227-af6ae679c178\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" Jul 08 18:51:09.389817 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.389795 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/19920a04-89c6-40ab-8227-af6ae679c178-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bb8746f75-dbnm2\" (UID: \"19920a04-89c6-40ab-8227-af6ae679c178\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" Jul 08 18:51:09.389872 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.389855 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19920a04-89c6-40ab-8227-af6ae679c178-tmp\") pod \"opendatahub-operator-controller-manager-6bb8746f75-dbnm2\" (UID: \"19920a04-89c6-40ab-8227-af6ae679c178\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" Jul 08 18:51:09.390049 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.390030 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/19920a04-89c6-40ab-8227-af6ae679c178-manifests\") pod \"opendatahub-operator-controller-manager-6bb8746f75-dbnm2\" (UID: \"19920a04-89c6-40ab-8227-af6ae679c178\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" Jul 08 18:51:09.392168 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.392135 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19920a04-89c6-40ab-8227-af6ae679c178-tmp\") pod \"opendatahub-operator-controller-manager-6bb8746f75-dbnm2\" (UID: \"19920a04-89c6-40ab-8227-af6ae679c178\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" Jul 08 18:51:09.392305 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.392288 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/19920a04-89c6-40ab-8227-af6ae679c178-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6bb8746f75-dbnm2\" (UID: \"19920a04-89c6-40ab-8227-af6ae679c178\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" Jul 08 18:51:09.392359 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.392304 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/19920a04-89c6-40ab-8227-af6ae679c178-webhook-cert\") pod \"opendatahub-operator-controller-manager-6bb8746f75-dbnm2\" (UID: \"19920a04-89c6-40ab-8227-af6ae679c178\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" Jul 08 18:51:09.401556 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.401528 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzt6m\" (UniqueName: \"kubernetes.io/projected/19920a04-89c6-40ab-8227-af6ae679c178-kube-api-access-lzt6m\") pod \"opendatahub-operator-controller-manager-6bb8746f75-dbnm2\" (UID: \"19920a04-89c6-40ab-8227-af6ae679c178\") " pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" Jul 08 18:51:09.494548 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.494446 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" Jul 08 18:51:09.632223 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.632187 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2"] Jul 08 18:51:09.635336 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:51:09.635310 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19920a04_89c6_40ab_8227_af6ae679c178.slice/crio-bd84a7f5eb9f936502d296f7904a396a44549e48dbbda0b6b94a1bab11655f16 WatchSource:0}: Error finding container bd84a7f5eb9f936502d296f7904a396a44549e48dbbda0b6b94a1bab11655f16: Status 404 returned error can't find the container with id bd84a7f5eb9f936502d296f7904a396a44549e48dbbda0b6b94a1bab11655f16 Jul 08 18:51:09.637374 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:09.637352 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:51:10.285473 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:10.285434 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" event={"ID":"19920a04-89c6-40ab-8227-af6ae679c178","Type":"ContainerStarted","Data":"bd84a7f5eb9f936502d296f7904a396a44549e48dbbda0b6b94a1bab11655f16"} Jul 08 18:51:13.299395 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:13.299358 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" event={"ID":"19920a04-89c6-40ab-8227-af6ae679c178","Type":"ContainerStarted","Data":"6cde714d513281d9a76c070e788d67ce5cbf38160497bcacc80cf77e8a907a01"} Jul 08 18:51:14.305035 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:14.304997 2552 generic.go:356] "Generic (PLEG): container finished" podID="19920a04-89c6-40ab-8227-af6ae679c178" containerID="6cde714d513281d9a76c070e788d67ce5cbf38160497bcacc80cf77e8a907a01" exitCode=0 Jul 08 18:51:14.305454 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:14.305054 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" event={"ID":"19920a04-89c6-40ab-8227-af6ae679c178","Type":"ContainerDied","Data":"6cde714d513281d9a76c070e788d67ce5cbf38160497bcacc80cf77e8a907a01"} Jul 08 18:51:15.312071 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:15.312035 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" event={"ID":"19920a04-89c6-40ab-8227-af6ae679c178","Type":"ContainerStarted","Data":"ac9c13e5b0ea935ed492d537c0705632a14d1437a1c0e16dc07fe279df9dbc82"} Jul 08 18:51:15.312582 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:15.312193 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" Jul 08 18:51:15.338659 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:15.338601 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" podStartSLOduration=1.772531239 podStartE2EDuration="6.338560658s" totalImagesPullingTime="3.476514934s" totalInitContainerRuntime="1.089514485s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:51:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:51:15.336450328 +0000 UTC m=+334.097006354" watchObservedRunningTime="2026-07-08 18:51:15.338560658 +0000 UTC m=+334.099116683" Jul 08 18:51:26.318501 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:26.318472 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6bb8746f75-dbnm2" Jul 08 18:51:37.796941 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.796865 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7578f4df-vwqbg"] Jul 08 18:51:37.799829 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.799811 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7578f4df-vwqbg" Jul 08 18:51:37.807290 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.807264 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 08 18:51:37.808129 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.808087 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 08 18:51:37.808257 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.808240 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 08 18:51:37.808327 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.808288 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 08 18:51:37.808380 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.808339 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 08 18:51:37.808380 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.808360 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8lq4c\"" Jul 08 18:51:37.817788 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.817756 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7578f4df-vwqbg"] Jul 08 18:51:37.833786 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.833753 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89"] Jul 08 18:51:37.836743 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.836725 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:37.840906 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.840882 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 08 18:51:37.841160 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.841141 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 18:51:37.841160 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.841150 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 08 18:51:37.841333 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.841145 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 08 18:51:37.841333 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.841219 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6r2pq\"" Jul 08 18:51:37.841333 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.841287 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 18:51:37.841497 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.841415 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 18:51:37.894395 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.894360 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e3f6602c-0eff-488f-808e-ae5a9b077431-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xxx89\" (UID: \"e3f6602c-0eff-488f-808e-ae5a9b077431\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:37.894607 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.894402 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p986\" (UniqueName: \"kubernetes.io/projected/e3f6602c-0eff-488f-808e-ae5a9b077431-kube-api-access-5p986\") pod \"istiod-openshift-gateway-94bb8fbfd-xxx89\" (UID: \"e3f6602c-0eff-488f-808e-ae5a9b077431\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:37.894607 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.894431 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e3f6602c-0eff-488f-808e-ae5a9b077431-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xxx89\" (UID: \"e3f6602c-0eff-488f-808e-ae5a9b077431\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:37.894607 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.894532 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljpxc\" (UniqueName: \"kubernetes.io/projected/4e51c01a-657b-4288-9fc2-353772858f2d-kube-api-access-ljpxc\") pod \"lws-controller-manager-7578f4df-vwqbg\" (UID: \"4e51c01a-657b-4288-9fc2-353772858f2d\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-vwqbg" Jul 08 18:51:37.894607 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.894577 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e3f6602c-0eff-488f-808e-ae5a9b077431-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xxx89\" (UID: \"e3f6602c-0eff-488f-808e-ae5a9b077431\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:37.894824 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.894610 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4e51c01a-657b-4288-9fc2-353772858f2d-manager-config\") pod \"lws-controller-manager-7578f4df-vwqbg\" (UID: \"4e51c01a-657b-4288-9fc2-353772858f2d\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-vwqbg" Jul 08 18:51:37.894824 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.894656 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3f6602c-0eff-488f-808e-ae5a9b077431-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xxx89\" (UID: \"e3f6602c-0eff-488f-808e-ae5a9b077431\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:37.894824 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.894683 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e51c01a-657b-4288-9fc2-353772858f2d-metrics-cert\") pod \"lws-controller-manager-7578f4df-vwqbg\" (UID: \"4e51c01a-657b-4288-9fc2-353772858f2d\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-vwqbg" Jul 08 18:51:37.894824 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.894714 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3f6602c-0eff-488f-808e-ae5a9b077431-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xxx89\" (UID: \"e3f6602c-0eff-488f-808e-ae5a9b077431\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:37.894824 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.894743 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e51c01a-657b-4288-9fc2-353772858f2d-cert\") pod \"lws-controller-manager-7578f4df-vwqbg\" (UID: \"4e51c01a-657b-4288-9fc2-353772858f2d\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-vwqbg" Jul 08 18:51:37.894824 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.894771 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3f6602c-0eff-488f-808e-ae5a9b077431-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xxx89\" (UID: \"e3f6602c-0eff-488f-808e-ae5a9b077431\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:37.910892 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.910856 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89"] Jul 08 18:51:37.995636 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.995602 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e3f6602c-0eff-488f-808e-ae5a9b077431-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xxx89\" (UID: \"e3f6602c-0eff-488f-808e-ae5a9b077431\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:37.995636 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.995644 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4e51c01a-657b-4288-9fc2-353772858f2d-manager-config\") pod \"lws-controller-manager-7578f4df-vwqbg\" (UID: \"4e51c01a-657b-4288-9fc2-353772858f2d\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-vwqbg" Jul 08 18:51:37.995845 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.995674 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3f6602c-0eff-488f-808e-ae5a9b077431-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xxx89\" (UID: \"e3f6602c-0eff-488f-808e-ae5a9b077431\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:37.995845 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.995698 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e51c01a-657b-4288-9fc2-353772858f2d-metrics-cert\") pod \"lws-controller-manager-7578f4df-vwqbg\" (UID: \"4e51c01a-657b-4288-9fc2-353772858f2d\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-vwqbg" Jul 08 18:51:37.995912 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.995884 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3f6602c-0eff-488f-808e-ae5a9b077431-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xxx89\" (UID: \"e3f6602c-0eff-488f-808e-ae5a9b077431\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:37.995952 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.995936 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e51c01a-657b-4288-9fc2-353772858f2d-cert\") pod \"lws-controller-manager-7578f4df-vwqbg\" (UID: \"4e51c01a-657b-4288-9fc2-353772858f2d\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-vwqbg" Jul 08 18:51:37.995990 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.995975 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3f6602c-0eff-488f-808e-ae5a9b077431-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xxx89\" (UID: \"e3f6602c-0eff-488f-808e-ae5a9b077431\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:37.996032 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.996014 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e3f6602c-0eff-488f-808e-ae5a9b077431-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xxx89\" (UID: \"e3f6602c-0eff-488f-808e-ae5a9b077431\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:37.996088 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.996055 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p986\" (UniqueName: \"kubernetes.io/projected/e3f6602c-0eff-488f-808e-ae5a9b077431-kube-api-access-5p986\") pod \"istiod-openshift-gateway-94bb8fbfd-xxx89\" (UID: \"e3f6602c-0eff-488f-808e-ae5a9b077431\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:37.996165 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.996105 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e3f6602c-0eff-488f-808e-ae5a9b077431-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xxx89\" (UID: \"e3f6602c-0eff-488f-808e-ae5a9b077431\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:37.996227 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.996185 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljpxc\" (UniqueName: \"kubernetes.io/projected/4e51c01a-657b-4288-9fc2-353772858f2d-kube-api-access-ljpxc\") pod \"lws-controller-manager-7578f4df-vwqbg\" (UID: \"4e51c01a-657b-4288-9fc2-353772858f2d\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-vwqbg" Jul 08 18:51:37.996487 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.996449 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4e51c01a-657b-4288-9fc2-353772858f2d-manager-config\") pod \"lws-controller-manager-7578f4df-vwqbg\" (UID: \"4e51c01a-657b-4288-9fc2-353772858f2d\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-vwqbg" Jul 08 18:51:37.996998 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.996949 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e3f6602c-0eff-488f-808e-ae5a9b077431-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xxx89\" (UID: \"e3f6602c-0eff-488f-808e-ae5a9b077431\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:37.998443 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.998419 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e3f6602c-0eff-488f-808e-ae5a9b077431-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xxx89\" (UID: \"e3f6602c-0eff-488f-808e-ae5a9b077431\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:37.998625 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.998605 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3f6602c-0eff-488f-808e-ae5a9b077431-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xxx89\" (UID: \"e3f6602c-0eff-488f-808e-ae5a9b077431\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:37.998667 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.998620 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4e51c01a-657b-4288-9fc2-353772858f2d-cert\") pod \"lws-controller-manager-7578f4df-vwqbg\" (UID: \"4e51c01a-657b-4288-9fc2-353772858f2d\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-vwqbg" Jul 08 18:51:37.998940 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.998920 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3f6602c-0eff-488f-808e-ae5a9b077431-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xxx89\" (UID: \"e3f6602c-0eff-488f-808e-ae5a9b077431\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:37.999087 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.999064 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4e51c01a-657b-4288-9fc2-353772858f2d-metrics-cert\") pod \"lws-controller-manager-7578f4df-vwqbg\" (UID: \"4e51c01a-657b-4288-9fc2-353772858f2d\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-vwqbg" Jul 08 18:51:37.999162 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:37.999147 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e3f6602c-0eff-488f-808e-ae5a9b077431-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xxx89\" (UID: \"e3f6602c-0eff-488f-808e-ae5a9b077431\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:38.004311 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:38.004291 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3f6602c-0eff-488f-808e-ae5a9b077431-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xxx89\" (UID: \"e3f6602c-0eff-488f-808e-ae5a9b077431\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:38.004633 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:38.004615 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljpxc\" (UniqueName: \"kubernetes.io/projected/4e51c01a-657b-4288-9fc2-353772858f2d-kube-api-access-ljpxc\") pod \"lws-controller-manager-7578f4df-vwqbg\" (UID: \"4e51c01a-657b-4288-9fc2-353772858f2d\") " pod="openshift-lws-operator/lws-controller-manager-7578f4df-vwqbg" Jul 08 18:51:38.004933 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:38.004915 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p986\" (UniqueName: \"kubernetes.io/projected/e3f6602c-0eff-488f-808e-ae5a9b077431-kube-api-access-5p986\") pod \"istiod-openshift-gateway-94bb8fbfd-xxx89\" (UID: \"e3f6602c-0eff-488f-808e-ae5a9b077431\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:38.109411 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:38.109372 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7578f4df-vwqbg" Jul 08 18:51:38.145562 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:38.145520 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:38.266404 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:38.266378 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7578f4df-vwqbg"] Jul 08 18:51:38.269182 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:51:38.269139 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e51c01a_657b_4288_9fc2_353772858f2d.slice/crio-a8b1ff3536d5043a449de05f35e1f8c1cc953e2320eb592f41445aa97654aeb1 WatchSource:0}: Error finding container a8b1ff3536d5043a449de05f35e1f8c1cc953e2320eb592f41445aa97654aeb1: Status 404 returned error can't find the container with id a8b1ff3536d5043a449de05f35e1f8c1cc953e2320eb592f41445aa97654aeb1 Jul 08 18:51:38.318320 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:38.318289 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89"] Jul 08 18:51:38.318994 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:51:38.318967 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f6602c_0eff_488f_808e_ae5a9b077431.slice/crio-bdd40ff2f73b213832440607f4dbac0344ee930efb0e8b92139b9c340c2a5bfb WatchSource:0}: Error finding container bdd40ff2f73b213832440607f4dbac0344ee930efb0e8b92139b9c340c2a5bfb: Status 404 returned error can't find the container with id bdd40ff2f73b213832440607f4dbac0344ee930efb0e8b92139b9c340c2a5bfb Jul 08 18:51:38.389842 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:38.389744 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" event={"ID":"e3f6602c-0eff-488f-808e-ae5a9b077431","Type":"ContainerStarted","Data":"bdd40ff2f73b213832440607f4dbac0344ee930efb0e8b92139b9c340c2a5bfb"} Jul 08 18:51:38.390927 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:38.390901 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7578f4df-vwqbg" event={"ID":"4e51c01a-657b-4288-9fc2-353772858f2d","Type":"ContainerStarted","Data":"a8b1ff3536d5043a449de05f35e1f8c1cc953e2320eb592f41445aa97654aeb1"} Jul 08 18:51:40.398761 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:40.398721 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 08 18:51:40.399159 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:40.398805 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 08 18:51:41.407683 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:41.407636 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" event={"ID":"e3f6602c-0eff-488f-808e-ae5a9b077431","Type":"ContainerStarted","Data":"fbdb2dec98dc1a339be5a83fd6510ac17e9caaad8fe563c391827209f8a51d8f"} Jul 08 18:51:41.408172 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:41.407911 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:41.409380 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:41.409345 2552 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-xxx89 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 08 18:51:41.409494 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:41.409412 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" podUID="e3f6602c-0eff-488f-808e-ae5a9b077431" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 18:51:41.445213 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:41.445138 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" podStartSLOduration=2.3677302510000002 podStartE2EDuration="4.445097733s" totalImagesPullingTime="2.077367482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:51:41.443862997 +0000 UTC m=+360.204419024" watchObservedRunningTime="2026-07-08 18:51:41.445097733 +0000 UTC m=+360.205653760" Jul 08 18:51:42.412748 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:42.412706 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7578f4df-vwqbg" event={"ID":"4e51c01a-657b-4288-9fc2-353772858f2d","Type":"ContainerStarted","Data":"18b0e7d69aca2650d438ca88a33bd64d85ed3a47a97573b7dd20557cb37662e5"} Jul 08 18:51:42.413132 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:42.412776 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7578f4df-vwqbg" Jul 08 18:51:42.413674 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:42.413657 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xxx89" Jul 08 18:51:42.441867 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:42.441805 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7578f4df-vwqbg" podStartSLOduration=1.455311971 podStartE2EDuration="5.441787918s" totalImagesPullingTime="3.986475947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:51:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:51:42.439947647 +0000 UTC m=+361.200503685" watchObservedRunningTime="2026-07-08 18:51:42.441787918 +0000 UTC m=+361.202343943" Jul 08 18:51:53.418826 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:51:53.418794 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7578f4df-vwqbg" Jul 08 18:53:44.057826 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:53:44.057791 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7xj7"] Jul 08 18:53:44.059828 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:53:44.059813 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7xj7" Jul 08 18:53:44.063149 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:53:44.063098 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 18:53:44.064168 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:53:44.064147 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-tsnfp\"" Jul 08 18:53:44.065487 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:53:44.065466 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 18:53:44.121002 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:53:44.120966 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhfdz\" (UniqueName: \"kubernetes.io/projected/13cfb9a6-5e78-4612-8a83-14dce5e70356-kube-api-access-zhfdz\") pod \"limitador-operator-controller-manager-859d7b78bd-n7xj7\" (UID: \"13cfb9a6-5e78-4612-8a83-14dce5e70356\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7xj7" Jul 08 18:53:44.125769 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:53:44.125748 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7xj7"] Jul 08 18:53:44.221694 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:53:44.221668 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhfdz\" (UniqueName: \"kubernetes.io/projected/13cfb9a6-5e78-4612-8a83-14dce5e70356-kube-api-access-zhfdz\") pod \"limitador-operator-controller-manager-859d7b78bd-n7xj7\" (UID: \"13cfb9a6-5e78-4612-8a83-14dce5e70356\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7xj7" Jul 08 18:53:44.234478 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:53:44.234452 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhfdz\" (UniqueName: \"kubernetes.io/projected/13cfb9a6-5e78-4612-8a83-14dce5e70356-kube-api-access-zhfdz\") pod \"limitador-operator-controller-manager-859d7b78bd-n7xj7\" (UID: \"13cfb9a6-5e78-4612-8a83-14dce5e70356\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7xj7" Jul 08 18:53:44.371159 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:53:44.371103 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7xj7" Jul 08 18:53:44.502342 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:53:44.502321 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7xj7"] Jul 08 18:53:44.857384 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:53:44.857348 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7xj7" event={"ID":"13cfb9a6-5e78-4612-8a83-14dce5e70356","Type":"ContainerStarted","Data":"68501f3255723144322af1aba88a56329985edef7de6ebd16d7ede7440addaa3"} Jul 08 18:53:46.866311 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:53:46.866279 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7xj7" event={"ID":"13cfb9a6-5e78-4612-8a83-14dce5e70356","Type":"ContainerStarted","Data":"e285be438199330dd72b9321b5338d2d7b423af5b76cc923890cf1b1392f5c62"} Jul 08 18:53:46.866661 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:53:46.866407 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7xj7" Jul 08 18:53:46.886344 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:53:46.886297 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7xj7" podStartSLOduration=0.992435915 podStartE2EDuration="2.886282111s" totalImagesPullingTime="1.893846196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:53:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:53:46.885308584 +0000 UTC m=+485.645864610" watchObservedRunningTime="2026-07-08 18:53:46.886282111 +0000 UTC m=+485.646838134" Jul 08 18:53:57.871938 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:53:57.871909 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-n7xj7" Jul 08 18:55:58.688958 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:55:58.688922 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-r5xb4"] Jul 08 18:55:58.692422 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:55:58.692399 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-r5xb4" Jul 08 18:55:58.694920 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:55:58.694898 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jknc6\"" Jul 08 18:55:58.695300 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:55:58.695282 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 08 18:55:58.707608 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:55:58.707586 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-r5xb4"] Jul 08 18:55:58.798454 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:55:58.798419 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvxt5\" (UniqueName: \"kubernetes.io/projected/624d4916-cbd4-4ffc-a7e5-f2038ced2654-kube-api-access-qvxt5\") pod \"payload-pre-processing-7964457696-r5xb4\" (UID: \"624d4916-cbd4-4ffc-a7e5-f2038ced2654\") " pod="openshift-ingress/payload-pre-processing-7964457696-r5xb4" Jul 08 18:55:58.798627 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:55:58.798481 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/624d4916-cbd4-4ffc-a7e5-f2038ced2654-plugins-config-volume\") pod \"payload-pre-processing-7964457696-r5xb4\" (UID: \"624d4916-cbd4-4ffc-a7e5-f2038ced2654\") " pod="openshift-ingress/payload-pre-processing-7964457696-r5xb4" Jul 08 18:55:58.899461 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:55:58.899417 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvxt5\" (UniqueName: \"kubernetes.io/projected/624d4916-cbd4-4ffc-a7e5-f2038ced2654-kube-api-access-qvxt5\") pod \"payload-pre-processing-7964457696-r5xb4\" (UID: \"624d4916-cbd4-4ffc-a7e5-f2038ced2654\") " pod="openshift-ingress/payload-pre-processing-7964457696-r5xb4" Jul 08 18:55:58.899637 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:55:58.899490 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/624d4916-cbd4-4ffc-a7e5-f2038ced2654-plugins-config-volume\") pod \"payload-pre-processing-7964457696-r5xb4\" (UID: \"624d4916-cbd4-4ffc-a7e5-f2038ced2654\") " pod="openshift-ingress/payload-pre-processing-7964457696-r5xb4" Jul 08 18:55:58.900331 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:55:58.900311 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/624d4916-cbd4-4ffc-a7e5-f2038ced2654-plugins-config-volume\") pod \"payload-pre-processing-7964457696-r5xb4\" (UID: \"624d4916-cbd4-4ffc-a7e5-f2038ced2654\") " pod="openshift-ingress/payload-pre-processing-7964457696-r5xb4" Jul 08 18:55:58.911206 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:55:58.911187 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvxt5\" (UniqueName: \"kubernetes.io/projected/624d4916-cbd4-4ffc-a7e5-f2038ced2654-kube-api-access-qvxt5\") pod \"payload-pre-processing-7964457696-r5xb4\" (UID: \"624d4916-cbd4-4ffc-a7e5-f2038ced2654\") " pod="openshift-ingress/payload-pre-processing-7964457696-r5xb4" Jul 08 18:55:59.003051 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:55:59.002967 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-r5xb4" Jul 08 18:55:59.137342 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:55:59.136012 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-r5xb4"] Jul 08 18:55:59.139243 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:55:59.139211 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod624d4916_cbd4_4ffc_a7e5_f2038ced2654.slice/crio-f0286bac3bbea1210800596bae849870df12aa8a4bcb88172eea9662804b1765 WatchSource:0}: Error finding container f0286bac3bbea1210800596bae849870df12aa8a4bcb88172eea9662804b1765: Status 404 returned error can't find the container with id f0286bac3bbea1210800596bae849870df12aa8a4bcb88172eea9662804b1765 Jul 08 18:55:59.328801 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:55:59.328769 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-r5xb4" event={"ID":"624d4916-cbd4-4ffc-a7e5-f2038ced2654","Type":"ContainerStarted","Data":"f0286bac3bbea1210800596bae849870df12aa8a4bcb88172eea9662804b1765"} Jul 08 18:56:01.339273 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:01.339237 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-r5xb4" event={"ID":"624d4916-cbd4-4ffc-a7e5-f2038ced2654","Type":"ContainerStarted","Data":"e194caceacf5a2cd98a207670deb55a1665adb9a598a7e2fb2b530cf5f705aa3"} Jul 08 18:56:01.339675 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:01.339356 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-r5xb4" Jul 08 18:56:01.359064 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:01.359002 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-r5xb4" podStartSLOduration=1.918472581 podStartE2EDuration="3.358982453s" totalImagesPullingTime="1.440509872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:55:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:56:01.356787495 +0000 UTC m=+620.117343523" watchObservedRunningTime="2026-07-08 18:56:01.358982453 +0000 UTC m=+620.119538481" Jul 08 18:56:12.345677 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:12.345642 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-r5xb4" Jul 08 18:56:31.919744 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:31.919708 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc"] Jul 08 18:56:31.923081 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:31.923062 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:31.926077 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:31.926055 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 18:56:31.927387 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:31.927369 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 18:56:31.927458 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:31.927414 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ff9sn\"" Jul 08 18:56:31.927501 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:31.927414 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 08 18:56:31.941073 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:31.941049 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc"] Jul 08 18:56:32.060255 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:32.060218 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4811fb3d-074d-47b9-8be5-549cb9e99ad7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gvjkc\" (UID: \"4811fb3d-074d-47b9-8be5-549cb9e99ad7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:32.060439 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:32.060264 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4811fb3d-074d-47b9-8be5-549cb9e99ad7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gvjkc\" (UID: \"4811fb3d-074d-47b9-8be5-549cb9e99ad7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:32.060439 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:32.060285 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4811fb3d-074d-47b9-8be5-549cb9e99ad7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gvjkc\" (UID: \"4811fb3d-074d-47b9-8be5-549cb9e99ad7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:32.060439 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:32.060305 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4811fb3d-074d-47b9-8be5-549cb9e99ad7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gvjkc\" (UID: \"4811fb3d-074d-47b9-8be5-549cb9e99ad7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:32.060439 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:32.060386 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4811fb3d-074d-47b9-8be5-549cb9e99ad7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gvjkc\" (UID: \"4811fb3d-074d-47b9-8be5-549cb9e99ad7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:32.060439 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:32.060434 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pnmh\" (UniqueName: \"kubernetes.io/projected/4811fb3d-074d-47b9-8be5-549cb9e99ad7-kube-api-access-9pnmh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gvjkc\" (UID: \"4811fb3d-074d-47b9-8be5-549cb9e99ad7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:32.161536 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:32.161498 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4811fb3d-074d-47b9-8be5-549cb9e99ad7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gvjkc\" (UID: \"4811fb3d-074d-47b9-8be5-549cb9e99ad7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:32.161536 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:32.161541 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4811fb3d-074d-47b9-8be5-549cb9e99ad7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gvjkc\" (UID: \"4811fb3d-074d-47b9-8be5-549cb9e99ad7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:32.161792 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:32.161585 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4811fb3d-074d-47b9-8be5-549cb9e99ad7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gvjkc\" (UID: \"4811fb3d-074d-47b9-8be5-549cb9e99ad7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:32.161792 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:32.161616 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pnmh\" (UniqueName: \"kubernetes.io/projected/4811fb3d-074d-47b9-8be5-549cb9e99ad7-kube-api-access-9pnmh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gvjkc\" (UID: \"4811fb3d-074d-47b9-8be5-549cb9e99ad7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:32.161792 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:32.161699 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4811fb3d-074d-47b9-8be5-549cb9e99ad7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gvjkc\" (UID: \"4811fb3d-074d-47b9-8be5-549cb9e99ad7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:32.161792 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:32.161732 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4811fb3d-074d-47b9-8be5-549cb9e99ad7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gvjkc\" (UID: \"4811fb3d-074d-47b9-8be5-549cb9e99ad7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:32.162012 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:32.161980 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4811fb3d-074d-47b9-8be5-549cb9e99ad7-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gvjkc\" (UID: \"4811fb3d-074d-47b9-8be5-549cb9e99ad7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:32.162170 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:32.162056 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4811fb3d-074d-47b9-8be5-549cb9e99ad7-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gvjkc\" (UID: \"4811fb3d-074d-47b9-8be5-549cb9e99ad7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:32.162236 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:32.162172 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4811fb3d-074d-47b9-8be5-549cb9e99ad7-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gvjkc\" (UID: \"4811fb3d-074d-47b9-8be5-549cb9e99ad7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:32.164017 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:32.163985 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4811fb3d-074d-47b9-8be5-549cb9e99ad7-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gvjkc\" (UID: \"4811fb3d-074d-47b9-8be5-549cb9e99ad7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:32.164252 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:32.164232 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4811fb3d-074d-47b9-8be5-549cb9e99ad7-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gvjkc\" (UID: \"4811fb3d-074d-47b9-8be5-549cb9e99ad7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:32.173953 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:32.173893 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pnmh\" (UniqueName: \"kubernetes.io/projected/4811fb3d-074d-47b9-8be5-549cb9e99ad7-kube-api-access-9pnmh\") pod \"e2e-distinct-simulated-kserve-59975d69f9-gvjkc\" (UID: \"4811fb3d-074d-47b9-8be5-549cb9e99ad7\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:32.233214 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:32.233177 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:32.373675 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:32.373646 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc"] Jul 08 18:56:32.376326 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:56:32.376301 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4811fb3d_074d_47b9_8be5_549cb9e99ad7.slice/crio-0bf1f3a7e170a58055e523d8e500fc8bb69779756fee65cc093fa9ee43bc4b47 WatchSource:0}: Error finding container 0bf1f3a7e170a58055e523d8e500fc8bb69779756fee65cc093fa9ee43bc4b47: Status 404 returned error can't find the container with id 0bf1f3a7e170a58055e523d8e500fc8bb69779756fee65cc093fa9ee43bc4b47 Jul 08 18:56:32.377654 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:32.377637 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 18:56:32.461334 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:32.461229 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" event={"ID":"4811fb3d-074d-47b9-8be5-549cb9e99ad7","Type":"ContainerStarted","Data":"0bf1f3a7e170a58055e523d8e500fc8bb69779756fee65cc093fa9ee43bc4b47"} Jul 08 18:56:33.468081 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:33.468039 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" event={"ID":"4811fb3d-074d-47b9-8be5-549cb9e99ad7","Type":"ContainerStarted","Data":"31cde0d836b505f62ab8902588e5d887d06f441af94654fcbbd3e10770beff0d"} Jul 08 18:56:33.487893 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:33.487836 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" podStartSLOduration=1.4837138859999999 podStartE2EDuration="2.48781591s" totalImagesPullingTime="1.004102024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:56:33.486812959 +0000 UTC m=+652.247368997" watchObservedRunningTime="2026-07-08 18:56:33.48781591 +0000 UTC m=+652.248371935" Jul 08 18:56:42.234066 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:42.234030 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:42.234608 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:42.234095 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:42.246492 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:42.246471 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:42.514290 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:42.514209 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-gvjkc" Jul 08 18:56:55.922158 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:55.922109 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd"] Jul 08 18:56:55.925680 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:55.925660 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:56:55.928842 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:55.928824 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 08 18:56:55.940632 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:55.940612 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd"] Jul 08 18:56:56.056381 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:56.056351 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adc17ab4-1a04-48db-ab02-490a6c688e7d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd\" (UID: \"adc17ab4-1a04-48db-ab02-490a6c688e7d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:56:56.056540 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:56.056390 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adc17ab4-1a04-48db-ab02-490a6c688e7d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd\" (UID: \"adc17ab4-1a04-48db-ab02-490a6c688e7d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:56:56.056540 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:56.056420 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adc17ab4-1a04-48db-ab02-490a6c688e7d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd\" (UID: \"adc17ab4-1a04-48db-ab02-490a6c688e7d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:56:56.056540 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:56.056438 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adc17ab4-1a04-48db-ab02-490a6c688e7d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd\" (UID: \"adc17ab4-1a04-48db-ab02-490a6c688e7d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:56:56.056540 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:56.056463 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp58c\" (UniqueName: \"kubernetes.io/projected/adc17ab4-1a04-48db-ab02-490a6c688e7d-kube-api-access-wp58c\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd\" (UID: \"adc17ab4-1a04-48db-ab02-490a6c688e7d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:56:56.056540 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:56.056488 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adc17ab4-1a04-48db-ab02-490a6c688e7d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd\" (UID: \"adc17ab4-1a04-48db-ab02-490a6c688e7d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:56:56.157056 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:56.157031 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adc17ab4-1a04-48db-ab02-490a6c688e7d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd\" (UID: \"adc17ab4-1a04-48db-ab02-490a6c688e7d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:56:56.157218 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:56.157064 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adc17ab4-1a04-48db-ab02-490a6c688e7d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd\" (UID: \"adc17ab4-1a04-48db-ab02-490a6c688e7d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:56:56.157218 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:56.157093 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adc17ab4-1a04-48db-ab02-490a6c688e7d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd\" (UID: \"adc17ab4-1a04-48db-ab02-490a6c688e7d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:56:56.157218 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:56.157113 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adc17ab4-1a04-48db-ab02-490a6c688e7d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd\" (UID: \"adc17ab4-1a04-48db-ab02-490a6c688e7d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:56:56.157218 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:56.157153 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp58c\" (UniqueName: \"kubernetes.io/projected/adc17ab4-1a04-48db-ab02-490a6c688e7d-kube-api-access-wp58c\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd\" (UID: \"adc17ab4-1a04-48db-ab02-490a6c688e7d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:56:56.157218 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:56.157187 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adc17ab4-1a04-48db-ab02-490a6c688e7d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd\" (UID: \"adc17ab4-1a04-48db-ab02-490a6c688e7d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:56:56.157513 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:56.157425 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/adc17ab4-1a04-48db-ab02-490a6c688e7d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd\" (UID: \"adc17ab4-1a04-48db-ab02-490a6c688e7d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:56:56.157513 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:56.157498 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/adc17ab4-1a04-48db-ab02-490a6c688e7d-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd\" (UID: \"adc17ab4-1a04-48db-ab02-490a6c688e7d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:56:56.157628 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:56.157515 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/adc17ab4-1a04-48db-ab02-490a6c688e7d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd\" (UID: \"adc17ab4-1a04-48db-ab02-490a6c688e7d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:56:56.159427 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:56.159406 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/adc17ab4-1a04-48db-ab02-490a6c688e7d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd\" (UID: \"adc17ab4-1a04-48db-ab02-490a6c688e7d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:56:56.159679 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:56.159661 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adc17ab4-1a04-48db-ab02-490a6c688e7d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd\" (UID: \"adc17ab4-1a04-48db-ab02-490a6c688e7d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:56:56.167276 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:56.167251 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp58c\" (UniqueName: \"kubernetes.io/projected/adc17ab4-1a04-48db-ab02-490a6c688e7d-kube-api-access-wp58c\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd\" (UID: \"adc17ab4-1a04-48db-ab02-490a6c688e7d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:56:56.234875 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:56.234815 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:56:56.362741 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:56.362719 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd"] Jul 08 18:56:56.365006 ip-10-0-135-240 kubenswrapper[2552]: W0708 18:56:56.364980 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc17ab4_1a04_48db_ab02_490a6c688e7d.slice/crio-0c3a7abef13db045c38aa2569137908fcfbd67750d8685e1bef364765545225d WatchSource:0}: Error finding container 0c3a7abef13db045c38aa2569137908fcfbd67750d8685e1bef364765545225d: Status 404 returned error can't find the container with id 0c3a7abef13db045c38aa2569137908fcfbd67750d8685e1bef364765545225d Jul 08 18:56:56.560064 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:56.559988 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" event={"ID":"adc17ab4-1a04-48db-ab02-490a6c688e7d","Type":"ContainerStarted","Data":"0c3a7abef13db045c38aa2569137908fcfbd67750d8685e1bef364765545225d"} Jul 08 18:56:57.566166 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:56:57.566133 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" event={"ID":"adc17ab4-1a04-48db-ab02-490a6c688e7d","Type":"ContainerStarted","Data":"b24466f1bb206d011745bd603251a98b46af57fad5ddabee3c9890458f93368e"} Jul 08 18:57:06.235674 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:57:06.235631 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:57:06.236069 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:57:06.235702 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:57:06.248169 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:57:06.248142 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 18:57:06.267738 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:57:06.267689 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" podStartSLOduration=11.05316369 podStartE2EDuration="11.267671383s" totalImagesPullingTime="214.507693ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 18:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 18:56:57.599613017 +0000 UTC m=+676.360169046" watchObservedRunningTime="2026-07-08 18:57:06.267671383 +0000 UTC m=+685.028227408" Jul 08 18:57:06.616885 ip-10-0-135-240 kubenswrapper[2552]: I0708 18:57:06.616856 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd" Jul 08 19:18:03.995227 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:03.995194 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9"] Jul 08 19:18:03.998311 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:03.998291 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9" Jul 08 19:18:04.000672 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:04.000653 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 19:18:04.001423 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:04.001406 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-s5q9r\"" Jul 08 19:18:04.001505 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:04.001433 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-2d9136-serving-cert\"" Jul 08 19:18:04.001505 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:04.001406 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 19:18:04.007879 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:04.007859 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c869209b-def3-49dc-a34a-fb282ab05447-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9\" (UID: \"c869209b-def3-49dc-a34a-fb282ab05447\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9" Jul 08 19:18:04.007980 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:04.007916 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c869209b-def3-49dc-a34a-fb282ab05447-maas-api-tls\") pod \"maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9\" (UID: \"c869209b-def3-49dc-a34a-fb282ab05447\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9" Jul 08 19:18:04.008053 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:04.008040 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qjzb\" (UniqueName: \"kubernetes.io/projected/c869209b-def3-49dc-a34a-fb282ab05447-kube-api-access-4qjzb\") pod \"maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9\" (UID: \"c869209b-def3-49dc-a34a-fb282ab05447\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9" Jul 08 19:18:04.011206 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:04.011176 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9"] Jul 08 19:18:04.108397 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:04.108362 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qjzb\" (UniqueName: \"kubernetes.io/projected/c869209b-def3-49dc-a34a-fb282ab05447-kube-api-access-4qjzb\") pod \"maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9\" (UID: \"c869209b-def3-49dc-a34a-fb282ab05447\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9" Jul 08 19:18:04.108397 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:04.108404 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c869209b-def3-49dc-a34a-fb282ab05447-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9\" (UID: \"c869209b-def3-49dc-a34a-fb282ab05447\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9" Jul 08 19:18:04.108636 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:04.108523 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c869209b-def3-49dc-a34a-fb282ab05447-maas-api-tls\") pod \"maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9\" (UID: \"c869209b-def3-49dc-a34a-fb282ab05447\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9" Jul 08 19:18:04.109007 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:04.108987 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c869209b-def3-49dc-a34a-fb282ab05447-openshift-service-ca\") pod \"maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9\" (UID: \"c869209b-def3-49dc-a34a-fb282ab05447\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9" Jul 08 19:18:04.110916 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:04.110894 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c869209b-def3-49dc-a34a-fb282ab05447-maas-api-tls\") pod \"maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9\" (UID: \"c869209b-def3-49dc-a34a-fb282ab05447\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9" Jul 08 19:18:04.126044 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:04.126018 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qjzb\" (UniqueName: \"kubernetes.io/projected/c869209b-def3-49dc-a34a-fb282ab05447-kube-api-access-4qjzb\") pod \"maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9\" (UID: \"c869209b-def3-49dc-a34a-fb282ab05447\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9" Jul 08 19:18:04.308510 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:04.308411 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9" Jul 08 19:18:04.439621 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:04.439595 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9"] Jul 08 19:18:04.441933 ip-10-0-135-240 kubenswrapper[2552]: W0708 19:18:04.441907 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc869209b_def3_49dc_a34a_fb282ab05447.slice/crio-c5ee00adfe9125e2a5320ac5da3adb5aec9890f85c098940e788303e3be67bb2 WatchSource:0}: Error finding container c5ee00adfe9125e2a5320ac5da3adb5aec9890f85c098940e788303e3be67bb2: Status 404 returned error can't find the container with id c5ee00adfe9125e2a5320ac5da3adb5aec9890f85c098940e788303e3be67bb2 Jul 08 19:18:04.446320 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:04.446300 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 19:18:04.665062 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:04.665027 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9" event={"ID":"c869209b-def3-49dc-a34a-fb282ab05447","Type":"ContainerStarted","Data":"c5ee00adfe9125e2a5320ac5da3adb5aec9890f85c098940e788303e3be67bb2"} Jul 08 19:18:07.680721 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:07.680678 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9" event={"ID":"c869209b-def3-49dc-a34a-fb282ab05447","Type":"ContainerStarted","Data":"b9ce62f55692f9e40040d0dabef4e582c45b94b009641e54bf286a7dda30735d"} Jul 08 19:18:07.681095 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:07.680804 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9" Jul 08 19:18:07.701018 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:07.700966 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9" podStartSLOduration=2.32991268 podStartE2EDuration="4.700950181s" totalImagesPullingTime="2.371037501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:18:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:18:07.698991826 +0000 UTC m=+1946.459547851" watchObservedRunningTime="2026-07-08 19:18:07.700950181 +0000 UTC m=+1946.461506207" Jul 08 19:18:13.690590 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:13.690557 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9" Jul 08 19:18:34.892730 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:34.892648 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw"] Jul 08 19:18:34.895871 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:34.895856 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:34.899492 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:34.899465 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2d9136\"/\"kube-root-ca.crt\"" Jul 08 19:18:34.899609 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:34.899497 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-2d9136\"/\"openshift-service-ca.crt\"" Jul 08 19:18:34.899609 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:34.899464 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2d9136\"/\"test-model-2d9136-kserve-self-signed-certs\"" Jul 08 19:18:34.899609 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:34.899465 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-2d9136\"/\"default-dockercfg-tjs45\"" Jul 08 19:18:34.905646 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:34.905624 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw"] Jul 08 19:18:34.962189 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:34.962157 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3af43101-6d9f-42af-bc11-8416f04ec466-tls-certs\") pod \"test-model-2d9136-kserve-7c57598d4c-4fdxw\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:34.962340 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:34.962201 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl8rn\" (UniqueName: \"kubernetes.io/projected/3af43101-6d9f-42af-bc11-8416f04ec466-kube-api-access-hl8rn\") pod \"test-model-2d9136-kserve-7c57598d4c-4fdxw\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:34.962340 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:34.962310 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-home\") pod \"test-model-2d9136-kserve-7c57598d4c-4fdxw\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:34.962340 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:34.962332 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-dshm\") pod \"test-model-2d9136-kserve-7c57598d4c-4fdxw\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:34.962476 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:34.962363 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-model-cache\") pod \"test-model-2d9136-kserve-7c57598d4c-4fdxw\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:34.962476 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:34.962437 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-tmp-dir\") pod \"test-model-2d9136-kserve-7c57598d4c-4fdxw\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:35.063416 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:35.063383 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-model-cache\") pod \"test-model-2d9136-kserve-7c57598d4c-4fdxw\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:35.063600 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:35.063427 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-tmp-dir\") pod \"test-model-2d9136-kserve-7c57598d4c-4fdxw\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:35.063600 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:35.063459 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3af43101-6d9f-42af-bc11-8416f04ec466-tls-certs\") pod \"test-model-2d9136-kserve-7c57598d4c-4fdxw\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:35.063600 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:35.063477 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl8rn\" (UniqueName: \"kubernetes.io/projected/3af43101-6d9f-42af-bc11-8416f04ec466-kube-api-access-hl8rn\") pod \"test-model-2d9136-kserve-7c57598d4c-4fdxw\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:35.063600 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:35.063517 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-home\") pod \"test-model-2d9136-kserve-7c57598d4c-4fdxw\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:35.063600 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:35.063531 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-dshm\") pod \"test-model-2d9136-kserve-7c57598d4c-4fdxw\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:35.063841 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:35.063793 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-model-cache\") pod \"test-model-2d9136-kserve-7c57598d4c-4fdxw\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:35.063841 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:35.063813 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-tmp-dir\") pod \"test-model-2d9136-kserve-7c57598d4c-4fdxw\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:35.063921 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:35.063847 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-home\") pod \"test-model-2d9136-kserve-7c57598d4c-4fdxw\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:35.065824 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:35.065784 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-dshm\") pod \"test-model-2d9136-kserve-7c57598d4c-4fdxw\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:35.066002 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:35.065986 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3af43101-6d9f-42af-bc11-8416f04ec466-tls-certs\") pod \"test-model-2d9136-kserve-7c57598d4c-4fdxw\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:35.075308 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:35.075282 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl8rn\" (UniqueName: \"kubernetes.io/projected/3af43101-6d9f-42af-bc11-8416f04ec466-kube-api-access-hl8rn\") pod \"test-model-2d9136-kserve-7c57598d4c-4fdxw\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:35.205660 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:35.205566 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:35.350486 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:35.350458 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw"] Jul 08 19:18:35.351766 ip-10-0-135-240 kubenswrapper[2552]: W0708 19:18:35.351739 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3af43101_6d9f_42af_bc11_8416f04ec466.slice/crio-6d7d65cab15afb36feeecd2f208e4983d9d80439b2d08331ffe8a7015335d812 WatchSource:0}: Error finding container 6d7d65cab15afb36feeecd2f208e4983d9d80439b2d08331ffe8a7015335d812: Status 404 returned error can't find the container with id 6d7d65cab15afb36feeecd2f208e4983d9d80439b2d08331ffe8a7015335d812 Jul 08 19:18:35.795409 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:35.795365 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" event={"ID":"3af43101-6d9f-42af-bc11-8416f04ec466","Type":"ContainerStarted","Data":"f62aff2bb9053211c5876b84b13712ce43f83a7ed30d1e520ab3559fbfc8f1ce"} Jul 08 19:18:35.795583 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:35.795419 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" event={"ID":"3af43101-6d9f-42af-bc11-8416f04ec466","Type":"ContainerStarted","Data":"6d7d65cab15afb36feeecd2f208e4983d9d80439b2d08331ffe8a7015335d812"} Jul 08 19:18:35.815890 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:35.815843 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" podStartSLOduration=1.815827052 podStartE2EDuration="1.815827052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:18:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:18:35.814533931 +0000 UTC m=+1974.575089950" watchObservedRunningTime="2026-07-08 19:18:35.815827052 +0000 UTC m=+1974.576383077" Jul 08 19:18:45.206171 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:45.206093 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:45.206171 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:45.206179 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:45.218534 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:45.218503 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:45.848532 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:45.848501 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:18:57.982624 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:18:57.982588 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw"] Jul 08 19:19:13.002837 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.002761 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" podUID="3af43101-6d9f-42af-bc11-8416f04ec466" containerName="main" containerID="cri-o://f62aff2bb9053211c5876b84b13712ce43f83a7ed30d1e520ab3559fbfc8f1ce" gracePeriod=45 Jul 08 19:19:13.252666 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.252641 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:19:13.295431 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.295348 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hl8rn\" (UniqueName: \"kubernetes.io/projected/3af43101-6d9f-42af-bc11-8416f04ec466-kube-api-access-hl8rn\") pod \"3af43101-6d9f-42af-bc11-8416f04ec466\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " Jul 08 19:19:13.295431 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.295421 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-tmp-dir\") pod \"3af43101-6d9f-42af-bc11-8416f04ec466\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " Jul 08 19:19:13.295645 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.295439 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-model-cache\") pod \"3af43101-6d9f-42af-bc11-8416f04ec466\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " Jul 08 19:19:13.295645 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.295466 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3af43101-6d9f-42af-bc11-8416f04ec466-tls-certs\") pod \"3af43101-6d9f-42af-bc11-8416f04ec466\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " Jul 08 19:19:13.295645 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.295490 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-dshm\") pod \"3af43101-6d9f-42af-bc11-8416f04ec466\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " Jul 08 19:19:13.295645 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.295512 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-home\") pod \"3af43101-6d9f-42af-bc11-8416f04ec466\" (UID: \"3af43101-6d9f-42af-bc11-8416f04ec466\") " Jul 08 19:19:13.295839 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.295739 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-model-cache" (OuterVolumeSpecName: "model-cache") pod "3af43101-6d9f-42af-bc11-8416f04ec466" (UID: "3af43101-6d9f-42af-bc11-8416f04ec466"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:19:13.295839 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.295758 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3af43101-6d9f-42af-bc11-8416f04ec466" (UID: "3af43101-6d9f-42af-bc11-8416f04ec466"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:19:13.295910 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.295833 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-home" (OuterVolumeSpecName: "home") pod "3af43101-6d9f-42af-bc11-8416f04ec466" (UID: "3af43101-6d9f-42af-bc11-8416f04ec466"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:19:13.297721 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.297684 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-dshm" (OuterVolumeSpecName: "dshm") pod "3af43101-6d9f-42af-bc11-8416f04ec466" (UID: "3af43101-6d9f-42af-bc11-8416f04ec466"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 19:19:13.297828 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.297748 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3af43101-6d9f-42af-bc11-8416f04ec466-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3af43101-6d9f-42af-bc11-8416f04ec466" (UID: "3af43101-6d9f-42af-bc11-8416f04ec466"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:19:13.297828 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.297770 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3af43101-6d9f-42af-bc11-8416f04ec466-kube-api-access-hl8rn" (OuterVolumeSpecName: "kube-api-access-hl8rn") pod "3af43101-6d9f-42af-bc11-8416f04ec466" (UID: "3af43101-6d9f-42af-bc11-8416f04ec466"). InnerVolumeSpecName "kube-api-access-hl8rn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:19:13.396486 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.396449 2552 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-dshm\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Jul 08 19:19:13.396486 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.396477 2552 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-home\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Jul 08 19:19:13.396486 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.396488 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hl8rn\" (UniqueName: \"kubernetes.io/projected/3af43101-6d9f-42af-bc11-8416f04ec466-kube-api-access-hl8rn\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Jul 08 19:19:13.396709 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.396497 2552 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-tmp-dir\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Jul 08 19:19:13.396709 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.396505 2552 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3af43101-6d9f-42af-bc11-8416f04ec466-model-cache\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Jul 08 19:19:13.396709 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.396513 2552 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3af43101-6d9f-42af-bc11-8416f04ec466-tls-certs\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Jul 08 19:19:13.951495 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.951460 2552 generic.go:356] "Generic (PLEG): container finished" podID="3af43101-6d9f-42af-bc11-8416f04ec466" containerID="f62aff2bb9053211c5876b84b13712ce43f83a7ed30d1e520ab3559fbfc8f1ce" exitCode=0 Jul 08 19:19:13.951687 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.951509 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" event={"ID":"3af43101-6d9f-42af-bc11-8416f04ec466","Type":"ContainerDied","Data":"f62aff2bb9053211c5876b84b13712ce43f83a7ed30d1e520ab3559fbfc8f1ce"} Jul 08 19:19:13.951687 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.951513 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" Jul 08 19:19:13.951687 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.951543 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw" event={"ID":"3af43101-6d9f-42af-bc11-8416f04ec466","Type":"ContainerDied","Data":"6d7d65cab15afb36feeecd2f208e4983d9d80439b2d08331ffe8a7015335d812"} Jul 08 19:19:13.951687 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.951571 2552 scope.go:117] "RemoveContainer" containerID="f62aff2bb9053211c5876b84b13712ce43f83a7ed30d1e520ab3559fbfc8f1ce" Jul 08 19:19:13.959981 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.959961 2552 scope.go:117] "RemoveContainer" containerID="f62aff2bb9053211c5876b84b13712ce43f83a7ed30d1e520ab3559fbfc8f1ce" Jul 08 19:19:13.960252 ip-10-0-135-240 kubenswrapper[2552]: E0708 19:19:13.960221 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f62aff2bb9053211c5876b84b13712ce43f83a7ed30d1e520ab3559fbfc8f1ce\": container with ID starting with f62aff2bb9053211c5876b84b13712ce43f83a7ed30d1e520ab3559fbfc8f1ce not found: ID does not exist" containerID="f62aff2bb9053211c5876b84b13712ce43f83a7ed30d1e520ab3559fbfc8f1ce" Jul 08 19:19:13.960325 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.960263 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f62aff2bb9053211c5876b84b13712ce43f83a7ed30d1e520ab3559fbfc8f1ce"} err="failed to get container status \"f62aff2bb9053211c5876b84b13712ce43f83a7ed30d1e520ab3559fbfc8f1ce\": rpc error: code = NotFound desc = could not find container \"f62aff2bb9053211c5876b84b13712ce43f83a7ed30d1e520ab3559fbfc8f1ce\": container with ID starting with f62aff2bb9053211c5876b84b13712ce43f83a7ed30d1e520ab3559fbfc8f1ce not found: ID does not exist" Jul 08 19:19:13.973221 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.973196 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw"] Jul 08 19:19:13.977747 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.977727 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-2d9136/test-model-2d9136-kserve-7c57598d4c-4fdxw"] Jul 08 19:19:13.990233 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:13.990211 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3af43101-6d9f-42af-bc11-8416f04ec466" path="/var/lib/kubelet/pods/3af43101-6d9f-42af-bc11-8416f04ec466/volumes" Jul 08 19:19:42.304767 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:42.304674 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9"] Jul 08 19:19:42.305274 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:42.304915 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9" podUID="c869209b-def3-49dc-a34a-fb282ab05447" containerName="maas-api" containerID="cri-o://b9ce62f55692f9e40040d0dabef4e582c45b94b009641e54bf286a7dda30735d" gracePeriod=30 Jul 08 19:19:42.550412 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:42.550389 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9" Jul 08 19:19:42.644489 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:42.644452 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qjzb\" (UniqueName: \"kubernetes.io/projected/c869209b-def3-49dc-a34a-fb282ab05447-kube-api-access-4qjzb\") pod \"c869209b-def3-49dc-a34a-fb282ab05447\" (UID: \"c869209b-def3-49dc-a34a-fb282ab05447\") " Jul 08 19:19:42.644489 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:42.644490 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c869209b-def3-49dc-a34a-fb282ab05447-openshift-service-ca\") pod \"c869209b-def3-49dc-a34a-fb282ab05447\" (UID: \"c869209b-def3-49dc-a34a-fb282ab05447\") " Jul 08 19:19:42.644747 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:42.644527 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c869209b-def3-49dc-a34a-fb282ab05447-maas-api-tls\") pod \"c869209b-def3-49dc-a34a-fb282ab05447\" (UID: \"c869209b-def3-49dc-a34a-fb282ab05447\") " Jul 08 19:19:42.644924 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:42.644898 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c869209b-def3-49dc-a34a-fb282ab05447-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c869209b-def3-49dc-a34a-fb282ab05447" (UID: "c869209b-def3-49dc-a34a-fb282ab05447"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:19:42.646671 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:42.646649 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c869209b-def3-49dc-a34a-fb282ab05447-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c869209b-def3-49dc-a34a-fb282ab05447" (UID: "c869209b-def3-49dc-a34a-fb282ab05447"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:19:42.646742 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:42.646720 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c869209b-def3-49dc-a34a-fb282ab05447-kube-api-access-4qjzb" (OuterVolumeSpecName: "kube-api-access-4qjzb") pod "c869209b-def3-49dc-a34a-fb282ab05447" (UID: "c869209b-def3-49dc-a34a-fb282ab05447"). InnerVolumeSpecName "kube-api-access-4qjzb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:19:42.745601 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:42.745553 2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c869209b-def3-49dc-a34a-fb282ab05447-openshift-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Jul 08 19:19:42.745601 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:42.745597 2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c869209b-def3-49dc-a34a-fb282ab05447-maas-api-tls\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Jul 08 19:19:42.745601 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:42.745607 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qjzb\" (UniqueName: \"kubernetes.io/projected/c869209b-def3-49dc-a34a-fb282ab05447-kube-api-access-4qjzb\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Jul 08 19:19:43.070048 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:43.070017 2552 generic.go:356] "Generic (PLEG): container finished" podID="c869209b-def3-49dc-a34a-fb282ab05447" containerID="b9ce62f55692f9e40040d0dabef4e582c45b94b009641e54bf286a7dda30735d" exitCode=0 Jul 08 19:19:43.070289 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:43.070066 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9" Jul 08 19:19:43.070289 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:43.070130 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9" event={"ID":"c869209b-def3-49dc-a34a-fb282ab05447","Type":"ContainerDied","Data":"b9ce62f55692f9e40040d0dabef4e582c45b94b009641e54bf286a7dda30735d"} Jul 08 19:19:43.070289 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:43.070191 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9" event={"ID":"c869209b-def3-49dc-a34a-fb282ab05447","Type":"ContainerDied","Data":"c5ee00adfe9125e2a5320ac5da3adb5aec9890f85c098940e788303e3be67bb2"} Jul 08 19:19:43.070289 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:43.070222 2552 scope.go:117] "RemoveContainer" containerID="b9ce62f55692f9e40040d0dabef4e582c45b94b009641e54bf286a7dda30735d" Jul 08 19:19:43.078789 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:43.078773 2552 scope.go:117] "RemoveContainer" containerID="b9ce62f55692f9e40040d0dabef4e582c45b94b009641e54bf286a7dda30735d" Jul 08 19:19:43.079072 ip-10-0-135-240 kubenswrapper[2552]: E0708 19:19:43.079055 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9ce62f55692f9e40040d0dabef4e582c45b94b009641e54bf286a7dda30735d\": container with ID starting with b9ce62f55692f9e40040d0dabef4e582c45b94b009641e54bf286a7dda30735d not found: ID does not exist" containerID="b9ce62f55692f9e40040d0dabef4e582c45b94b009641e54bf286a7dda30735d" Jul 08 19:19:43.079152 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:43.079082 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9ce62f55692f9e40040d0dabef4e582c45b94b009641e54bf286a7dda30735d"} err="failed to get container status \"b9ce62f55692f9e40040d0dabef4e582c45b94b009641e54bf286a7dda30735d\": rpc error: code = NotFound desc = could not find container \"b9ce62f55692f9e40040d0dabef4e582c45b94b009641e54bf286a7dda30735d\": container with ID starting with b9ce62f55692f9e40040d0dabef4e582c45b94b009641e54bf286a7dda30735d not found: ID does not exist" Jul 08 19:19:43.095854 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:43.095828 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9"] Jul 08 19:19:43.101714 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:43.101692 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-2d9136-59c67b7db7-spxw9"] Jul 08 19:19:43.991306 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:43.991272 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c869209b-def3-49dc-a34a-fb282ab05447" path="/var/lib/kubelet/pods/c869209b-def3-49dc-a34a-fb282ab05447/volumes" Jul 08 19:19:52.223236 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.223202 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw"] Jul 08 19:19:52.223645 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.223630 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3af43101-6d9f-42af-bc11-8416f04ec466" containerName="main" Jul 08 19:19:52.223690 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.223648 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="3af43101-6d9f-42af-bc11-8416f04ec466" containerName="main" Jul 08 19:19:52.223690 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.223668 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c869209b-def3-49dc-a34a-fb282ab05447" containerName="maas-api" Jul 08 19:19:52.223690 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.223677 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="c869209b-def3-49dc-a34a-fb282ab05447" containerName="maas-api" Jul 08 19:19:52.223780 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.223745 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="3af43101-6d9f-42af-bc11-8416f04ec466" containerName="main" Jul 08 19:19:52.223780 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.223757 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="c869209b-def3-49dc-a34a-fb282ab05447" containerName="maas-api" Jul 08 19:19:52.226927 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.226908 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw" Jul 08 19:19:52.229540 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.229518 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-ef94f1-serving-cert\"" Jul 08 19:19:52.229670 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.229567 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 19:19:52.230647 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.230629 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 19:19:52.230748 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.230635 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-s5q9r\"" Jul 08 19:19:52.237327 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.237303 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw"] Jul 08 19:19:52.318883 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.318842 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac6e843-009a-4e5b-bef1-e5d219f67def-openshift-service-ca\") pod \"maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw\" (UID: \"fac6e843-009a-4e5b-bef1-e5d219f67def\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw" Jul 08 19:19:52.319074 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.318968 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fac6e843-009a-4e5b-bef1-e5d219f67def-maas-api-tls\") pod \"maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw\" (UID: \"fac6e843-009a-4e5b-bef1-e5d219f67def\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw" Jul 08 19:19:52.319074 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.319018 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m6zc\" (UniqueName: \"kubernetes.io/projected/fac6e843-009a-4e5b-bef1-e5d219f67def-kube-api-access-9m6zc\") pod \"maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw\" (UID: \"fac6e843-009a-4e5b-bef1-e5d219f67def\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw" Jul 08 19:19:52.420143 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.420095 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac6e843-009a-4e5b-bef1-e5d219f67def-openshift-service-ca\") pod \"maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw\" (UID: \"fac6e843-009a-4e5b-bef1-e5d219f67def\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw" Jul 08 19:19:52.420339 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.420220 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fac6e843-009a-4e5b-bef1-e5d219f67def-maas-api-tls\") pod \"maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw\" (UID: \"fac6e843-009a-4e5b-bef1-e5d219f67def\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw" Jul 08 19:19:52.420339 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.420263 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m6zc\" (UniqueName: \"kubernetes.io/projected/fac6e843-009a-4e5b-bef1-e5d219f67def-kube-api-access-9m6zc\") pod \"maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw\" (UID: \"fac6e843-009a-4e5b-bef1-e5d219f67def\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw" Jul 08 19:19:52.420745 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.420723 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac6e843-009a-4e5b-bef1-e5d219f67def-openshift-service-ca\") pod \"maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw\" (UID: \"fac6e843-009a-4e5b-bef1-e5d219f67def\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw" Jul 08 19:19:52.422747 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.422720 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fac6e843-009a-4e5b-bef1-e5d219f67def-maas-api-tls\") pod \"maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw\" (UID: \"fac6e843-009a-4e5b-bef1-e5d219f67def\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw" Jul 08 19:19:52.429594 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.429571 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m6zc\" (UniqueName: \"kubernetes.io/projected/fac6e843-009a-4e5b-bef1-e5d219f67def-kube-api-access-9m6zc\") pod \"maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw\" (UID: \"fac6e843-009a-4e5b-bef1-e5d219f67def\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw" Jul 08 19:19:52.538783 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.538699 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw" Jul 08 19:19:52.667757 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:52.667731 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw"] Jul 08 19:19:52.670304 ip-10-0-135-240 kubenswrapper[2552]: W0708 19:19:52.670272 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfac6e843_009a_4e5b_bef1_e5d219f67def.slice/crio-25b32e40bb7d900a0a5c10dd4f1fa1448131d5326db24c34a6279e9398a7bfba WatchSource:0}: Error finding container 25b32e40bb7d900a0a5c10dd4f1fa1448131d5326db24c34a6279e9398a7bfba: Status 404 returned error can't find the container with id 25b32e40bb7d900a0a5c10dd4f1fa1448131d5326db24c34a6279e9398a7bfba Jul 08 19:19:53.112374 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:53.112344 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw" event={"ID":"fac6e843-009a-4e5b-bef1-e5d219f67def","Type":"ContainerStarted","Data":"25b32e40bb7d900a0a5c10dd4f1fa1448131d5326db24c34a6279e9398a7bfba"} Jul 08 19:19:54.118539 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:54.118506 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw" event={"ID":"fac6e843-009a-4e5b-bef1-e5d219f67def","Type":"ContainerStarted","Data":"120c8e1a9317078361aeb091366d18369ed2095c4af2aa3c312ff62ab6227ba7"} Jul 08 19:19:54.118916 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:54.118611 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw" Jul 08 19:19:54.155065 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:19:54.155016 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw" podStartSLOduration=1.74806634 podStartE2EDuration="2.155001709s" totalImagesPullingTime="406.935369ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:19:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:19:54.153794362 +0000 UTC m=+2052.914350389" watchObservedRunningTime="2026-07-08 19:19:54.155001709 +0000 UTC m=+2052.915557734" Jul 08 19:20:00.133994 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:00.133957 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw" Jul 08 19:20:00.265891 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:00.265855 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9"] Jul 08 19:20:00.269383 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:00.269359 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9" Jul 08 19:20:00.272900 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:00.272878 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-c29bbf-serving-cert\"" Jul 08 19:20:00.277294 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:00.277267 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ab9f66f-9d5b-4683-b251-5e9a879186c7-maas-api-tls\") pod \"maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9\" (UID: \"6ab9f66f-9d5b-4683-b251-5e9a879186c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9" Jul 08 19:20:00.277381 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:00.277314 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt66b\" (UniqueName: \"kubernetes.io/projected/6ab9f66f-9d5b-4683-b251-5e9a879186c7-kube-api-access-zt66b\") pod \"maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9\" (UID: \"6ab9f66f-9d5b-4683-b251-5e9a879186c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9" Jul 08 19:20:00.277381 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:00.277341 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab9f66f-9d5b-4683-b251-5e9a879186c7-openshift-service-ca\") pod \"maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9\" (UID: \"6ab9f66f-9d5b-4683-b251-5e9a879186c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9" Jul 08 19:20:00.284023 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:00.284002 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9"] Jul 08 19:20:00.377895 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:00.377859 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ab9f66f-9d5b-4683-b251-5e9a879186c7-maas-api-tls\") pod \"maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9\" (UID: \"6ab9f66f-9d5b-4683-b251-5e9a879186c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9" Jul 08 19:20:00.378071 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:00.377902 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt66b\" (UniqueName: \"kubernetes.io/projected/6ab9f66f-9d5b-4683-b251-5e9a879186c7-kube-api-access-zt66b\") pod \"maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9\" (UID: \"6ab9f66f-9d5b-4683-b251-5e9a879186c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9" Jul 08 19:20:00.378071 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:00.377923 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab9f66f-9d5b-4683-b251-5e9a879186c7-openshift-service-ca\") pod \"maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9\" (UID: \"6ab9f66f-9d5b-4683-b251-5e9a879186c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9" Jul 08 19:20:00.378633 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:00.378607 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab9f66f-9d5b-4683-b251-5e9a879186c7-openshift-service-ca\") pod \"maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9\" (UID: \"6ab9f66f-9d5b-4683-b251-5e9a879186c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9" Jul 08 19:20:00.380393 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:00.380372 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ab9f66f-9d5b-4683-b251-5e9a879186c7-maas-api-tls\") pod \"maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9\" (UID: \"6ab9f66f-9d5b-4683-b251-5e9a879186c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9" Jul 08 19:20:00.387990 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:00.387938 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt66b\" (UniqueName: \"kubernetes.io/projected/6ab9f66f-9d5b-4683-b251-5e9a879186c7-kube-api-access-zt66b\") pod \"maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9\" (UID: \"6ab9f66f-9d5b-4683-b251-5e9a879186c7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9" Jul 08 19:20:00.580591 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:00.580556 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9" Jul 08 19:20:00.722838 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:00.722809 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9"] Jul 08 19:20:00.724804 ip-10-0-135-240 kubenswrapper[2552]: W0708 19:20:00.724782 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ab9f66f_9d5b_4683_b251_5e9a879186c7.slice/crio-27a5a184547c32496de3715b46438d36f6d1e3c1ebae4e705ea959af21b13cb7 WatchSource:0}: Error finding container 27a5a184547c32496de3715b46438d36f6d1e3c1ebae4e705ea959af21b13cb7: Status 404 returned error can't find the container with id 27a5a184547c32496de3715b46438d36f6d1e3c1ebae4e705ea959af21b13cb7 Jul 08 19:20:01.152036 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:01.152003 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9" event={"ID":"6ab9f66f-9d5b-4683-b251-5e9a879186c7","Type":"ContainerStarted","Data":"27a5a184547c32496de3715b46438d36f6d1e3c1ebae4e705ea959af21b13cb7"} Jul 08 19:20:02.157765 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:02.157728 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9" event={"ID":"6ab9f66f-9d5b-4683-b251-5e9a879186c7","Type":"ContainerStarted","Data":"15bd44f0f01490f65668c08603b55cab930b21238ce94f06c2b47390055934a1"} Jul 08 19:20:02.158170 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:02.157863 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9" Jul 08 19:20:02.178446 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:02.178397 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9" podStartSLOduration=1.323502237 podStartE2EDuration="2.178383208s" totalImagesPullingTime="854.880971ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:20:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:20:02.177187828 +0000 UTC m=+2060.937743860" watchObservedRunningTime="2026-07-08 19:20:02.178383208 +0000 UTC m=+2060.938939241" Jul 08 19:20:08.167478 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:08.167449 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9" Jul 08 19:20:13.851289 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:13.851256 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw"] Jul 08 19:20:13.851760 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:13.851440 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw" podUID="fac6e843-009a-4e5b-bef1-e5d219f67def" containerName="maas-api" containerID="cri-o://120c8e1a9317078361aeb091366d18369ed2095c4af2aa3c312ff62ab6227ba7" gracePeriod=30 Jul 08 19:20:14.091318 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:14.091293 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw" Jul 08 19:20:14.195148 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:14.195037 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fac6e843-009a-4e5b-bef1-e5d219f67def-maas-api-tls\") pod \"fac6e843-009a-4e5b-bef1-e5d219f67def\" (UID: \"fac6e843-009a-4e5b-bef1-e5d219f67def\") " Jul 08 19:20:14.195291 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:14.195159 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac6e843-009a-4e5b-bef1-e5d219f67def-openshift-service-ca\") pod \"fac6e843-009a-4e5b-bef1-e5d219f67def\" (UID: \"fac6e843-009a-4e5b-bef1-e5d219f67def\") " Jul 08 19:20:14.195291 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:14.195225 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9m6zc\" (UniqueName: \"kubernetes.io/projected/fac6e843-009a-4e5b-bef1-e5d219f67def-kube-api-access-9m6zc\") pod \"fac6e843-009a-4e5b-bef1-e5d219f67def\" (UID: \"fac6e843-009a-4e5b-bef1-e5d219f67def\") " Jul 08 19:20:14.195514 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:14.195480 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fac6e843-009a-4e5b-bef1-e5d219f67def-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fac6e843-009a-4e5b-bef1-e5d219f67def" (UID: "fac6e843-009a-4e5b-bef1-e5d219f67def"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:20:14.197258 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:14.197226 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fac6e843-009a-4e5b-bef1-e5d219f67def-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fac6e843-009a-4e5b-bef1-e5d219f67def" (UID: "fac6e843-009a-4e5b-bef1-e5d219f67def"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:20:14.197343 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:14.197312 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fac6e843-009a-4e5b-bef1-e5d219f67def-kube-api-access-9m6zc" (OuterVolumeSpecName: "kube-api-access-9m6zc") pod "fac6e843-009a-4e5b-bef1-e5d219f67def" (UID: "fac6e843-009a-4e5b-bef1-e5d219f67def"). InnerVolumeSpecName "kube-api-access-9m6zc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:20:14.212002 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:14.211974 2552 generic.go:356] "Generic (PLEG): container finished" podID="fac6e843-009a-4e5b-bef1-e5d219f67def" containerID="120c8e1a9317078361aeb091366d18369ed2095c4af2aa3c312ff62ab6227ba7" exitCode=0 Jul 08 19:20:14.212170 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:14.212019 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw" Jul 08 19:20:14.212170 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:14.212071 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw" event={"ID":"fac6e843-009a-4e5b-bef1-e5d219f67def","Type":"ContainerDied","Data":"120c8e1a9317078361aeb091366d18369ed2095c4af2aa3c312ff62ab6227ba7"} Jul 08 19:20:14.212170 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:14.212149 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw" event={"ID":"fac6e843-009a-4e5b-bef1-e5d219f67def","Type":"ContainerDied","Data":"25b32e40bb7d900a0a5c10dd4f1fa1448131d5326db24c34a6279e9398a7bfba"} Jul 08 19:20:14.212279 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:14.212181 2552 scope.go:117] "RemoveContainer" containerID="120c8e1a9317078361aeb091366d18369ed2095c4af2aa3c312ff62ab6227ba7" Jul 08 19:20:14.220363 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:14.220347 2552 scope.go:117] "RemoveContainer" containerID="120c8e1a9317078361aeb091366d18369ed2095c4af2aa3c312ff62ab6227ba7" Jul 08 19:20:14.220593 ip-10-0-135-240 kubenswrapper[2552]: E0708 19:20:14.220579 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"120c8e1a9317078361aeb091366d18369ed2095c4af2aa3c312ff62ab6227ba7\": container with ID starting with 120c8e1a9317078361aeb091366d18369ed2095c4af2aa3c312ff62ab6227ba7 not found: ID does not exist" containerID="120c8e1a9317078361aeb091366d18369ed2095c4af2aa3c312ff62ab6227ba7" Jul 08 19:20:14.220638 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:14.220602 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"120c8e1a9317078361aeb091366d18369ed2095c4af2aa3c312ff62ab6227ba7"} err="failed to get container status \"120c8e1a9317078361aeb091366d18369ed2095c4af2aa3c312ff62ab6227ba7\": rpc error: code = NotFound desc = could not find container \"120c8e1a9317078361aeb091366d18369ed2095c4af2aa3c312ff62ab6227ba7\": container with ID starting with 120c8e1a9317078361aeb091366d18369ed2095c4af2aa3c312ff62ab6227ba7 not found: ID does not exist" Jul 08 19:20:14.238197 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:14.238169 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw"] Jul 08 19:20:14.243017 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:14.242994 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-ef94f1-65585cc6b7-bkdpw"] Jul 08 19:20:14.295825 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:14.295788 2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fac6e843-009a-4e5b-bef1-e5d219f67def-openshift-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Jul 08 19:20:14.295825 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:14.295818 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9m6zc\" (UniqueName: \"kubernetes.io/projected/fac6e843-009a-4e5b-bef1-e5d219f67def-kube-api-access-9m6zc\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Jul 08 19:20:14.295825 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:14.295829 2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fac6e843-009a-4e5b-bef1-e5d219f67def-maas-api-tls\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Jul 08 19:20:15.990994 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:15.990960 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fac6e843-009a-4e5b-bef1-e5d219f67def" path="/var/lib/kubelet/pods/fac6e843-009a-4e5b-bef1-e5d219f67def/volumes" Jul 08 19:20:21.809292 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:21.809254 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9"] Jul 08 19:20:21.810065 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:21.810030 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9" podUID="6ab9f66f-9d5b-4683-b251-5e9a879186c7" containerName="maas-api" containerID="cri-o://15bd44f0f01490f65668c08603b55cab930b21238ce94f06c2b47390055934a1" gracePeriod=30 Jul 08 19:20:22.054515 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:22.054487 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9" Jul 08 19:20:22.166102 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:22.166064 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab9f66f-9d5b-4683-b251-5e9a879186c7-openshift-service-ca\") pod \"6ab9f66f-9d5b-4683-b251-5e9a879186c7\" (UID: \"6ab9f66f-9d5b-4683-b251-5e9a879186c7\") " Jul 08 19:20:22.166299 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:22.166171 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ab9f66f-9d5b-4683-b251-5e9a879186c7-maas-api-tls\") pod \"6ab9f66f-9d5b-4683-b251-5e9a879186c7\" (UID: \"6ab9f66f-9d5b-4683-b251-5e9a879186c7\") " Jul 08 19:20:22.166299 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:22.166227 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zt66b\" (UniqueName: \"kubernetes.io/projected/6ab9f66f-9d5b-4683-b251-5e9a879186c7-kube-api-access-zt66b\") pod \"6ab9f66f-9d5b-4683-b251-5e9a879186c7\" (UID: \"6ab9f66f-9d5b-4683-b251-5e9a879186c7\") " Jul 08 19:20:22.166451 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:22.166428 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ab9f66f-9d5b-4683-b251-5e9a879186c7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6ab9f66f-9d5b-4683-b251-5e9a879186c7" (UID: "6ab9f66f-9d5b-4683-b251-5e9a879186c7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:20:22.168434 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:22.168402 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ab9f66f-9d5b-4683-b251-5e9a879186c7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6ab9f66f-9d5b-4683-b251-5e9a879186c7" (UID: "6ab9f66f-9d5b-4683-b251-5e9a879186c7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:20:22.168434 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:22.168405 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ab9f66f-9d5b-4683-b251-5e9a879186c7-kube-api-access-zt66b" (OuterVolumeSpecName: "kube-api-access-zt66b") pod "6ab9f66f-9d5b-4683-b251-5e9a879186c7" (UID: "6ab9f66f-9d5b-4683-b251-5e9a879186c7"). InnerVolumeSpecName "kube-api-access-zt66b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:20:22.247680 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:22.247646 2552 generic.go:356] "Generic (PLEG): container finished" podID="6ab9f66f-9d5b-4683-b251-5e9a879186c7" containerID="15bd44f0f01490f65668c08603b55cab930b21238ce94f06c2b47390055934a1" exitCode=0 Jul 08 19:20:22.247867 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:22.247692 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9" Jul 08 19:20:22.247867 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:22.247732 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9" event={"ID":"6ab9f66f-9d5b-4683-b251-5e9a879186c7","Type":"ContainerDied","Data":"15bd44f0f01490f65668c08603b55cab930b21238ce94f06c2b47390055934a1"} Jul 08 19:20:22.247867 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:22.247794 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9" event={"ID":"6ab9f66f-9d5b-4683-b251-5e9a879186c7","Type":"ContainerDied","Data":"27a5a184547c32496de3715b46438d36f6d1e3c1ebae4e705ea959af21b13cb7"} Jul 08 19:20:22.247867 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:22.247825 2552 scope.go:117] "RemoveContainer" containerID="15bd44f0f01490f65668c08603b55cab930b21238ce94f06c2b47390055934a1" Jul 08 19:20:22.256482 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:22.256463 2552 scope.go:117] "RemoveContainer" containerID="15bd44f0f01490f65668c08603b55cab930b21238ce94f06c2b47390055934a1" Jul 08 19:20:22.256752 ip-10-0-135-240 kubenswrapper[2552]: E0708 19:20:22.256717 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15bd44f0f01490f65668c08603b55cab930b21238ce94f06c2b47390055934a1\": container with ID starting with 15bd44f0f01490f65668c08603b55cab930b21238ce94f06c2b47390055934a1 not found: ID does not exist" containerID="15bd44f0f01490f65668c08603b55cab930b21238ce94f06c2b47390055934a1" Jul 08 19:20:22.256850 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:22.256752 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15bd44f0f01490f65668c08603b55cab930b21238ce94f06c2b47390055934a1"} err="failed to get container status \"15bd44f0f01490f65668c08603b55cab930b21238ce94f06c2b47390055934a1\": rpc error: code = NotFound desc = could not find container \"15bd44f0f01490f65668c08603b55cab930b21238ce94f06c2b47390055934a1\": container with ID starting with 15bd44f0f01490f65668c08603b55cab930b21238ce94f06c2b47390055934a1 not found: ID does not exist" Jul 08 19:20:22.266891 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:22.266869 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt66b\" (UniqueName: \"kubernetes.io/projected/6ab9f66f-9d5b-4683-b251-5e9a879186c7-kube-api-access-zt66b\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Jul 08 19:20:22.266891 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:22.266891 2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ab9f66f-9d5b-4683-b251-5e9a879186c7-openshift-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Jul 08 19:20:22.267007 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:22.266901 2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ab9f66f-9d5b-4683-b251-5e9a879186c7-maas-api-tls\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Jul 08 19:20:22.283049 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:22.283027 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9"] Jul 08 19:20:22.287431 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:22.287408 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c29bbf-79c4d44c77-nbfd9"] Jul 08 19:20:23.989882 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:23.989851 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ab9f66f-9d5b-4683-b251-5e9a879186c7" path="/var/lib/kubelet/pods/6ab9f66f-9d5b-4683-b251-5e9a879186c7/volumes" Jul 08 19:20:31.937605 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:31.937575 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg"] Jul 08 19:20:31.937982 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:31.937859 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ab9f66f-9d5b-4683-b251-5e9a879186c7" containerName="maas-api" Jul 08 19:20:31.937982 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:31.937869 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ab9f66f-9d5b-4683-b251-5e9a879186c7" containerName="maas-api" Jul 08 19:20:31.937982 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:31.937881 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fac6e843-009a-4e5b-bef1-e5d219f67def" containerName="maas-api" Jul 08 19:20:31.937982 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:31.937886 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="fac6e843-009a-4e5b-bef1-e5d219f67def" containerName="maas-api" Jul 08 19:20:31.937982 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:31.937952 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ab9f66f-9d5b-4683-b251-5e9a879186c7" containerName="maas-api" Jul 08 19:20:31.937982 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:31.937968 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="fac6e843-009a-4e5b-bef1-e5d219f67def" containerName="maas-api" Jul 08 19:20:31.942457 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:31.942435 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg" Jul 08 19:20:31.945328 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:31.945307 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-7ac7e6-serving-cert\"" Jul 08 19:20:31.945474 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:31.945414 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-s5q9r\"" Jul 08 19:20:31.946332 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:31.946313 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 19:20:31.946412 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:31.946397 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 19:20:31.954577 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:31.954555 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg"] Jul 08 19:20:32.053541 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:32.053504 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f832aa94-5977-4857-9444-e080bfdc13b2-maas-api-tls\") pod \"maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg\" (UID: \"f832aa94-5977-4857-9444-e080bfdc13b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg" Jul 08 19:20:32.053704 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:32.053630 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5vbr\" (UniqueName: \"kubernetes.io/projected/f832aa94-5977-4857-9444-e080bfdc13b2-kube-api-access-z5vbr\") pod \"maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg\" (UID: \"f832aa94-5977-4857-9444-e080bfdc13b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg" Jul 08 19:20:32.053704 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:32.053656 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f832aa94-5977-4857-9444-e080bfdc13b2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg\" (UID: \"f832aa94-5977-4857-9444-e080bfdc13b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg" Jul 08 19:20:32.155168 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:32.155106 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f832aa94-5977-4857-9444-e080bfdc13b2-maas-api-tls\") pod \"maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg\" (UID: \"f832aa94-5977-4857-9444-e080bfdc13b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg" Jul 08 19:20:32.155365 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:32.155210 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5vbr\" (UniqueName: \"kubernetes.io/projected/f832aa94-5977-4857-9444-e080bfdc13b2-kube-api-access-z5vbr\") pod \"maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg\" (UID: \"f832aa94-5977-4857-9444-e080bfdc13b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg" Jul 08 19:20:32.155365 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:32.155235 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f832aa94-5977-4857-9444-e080bfdc13b2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg\" (UID: \"f832aa94-5977-4857-9444-e080bfdc13b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg" Jul 08 19:20:32.155899 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:32.155875 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f832aa94-5977-4857-9444-e080bfdc13b2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg\" (UID: \"f832aa94-5977-4857-9444-e080bfdc13b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg" Jul 08 19:20:32.157757 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:32.157736 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f832aa94-5977-4857-9444-e080bfdc13b2-maas-api-tls\") pod \"maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg\" (UID: \"f832aa94-5977-4857-9444-e080bfdc13b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg" Jul 08 19:20:32.167548 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:32.167525 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5vbr\" (UniqueName: \"kubernetes.io/projected/f832aa94-5977-4857-9444-e080bfdc13b2-kube-api-access-z5vbr\") pod \"maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg\" (UID: \"f832aa94-5977-4857-9444-e080bfdc13b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg" Jul 08 19:20:32.252518 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:32.252441 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg" Jul 08 19:20:32.398970 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:32.398936 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg"] Jul 08 19:20:32.402007 ip-10-0-135-240 kubenswrapper[2552]: W0708 19:20:32.401980 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf832aa94_5977_4857_9444_e080bfdc13b2.slice/crio-c01e47449e57406f7295d8afc3fa19bdb389c93ad84186255443522e12917cb4 WatchSource:0}: Error finding container c01e47449e57406f7295d8afc3fa19bdb389c93ad84186255443522e12917cb4: Status 404 returned error can't find the container with id c01e47449e57406f7295d8afc3fa19bdb389c93ad84186255443522e12917cb4 Jul 08 19:20:33.296136 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:33.296032 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg" event={"ID":"f832aa94-5977-4857-9444-e080bfdc13b2","Type":"ContainerStarted","Data":"1320fc6577a16e7b39257099f0aa0005ec7d1400553edf11ddada8730bdb59ef"} Jul 08 19:20:33.296136 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:33.296084 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg" event={"ID":"f832aa94-5977-4857-9444-e080bfdc13b2","Type":"ContainerStarted","Data":"c01e47449e57406f7295d8afc3fa19bdb389c93ad84186255443522e12917cb4"} Jul 08 19:20:33.296552 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:33.296181 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg" Jul 08 19:20:33.314426 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:33.314382 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg" podStartSLOduration=1.772554518 podStartE2EDuration="2.314364962s" totalImagesPullingTime="541.810444ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:20:33.312892452 +0000 UTC m=+2092.073448483" watchObservedRunningTime="2026-07-08 19:20:33.314364962 +0000 UTC m=+2092.074921003" Jul 08 19:20:39.306307 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:39.306279 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg" Jul 08 19:20:40.552183 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:40.552146 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc"] Jul 08 19:20:40.555727 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:40.555703 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" Jul 08 19:20:40.558738 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:40.558544 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-b28b28-serving-cert\"" Jul 08 19:20:40.568681 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:40.568659 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc"] Jul 08 19:20:40.731612 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:40.731581 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a199e0d7-0204-4260-8eba-a83dd1916fd0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc\" (UID: \"a199e0d7-0204-4260-8eba-a83dd1916fd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" Jul 08 19:20:40.731612 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:40.731618 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdl92\" (UniqueName: \"kubernetes.io/projected/a199e0d7-0204-4260-8eba-a83dd1916fd0-kube-api-access-xdl92\") pod \"maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc\" (UID: \"a199e0d7-0204-4260-8eba-a83dd1916fd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" Jul 08 19:20:40.731830 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:40.731657 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a199e0d7-0204-4260-8eba-a83dd1916fd0-maas-api-tls\") pod \"maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc\" (UID: \"a199e0d7-0204-4260-8eba-a83dd1916fd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" Jul 08 19:20:40.832850 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:40.832814 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a199e0d7-0204-4260-8eba-a83dd1916fd0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc\" (UID: \"a199e0d7-0204-4260-8eba-a83dd1916fd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" Jul 08 19:20:40.832850 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:40.832854 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdl92\" (UniqueName: \"kubernetes.io/projected/a199e0d7-0204-4260-8eba-a83dd1916fd0-kube-api-access-xdl92\") pod \"maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc\" (UID: \"a199e0d7-0204-4260-8eba-a83dd1916fd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" Jul 08 19:20:40.833017 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:40.832889 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a199e0d7-0204-4260-8eba-a83dd1916fd0-maas-api-tls\") pod \"maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc\" (UID: \"a199e0d7-0204-4260-8eba-a83dd1916fd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" Jul 08 19:20:40.833017 ip-10-0-135-240 kubenswrapper[2552]: E0708 19:20:40.832992 2552 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-serving-cert: secret "maas-api-e2e-shared-b-b28b28-serving-cert" not found Jul 08 19:20:40.833078 ip-10-0-135-240 kubenswrapper[2552]: E0708 19:20:40.833058 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a199e0d7-0204-4260-8eba-a83dd1916fd0-maas-api-tls podName:a199e0d7-0204-4260-8eba-a83dd1916fd0 nodeName:}" failed. No retries permitted until 2026-07-08 19:20:41.333039589 +0000 UTC m=+2100.093595595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a199e0d7-0204-4260-8eba-a83dd1916fd0-maas-api-tls") pod "maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" (UID: "a199e0d7-0204-4260-8eba-a83dd1916fd0") : secret "maas-api-e2e-shared-b-b28b28-serving-cert" not found Jul 08 19:20:40.833498 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:40.833473 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a199e0d7-0204-4260-8eba-a83dd1916fd0-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc\" (UID: \"a199e0d7-0204-4260-8eba-a83dd1916fd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" Jul 08 19:20:40.842978 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:40.842946 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdl92\" (UniqueName: \"kubernetes.io/projected/a199e0d7-0204-4260-8eba-a83dd1916fd0-kube-api-access-xdl92\") pod \"maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc\" (UID: \"a199e0d7-0204-4260-8eba-a83dd1916fd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" Jul 08 19:20:41.335554 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:41.335521 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a199e0d7-0204-4260-8eba-a83dd1916fd0-maas-api-tls\") pod \"maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc\" (UID: \"a199e0d7-0204-4260-8eba-a83dd1916fd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" Jul 08 19:20:41.338034 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:41.338003 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a199e0d7-0204-4260-8eba-a83dd1916fd0-maas-api-tls\") pod \"maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc\" (UID: \"a199e0d7-0204-4260-8eba-a83dd1916fd0\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" Jul 08 19:20:41.468062 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:41.468025 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" Jul 08 19:20:41.597990 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:41.597942 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc"] Jul 08 19:20:41.600329 ip-10-0-135-240 kubenswrapper[2552]: W0708 19:20:41.600302 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda199e0d7_0204_4260_8eba_a83dd1916fd0.slice/crio-0db3d9b6a3e10b15dde47e6c8ee0b4d376e9f32b26b0ee7217a0e11d68314e16 WatchSource:0}: Error finding container 0db3d9b6a3e10b15dde47e6c8ee0b4d376e9f32b26b0ee7217a0e11d68314e16: Status 404 returned error can't find the container with id 0db3d9b6a3e10b15dde47e6c8ee0b4d376e9f32b26b0ee7217a0e11d68314e16 Jul 08 19:20:42.334311 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:42.334278 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" event={"ID":"a199e0d7-0204-4260-8eba-a83dd1916fd0","Type":"ContainerStarted","Data":"9c9f90ed21f8bb99c2103318482e441e588d0aed93dc73f66ef61ee05beb99b9"} Jul 08 19:20:42.334531 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:42.334332 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" event={"ID":"a199e0d7-0204-4260-8eba-a83dd1916fd0","Type":"ContainerStarted","Data":"0db3d9b6a3e10b15dde47e6c8ee0b4d376e9f32b26b0ee7217a0e11d68314e16"} Jul 08 19:20:42.334531 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:42.334390 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" Jul 08 19:20:42.356460 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:42.356413 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" podStartSLOduration=2.043714697 podStartE2EDuration="2.356397478s" totalImagesPullingTime="312.682781ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 19:20:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:20:42.354208729 +0000 UTC m=+2101.114764755" watchObservedRunningTime="2026-07-08 19:20:42.356397478 +0000 UTC m=+2101.116953520" Jul 08 19:20:48.343690 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:20:48.343653 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" Jul 08 19:23:51.163051 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:51.163019 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg"] Jul 08 19:23:51.165367 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:51.163289 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg" podUID="f832aa94-5977-4857-9444-e080bfdc13b2" containerName="maas-api" containerID="cri-o://1320fc6577a16e7b39257099f0aa0005ec7d1400553edf11ddada8730bdb59ef" gracePeriod=30 Jul 08 19:23:51.403081 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:51.403054 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg" Jul 08 19:23:51.520907 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:51.520807 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5vbr\" (UniqueName: \"kubernetes.io/projected/f832aa94-5977-4857-9444-e080bfdc13b2-kube-api-access-z5vbr\") pod \"f832aa94-5977-4857-9444-e080bfdc13b2\" (UID: \"f832aa94-5977-4857-9444-e080bfdc13b2\") " Jul 08 19:23:51.520907 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:51.520881 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f832aa94-5977-4857-9444-e080bfdc13b2-openshift-service-ca\") pod \"f832aa94-5977-4857-9444-e080bfdc13b2\" (UID: \"f832aa94-5977-4857-9444-e080bfdc13b2\") " Jul 08 19:23:51.521154 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:51.520910 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f832aa94-5977-4857-9444-e080bfdc13b2-maas-api-tls\") pod \"f832aa94-5977-4857-9444-e080bfdc13b2\" (UID: \"f832aa94-5977-4857-9444-e080bfdc13b2\") " Jul 08 19:23:51.521251 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:51.521228 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f832aa94-5977-4857-9444-e080bfdc13b2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f832aa94-5977-4857-9444-e080bfdc13b2" (UID: "f832aa94-5977-4857-9444-e080bfdc13b2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:23:51.523068 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:51.523036 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f832aa94-5977-4857-9444-e080bfdc13b2-kube-api-access-z5vbr" (OuterVolumeSpecName: "kube-api-access-z5vbr") pod "f832aa94-5977-4857-9444-e080bfdc13b2" (UID: "f832aa94-5977-4857-9444-e080bfdc13b2"). InnerVolumeSpecName "kube-api-access-z5vbr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:23:51.523185 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:51.523031 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f832aa94-5977-4857-9444-e080bfdc13b2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f832aa94-5977-4857-9444-e080bfdc13b2" (UID: "f832aa94-5977-4857-9444-e080bfdc13b2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:23:51.621855 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:51.621822 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5vbr\" (UniqueName: \"kubernetes.io/projected/f832aa94-5977-4857-9444-e080bfdc13b2-kube-api-access-z5vbr\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Jul 08 19:23:51.621855 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:51.621847 2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f832aa94-5977-4857-9444-e080bfdc13b2-openshift-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Jul 08 19:23:51.621855 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:51.621858 2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f832aa94-5977-4857-9444-e080bfdc13b2-maas-api-tls\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Jul 08 19:23:52.110471 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:52.110436 2552 generic.go:356] "Generic (PLEG): container finished" podID="f832aa94-5977-4857-9444-e080bfdc13b2" containerID="1320fc6577a16e7b39257099f0aa0005ec7d1400553edf11ddada8730bdb59ef" exitCode=0 Jul 08 19:23:52.110615 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:52.110480 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg" Jul 08 19:23:52.110615 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:52.110506 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg" event={"ID":"f832aa94-5977-4857-9444-e080bfdc13b2","Type":"ContainerDied","Data":"1320fc6577a16e7b39257099f0aa0005ec7d1400553edf11ddada8730bdb59ef"} Jul 08 19:23:52.110615 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:52.110547 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg" event={"ID":"f832aa94-5977-4857-9444-e080bfdc13b2","Type":"ContainerDied","Data":"c01e47449e57406f7295d8afc3fa19bdb389c93ad84186255443522e12917cb4"} Jul 08 19:23:52.110615 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:52.110569 2552 scope.go:117] "RemoveContainer" containerID="1320fc6577a16e7b39257099f0aa0005ec7d1400553edf11ddada8730bdb59ef" Jul 08 19:23:52.119091 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:52.119073 2552 scope.go:117] "RemoveContainer" containerID="1320fc6577a16e7b39257099f0aa0005ec7d1400553edf11ddada8730bdb59ef" Jul 08 19:23:52.119375 ip-10-0-135-240 kubenswrapper[2552]: E0708 19:23:52.119358 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1320fc6577a16e7b39257099f0aa0005ec7d1400553edf11ddada8730bdb59ef\": container with ID starting with 1320fc6577a16e7b39257099f0aa0005ec7d1400553edf11ddada8730bdb59ef not found: ID does not exist" containerID="1320fc6577a16e7b39257099f0aa0005ec7d1400553edf11ddada8730bdb59ef" Jul 08 19:23:52.119423 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:52.119382 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1320fc6577a16e7b39257099f0aa0005ec7d1400553edf11ddada8730bdb59ef"} err="failed to get container status \"1320fc6577a16e7b39257099f0aa0005ec7d1400553edf11ddada8730bdb59ef\": rpc error: code = NotFound desc = could not find container \"1320fc6577a16e7b39257099f0aa0005ec7d1400553edf11ddada8730bdb59ef\": container with ID starting with 1320fc6577a16e7b39257099f0aa0005ec7d1400553edf11ddada8730bdb59ef not found: ID does not exist" Jul 08 19:23:52.128719 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:52.128694 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg"] Jul 08 19:23:52.131255 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:52.131230 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7ac7e6-69d4d9478-vpqxg"] Jul 08 19:23:53.990041 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:53.990007 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f832aa94-5977-4857-9444-e080bfdc13b2" path="/var/lib/kubelet/pods/f832aa94-5977-4857-9444-e080bfdc13b2/volumes" Jul 08 19:23:57.913588 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:57.913550 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc"] Jul 08 19:23:57.914035 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:57.913832 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" podUID="a199e0d7-0204-4260-8eba-a83dd1916fd0" containerName="maas-api" containerID="cri-o://9c9f90ed21f8bb99c2103318482e441e588d0aed93dc73f66ef61ee05beb99b9" gracePeriod=30 Jul 08 19:23:58.138558 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:58.138522 2552 generic.go:356] "Generic (PLEG): container finished" podID="a199e0d7-0204-4260-8eba-a83dd1916fd0" containerID="9c9f90ed21f8bb99c2103318482e441e588d0aed93dc73f66ef61ee05beb99b9" exitCode=0 Jul 08 19:23:58.138711 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:58.138591 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" event={"ID":"a199e0d7-0204-4260-8eba-a83dd1916fd0","Type":"ContainerDied","Data":"9c9f90ed21f8bb99c2103318482e441e588d0aed93dc73f66ef61ee05beb99b9"} Jul 08 19:23:58.153621 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:58.153594 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" Jul 08 19:23:58.281231 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:58.281140 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a199e0d7-0204-4260-8eba-a83dd1916fd0-openshift-service-ca\") pod \"a199e0d7-0204-4260-8eba-a83dd1916fd0\" (UID: \"a199e0d7-0204-4260-8eba-a83dd1916fd0\") " Jul 08 19:23:58.281231 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:58.281180 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdl92\" (UniqueName: \"kubernetes.io/projected/a199e0d7-0204-4260-8eba-a83dd1916fd0-kube-api-access-xdl92\") pod \"a199e0d7-0204-4260-8eba-a83dd1916fd0\" (UID: \"a199e0d7-0204-4260-8eba-a83dd1916fd0\") " Jul 08 19:23:58.281231 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:58.281216 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a199e0d7-0204-4260-8eba-a83dd1916fd0-maas-api-tls\") pod \"a199e0d7-0204-4260-8eba-a83dd1916fd0\" (UID: \"a199e0d7-0204-4260-8eba-a83dd1916fd0\") " Jul 08 19:23:58.281538 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:58.281484 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a199e0d7-0204-4260-8eba-a83dd1916fd0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a199e0d7-0204-4260-8eba-a83dd1916fd0" (UID: "a199e0d7-0204-4260-8eba-a83dd1916fd0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 19:23:58.283272 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:58.283247 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a199e0d7-0204-4260-8eba-a83dd1916fd0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a199e0d7-0204-4260-8eba-a83dd1916fd0" (UID: "a199e0d7-0204-4260-8eba-a83dd1916fd0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 19:23:58.283361 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:58.283287 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a199e0d7-0204-4260-8eba-a83dd1916fd0-kube-api-access-xdl92" (OuterVolumeSpecName: "kube-api-access-xdl92") pod "a199e0d7-0204-4260-8eba-a83dd1916fd0" (UID: "a199e0d7-0204-4260-8eba-a83dd1916fd0"). InnerVolumeSpecName "kube-api-access-xdl92". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 19:23:58.382262 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:58.382222 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdl92\" (UniqueName: \"kubernetes.io/projected/a199e0d7-0204-4260-8eba-a83dd1916fd0-kube-api-access-xdl92\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Jul 08 19:23:58.382262 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:58.382254 2552 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a199e0d7-0204-4260-8eba-a83dd1916fd0-maas-api-tls\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Jul 08 19:23:58.382262 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:58.382267 2552 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a199e0d7-0204-4260-8eba-a83dd1916fd0-openshift-service-ca\") on node \"ip-10-0-135-240.ec2.internal\" DevicePath \"\"" Jul 08 19:23:59.144590 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:59.144555 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" event={"ID":"a199e0d7-0204-4260-8eba-a83dd1916fd0","Type":"ContainerDied","Data":"0db3d9b6a3e10b15dde47e6c8ee0b4d376e9f32b26b0ee7217a0e11d68314e16"} Jul 08 19:23:59.145025 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:59.144616 2552 scope.go:117] "RemoveContainer" containerID="9c9f90ed21f8bb99c2103318482e441e588d0aed93dc73f66ef61ee05beb99b9" Jul 08 19:23:59.145025 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:59.144562 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc" Jul 08 19:23:59.166043 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:59.166017 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc"] Jul 08 19:23:59.172240 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:59.172216 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b28b28-7654bf798d-45jnc"] Jul 08 19:23:59.989845 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:23:59.989813 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a199e0d7-0204-4260-8eba-a83dd1916fd0" path="/var/lib/kubelet/pods/a199e0d7-0204-4260-8eba-a83dd1916fd0/volumes" Jul 08 19:24:10.209501 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:10.209473 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bb8746f75-dbnm2_19920a04-89c6-40ab-8227-af6ae679c178/copy-manifests/0.log" Jul 08 19:24:10.217140 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:10.217092 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bb8746f75-dbnm2_19920a04-89c6-40ab-8227-af6ae679c178/manager/0.log" Jul 08 19:24:12.571802 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:12.571770 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-n7xj7_13cfb9a6-5e78-4612-8a83-14dce5e70356/manager/0.log" Jul 08 19:24:13.060345 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:13.060264 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xxx89_e3f6602c-0eff-488f-808e-ae5a9b077431/discovery/0.log" Jul 08 19:24:13.555114 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:13.555084 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-r5xb4_624d4916-cbd4-4ffc-a7e5-f2038ced2654/payload-pre-processing/0.log" Jul 08 19:24:14.262565 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:14.262538 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-gvjkc_4811fb3d-074d-47b9-8be5-549cb9e99ad7/main/0.log" Jul 08 19:24:14.500370 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:14.500304 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db7kqkd_adc17ab4-1a04-48db-ab02-490a6c688e7d/main/0.log" Jul 08 19:24:22.189926 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:22.189891 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8qr2f_b70588ff-d41a-450a-a622-d06fd0318b56/global-pull-secret-syncer/0.log" Jul 08 19:24:22.353289 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:22.353256 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-q62zb_834d498e-ff9e-42cd-af1d-fcf31aeffdb6/konnectivity-agent/0.log" Jul 08 19:24:22.434724 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:22.434689 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-240.ec2.internal_3b12c154aed0715acfb2aca1c887480a/haproxy/0.log" Jul 08 19:24:28.071192 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:28.071158 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-n7xj7_13cfb9a6-5e78-4612-8a83-14dce5e70356/manager/0.log" Jul 08 19:24:30.113626 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:30.113598 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dlhsm_0848f447-fbb1-4fca-82f3-bba8fc13fc5c/node-exporter/0.log" Jul 08 19:24:30.138806 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:30.138729 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dlhsm_0848f447-fbb1-4fca-82f3-bba8fc13fc5c/kube-rbac-proxy/0.log" Jul 08 19:24:30.161857 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:30.161832 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dlhsm_0848f447-fbb1-4fca-82f3-bba8fc13fc5c/init-textfile/0.log" Jul 08 19:24:30.441228 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:30.441146 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b7f9bc31-1077-4b34-ac32-9bd2235fa14d/prometheus/0.log" Jul 08 19:24:30.470248 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:30.470221 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b7f9bc31-1077-4b34-ac32-9bd2235fa14d/config-reloader/0.log" Jul 08 19:24:30.491652 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:30.491624 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b7f9bc31-1077-4b34-ac32-9bd2235fa14d/thanos-sidecar/0.log" Jul 08 19:24:30.513362 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:30.513331 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b7f9bc31-1077-4b34-ac32-9bd2235fa14d/kube-rbac-proxy-web/0.log" Jul 08 19:24:30.536524 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:30.536500 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b7f9bc31-1077-4b34-ac32-9bd2235fa14d/kube-rbac-proxy/0.log" Jul 08 19:24:30.557660 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:30.557633 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b7f9bc31-1077-4b34-ac32-9bd2235fa14d/kube-rbac-proxy-thanos/0.log" Jul 08 19:24:30.582007 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:30.581980 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b7f9bc31-1077-4b34-ac32-9bd2235fa14d/init-config-reloader/0.log" Jul 08 19:24:32.912150 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:32.912099 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh"] Jul 08 19:24:32.912536 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:32.912423 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f832aa94-5977-4857-9444-e080bfdc13b2" containerName="maas-api" Jul 08 19:24:32.912536 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:32.912434 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f832aa94-5977-4857-9444-e080bfdc13b2" containerName="maas-api" Jul 08 19:24:32.912536 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:32.912454 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a199e0d7-0204-4260-8eba-a83dd1916fd0" containerName="maas-api" Jul 08 19:24:32.912536 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:32.912460 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="a199e0d7-0204-4260-8eba-a83dd1916fd0" containerName="maas-api" Jul 08 19:24:32.912536 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:32.912507 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="f832aa94-5977-4857-9444-e080bfdc13b2" containerName="maas-api" Jul 08 19:24:32.912536 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:32.912515 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="a199e0d7-0204-4260-8eba-a83dd1916fd0" containerName="maas-api" Jul 08 19:24:32.915217 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:32.915201 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh" Jul 08 19:24:32.917610 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:32.917589 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-87fkv\"/\"kube-root-ca.crt\"" Jul 08 19:24:32.917734 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:32.917701 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-87fkv\"/\"openshift-service-ca.crt\"" Jul 08 19:24:32.918443 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:32.918427 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-87fkv\"/\"default-dockercfg-s4hc9\"" Jul 08 19:24:32.925066 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:32.925044 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh"] Jul 08 19:24:32.945570 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:32.945535 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba3b71a5-ef08-49f7-8675-9f856f080d7c-sys\") pod \"perf-node-gather-daemonset-8jcsh\" (UID: \"ba3b71a5-ef08-49f7-8675-9f856f080d7c\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh" Jul 08 19:24:32.945720 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:32.945620 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ba3b71a5-ef08-49f7-8675-9f856f080d7c-podres\") pod \"perf-node-gather-daemonset-8jcsh\" (UID: \"ba3b71a5-ef08-49f7-8675-9f856f080d7c\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh" Jul 08 19:24:32.945720 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:32.945651 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ba3b71a5-ef08-49f7-8675-9f856f080d7c-proc\") pod \"perf-node-gather-daemonset-8jcsh\" (UID: \"ba3b71a5-ef08-49f7-8675-9f856f080d7c\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh" Jul 08 19:24:32.945720 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:32.945669 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba3b71a5-ef08-49f7-8675-9f856f080d7c-lib-modules\") pod \"perf-node-gather-daemonset-8jcsh\" (UID: \"ba3b71a5-ef08-49f7-8675-9f856f080d7c\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh" Jul 08 19:24:32.945720 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:32.945692 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9prx\" (UniqueName: \"kubernetes.io/projected/ba3b71a5-ef08-49f7-8675-9f856f080d7c-kube-api-access-s9prx\") pod \"perf-node-gather-daemonset-8jcsh\" (UID: \"ba3b71a5-ef08-49f7-8675-9f856f080d7c\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh" Jul 08 19:24:33.046484 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:33.046441 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba3b71a5-ef08-49f7-8675-9f856f080d7c-sys\") pod \"perf-node-gather-daemonset-8jcsh\" (UID: \"ba3b71a5-ef08-49f7-8675-9f856f080d7c\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh" Jul 08 19:24:33.046659 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:33.046589 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba3b71a5-ef08-49f7-8675-9f856f080d7c-sys\") pod \"perf-node-gather-daemonset-8jcsh\" (UID: \"ba3b71a5-ef08-49f7-8675-9f856f080d7c\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh" Jul 08 19:24:33.046659 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:33.046616 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ba3b71a5-ef08-49f7-8675-9f856f080d7c-podres\") pod \"perf-node-gather-daemonset-8jcsh\" (UID: \"ba3b71a5-ef08-49f7-8675-9f856f080d7c\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh" Jul 08 19:24:33.046731 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:33.046658 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ba3b71a5-ef08-49f7-8675-9f856f080d7c-proc\") pod \"perf-node-gather-daemonset-8jcsh\" (UID: \"ba3b71a5-ef08-49f7-8675-9f856f080d7c\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh" Jul 08 19:24:33.046731 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:33.046681 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba3b71a5-ef08-49f7-8675-9f856f080d7c-lib-modules\") pod \"perf-node-gather-daemonset-8jcsh\" (UID: \"ba3b71a5-ef08-49f7-8675-9f856f080d7c\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh" Jul 08 19:24:33.046731 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:33.046715 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ba3b71a5-ef08-49f7-8675-9f856f080d7c-podres\") pod \"perf-node-gather-daemonset-8jcsh\" (UID: \"ba3b71a5-ef08-49f7-8675-9f856f080d7c\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh" Jul 08 19:24:33.046731 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:33.046718 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9prx\" (UniqueName: \"kubernetes.io/projected/ba3b71a5-ef08-49f7-8675-9f856f080d7c-kube-api-access-s9prx\") pod \"perf-node-gather-daemonset-8jcsh\" (UID: \"ba3b71a5-ef08-49f7-8675-9f856f080d7c\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh" Jul 08 19:24:33.046876 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:33.046796 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ba3b71a5-ef08-49f7-8675-9f856f080d7c-proc\") pod \"perf-node-gather-daemonset-8jcsh\" (UID: \"ba3b71a5-ef08-49f7-8675-9f856f080d7c\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh" Jul 08 19:24:33.046876 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:33.046854 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba3b71a5-ef08-49f7-8675-9f856f080d7c-lib-modules\") pod \"perf-node-gather-daemonset-8jcsh\" (UID: \"ba3b71a5-ef08-49f7-8675-9f856f080d7c\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh" Jul 08 19:24:33.054562 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:33.054531 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9prx\" (UniqueName: \"kubernetes.io/projected/ba3b71a5-ef08-49f7-8675-9f856f080d7c-kube-api-access-s9prx\") pod \"perf-node-gather-daemonset-8jcsh\" (UID: \"ba3b71a5-ef08-49f7-8675-9f856f080d7c\") " pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh" Jul 08 19:24:33.225629 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:33.225529 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh" Jul 08 19:24:33.355754 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:33.355728 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh"] Jul 08 19:24:33.358225 ip-10-0-135-240 kubenswrapper[2552]: W0708 19:24:33.358191 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podba3b71a5_ef08_49f7_8675_9f856f080d7c.slice/crio-457cce293f7ade16192e4ef817126134785b9afc40ae107b74d5005d9718ef5b WatchSource:0}: Error finding container 457cce293f7ade16192e4ef817126134785b9afc40ae107b74d5005d9718ef5b: Status 404 returned error can't find the container with id 457cce293f7ade16192e4ef817126134785b9afc40ae107b74d5005d9718ef5b Jul 08 19:24:34.295465 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:34.295426 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh" event={"ID":"ba3b71a5-ef08-49f7-8675-9f856f080d7c","Type":"ContainerStarted","Data":"4a33d984cc0a60699ced04592f1acc2fe1cde556c9bae72decbc3237adb834a8"} Jul 08 19:24:34.295850 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:34.295478 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh" event={"ID":"ba3b71a5-ef08-49f7-8675-9f856f080d7c","Type":"ContainerStarted","Data":"457cce293f7ade16192e4ef817126134785b9afc40ae107b74d5005d9718ef5b"} Jul 08 19:24:34.295850 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:34.295501 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh" Jul 08 19:24:34.312940 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:34.312889 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh" podStartSLOduration=2.312871195 podStartE2EDuration="2.312871195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 19:24:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 19:24:34.312062941 +0000 UTC m=+2333.072618966" watchObservedRunningTime="2026-07-08 19:24:34.312871195 +0000 UTC m=+2333.073427221" Jul 08 19:24:35.154236 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:35.154204 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-twvqc_cc500c34-5a22-4da9-ab09-308d99e6f06f/dns/0.log" Jul 08 19:24:35.175372 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:35.175335 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-twvqc_cc500c34-5a22-4da9-ab09-308d99e6f06f/kube-rbac-proxy/0.log" Jul 08 19:24:35.249614 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:35.249587 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vltc2_9466f79e-04ce-4d16-8de0-2e66e513a1b8/dns-node-resolver/0.log" Jul 08 19:24:35.821150 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:35.821099 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5kll8_c53b63f5-f85d-4d79-9b48-acc1ba69c016/node-ca/0.log" Jul 08 19:24:36.961378 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:36.961313 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xxx89_e3f6602c-0eff-488f-808e-ae5a9b077431/discovery/0.log" Jul 08 19:24:37.123633 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:37.123595 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-r5xb4_624d4916-cbd4-4ffc-a7e5-f2038ced2654/payload-pre-processing/0.log" Jul 08 19:24:37.955766 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:37.955739 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ptx78_273128b2-e74b-44e4-b4c9-bd9a060bf075/serve-healthcheck-canary/0.log" Jul 08 19:24:38.457390 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:38.457354 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6mqzt_601dee8f-636a-440b-9cf3-e07f18e171ca/kube-rbac-proxy/0.log" Jul 08 19:24:38.480006 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:38.479979 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6mqzt_601dee8f-636a-440b-9cf3-e07f18e171ca/exporter/0.log" Jul 08 19:24:38.506598 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:38.506569 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6mqzt_601dee8f-636a-440b-9cf3-e07f18e171ca/extractor/0.log" Jul 08 19:24:40.309322 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:40.309297 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-87fkv/perf-node-gather-daemonset-8jcsh" Jul 08 19:24:41.317007 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:41.316979 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bb8746f75-dbnm2_19920a04-89c6-40ab-8227-af6ae679c178/manager/0.log" Jul 08 19:24:41.352589 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:41.352562 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6bb8746f75-dbnm2_19920a04-89c6-40ab-8227-af6ae679c178/copy-manifests/0.log" Jul 08 19:24:42.830869 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:42.830837 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7578f4df-vwqbg_4e51c01a-657b-4288-9fc2-353772858f2d/manager/0.log" Jul 08 19:24:43.163801 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:43.163766 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xxx89_e3f6602c-0eff-488f-808e-ae5a9b077431/discovery/0.log" Jul 08 19:24:43.308026 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:43.307993 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-r5xb4_624d4916-cbd4-4ffc-a7e5-f2038ced2654/payload-pre-processing/0.log" Jul 08 19:24:44.653866 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:44.653832 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xxx89_e3f6602c-0eff-488f-808e-ae5a9b077431/discovery/0.log" Jul 08 19:24:44.782817 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:44.782784 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-r5xb4_624d4916-cbd4-4ffc-a7e5-f2038ced2654/payload-pre-processing/0.log" Jul 08 19:24:47.962315 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:47.962283 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-dbxmn_82cd28ad-c832-42b7-96d2-b25a09b6ca5f/migrator/0.log" Jul 08 19:24:47.981933 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:47.981902 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-dbxmn_82cd28ad-c832-42b7-96d2-b25a09b6ca5f/graceful-termination/0.log" Jul 08 19:24:49.422681 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:49.422654 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qxxv_bcaef550-9f6a-424b-a5b1-cfa8db9dce25/kube-multus-additional-cni-plugins/0.log" Jul 08 19:24:49.442384 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:49.442355 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qxxv_bcaef550-9f6a-424b-a5b1-cfa8db9dce25/egress-router-binary-copy/0.log" Jul 08 19:24:49.462684 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:49.462657 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qxxv_bcaef550-9f6a-424b-a5b1-cfa8db9dce25/cni-plugins/0.log" Jul 08 19:24:49.485458 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:49.485436 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qxxv_bcaef550-9f6a-424b-a5b1-cfa8db9dce25/bond-cni-plugin/0.log" Jul 08 19:24:49.504712 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:49.504690 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qxxv_bcaef550-9f6a-424b-a5b1-cfa8db9dce25/routeoverride-cni/0.log" Jul 08 19:24:49.528976 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:49.528950 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qxxv_bcaef550-9f6a-424b-a5b1-cfa8db9dce25/whereabouts-cni-bincopy/0.log" Jul 08 19:24:49.552503 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:49.552471 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9qxxv_bcaef550-9f6a-424b-a5b1-cfa8db9dce25/whereabouts-cni/0.log" Jul 08 19:24:49.939684 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:49.939648 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rqb8d_aa0c7a77-7519-470b-b3ac-5fea0abdf1dd/kube-multus/0.log" Jul 08 19:24:50.047008 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:50.046971 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qwpjz_5f414ab9-ae98-4c7e-9edc-962d4bc015d9/network-metrics-daemon/0.log" Jul 08 19:24:50.068580 ip-10-0-135-240 kubenswrapper[2552]: I0708 19:24:50.068552 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qwpjz_5f414ab9-ae98-4c7e-9edc-962d4bc015d9/kube-rbac-proxy/0.log"