Jul 12 18:16:58.846987 ip-10-0-141-130 systemd[1]: Starting Kubernetes Kubelet... Jul 12 18:17:02.116451 ip-10-0-141-130 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 12 18:17:02.116451 ip-10-0-141-130 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 12 18:17:02.116451 ip-10-0-141-130 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 12 18:17:02.116451 ip-10-0-141-130 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 12 18:17:02.116451 ip-10-0-141-130 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 12 18:17:02.117110 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.116463 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 12 18:17:02.121632 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121602 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 18:17:02.121742 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121731 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 18:17:02.121742 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121736 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 18:17:02.121742 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121739 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 18:17:02.121742 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121743 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 18:17:02.121742 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121746 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 18:17:02.121940 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121749 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 18:17:02.121940 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121752 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 18:17:02.121940 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121755 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 18:17:02.121940 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121758 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 18:17:02.121940 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121761 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 18:17:02.121940 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121763 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 18:17:02.121940 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121766 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 18:17:02.121940 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121769 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 18:17:02.121940 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121771 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 18:17:02.121940 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121773 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 18:17:02.121940 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121776 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 18:17:02.121940 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121778 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 18:17:02.121940 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121781 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 18:17:02.121940 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121784 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 18:17:02.121940 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121787 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 18:17:02.121940 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121792 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 18:17:02.121940 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121795 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 18:17:02.121940 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121797 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 18:17:02.121940 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121800 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 18:17:02.121940 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121803 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 18:17:02.122428 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121805 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 18:17:02.122428 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121808 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 18:17:02.122428 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121811 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 18:17:02.122428 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121814 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 18:17:02.122428 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121816 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 18:17:02.122428 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121819 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 18:17:02.122428 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121821 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 18:17:02.122428 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121824 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 18:17:02.122428 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121826 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 18:17:02.122428 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121829 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 18:17:02.122428 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121832 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 18:17:02.122428 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121834 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 18:17:02.122428 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121837 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 18:17:02.122428 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121842 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 18:17:02.122428 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121847 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 18:17:02.122428 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121851 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 18:17:02.122428 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121854 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 18:17:02.122428 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121857 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 18:17:02.122428 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121861 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 18:17:02.122864 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121864 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 18:17:02.122864 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121866 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 18:17:02.122864 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121869 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 18:17:02.122864 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121872 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 18:17:02.122864 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121875 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 18:17:02.122864 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121879 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 18:17:02.122864 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121882 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 18:17:02.122864 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121885 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 18:17:02.122864 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121888 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 18:17:02.122864 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121891 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 18:17:02.122864 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121893 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 12 18:17:02.122864 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121896 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 18:17:02.122864 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121903 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 18:17:02.122864 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121905 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 18:17:02.122864 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121908 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 18:17:02.122864 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121912 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 18:17:02.122864 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121915 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 18:17:02.122864 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121919 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 18:17:02.122864 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121922 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 18:17:02.122864 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121926 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 18:17:02.123336 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121929 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 18:17:02.123336 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121932 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 18:17:02.123336 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121934 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 18:17:02.123336 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121937 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 18:17:02.123336 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121940 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 18:17:02.123336 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121942 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 18:17:02.123336 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121947 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 18:17:02.123336 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121951 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 18:17:02.123336 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121955 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 18:17:02.123336 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121958 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 18:17:02.123336 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121961 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 18:17:02.123336 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121964 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 18:17:02.123336 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121967 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 18:17:02.123336 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121969 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 18:17:02.123336 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121972 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 18:17:02.123336 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121974 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 18:17:02.123336 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121977 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 18:17:02.123336 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121980 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 18:17:02.123336 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121984 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 18:17:02.123787 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121986 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 18:17:02.123787 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121989 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 18:17:02.123787 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121992 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 18:17:02.123787 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121994 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 18:17:02.123787 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121997 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 18:17:02.123787 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.121999 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 18:17:02.123787 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122001 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 18:17:02.123787 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122004 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 18:17:02.123787 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122009 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 18:17:02.123787 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122012 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 18:17:02.123787 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122014 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 18:17:02.123787 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122017 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 18:17:02.123787 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122020 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 18:17:02.123787 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122022 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 18:17:02.123787 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122025 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 18:17:02.123787 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122809 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 18:17:02.123787 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122816 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 18:17:02.123787 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122820 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 18:17:02.123787 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122823 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 18:17:02.124258 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122827 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 18:17:02.124258 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122831 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 18:17:02.124258 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122836 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 18:17:02.124258 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122841 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 18:17:02.124258 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122844 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 18:17:02.124258 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122848 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 18:17:02.124258 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122851 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 18:17:02.124258 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122854 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 18:17:02.124258 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122856 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 18:17:02.124258 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122859 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 18:17:02.124258 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122861 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 18:17:02.124258 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122864 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 18:17:02.124258 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122867 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 18:17:02.124258 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122871 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 18:17:02.124258 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122874 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 18:17:02.124258 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122876 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 18:17:02.124258 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122879 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 18:17:02.124258 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122882 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 18:17:02.124258 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122885 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 18:17:02.124258 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122887 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 18:17:02.124762 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122890 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 18:17:02.124762 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122893 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 18:17:02.124762 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122895 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 18:17:02.124762 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122898 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 18:17:02.124762 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122901 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 18:17:02.124762 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122903 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 18:17:02.124762 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122905 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 18:17:02.124762 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122908 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 18:17:02.124762 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122910 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 18:17:02.124762 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122913 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 18:17:02.124762 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122915 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 18:17:02.124762 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122918 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 18:17:02.124762 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122921 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 18:17:02.124762 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122923 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 18:17:02.124762 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122926 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 18:17:02.124762 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122929 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 18:17:02.124762 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122931 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 18:17:02.124762 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122934 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 18:17:02.124762 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122938 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 18:17:02.125224 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122941 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 18:17:02.125224 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122944 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 18:17:02.125224 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122947 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 18:17:02.125224 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122949 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 18:17:02.125224 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122952 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 18:17:02.125224 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122954 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 18:17:02.125224 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122957 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 18:17:02.125224 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122960 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 18:17:02.125224 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122962 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 18:17:02.125224 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122965 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 18:17:02.125224 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122968 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 18:17:02.125224 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122970 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 18:17:02.125224 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122973 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 18:17:02.125224 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122976 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 18:17:02.125224 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122978 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 18:17:02.125224 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122981 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 18:17:02.125224 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122983 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 18:17:02.125224 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122986 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 18:17:02.125224 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122988 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 18:17:02.125224 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122991 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 18:17:02.125715 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122993 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 18:17:02.125715 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122995 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 18:17:02.125715 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.122998 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 18:17:02.125715 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123000 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 12 18:17:02.125715 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123003 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 18:17:02.125715 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123006 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 18:17:02.125715 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123009 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 18:17:02.125715 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123011 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 18:17:02.125715 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123015 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 18:17:02.125715 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123017 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 18:17:02.125715 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123020 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 18:17:02.125715 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123022 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 18:17:02.125715 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123025 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 18:17:02.125715 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123027 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 18:17:02.125715 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123030 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 18:17:02.125715 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123033 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 18:17:02.125715 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123035 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 18:17:02.125715 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123038 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 18:17:02.125715 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123040 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 18:17:02.125715 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123043 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 18:17:02.126205 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123046 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 18:17:02.126205 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123049 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 18:17:02.126205 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123051 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 18:17:02.126205 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123054 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 18:17:02.126205 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123056 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 18:17:02.126205 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123059 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 18:17:02.126205 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123061 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 18:17:02.126205 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123065 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 18:17:02.126205 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123068 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 18:17:02.126205 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123070 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 18:17:02.126205 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123073 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 18:17:02.126205 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123090 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 18:17:02.126205 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123092 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 18:17:02.126205 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123096 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 18:17:02.126205 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123099 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 18:17:02.126205 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123101 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 18:17:02.126205 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123489 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 18:17:02.126205 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123494 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 18:17:02.126205 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123497 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 18:17:02.126205 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123500 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 18:17:02.126677 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123503 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 18:17:02.126677 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123505 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 18:17:02.126677 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123508 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 18:17:02.126677 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123511 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 18:17:02.126677 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123513 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 18:17:02.126677 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123516 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 12 18:17:02.126677 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123519 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 18:17:02.126677 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123521 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 18:17:02.126677 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123524 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 18:17:02.126677 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123527 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 18:17:02.126677 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123529 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 18:17:02.126677 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123532 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 18:17:02.126677 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123535 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 18:17:02.126677 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123538 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 18:17:02.126677 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123541 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 18:17:02.126677 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123544 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 18:17:02.126677 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123546 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 18:17:02.126677 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123549 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 18:17:02.126677 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123551 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 18:17:02.127132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123554 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 18:17:02.127132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123556 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 18:17:02.127132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123559 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 18:17:02.127132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123561 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 18:17:02.127132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123564 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 18:17:02.127132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123568 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 18:17:02.127132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123571 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 18:17:02.127132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123573 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 18:17:02.127132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123576 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 18:17:02.127132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123579 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 18:17:02.127132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123582 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 18:17:02.127132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123584 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 18:17:02.127132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123587 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 18:17:02.127132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123589 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 18:17:02.127132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123592 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 18:17:02.127132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123594 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 18:17:02.127132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123597 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 18:17:02.127132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123599 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 18:17:02.127132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123602 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 18:17:02.127585 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123604 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 18:17:02.127585 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123608 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 18:17:02.127585 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123612 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 18:17:02.127585 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123614 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 18:17:02.127585 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123618 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 18:17:02.127585 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123621 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 18:17:02.127585 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123624 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 18:17:02.127585 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123627 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 18:17:02.127585 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123630 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 18:17:02.127585 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123634 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 18:17:02.127585 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123636 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 18:17:02.127585 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123639 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 18:17:02.127585 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123642 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 18:17:02.127585 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123645 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 18:17:02.127585 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123648 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 18:17:02.127585 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123651 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 18:17:02.127585 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123653 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 18:17:02.127585 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123655 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 18:17:02.127585 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123658 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 18:17:02.128033 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123660 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 18:17:02.128033 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123663 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 18:17:02.128033 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123665 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 18:17:02.128033 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123668 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 18:17:02.128033 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123670 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 18:17:02.128033 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123673 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 18:17:02.128033 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123676 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 18:17:02.128033 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123678 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 18:17:02.128033 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123680 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 18:17:02.128033 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123683 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 18:17:02.128033 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123685 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 18:17:02.128033 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123688 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 18:17:02.128033 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123690 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 18:17:02.128033 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123693 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 18:17:02.128033 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123695 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 18:17:02.128033 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123697 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 18:17:02.128033 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123700 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 18:17:02.128033 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123703 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 18:17:02.128033 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123705 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 18:17:02.128033 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123708 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 18:17:02.128529 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123710 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 18:17:02.128529 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123713 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 18:17:02.128529 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123716 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 18:17:02.128529 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123718 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 18:17:02.128529 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123721 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 18:17:02.128529 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123724 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 18:17:02.128529 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123727 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 18:17:02.128529 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123729 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 18:17:02.128529 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123732 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 18:17:02.128529 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123734 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 18:17:02.128529 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123737 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 18:17:02.128529 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123739 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 18:17:02.128529 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123742 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 18:17:02.128529 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123744 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 18:17:02.128529 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123747 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 18:17:02.128529 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123749 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 18:17:02.128529 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123752 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 18:17:02.128529 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.123754 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 18:17:02.128529 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123838 2556 flags.go:64] FLAG: --address="0.0.0.0" Jul 12 18:17:02.128529 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123845 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 12 18:17:02.128529 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123851 2556 flags.go:64] FLAG: --anonymous-auth="true" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123856 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123860 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123863 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123868 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123872 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123875 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123878 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123881 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123884 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123887 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123890 2556 flags.go:64] FLAG: --cgroup-root="" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123893 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123896 2556 flags.go:64] FLAG: --client-ca-file="" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123900 2556 flags.go:64] FLAG: --cloud-provider="external" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123903 2556 flags.go:64] FLAG: --cluster-dns="[]" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123908 2556 flags.go:64] FLAG: --cluster-domain="" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123911 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123914 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123917 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123921 2556 flags.go:64] FLAG: --container-log-max-files="5" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123924 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123928 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 12 18:17:02.129022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123931 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123934 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123937 2556 flags.go:64] FLAG: --contention-profiling="false" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123940 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123943 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123947 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123949 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123954 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123956 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123959 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123962 2556 flags.go:64] FLAG: --enable-load-reader="false" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123965 2556 flags.go:64] FLAG: --enable-server="true" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123968 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123972 2556 flags.go:64] FLAG: --event-burst="100" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123975 2556 flags.go:64] FLAG: --event-qps="50" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123978 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123981 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123984 2556 flags.go:64] FLAG: --eviction-hard="" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123987 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123990 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123993 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123996 2556 flags.go:64] FLAG: --eviction-soft="" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.123999 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124005 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124009 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 12 18:17:02.129557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124012 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124015 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124018 2556 flags.go:64] FLAG: --fail-swap-on="true" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124021 2556 flags.go:64] FLAG: --feature-gates="" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124024 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124027 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124030 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124033 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124036 2556 flags.go:64] FLAG: --healthz-port="10248" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124039 2556 flags.go:64] FLAG: --help="false" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124042 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-141-130.ec2.internal" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124045 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124048 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124051 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124054 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124057 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124060 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124063 2556 flags.go:64] FLAG: --image-service-endpoint="" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124066 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124068 2556 flags.go:64] FLAG: --kube-api-burst="100" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124071 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124087 2556 flags.go:64] FLAG: --kube-api-qps="50" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124090 2556 flags.go:64] FLAG: --kube-reserved="" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124093 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 12 18:17:02.130214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124096 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124099 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124102 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124105 2556 flags.go:64] FLAG: --lock-file="" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124108 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124110 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124115 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124120 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124127 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124130 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124133 2556 flags.go:64] FLAG: --logging-format="text" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124136 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124139 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124142 2556 flags.go:64] FLAG: --manifest-url="" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124145 2556 flags.go:64] FLAG: --manifest-url-header="" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124149 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124152 2556 flags.go:64] FLAG: --max-open-files="1000000" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124156 2556 flags.go:64] FLAG: --max-pods="110" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124159 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124162 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124165 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124168 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124171 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124174 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124177 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 12 18:17:02.130812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124183 2556 flags.go:64] FLAG: --node-status-max-images="50" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124186 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124189 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124192 2556 flags.go:64] FLAG: --pod-cidr="" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124195 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124201 2556 flags.go:64] FLAG: --pod-manifest-path="" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124204 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124207 2556 flags.go:64] FLAG: --pods-per-core="0" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124212 2556 flags.go:64] FLAG: --port="10250" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124215 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124217 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d2521c16f01f1ca8" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124220 2556 flags.go:64] FLAG: --qos-reserved="" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124223 2556 flags.go:64] FLAG: --read-only-port="10255" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124226 2556 flags.go:64] FLAG: --register-node="true" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124231 2556 flags.go:64] FLAG: --register-with-taints="" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124235 2556 flags.go:64] FLAG: --registry-burst="10" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124243 2556 flags.go:64] FLAG: --registry-qps="5" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124246 2556 flags.go:64] FLAG: --reserved-cpus="" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124249 2556 flags.go:64] FLAG: --reserved-memory="" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124253 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124256 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124259 2556 flags.go:64] FLAG: --rotate-certificates="false" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124262 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124265 2556 flags.go:64] FLAG: --runonce="false" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124268 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 12 18:17:02.131418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124271 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124274 2556 flags.go:64] FLAG: --seccomp-default="false" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124277 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124280 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124283 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124286 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124289 2556 flags.go:64] FLAG: --storage-driver-password="root" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124292 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124295 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124297 2556 flags.go:64] FLAG: --storage-driver-user="root" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124300 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124303 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124306 2556 flags.go:64] FLAG: --system-cgroups="" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124309 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124314 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124318 2556 flags.go:64] FLAG: --tls-cert-file="" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124320 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124326 2556 flags.go:64] FLAG: --tls-min-version="" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124329 2556 flags.go:64] FLAG: --tls-private-key-file="" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124331 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124334 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124338 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124341 2556 flags.go:64] FLAG: --v="2" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124345 2556 flags.go:64] FLAG: --version="false" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124350 2556 flags.go:64] FLAG: --vmodule="" Jul 12 18:17:02.131999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124354 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 12 18:17:02.132610 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.124357 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 12 18:17:02.132610 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124474 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 18:17:02.132610 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124477 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 18:17:02.132610 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124481 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 18:17:02.132610 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124484 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 18:17:02.132610 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124487 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 18:17:02.132610 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124490 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 18:17:02.132610 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124493 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 18:17:02.132610 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124496 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 18:17:02.132610 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124499 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 18:17:02.132610 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124501 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 18:17:02.132610 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124504 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 18:17:02.132610 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124506 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 18:17:02.132610 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124509 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 18:17:02.132610 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124512 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 18:17:02.132610 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124514 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 18:17:02.132610 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124517 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 18:17:02.132610 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124520 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 18:17:02.132610 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124522 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 18:17:02.132610 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124525 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 18:17:02.133110 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124527 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 18:17:02.133110 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124532 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 12 18:17:02.133110 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124534 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 18:17:02.133110 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124537 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 18:17:02.133110 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124539 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 18:17:02.133110 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124542 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 18:17:02.133110 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124544 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 18:17:02.133110 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124548 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 18:17:02.133110 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124551 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 18:17:02.133110 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124554 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 18:17:02.133110 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124557 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 18:17:02.133110 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124560 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 18:17:02.133110 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124563 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 18:17:02.133110 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124566 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 18:17:02.133110 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124569 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 18:17:02.133110 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124571 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 18:17:02.133110 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124574 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 18:17:02.133110 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124577 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 18:17:02.133110 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124579 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 18:17:02.133110 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124582 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 18:17:02.133578 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124584 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 18:17:02.133578 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124588 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 18:17:02.133578 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124592 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 18:17:02.133578 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124594 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 18:17:02.133578 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124597 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 18:17:02.133578 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124599 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 18:17:02.133578 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124602 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 18:17:02.133578 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124605 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 18:17:02.133578 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124608 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 18:17:02.133578 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124610 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 18:17:02.133578 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124613 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 18:17:02.133578 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124615 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 18:17:02.133578 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124618 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 18:17:02.133578 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124622 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 18:17:02.133578 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124625 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 18:17:02.133578 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124628 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 18:17:02.133578 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124630 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 18:17:02.133578 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124633 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 18:17:02.133578 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124635 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 18:17:02.134036 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124639 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 18:17:02.134036 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124642 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 18:17:02.134036 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124645 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 18:17:02.134036 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124647 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 18:17:02.134036 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124649 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 18:17:02.134036 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124652 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 18:17:02.134036 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124655 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 18:17:02.134036 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124658 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 18:17:02.134036 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124660 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 18:17:02.134036 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124663 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 18:17:02.134036 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124665 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 18:17:02.134036 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124667 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 18:17:02.134036 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124670 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 18:17:02.134036 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124673 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 18:17:02.134036 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124677 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 18:17:02.134036 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124680 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 18:17:02.134036 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124683 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 18:17:02.134036 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124685 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 18:17:02.134036 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124688 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 18:17:02.134541 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124691 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 18:17:02.134541 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124693 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 18:17:02.134541 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124695 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 18:17:02.134541 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124698 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 18:17:02.134541 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124701 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 18:17:02.134541 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124703 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 18:17:02.134541 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124706 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 18:17:02.134541 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124710 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 18:17:02.134541 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124713 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 18:17:02.134541 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124715 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 18:17:02.134541 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124718 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 18:17:02.134541 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124720 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 18:17:02.134541 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124723 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 18:17:02.134541 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124726 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 18:17:02.134541 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124729 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 18:17:02.134541 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124733 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 18:17:02.134541 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124736 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 18:17:02.134541 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124739 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 18:17:02.134541 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124742 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 18:17:02.134995 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124746 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 18:17:02.134995 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124749 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 18:17:02.134995 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.124751 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 18:17:02.134995 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.125667 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 12 18:17:02.134995 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.132099 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 12 18:17:02.134995 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.132115 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 12 18:17:02.134995 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.132136 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 12 18:17:02.134995 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.132142 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 12 18:17:02.134995 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132214 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 18:17:02.134995 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132219 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 18:17:02.134995 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132223 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 18:17:02.134995 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132226 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 18:17:02.134995 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132229 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 18:17:02.134995 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132231 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 18:17:02.134995 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132234 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 18:17:02.135533 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132237 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 18:17:02.135533 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132240 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 18:17:02.135533 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132243 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 18:17:02.135533 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132245 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 18:17:02.135533 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132248 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 18:17:02.135533 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132250 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 18:17:02.135533 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132253 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 18:17:02.135533 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132257 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 18:17:02.135533 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132261 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 18:17:02.135533 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132264 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 18:17:02.135533 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132267 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 18:17:02.135533 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132270 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 18:17:02.135533 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132272 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 18:17:02.135533 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132275 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 18:17:02.135533 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132278 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 18:17:02.135533 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132280 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 18:17:02.135533 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132283 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 18:17:02.135533 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132286 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 18:17:02.135533 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132288 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 18:17:02.136001 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132291 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 18:17:02.136001 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132293 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 18:17:02.136001 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132296 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 18:17:02.136001 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132301 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 18:17:02.136001 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132304 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 18:17:02.136001 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132306 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 18:17:02.136001 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132309 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 18:17:02.136001 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132311 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 18:17:02.136001 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132314 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 18:17:02.136001 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132317 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 18:17:02.136001 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132319 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 18:17:02.136001 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132321 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 18:17:02.136001 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132324 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 18:17:02.136001 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132328 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 18:17:02.136001 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132331 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 18:17:02.136001 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132335 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 18:17:02.136001 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132337 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 18:17:02.136001 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132340 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 18:17:02.136001 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132343 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 18:17:02.136467 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132345 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 18:17:02.136467 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132348 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 18:17:02.136467 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132351 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 18:17:02.136467 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132353 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 18:17:02.136467 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132356 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 18:17:02.136467 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132359 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 18:17:02.136467 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132362 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 18:17:02.136467 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132364 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 18:17:02.136467 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132367 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 18:17:02.136467 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132369 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 18:17:02.136467 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132372 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 18:17:02.136467 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132375 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 18:17:02.136467 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132377 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 18:17:02.136467 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132381 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 18:17:02.136467 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132384 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 18:17:02.136467 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132387 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 18:17:02.136467 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132391 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 18:17:02.136467 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132394 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 18:17:02.136467 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132397 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 18:17:02.136467 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132400 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 18:17:02.137132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132402 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 18:17:02.137132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132405 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 18:17:02.137132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132407 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 18:17:02.137132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132410 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 18:17:02.137132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132413 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 18:17:02.137132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132415 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 18:17:02.137132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132418 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 18:17:02.137132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132420 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 18:17:02.137132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132423 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 18:17:02.137132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132425 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 18:17:02.137132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132428 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 18:17:02.137132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132430 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 18:17:02.137132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132432 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 18:17:02.137132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132435 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 18:17:02.137132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132437 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 18:17:02.137132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132440 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 18:17:02.137132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132443 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 18:17:02.137132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132445 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 18:17:02.137132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132447 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 18:17:02.137132 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132450 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 18:17:02.137931 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132453 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 18:17:02.137931 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132455 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 18:17:02.137931 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132458 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 12 18:17:02.137931 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132460 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 18:17:02.137931 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132463 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 18:17:02.137931 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132465 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 18:17:02.137931 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132468 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 18:17:02.137931 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132470 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 18:17:02.137931 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132473 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 18:17:02.137931 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132476 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 18:17:02.137931 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132479 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 18:17:02.137931 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132482 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 18:17:02.137931 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132484 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 18:17:02.137931 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132486 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 18:17:02.137931 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.132491 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 12 18:17:02.138348 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132623 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 18:17:02.138348 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132629 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 18:17:02.138348 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132632 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 18:17:02.138348 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132635 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 18:17:02.138348 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132637 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 18:17:02.138348 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132641 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 18:17:02.138348 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132645 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 18:17:02.138348 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132648 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 18:17:02.138348 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132651 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 18:17:02.138348 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132654 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 18:17:02.138348 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132656 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 18:17:02.138348 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132659 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 18:17:02.138348 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132662 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 18:17:02.138348 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132665 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 18:17:02.138348 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132668 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 18:17:02.138348 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132670 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 18:17:02.138348 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132673 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 18:17:02.138348 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132676 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 18:17:02.138348 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132678 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 18:17:02.138828 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132681 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 18:17:02.138828 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132683 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 18:17:02.138828 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132686 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 18:17:02.138828 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132689 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 18:17:02.138828 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132691 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 18:17:02.138828 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132694 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 18:17:02.138828 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132696 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 18:17:02.138828 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132698 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 18:17:02.138828 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132702 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 18:17:02.138828 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132705 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 18:17:02.138828 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132708 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 18:17:02.138828 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132711 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 18:17:02.138828 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132715 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 18:17:02.138828 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132717 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 18:17:02.138828 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132720 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 18:17:02.138828 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132723 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 18:17:02.138828 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132726 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 18:17:02.138828 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132729 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 18:17:02.138828 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132731 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 18:17:02.138828 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132734 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 18:17:02.139471 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132736 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 18:17:02.139471 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132739 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 18:17:02.139471 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132741 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 18:17:02.139471 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132744 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 18:17:02.139471 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132746 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 18:17:02.139471 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132749 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 18:17:02.139471 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132751 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 18:17:02.139471 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132754 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 18:17:02.139471 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132756 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 18:17:02.139471 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132759 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 18:17:02.139471 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132761 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 18:17:02.139471 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132764 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 18:17:02.139471 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132767 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 18:17:02.139471 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132769 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 18:17:02.139471 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132772 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 12 18:17:02.139471 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132774 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 18:17:02.139471 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132777 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 18:17:02.139471 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132779 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 18:17:02.139471 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132782 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 18:17:02.139471 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132784 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 18:17:02.140039 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132787 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 18:17:02.140039 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132789 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 18:17:02.140039 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132793 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 18:17:02.140039 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132795 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 18:17:02.140039 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132798 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 18:17:02.140039 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132800 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 18:17:02.140039 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132803 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 18:17:02.140039 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132805 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 18:17:02.140039 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132808 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 18:17:02.140039 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132811 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 18:17:02.140039 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132813 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 18:17:02.140039 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132816 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 18:17:02.140039 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132818 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 18:17:02.140039 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132821 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 18:17:02.140039 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132823 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 18:17:02.140039 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132825 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 18:17:02.140039 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132828 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 18:17:02.140039 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132830 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 18:17:02.140039 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132833 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 18:17:02.140039 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132835 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 18:17:02.140863 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132838 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 18:17:02.140863 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132841 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 18:17:02.140863 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132843 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 18:17:02.140863 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132846 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 18:17:02.140863 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132850 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 18:17:02.140863 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132853 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 18:17:02.140863 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132856 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 18:17:02.140863 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132858 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 18:17:02.140863 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132861 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 18:17:02.140863 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132864 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 18:17:02.140863 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132866 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 18:17:02.140863 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132869 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 18:17:02.140863 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132871 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 18:17:02.140863 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132874 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 18:17:02.140863 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132876 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 18:17:02.140863 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132885 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 18:17:02.140863 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132888 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 18:17:02.140863 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132890 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 18:17:02.140863 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132892 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 18:17:02.141366 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:02.132895 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 18:17:02.141366 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.132900 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 12 18:17:02.141366 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.133031 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jul 12 18:17:02.141366 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.135269 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 12 18:17:02.141366 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.136615 2556 server.go:1019] "Starting client certificate rotation" Jul 12 18:17:02.141366 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.136743 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 12 18:17:02.141366 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.136799 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 12 18:17:02.141366 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.139291 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 12 18:17:02.142218 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.142186 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 12 18:17:02.155978 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.155955 2556 log.go:25] "Validated CRI v1 runtime API" Jul 12 18:17:02.158089 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.158064 2556 log.go:25] "Validated CRI v1 image API" Jul 12 18:17:02.158914 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.158890 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 12 18:17:02.162744 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.162714 2556 fs.go:135] Filesystem UUIDs: map[1c2834f1-8f88-47fe-80c2-59888b68f608:/dev/nvme0n1p4 4d0c629d-6b75-441c-b118-9319ed93a382:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 12 18:17:02.162823 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.162741 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 12 18:17:02.164425 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.164397 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 12 18:17:02.168446 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.168327 2556 manager.go:216] Machine: {Timestamp:2026-07-12 18:17:02.167064721 +0000 UTC m=+1.865823879 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100419 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2db79354ea06837a174544f07a2a25 SystemUUID:ec2db793-54ea-0683-7a17-4544f07a2a25 BootID:9317645b-5e7f-4378-87eb-a74d1829e070 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:be:83:90:4c:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:be:83:90:4c:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:b0:c6:12:5e:dd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 12 18:17:02.168446 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.168437 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 12 18:17:02.168588 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.168553 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 12 18:17:02.171650 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.171619 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 12 18:17:02.171805 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.171652 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-130.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 12 18:17:02.172340 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.172329 2556 topology_manager.go:138] "Creating topology manager with none policy" Jul 12 18:17:02.172373 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.172343 2556 container_manager_linux.go:309] "Creating device plugin manager" Jul 12 18:17:02.172373 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.172358 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 12 18:17:02.172981 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.172971 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 12 18:17:02.174117 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.174106 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 12 18:17:02.177761 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.177748 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 12 18:17:02.177889 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.177878 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 12 18:17:02.177928 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.177910 2556 kubelet.go:486] "Attempting to sync node with API server" Jul 12 18:17:02.177928 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.177922 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 12 18:17:02.178000 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.177938 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 12 18:17:02.178000 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.177950 2556 kubelet.go:398] "Adding apiserver pod source" Jul 12 18:17:02.178000 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.177960 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 12 18:17:02.178359 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.178347 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 12 18:17:02.178398 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.178364 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 12 18:17:02.180599 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.180581 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 12 18:17:02.182284 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.182270 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 12 18:17:02.182335 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.182301 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 12 18:17:02.182501 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.182489 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 12 18:17:02.182547 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.182508 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 12 18:17:02.182547 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.182515 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 12 18:17:02.182547 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.182521 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 12 18:17:02.182547 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.182529 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 12 18:17:02.182547 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.182535 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 12 18:17:02.183033 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.183024 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 12 18:17:02.183063 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.183033 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 12 18:17:02.183063 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.183041 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 12 18:17:02.183063 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.183047 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 12 18:17:02.183063 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.183056 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 12 18:17:02.183063 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.183063 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 12 18:17:02.183806 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.183795 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 12 18:17:02.183806 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.183806 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 12 18:17:02.187036 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.187021 2556 server.go:1268] "Started kubelet" Jul 12 18:17:02.187191 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.187136 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 12 18:17:02.187285 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.187193 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 12 18:17:02.187285 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.187274 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 12 18:17:02.187998 ip-10-0-141-130 systemd[1]: Started Kubernetes Kubelet. Jul 12 18:17:02.192903 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.192881 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 12 18:17:02.193533 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.192940 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-130.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 12 18:17:02.193666 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:02.193634 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-130.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 12 18:17:02.193778 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:02.193742 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 12 18:17:02.193916 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.193897 2556 server.go:310] "Adding debug handlers to kubelet server" Jul 12 18:17:02.194902 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:02.194831 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 12 18:17:02.196414 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:02.195548 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-130.ec2.internal.18c19d9c554cfa93 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-130.ec2.internal,UID:ip-10-0-141-130.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-130.ec2.internal,},FirstTimestamp:2026-07-12 18:17:02.186994323 +0000 UTC m=+1.885753482,LastTimestamp:2026-07-12 18:17:02.186994323 +0000 UTC m=+1.885753482,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-130.ec2.internal,}" Jul 12 18:17:02.197597 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.197577 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 12 18:17:02.197597 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.197585 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 12 18:17:02.197715 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:02.197660 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-130.ec2.internal\" not found" Jul 12 18:17:02.198122 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.198106 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 12 18:17:02.198122 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.198108 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 12 18:17:02.198250 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.198133 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 12 18:17:02.198250 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.198195 2556 reconstruct.go:97] "Volume reconstruction finished" Jul 12 18:17:02.198250 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.198203 2556 reconciler.go:29] "Reconciler: start to sync state" Jul 12 18:17:02.198425 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.198409 2556 factory.go:55] Registering systemd factory Jul 12 18:17:02.198539 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.198527 2556 factory.go:223] Registration of the systemd container factory successfully Jul 12 18:17:02.198768 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.198754 2556 factory.go:153] Registering CRI-O factory Jul 12 18:17:02.198833 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.198771 2556 factory.go:223] Registration of the crio container factory successfully Jul 12 18:17:02.198833 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.198826 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 12 18:17:02.198897 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.198850 2556 factory.go:103] Registering Raw factory Jul 12 18:17:02.198897 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.198869 2556 manager.go:1196] Started watching for new ooms in manager Jul 12 18:17:02.199299 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:02.199267 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-130.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 12 18:17:02.199391 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.199310 2556 manager.go:349] Starting recovery of all containers Jul 12 18:17:02.199391 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:02.199314 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 12 18:17:02.209319 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.209285 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c8gmz" Jul 12 18:17:02.210784 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.210703 2556 manager.go:354] Recovery completed Jul 12 18:17:02.214962 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.214948 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 18:17:02.216274 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.216250 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c8gmz" Jul 12 18:17:02.216905 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.216891 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-130.ec2.internal" event="NodeHasSufficientMemory" Jul 12 18:17:02.216964 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.216917 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 18:17:02.216964 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.216927 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-130.ec2.internal" event="NodeHasSufficientPID" Jul 12 18:17:02.217503 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.217489 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 12 18:17:02.217503 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.217499 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 18:17:02.217601 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.217502 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 12 18:17:02.217601 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.217567 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 12 18:17:02.218193 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.218179 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-130.ec2.internal" event="NodeHasSufficientMemory" Jul 12 18:17:02.218263 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.218206 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 18:17:02.218263 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.218219 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-130.ec2.internal" event="NodeHasSufficientPID" Jul 12 18:17:02.219953 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.219937 2556 policy_none.go:49] "None policy: Start" Jul 12 18:17:02.220007 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.219961 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 12 18:17:02.220007 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.219974 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 12 18:17:02.221986 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.221973 2556 policy_none.go:47] "Start" Jul 12 18:17:02.258809 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.258655 2556 manager.go:337] "Starting Device Plugin manager" Jul 12 18:17:02.258917 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:02.258831 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 12 18:17:02.258917 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.258843 2556 server.go:87] "Starting device plugin registration server" Jul 12 18:17:02.259137 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.259125 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 12 18:17:02.259199 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.259140 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 12 18:17:02.259269 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.259251 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 12 18:17:02.259352 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.259335 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 12 18:17:02.259352 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.259352 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 12 18:17:02.259889 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:02.259870 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 12 18:17:02.259973 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:02.259924 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-130.ec2.internal\" not found" Jul 12 18:17:02.332797 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.332756 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 12 18:17:02.334066 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.334049 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 12 18:17:02.334168 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.334098 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 12 18:17:02.334168 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.334128 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jul 12 18:17:02.334168 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:02.334164 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 12 18:17:02.336627 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.336605 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 18:17:02.359606 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.359584 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 18:17:02.360536 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.360515 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-130.ec2.internal" event="NodeHasSufficientMemory" Jul 12 18:17:02.360632 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.360555 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 18:17:02.360632 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.360566 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-130.ec2.internal" event="NodeHasSufficientPID" Jul 12 18:17:02.360632 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.360591 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-130.ec2.internal" Jul 12 18:17:02.372094 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.372035 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-130.ec2.internal" Jul 12 18:17:02.372094 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:02.372061 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-130.ec2.internal\": node \"ip-10-0-141-130.ec2.internal\" not found" Jul 12 18:17:02.396384 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:02.396357 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-130.ec2.internal\" not found" Jul 12 18:17:02.434962 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.434921 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-130.ec2.internal"] Jul 12 18:17:02.435172 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.435011 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 18:17:02.436048 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.436019 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-130.ec2.internal" event="NodeHasSufficientMemory" Jul 12 18:17:02.436156 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.436066 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 18:17:02.436156 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.436098 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-130.ec2.internal" event="NodeHasSufficientPID" Jul 12 18:17:02.437451 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.437435 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 18:17:02.437569 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.437553 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.ec2.internal" Jul 12 18:17:02.437621 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.437596 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 18:17:02.438238 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.438222 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-130.ec2.internal" event="NodeHasSufficientMemory" Jul 12 18:17:02.438238 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.438236 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-130.ec2.internal" event="NodeHasSufficientMemory" Jul 12 18:17:02.438419 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.438255 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 18:17:02.438419 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.438259 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 18:17:02.438419 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.438269 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-130.ec2.internal" event="NodeHasSufficientPID" Jul 12 18:17:02.438419 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.438274 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-130.ec2.internal" event="NodeHasSufficientPID" Jul 12 18:17:02.439524 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.439506 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.ec2.internal" Jul 12 18:17:02.439588 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.439540 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 18:17:02.440285 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.440269 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-130.ec2.internal" event="NodeHasSufficientMemory" Jul 12 18:17:02.440385 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.440293 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-130.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 18:17:02.440385 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.440304 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-130.ec2.internal" event="NodeHasSufficientPID" Jul 12 18:17:02.465027 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:02.464997 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-130.ec2.internal\" not found" node="ip-10-0-141-130.ec2.internal" Jul 12 18:17:02.469230 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:02.469211 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-130.ec2.internal\" not found" node="ip-10-0-141-130.ec2.internal" Jul 12 18:17:02.496459 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:02.496428 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-130.ec2.internal\" not found" Jul 12 18:17:02.597356 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:02.597306 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-130.ec2.internal\" not found" Jul 12 18:17:02.599548 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.599525 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6d699647f03e60e64b1e1e805c709ebc-config\") pod \"kube-apiserver-proxy-ip-10-0-141-130.ec2.internal\" (UID: \"6d699647f03e60e64b1e1e805c709ebc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.ec2.internal" Jul 12 18:17:02.599622 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.599556 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b590f9b194e8e45b2e34be79d9df5a64-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-130.ec2.internal\" (UID: \"b590f9b194e8e45b2e34be79d9df5a64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.ec2.internal" Jul 12 18:17:02.599622 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.599577 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b590f9b194e8e45b2e34be79d9df5a64-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-130.ec2.internal\" (UID: \"b590f9b194e8e45b2e34be79d9df5a64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.ec2.internal" Jul 12 18:17:02.698016 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:02.697956 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-130.ec2.internal\" not found" Jul 12 18:17:02.700187 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.700164 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b590f9b194e8e45b2e34be79d9df5a64-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-130.ec2.internal\" (UID: \"b590f9b194e8e45b2e34be79d9df5a64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.ec2.internal" Jul 12 18:17:02.700266 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.700201 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b590f9b194e8e45b2e34be79d9df5a64-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-130.ec2.internal\" (UID: \"b590f9b194e8e45b2e34be79d9df5a64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.ec2.internal" Jul 12 18:17:02.700266 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.700228 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6d699647f03e60e64b1e1e805c709ebc-config\") pod \"kube-apiserver-proxy-ip-10-0-141-130.ec2.internal\" (UID: \"6d699647f03e60e64b1e1e805c709ebc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.ec2.internal" Jul 12 18:17:02.700358 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.700267 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b590f9b194e8e45b2e34be79d9df5a64-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-130.ec2.internal\" (UID: \"b590f9b194e8e45b2e34be79d9df5a64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.ec2.internal" Jul 12 18:17:02.700358 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.700280 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6d699647f03e60e64b1e1e805c709ebc-config\") pod \"kube-apiserver-proxy-ip-10-0-141-130.ec2.internal\" (UID: \"6d699647f03e60e64b1e1e805c709ebc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.ec2.internal" Jul 12 18:17:02.700358 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.700270 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b590f9b194e8e45b2e34be79d9df5a64-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-130.ec2.internal\" (UID: \"b590f9b194e8e45b2e34be79d9df5a64\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.ec2.internal" Jul 12 18:17:02.767373 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.767330 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.ec2.internal" Jul 12 18:17:02.772206 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:02.772191 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.ec2.internal" Jul 12 18:17:02.799061 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:02.799019 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-130.ec2.internal\" not found" Jul 12 18:17:02.899495 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:02.899456 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-130.ec2.internal\" not found" Jul 12 18:17:02.999974 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:02.999887 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-130.ec2.internal\" not found" Jul 12 18:17:03.100408 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:03.100373 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-130.ec2.internal\" not found" Jul 12 18:17:03.135655 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:03.135619 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 12 18:17:03.136112 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:03.135785 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 12 18:17:03.200783 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:03.200753 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-130.ec2.internal\" not found" Jul 12 18:17:03.221155 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:03.221116 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-11 18:12:02 +0000 UTC" deadline="2028-02-13 01:26:35.422080173 +0000 UTC" Jul 12 18:17:03.221155 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:03.221147 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13927h9m32.200936584s" Jul 12 18:17:03.288506 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:03.288447 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 18:17:03.301569 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:03.301547 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-130.ec2.internal\" not found" Jul 12 18:17:03.401640 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:03.401605 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-130.ec2.internal\" not found" Jul 12 18:17:03.447931 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:03.447894 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d699647f03e60e64b1e1e805c709ebc.slice/crio-f388a56bf274a71421cb62d68b48efee919c0675334418f45cddacba1f3c8406 WatchSource:0}: Error finding container f388a56bf274a71421cb62d68b48efee919c0675334418f45cddacba1f3c8406: Status 404 returned error can't find the container with id f388a56bf274a71421cb62d68b48efee919c0675334418f45cddacba1f3c8406 Jul 12 18:17:03.448301 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:03.448281 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb590f9b194e8e45b2e34be79d9df5a64.slice/crio-0ed7959a5e5ffe7f5ba3a1e301b8afc3a7b2b6829a3c11850e073574d4f5dbbc WatchSource:0}: Error finding container 0ed7959a5e5ffe7f5ba3a1e301b8afc3a7b2b6829a3c11850e073574d4f5dbbc: Status 404 returned error can't find the container with id 0ed7959a5e5ffe7f5ba3a1e301b8afc3a7b2b6829a3c11850e073574d4f5dbbc Jul 12 18:17:03.453582 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:03.453566 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 18:17:03.502361 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:03.502331 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-130.ec2.internal\" not found" Jul 12 18:17:03.573123 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:03.573014 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 18:17:03.597873 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:03.597846 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.ec2.internal" Jul 12 18:17:03.609427 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:03.609402 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 12 18:17:03.610607 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:03.610590 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.ec2.internal" Jul 12 18:17:03.618376 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:03.618361 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 12 18:17:03.779869 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:03.779838 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 18:17:04.179002 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.178967 2556 apiserver.go:52] "Watching apiserver" Jul 12 18:17:04.186292 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.186263 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 12 18:17:04.188334 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.188289 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-fsg86","kube-system/kube-apiserver-proxy-ip-10-0-141-130.ec2.internal","openshift-image-registry/node-ca-plght","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.ec2.internal","openshift-network-diagnostics/network-check-target-sk4z9","openshift-ovn-kubernetes/ovnkube-node-899r5","kube-system/konnectivity-agent-xghs8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r","openshift-cluster-node-tuning-operator/tuned-t8wcl","openshift-dns/node-resolver-q2sxm","openshift-multus/multus-additional-cni-plugins-j8xtv","openshift-multus/multus-l9vdt","openshift-multus/network-metrics-daemon-vn8dd","openshift-network-operator/iptables-alerter-w65v7"] Jul 12 18:17:04.191580 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.191555 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q2sxm" Jul 12 18:17:04.194955 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.194923 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tjnrl\"" Jul 12 18:17:04.195058 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.194952 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:04.195058 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.194976 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 12 18:17:04.195058 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:04.195036 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn8dd" podUID="92c9c69e-5148-4be6-a348-7bb634c94566" Jul 12 18:17:04.195313 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.195292 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 12 18:17:04.196059 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.196040 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-plght" Jul 12 18:17:04.199264 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.198450 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 12 18:17:04.199264 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.199006 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w65v7" Jul 12 18:17:04.199650 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.199628 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 12 18:17:04.199893 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.199873 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-n9rmc\"" Jul 12 18:17:04.199985 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.199966 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 12 18:17:04.200063 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.199875 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 12 18:17:04.200533 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.200517 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:04.200615 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:04.200586 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sk4z9" podUID="d46d24aa-b5cf-4607-84ae-53ff23de58d9" Jul 12 18:17:04.201091 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.201059 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 12 18:17:04.201363 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.201344 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 12 18:17:04.201562 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.201547 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7zq8v\"" Jul 12 18:17:04.201709 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.201693 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 12 18:17:04.202873 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.202854 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.205896 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.205874 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.206223 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.206205 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 12 18:17:04.206382 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.206366 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 12 18:17:04.206552 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.206536 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 12 18:17:04.206614 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.206567 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-mv9gc\"" Jul 12 18:17:04.206771 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.206755 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 12 18:17:04.206827 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.206810 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 12 18:17:04.207130 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.207114 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 12 18:17:04.208205 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.208186 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xghs8" Jul 12 18:17:04.208290 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.208236 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 12 18:17:04.208421 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.208405 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 12 18:17:04.208823 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.208804 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6ckg2\"" Jul 12 18:17:04.209500 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.209480 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 12 18:17:04.209752 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.209734 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d273d74a-7734-44c2-ad9a-d3f7662b5ddc-serviceca\") pod \"node-ca-plght\" (UID: \"d273d74a-7734-44c2-ad9a-d3f7662b5ddc\") " pod="openshift-image-registry/node-ca-plght" Jul 12 18:17:04.209847 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.209766 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8t2w\" (UniqueName: \"kubernetes.io/projected/d273d74a-7734-44c2-ad9a-d3f7662b5ddc-kube-api-access-w8t2w\") pod \"node-ca-plght\" (UID: \"d273d74a-7734-44c2-ad9a-d3f7662b5ddc\") " pod="openshift-image-registry/node-ca-plght" Jul 12 18:17:04.209847 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.209806 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cx8q\" (UniqueName: \"kubernetes.io/projected/b088b3c1-17b7-4bce-8dc9-39b80e491ff0-kube-api-access-4cx8q\") pod \"iptables-alerter-w65v7\" (UID: \"b088b3c1-17b7-4bce-8dc9-39b80e491ff0\") " pod="openshift-network-operator/iptables-alerter-w65v7" Jul 12 18:17:04.209847 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.209834 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3030442-56ce-4562-89e3-dbfa9ed9be95-tmp-dir\") pod \"node-resolver-q2sxm\" (UID: \"b3030442-56ce-4562-89e3-dbfa9ed9be95\") " pod="openshift-dns/node-resolver-q2sxm" Jul 12 18:17:04.210001 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.209857 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d273d74a-7734-44c2-ad9a-d3f7662b5ddc-host\") pod \"node-ca-plght\" (UID: \"d273d74a-7734-44c2-ad9a-d3f7662b5ddc\") " pod="openshift-image-registry/node-ca-plght" Jul 12 18:17:04.210001 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.209879 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b3030442-56ce-4562-89e3-dbfa9ed9be95-hosts-file\") pod \"node-resolver-q2sxm\" (UID: \"b3030442-56ce-4562-89e3-dbfa9ed9be95\") " pod="openshift-dns/node-resolver-q2sxm" Jul 12 18:17:04.210001 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.209902 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmfsq\" (UniqueName: \"kubernetes.io/projected/b3030442-56ce-4562-89e3-dbfa9ed9be95-kube-api-access-lmfsq\") pod \"node-resolver-q2sxm\" (UID: \"b3030442-56ce-4562-89e3-dbfa9ed9be95\") " pod="openshift-dns/node-resolver-q2sxm" Jul 12 18:17:04.210001 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.209930 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b088b3c1-17b7-4bce-8dc9-39b80e491ff0-iptables-alerter-script\") pod \"iptables-alerter-w65v7\" (UID: \"b088b3c1-17b7-4bce-8dc9-39b80e491ff0\") " pod="openshift-network-operator/iptables-alerter-w65v7" Jul 12 18:17:04.210001 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.209961 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b088b3c1-17b7-4bce-8dc9-39b80e491ff0-host-slash\") pod \"iptables-alerter-w65v7\" (UID: \"b088b3c1-17b7-4bce-8dc9-39b80e491ff0\") " pod="openshift-network-operator/iptables-alerter-w65v7" Jul 12 18:17:04.210001 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.209983 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kn76\" (UniqueName: \"kubernetes.io/projected/d46d24aa-b5cf-4607-84ae-53ff23de58d9-kube-api-access-7kn76\") pod \"network-check-target-sk4z9\" (UID: \"d46d24aa-b5cf-4607-84ae-53ff23de58d9\") " pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:04.210303 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.210007 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs\") pod \"network-metrics-daemon-vn8dd\" (UID: \"92c9c69e-5148-4be6-a348-7bb634c94566\") " pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:04.210303 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.210039 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gnrv\" (UniqueName: \"kubernetes.io/projected/92c9c69e-5148-4be6-a348-7bb634c94566-kube-api-access-6gnrv\") pod \"network-metrics-daemon-vn8dd\" (UID: \"92c9c69e-5148-4be6-a348-7bb634c94566\") " pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:04.210487 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.210455 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 12 18:17:04.210577 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.210501 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.210635 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.210595 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 12 18:17:04.211270 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.210896 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kc5mg\"" Jul 12 18:17:04.213150 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.212781 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:04.213150 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:04.212859 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fsg86" podUID="27d0cbdc-10e6-4e60-8b17-c278fe65e4ec" Jul 12 18:17:04.213150 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.213053 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 12 18:17:04.213882 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.213506 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 12 18:17:04.213882 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.213692 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 12 18:17:04.214018 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.213904 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-rcsxx\"" Jul 12 18:17:04.215294 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.215275 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.217640 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.217623 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.218389 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.218370 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-l7frw\"" Jul 12 18:17:04.218722 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.218661 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 12 18:17:04.218801 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.218773 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 12 18:17:04.218859 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.218845 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 12 18:17:04.218959 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.218946 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 12 18:17:04.219759 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.219574 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 12 18:17:04.220319 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.220135 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 12 18:17:04.220671 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.220508 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bk9j6\"" Jul 12 18:17:04.239166 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.239144 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xpxrf" Jul 12 18:17:04.246610 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.246192 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xpxrf" Jul 12 18:17:04.300034 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.299961 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 12 18:17:04.311190 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311138 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3634787d-b1de-443d-9721-bb734e755223-cni-binary-copy\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.311190 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311174 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-etc-kubernetes\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.311190 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311202 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-host-run-ovn-kubernetes\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.311534 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311229 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/61fdf430-4362-45f5-8d71-56dc20adfba3-env-overrides\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.311534 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311250 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-sys\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.311534 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311274 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-multus-socket-dir-parent\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.311534 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311299 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-host-kubelet\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.311534 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311344 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/61fdf430-4362-45f5-8d71-56dc20adfba3-ovnkube-script-lib\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.311534 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311390 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2959f37-2d8d-4c33-b801-c2441982b9d3-agent-certs\") pod \"konnectivity-agent-xghs8\" (UID: \"d2959f37-2d8d-4c33-b801-c2441982b9d3\") " pod="kube-system/konnectivity-agent-xghs8" Jul 12 18:17:04.311534 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311429 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3030442-56ce-4562-89e3-dbfa9ed9be95-tmp-dir\") pod \"node-resolver-q2sxm\" (UID: \"b3030442-56ce-4562-89e3-dbfa9ed9be95\") " pod="openshift-dns/node-resolver-q2sxm" Jul 12 18:17:04.311534 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311455 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-host-run-multus-certs\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.311534 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311517 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-var-lib-openvswitch\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.311948 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311543 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-run-ovn\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.311948 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311567 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-host-cni-netd\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.311948 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311593 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b088b3c1-17b7-4bce-8dc9-39b80e491ff0-iptables-alerter-script\") pod \"iptables-alerter-w65v7\" (UID: \"b088b3c1-17b7-4bce-8dc9-39b80e491ff0\") " pod="openshift-network-operator/iptables-alerter-w65v7" Jul 12 18:17:04.311948 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311644 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tws5r\" (UID: \"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.311948 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311668 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a-socket-dir\") pod \"aws-ebs-csi-driver-node-tws5r\" (UID: \"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.311948 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311692 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-host-run-k8s-cni-cncf-io\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.311948 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311716 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-host-var-lib-cni-multus\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.311948 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311747 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh79t\" (UniqueName: \"kubernetes.io/projected/3634787d-b1de-443d-9721-bb734e755223-kube-api-access-nh79t\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.311948 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311770 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/694a2f71-426d-4555-92e1-0d2e92c359d9-etc-tuned\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.311948 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311794 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/694a2f71-426d-4555-92e1-0d2e92c359d9-tmp\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.311948 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311829 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.311948 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311893 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-multus-cni-dir\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.311948 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311917 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-host-var-lib-kubelet\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.311948 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311941 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-multus-conf-dir\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.313735 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311964 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-host-cni-bin\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.313735 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.311988 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a-registration-dir\") pod \"aws-ebs-csi-driver-node-tws5r\" (UID: \"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.313735 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312012 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-cnibin\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.313735 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312036 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-host-var-lib-cni-bin\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.313735 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312059 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-run-systemd\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.313735 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312098 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-run-openvswitch\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.313735 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312126 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-log-socket\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.313735 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312153 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d273d74a-7734-44c2-ad9a-d3f7662b5ddc-host\") pod \"node-ca-plght\" (UID: \"d273d74a-7734-44c2-ad9a-d3f7662b5ddc\") " pod="openshift-image-registry/node-ca-plght" Jul 12 18:17:04.313735 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312178 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a-etc-selinux\") pod \"aws-ebs-csi-driver-node-tws5r\" (UID: \"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.313735 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312203 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-systemd-units\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.313735 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312287 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-host-run-netns\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.313735 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312313 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b088b3c1-17b7-4bce-8dc9-39b80e491ff0-host-slash\") pod \"iptables-alerter-w65v7\" (UID: \"b088b3c1-17b7-4bce-8dc9-39b80e491ff0\") " pod="openshift-network-operator/iptables-alerter-w65v7" Jul 12 18:17:04.313735 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312337 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-cni-binary-copy\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.313735 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312364 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-os-release\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.313735 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312387 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/61fdf430-4362-45f5-8d71-56dc20adfba3-ovnkube-config\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.313735 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312412 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kng5x\" (UniqueName: \"kubernetes.io/projected/61fdf430-4362-45f5-8d71-56dc20adfba3-kube-api-access-kng5x\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.313735 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312437 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs\") pod \"network-metrics-daemon-vn8dd\" (UID: \"92c9c69e-5148-4be6-a348-7bb634c94566\") " pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:04.314594 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312481 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gnrv\" (UniqueName: \"kubernetes.io/projected/92c9c69e-5148-4be6-a348-7bb634c94566-kube-api-access-6gnrv\") pod \"network-metrics-daemon-vn8dd\" (UID: \"92c9c69e-5148-4be6-a348-7bb634c94566\") " pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:04.314594 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312505 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-etc-sysctl-d\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.314594 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312521 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d273d74a-7734-44c2-ad9a-d3f7662b5ddc-host\") pod \"node-ca-plght\" (UID: \"d273d74a-7734-44c2-ad9a-d3f7662b5ddc\") " pod="openshift-image-registry/node-ca-plght" Jul 12 18:17:04.314594 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312587 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-lib-modules\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.314594 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312615 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-cnibin\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.314594 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312643 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-etc-openvswitch\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.314594 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312668 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2959f37-2d8d-4c33-b801-c2441982b9d3-konnectivity-ca\") pod \"konnectivity-agent-xghs8\" (UID: \"d2959f37-2d8d-4c33-b801-c2441982b9d3\") " pod="kube-system/konnectivity-agent-xghs8" Jul 12 18:17:04.314594 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312689 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b088b3c1-17b7-4bce-8dc9-39b80e491ff0-iptables-alerter-script\") pod \"iptables-alerter-w65v7\" (UID: \"b088b3c1-17b7-4bce-8dc9-39b80e491ff0\") " pod="openshift-network-operator/iptables-alerter-w65v7" Jul 12 18:17:04.314594 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312700 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8t2w\" (UniqueName: \"kubernetes.io/projected/d273d74a-7734-44c2-ad9a-d3f7662b5ddc-kube-api-access-w8t2w\") pod \"node-ca-plght\" (UID: \"d273d74a-7734-44c2-ad9a-d3f7662b5ddc\") " pod="openshift-image-registry/node-ca-plght" Jul 12 18:17:04.314594 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312728 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-run\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.314594 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312763 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a-sys-fs\") pod \"aws-ebs-csi-driver-node-tws5r\" (UID: \"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.314594 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312780 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b088b3c1-17b7-4bce-8dc9-39b80e491ff0-host-slash\") pod \"iptables-alerter-w65v7\" (UID: \"b088b3c1-17b7-4bce-8dc9-39b80e491ff0\") " pod="openshift-network-operator/iptables-alerter-w65v7" Jul 12 18:17:04.314594 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312803 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3634787d-b1de-443d-9721-bb734e755223-multus-daemon-config\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.314594 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312834 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-etc-modprobe-d\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.314594 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312860 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-etc-systemd\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.314594 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312886 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-system-cni-dir\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.316633 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312914 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.316633 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.312978 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kn76\" (UniqueName: \"kubernetes.io/projected/d46d24aa-b5cf-4607-84ae-53ff23de58d9-kube-api-access-7kn76\") pod \"network-check-target-sk4z9\" (UID: \"d46d24aa-b5cf-4607-84ae-53ff23de58d9\") " pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:04.316633 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313009 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-etc-kubernetes\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.316633 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313038 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlv8j\" (UniqueName: \"kubernetes.io/projected/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-kube-api-access-vlv8j\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.316633 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313041 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3030442-56ce-4562-89e3-dbfa9ed9be95-tmp-dir\") pod \"node-resolver-q2sxm\" (UID: \"b3030442-56ce-4562-89e3-dbfa9ed9be95\") " pod="openshift-dns/node-resolver-q2sxm" Jul 12 18:17:04.316633 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313096 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-host-run-netns\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.316633 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:04.313101 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 18:17:04.316633 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313305 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/61fdf430-4362-45f5-8d71-56dc20adfba3-ovn-node-metrics-cert\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.316633 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313349 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-etc-sysctl-conf\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.316633 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313375 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5knqj\" (UniqueName: \"kubernetes.io/projected/694a2f71-426d-4555-92e1-0d2e92c359d9-kube-api-access-5knqj\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.316633 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313401 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-dbus\") pod \"global-pull-secret-syncer-fsg86\" (UID: \"27d0cbdc-10e6-4e60-8b17-c278fe65e4ec\") " pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:04.316633 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313454 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-os-release\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.316633 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313480 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-host-slash\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.316633 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313512 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-node-log\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.316633 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313540 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.316633 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313568 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d273d74a-7734-44c2-ad9a-d3f7662b5ddc-serviceca\") pod \"node-ca-plght\" (UID: \"d273d74a-7734-44c2-ad9a-d3f7662b5ddc\") " pod="openshift-image-registry/node-ca-plght" Jul 12 18:17:04.316633 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313595 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cx8q\" (UniqueName: \"kubernetes.io/projected/b088b3c1-17b7-4bce-8dc9-39b80e491ff0-kube-api-access-4cx8q\") pod \"iptables-alerter-w65v7\" (UID: \"b088b3c1-17b7-4bce-8dc9-39b80e491ff0\") " pod="openshift-network-operator/iptables-alerter-w65v7" Jul 12 18:17:04.317478 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313622 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-etc-sysconfig\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.317478 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313648 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-var-lib-kubelet\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.317478 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313715 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj2hq\" (UniqueName: \"kubernetes.io/projected/a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a-kube-api-access-sj2hq\") pod \"aws-ebs-csi-driver-node-tws5r\" (UID: \"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.317478 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313805 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a-device-dir\") pod \"aws-ebs-csi-driver-node-tws5r\" (UID: \"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.317478 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313846 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b3030442-56ce-4562-89e3-dbfa9ed9be95-hosts-file\") pod \"node-resolver-q2sxm\" (UID: \"b3030442-56ce-4562-89e3-dbfa9ed9be95\") " pod="openshift-dns/node-resolver-q2sxm" Jul 12 18:17:04.317478 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313873 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmfsq\" (UniqueName: \"kubernetes.io/projected/b3030442-56ce-4562-89e3-dbfa9ed9be95-kube-api-access-lmfsq\") pod \"node-resolver-q2sxm\" (UID: \"b3030442-56ce-4562-89e3-dbfa9ed9be95\") " pod="openshift-dns/node-resolver-q2sxm" Jul 12 18:17:04.317478 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313904 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-kubelet-config\") pod \"global-pull-secret-syncer-fsg86\" (UID: \"27d0cbdc-10e6-4e60-8b17-c278fe65e4ec\") " pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:04.317478 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313932 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.317478 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313959 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-system-cni-dir\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.317478 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.313985 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-hostroot\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.317478 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.314007 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-host\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.317478 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.314032 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret\") pod \"global-pull-secret-syncer-fsg86\" (UID: \"27d0cbdc-10e6-4e60-8b17-c278fe65e4ec\") " pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:04.317478 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:04.314155 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs podName:92c9c69e-5148-4be6-a348-7bb634c94566 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:04.814128448 +0000 UTC m=+4.512887612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs") pod "network-metrics-daemon-vn8dd" (UID: "92c9c69e-5148-4be6-a348-7bb634c94566") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 18:17:04.317478 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.314734 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d273d74a-7734-44c2-ad9a-d3f7662b5ddc-serviceca\") pod \"node-ca-plght\" (UID: \"d273d74a-7734-44c2-ad9a-d3f7662b5ddc\") " pod="openshift-image-registry/node-ca-plght" Jul 12 18:17:04.317478 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.315200 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b3030442-56ce-4562-89e3-dbfa9ed9be95-hosts-file\") pod \"node-resolver-q2sxm\" (UID: \"b3030442-56ce-4562-89e3-dbfa9ed9be95\") " pod="openshift-dns/node-resolver-q2sxm" Jul 12 18:17:04.319008 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.318299 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 12 18:17:04.319008 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:04.318699 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 18:17:04.319008 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:04.318719 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 18:17:04.319008 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:04.318731 2556 projected.go:196] Error preparing data for projected volume kube-api-access-7kn76 for pod openshift-network-diagnostics/network-check-target-sk4z9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 18:17:04.319008 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:04.318804 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d46d24aa-b5cf-4607-84ae-53ff23de58d9-kube-api-access-7kn76 podName:d46d24aa-b5cf-4607-84ae-53ff23de58d9 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:04.818788481 +0000 UTC m=+4.517547627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7kn76" (UniqueName: "kubernetes.io/projected/d46d24aa-b5cf-4607-84ae-53ff23de58d9-kube-api-access-7kn76") pod "network-check-target-sk4z9" (UID: "d46d24aa-b5cf-4607-84ae-53ff23de58d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 18:17:04.324230 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.323614 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gnrv\" (UniqueName: \"kubernetes.io/projected/92c9c69e-5148-4be6-a348-7bb634c94566-kube-api-access-6gnrv\") pod \"network-metrics-daemon-vn8dd\" (UID: \"92c9c69e-5148-4be6-a348-7bb634c94566\") " pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:04.324230 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.324192 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8t2w\" (UniqueName: \"kubernetes.io/projected/d273d74a-7734-44c2-ad9a-d3f7662b5ddc-kube-api-access-w8t2w\") pod \"node-ca-plght\" (UID: \"d273d74a-7734-44c2-ad9a-d3f7662b5ddc\") " pod="openshift-image-registry/node-ca-plght" Jul 12 18:17:04.327503 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.327480 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cx8q\" (UniqueName: \"kubernetes.io/projected/b088b3c1-17b7-4bce-8dc9-39b80e491ff0-kube-api-access-4cx8q\") pod \"iptables-alerter-w65v7\" (UID: \"b088b3c1-17b7-4bce-8dc9-39b80e491ff0\") " pod="openshift-network-operator/iptables-alerter-w65v7" Jul 12 18:17:04.327983 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.327962 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmfsq\" (UniqueName: \"kubernetes.io/projected/b3030442-56ce-4562-89e3-dbfa9ed9be95-kube-api-access-lmfsq\") pod \"node-resolver-q2sxm\" (UID: \"b3030442-56ce-4562-89e3-dbfa9ed9be95\") " pod="openshift-dns/node-resolver-q2sxm" Jul 12 18:17:04.340935 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.340870 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.ec2.internal" event={"ID":"b590f9b194e8e45b2e34be79d9df5a64","Type":"ContainerStarted","Data":"0ed7959a5e5ffe7f5ba3a1e301b8afc3a7b2b6829a3c11850e073574d4f5dbbc"} Jul 12 18:17:04.342443 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.342423 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.ec2.internal" event={"ID":"6d699647f03e60e64b1e1e805c709ebc","Type":"ContainerStarted","Data":"f388a56bf274a71421cb62d68b48efee919c0675334418f45cddacba1f3c8406"} Jul 12 18:17:04.383403 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.383374 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 18:17:04.414470 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.414414 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-kubelet-config\") pod \"global-pull-secret-syncer-fsg86\" (UID: \"27d0cbdc-10e6-4e60-8b17-c278fe65e4ec\") " pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:04.414470 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.414457 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.414710 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.414491 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-system-cni-dir\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.414710 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.414511 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-hostroot\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.414710 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.414531 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-host\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.414710 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.414595 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-host\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.414710 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.414621 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-kubelet-config\") pod \"global-pull-secret-syncer-fsg86\" (UID: \"27d0cbdc-10e6-4e60-8b17-c278fe65e4ec\") " pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:04.414710 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.414652 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-system-cni-dir\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.414710 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.414684 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-hostroot\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.415043 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.414717 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.415043 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.414754 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret\") pod \"global-pull-secret-syncer-fsg86\" (UID: \"27d0cbdc-10e6-4e60-8b17-c278fe65e4ec\") " pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:04.415043 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.414782 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3634787d-b1de-443d-9721-bb734e755223-cni-binary-copy\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.415043 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.414806 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-etc-kubernetes\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.415043 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.414830 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-host-run-ovn-kubernetes\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.415043 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.414853 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/61fdf430-4362-45f5-8d71-56dc20adfba3-env-overrides\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.415043 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:04.414858 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 18:17:04.415043 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.414875 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-sys\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.415043 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.414899 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-multus-socket-dir-parent\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.415043 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:04.414928 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret podName:27d0cbdc-10e6-4e60-8b17-c278fe65e4ec nodeName:}" failed. No retries permitted until 2026-07-12 18:17:04.914908214 +0000 UTC m=+4.613667365 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret") pod "global-pull-secret-syncer-fsg86" (UID: "27d0cbdc-10e6-4e60-8b17-c278fe65e4ec") : object "kube-system"/"original-pull-secret" not registered Jul 12 18:17:04.415043 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.414950 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-host-kubelet\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.415043 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.414950 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-multus-socket-dir-parent\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.415043 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.414998 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-host-kubelet\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.415043 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415033 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-etc-kubernetes\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.415773 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415066 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-host-run-ovn-kubernetes\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.415773 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415161 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-sys\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.415773 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415176 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/61fdf430-4362-45f5-8d71-56dc20adfba3-ovnkube-script-lib\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.415773 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415212 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2959f37-2d8d-4c33-b801-c2441982b9d3-agent-certs\") pod \"konnectivity-agent-xghs8\" (UID: \"d2959f37-2d8d-4c33-b801-c2441982b9d3\") " pod="kube-system/konnectivity-agent-xghs8" Jul 12 18:17:04.415773 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415238 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-host-run-multus-certs\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.415773 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415260 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-var-lib-openvswitch\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.415773 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415285 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-run-ovn\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.415773 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415307 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-host-cni-netd\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.415773 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415330 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tws5r\" (UID: \"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.415773 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415355 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a-socket-dir\") pod \"aws-ebs-csi-driver-node-tws5r\" (UID: \"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.415773 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415378 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-host-run-k8s-cni-cncf-io\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.415773 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415387 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3634787d-b1de-443d-9721-bb734e755223-cni-binary-copy\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.415773 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415402 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-host-var-lib-cni-multus\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.415773 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415421 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh79t\" (UniqueName: \"kubernetes.io/projected/3634787d-b1de-443d-9721-bb734e755223-kube-api-access-nh79t\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.415773 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415435 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/694a2f71-426d-4555-92e1-0d2e92c359d9-etc-tuned\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.415773 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415450 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/694a2f71-426d-4555-92e1-0d2e92c359d9-tmp\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.415773 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415465 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.416560 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415467 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-host-cni-netd\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.416560 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415482 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-multus-cni-dir\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.416560 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415573 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-host-run-multus-certs\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.416560 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415605 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-multus-cni-dir\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.416560 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415657 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tws5r\" (UID: \"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.416560 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415758 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a-socket-dir\") pod \"aws-ebs-csi-driver-node-tws5r\" (UID: \"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.416560 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415809 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-host-run-k8s-cni-cncf-io\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.416560 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415834 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-host-var-lib-cni-multus\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.416560 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415930 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/61fdf430-4362-45f5-8d71-56dc20adfba3-ovnkube-script-lib\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.416560 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415971 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-host-var-lib-kubelet\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.416560 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.415996 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-multus-conf-dir\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.416560 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416020 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-host-cni-bin\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.416560 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416031 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/61fdf430-4362-45f5-8d71-56dc20adfba3-env-overrides\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.416560 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416045 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a-registration-dir\") pod \"aws-ebs-csi-driver-node-tws5r\" (UID: \"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.416560 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416068 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-cnibin\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.416560 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416122 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-host-var-lib-cni-bin\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.416560 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416146 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-run-systemd\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.416560 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416170 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-run-openvswitch\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.417410 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416191 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-log-socket\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.417410 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416216 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a-etc-selinux\") pod \"aws-ebs-csi-driver-node-tws5r\" (UID: \"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.417410 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416240 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-systemd-units\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.417410 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416263 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-host-run-netns\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.417410 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416290 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-cni-binary-copy\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.417410 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416312 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-os-release\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.417410 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416332 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/61fdf430-4362-45f5-8d71-56dc20adfba3-ovnkube-config\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.417410 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416354 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kng5x\" (UniqueName: \"kubernetes.io/projected/61fdf430-4362-45f5-8d71-56dc20adfba3-kube-api-access-kng5x\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.417410 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416391 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-etc-sysctl-d\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.417410 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416413 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-lib-modules\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.417410 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416442 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-cnibin\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.417410 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416465 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-etc-openvswitch\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.417410 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416489 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2959f37-2d8d-4c33-b801-c2441982b9d3-konnectivity-ca\") pod \"konnectivity-agent-xghs8\" (UID: \"d2959f37-2d8d-4c33-b801-c2441982b9d3\") " pod="kube-system/konnectivity-agent-xghs8" Jul 12 18:17:04.417410 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416535 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-var-lib-openvswitch\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.417410 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416568 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-run\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.417410 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416591 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a-sys-fs\") pod \"aws-ebs-csi-driver-node-tws5r\" (UID: \"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.417410 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416605 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.418192 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416615 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3634787d-b1de-443d-9721-bb734e755223-multus-daemon-config\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.418192 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416639 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-etc-modprobe-d\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.418192 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416682 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-etc-systemd\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.418192 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416708 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-system-cni-dir\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.418192 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416733 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.418192 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416774 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-etc-kubernetes\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.418192 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416800 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlv8j\" (UniqueName: \"kubernetes.io/projected/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-kube-api-access-vlv8j\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.418192 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416824 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-host-run-netns\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.418192 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416849 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/61fdf430-4362-45f5-8d71-56dc20adfba3-ovn-node-metrics-cert\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.418192 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416877 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-etc-sysctl-conf\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.418192 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416903 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5knqj\" (UniqueName: \"kubernetes.io/projected/694a2f71-426d-4555-92e1-0d2e92c359d9-kube-api-access-5knqj\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.418192 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416926 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-dbus\") pod \"global-pull-secret-syncer-fsg86\" (UID: \"27d0cbdc-10e6-4e60-8b17-c278fe65e4ec\") " pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:04.418192 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416952 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-os-release\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.418192 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416975 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d2959f37-2d8d-4c33-b801-c2441982b9d3-konnectivity-ca\") pod \"konnectivity-agent-xghs8\" (UID: \"d2959f37-2d8d-4c33-b801-c2441982b9d3\") " pod="kube-system/konnectivity-agent-xghs8" Jul 12 18:17:04.418192 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.416976 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-host-slash\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.418192 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417009 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-host-slash\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.418192 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417020 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-node-log\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.419023 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417047 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.419023 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417053 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-run-ovn\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.419023 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417100 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-etc-sysconfig\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.419023 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417109 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/61fdf430-4362-45f5-8d71-56dc20adfba3-ovnkube-config\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.419023 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417126 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-var-lib-kubelet\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.419023 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417112 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-multus-conf-dir\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.419023 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417142 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-host-cni-bin\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.419023 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417155 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj2hq\" (UniqueName: \"kubernetes.io/projected/a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a-kube-api-access-sj2hq\") pod \"aws-ebs-csi-driver-node-tws5r\" (UID: \"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.419023 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417182 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a-device-dir\") pod \"aws-ebs-csi-driver-node-tws5r\" (UID: \"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.419023 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417196 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a-registration-dir\") pod \"aws-ebs-csi-driver-node-tws5r\" (UID: \"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.419023 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417257 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a-etc-selinux\") pod \"aws-ebs-csi-driver-node-tws5r\" (UID: \"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.419023 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417297 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-systemd-units\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.419023 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417311 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-etc-modprobe-d\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.419023 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417337 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-host-run-netns\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.419023 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417358 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-etc-systemd\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.419023 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417397 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-system-cni-dir\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.419023 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417586 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-log-socket\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.419978 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417629 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-var-lib-kubelet\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.419978 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417653 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3634787d-b1de-443d-9721-bb734e755223-multus-daemon-config\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.419978 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417702 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-cnibin\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.419978 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417770 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-etc-sysctl-d\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.419978 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417803 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-cni-binary-copy\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.419978 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417820 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-cnibin\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.419978 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417834 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-os-release\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.419978 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417857 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-etc-openvswitch\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.419978 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417885 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-host-run-netns\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.419978 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417893 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-node-log\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.419978 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417927 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.419978 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417963 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-host-var-lib-kubelet\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.419978 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417976 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a-device-dir\") pod \"aws-ebs-csi-driver-node-tws5r\" (UID: \"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.419978 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.417928 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-lib-modules\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.419978 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.418024 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-etc-sysconfig\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.419978 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.418098 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-dbus\") pod \"global-pull-secret-syncer-fsg86\" (UID: \"27d0cbdc-10e6-4e60-8b17-c278fe65e4ec\") " pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:04.419978 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.418099 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a-sys-fs\") pod \"aws-ebs-csi-driver-node-tws5r\" (UID: \"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.419978 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.418133 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-run-systemd\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.420858 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.418147 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-run\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.420858 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.418153 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3634787d-b1de-443d-9721-bb734e755223-host-var-lib-cni-bin\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.420858 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.418190 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/61fdf430-4362-45f5-8d71-56dc20adfba3-run-openvswitch\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.420858 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.418198 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-os-release\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.420858 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.418251 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-etc-sysctl-conf\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.420858 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.418307 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/694a2f71-426d-4555-92e1-0d2e92c359d9-etc-kubernetes\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.420858 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.418556 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.420858 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.420116 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/694a2f71-426d-4555-92e1-0d2e92c359d9-etc-tuned\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.420858 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.420615 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/694a2f71-426d-4555-92e1-0d2e92c359d9-tmp\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.420858 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.420771 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d2959f37-2d8d-4c33-b801-c2441982b9d3-agent-certs\") pod \"konnectivity-agent-xghs8\" (UID: \"d2959f37-2d8d-4c33-b801-c2441982b9d3\") " pod="kube-system/konnectivity-agent-xghs8" Jul 12 18:17:04.422200 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.422177 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/61fdf430-4362-45f5-8d71-56dc20adfba3-ovn-node-metrics-cert\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.427020 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.426980 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh79t\" (UniqueName: \"kubernetes.io/projected/3634787d-b1de-443d-9721-bb734e755223-kube-api-access-nh79t\") pod \"multus-l9vdt\" (UID: \"3634787d-b1de-443d-9721-bb734e755223\") " pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.427644 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.427621 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj2hq\" (UniqueName: \"kubernetes.io/projected/a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a-kube-api-access-sj2hq\") pod \"aws-ebs-csi-driver-node-tws5r\" (UID: \"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.428246 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.428224 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kng5x\" (UniqueName: \"kubernetes.io/projected/61fdf430-4362-45f5-8d71-56dc20adfba3-kube-api-access-kng5x\") pod \"ovnkube-node-899r5\" (UID: \"61fdf430-4362-45f5-8d71-56dc20adfba3\") " pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.428791 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.428759 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlv8j\" (UniqueName: \"kubernetes.io/projected/db4af9d8-455a-4a29-bb79-8ba71a1b0ca6-kube-api-access-vlv8j\") pod \"multus-additional-cni-plugins-j8xtv\" (UID: \"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6\") " pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.429510 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.429462 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5knqj\" (UniqueName: \"kubernetes.io/projected/694a2f71-426d-4555-92e1-0d2e92c359d9-kube-api-access-5knqj\") pod \"tuned-t8wcl\" (UID: \"694a2f71-426d-4555-92e1-0d2e92c359d9\") " pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.508490 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.508449 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q2sxm" Jul 12 18:17:04.518499 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:04.518414 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3030442_56ce_4562_89e3_dbfa9ed9be95.slice/crio-12e873464a56c7289ac214157f4d4bde0ccc292dd3bb5ad36c0bdd45ca04115a WatchSource:0}: Error finding container 12e873464a56c7289ac214157f4d4bde0ccc292dd3bb5ad36c0bdd45ca04115a: Status 404 returned error can't find the container with id 12e873464a56c7289ac214157f4d4bde0ccc292dd3bb5ad36c0bdd45ca04115a Jul 12 18:17:04.518750 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.518685 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-plght" Jul 12 18:17:04.528718 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:04.528694 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd273d74a_7734_44c2_ad9a_d3f7662b5ddc.slice/crio-99cd4ec5952c3d9ad522528a67f3b5b9873a2af0407096fc3a4b8cbeb017e76c WatchSource:0}: Error finding container 99cd4ec5952c3d9ad522528a67f3b5b9873a2af0407096fc3a4b8cbeb017e76c: Status 404 returned error can't find the container with id 99cd4ec5952c3d9ad522528a67f3b5b9873a2af0407096fc3a4b8cbeb017e76c Jul 12 18:17:04.530540 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.530518 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xghs8" Jul 12 18:17:04.536857 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.536753 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w65v7" Jul 12 18:17:04.539091 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:04.539051 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2959f37_2d8d_4c33_b801_c2441982b9d3.slice/crio-becd282c2b6d7b02a8a55c763584f7fc0b747a0aa784c4decac87b5991623020 WatchSource:0}: Error finding container becd282c2b6d7b02a8a55c763584f7fc0b747a0aa784c4decac87b5991623020: Status 404 returned error can't find the container with id becd282c2b6d7b02a8a55c763584f7fc0b747a0aa784c4decac87b5991623020 Jul 12 18:17:04.544519 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.544501 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:04.545761 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:04.545741 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb088b3c1_17b7_4bce_8dc9_39b80e491ff0.slice/crio-ba2dc6082a36f189053cf86fddfaf5ae55e43e69dfcdf4a0bbb2b795e11e3338 WatchSource:0}: Error finding container ba2dc6082a36f189053cf86fddfaf5ae55e43e69dfcdf4a0bbb2b795e11e3338: Status 404 returned error can't find the container with id ba2dc6082a36f189053cf86fddfaf5ae55e43e69dfcdf4a0bbb2b795e11e3338 Jul 12 18:17:04.553636 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.553616 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" Jul 12 18:17:04.553892 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:04.553868 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61fdf430_4362_45f5_8d71_56dc20adfba3.slice/crio-ca68999380668ba8eb9f99e92dd35958bf66ca6396f974097db908150902cce2 WatchSource:0}: Error finding container ca68999380668ba8eb9f99e92dd35958bf66ca6396f974097db908150902cce2: Status 404 returned error can't find the container with id ca68999380668ba8eb9f99e92dd35958bf66ca6396f974097db908150902cce2 Jul 12 18:17:04.562114 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.562065 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" Jul 12 18:17:04.569998 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.569977 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j8xtv" Jul 12 18:17:04.574817 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.574798 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l9vdt" Jul 12 18:17:04.820481 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.820450 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs\") pod \"network-metrics-daemon-vn8dd\" (UID: \"92c9c69e-5148-4be6-a348-7bb634c94566\") " pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:04.820644 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.820494 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kn76\" (UniqueName: \"kubernetes.io/projected/d46d24aa-b5cf-4607-84ae-53ff23de58d9-kube-api-access-7kn76\") pod \"network-check-target-sk4z9\" (UID: \"d46d24aa-b5cf-4607-84ae-53ff23de58d9\") " pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:04.820644 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:04.820613 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 18:17:04.820644 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:04.820633 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 18:17:04.820644 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:04.820630 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 18:17:04.820644 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:04.820646 2556 projected.go:196] Error preparing data for projected volume kube-api-access-7kn76 for pod openshift-network-diagnostics/network-check-target-sk4z9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 18:17:04.820870 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:04.820712 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs podName:92c9c69e-5148-4be6-a348-7bb634c94566 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:05.820688747 +0000 UTC m=+5.519447907 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs") pod "network-metrics-daemon-vn8dd" (UID: "92c9c69e-5148-4be6-a348-7bb634c94566") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 18:17:04.820870 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:04.820736 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d46d24aa-b5cf-4607-84ae-53ff23de58d9-kube-api-access-7kn76 podName:d46d24aa-b5cf-4607-84ae-53ff23de58d9 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:05.82072763 +0000 UTC m=+5.519486795 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kn76" (UniqueName: "kubernetes.io/projected/d46d24aa-b5cf-4607-84ae-53ff23de58d9-kube-api-access-7kn76") pod "network-check-target-sk4z9" (UID: "d46d24aa-b5cf-4607-84ae-53ff23de58d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 18:17:04.921686 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:04.921645 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret\") pod \"global-pull-secret-syncer-fsg86\" (UID: \"27d0cbdc-10e6-4e60-8b17-c278fe65e4ec\") " pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:04.921842 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:04.921793 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 18:17:04.921902 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:04.921874 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret podName:27d0cbdc-10e6-4e60-8b17-c278fe65e4ec nodeName:}" failed. No retries permitted until 2026-07-12 18:17:05.921851662 +0000 UTC m=+5.620610815 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret") pod "global-pull-secret-syncer-fsg86" (UID: "27d0cbdc-10e6-4e60-8b17-c278fe65e4ec") : object "kube-system"/"original-pull-secret" not registered Jul 12 18:17:05.249674 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:05.249629 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 18:12:04 +0000 UTC" deadline="2028-04-28 23:24:45.363576264 +0000 UTC" Jul 12 18:17:05.249674 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:05.249666 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15749h7m40.113915144s" Jul 12 18:17:05.334773 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:05.334746 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:05.334944 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:05.334882 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn8dd" podUID="92c9c69e-5148-4be6-a348-7bb634c94566" Jul 12 18:17:05.346838 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:05.346709 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-899r5" event={"ID":"61fdf430-4362-45f5-8d71-56dc20adfba3","Type":"ContainerStarted","Data":"ca68999380668ba8eb9f99e92dd35958bf66ca6396f974097db908150902cce2"} Jul 12 18:17:05.349015 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:05.348981 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w65v7" event={"ID":"b088b3c1-17b7-4bce-8dc9-39b80e491ff0","Type":"ContainerStarted","Data":"ba2dc6082a36f189053cf86fddfaf5ae55e43e69dfcdf4a0bbb2b795e11e3338"} Jul 12 18:17:05.350418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:05.350391 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xghs8" event={"ID":"d2959f37-2d8d-4c33-b801-c2441982b9d3","Type":"ContainerStarted","Data":"becd282c2b6d7b02a8a55c763584f7fc0b747a0aa784c4decac87b5991623020"} Jul 12 18:17:05.352327 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:05.352276 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-plght" event={"ID":"d273d74a-7734-44c2-ad9a-d3f7662b5ddc","Type":"ContainerStarted","Data":"99cd4ec5952c3d9ad522528a67f3b5b9873a2af0407096fc3a4b8cbeb017e76c"} Jul 12 18:17:05.353698 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:05.353674 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q2sxm" event={"ID":"b3030442-56ce-4562-89e3-dbfa9ed9be95","Type":"ContainerStarted","Data":"12e873464a56c7289ac214157f4d4bde0ccc292dd3bb5ad36c0bdd45ca04115a"} Jul 12 18:17:05.828610 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:05.828573 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs\") pod \"network-metrics-daemon-vn8dd\" (UID: \"92c9c69e-5148-4be6-a348-7bb634c94566\") " pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:05.828797 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:05.828635 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kn76\" (UniqueName: \"kubernetes.io/projected/d46d24aa-b5cf-4607-84ae-53ff23de58d9-kube-api-access-7kn76\") pod \"network-check-target-sk4z9\" (UID: \"d46d24aa-b5cf-4607-84ae-53ff23de58d9\") " pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:05.828870 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:05.828813 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 18:17:05.828870 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:05.828831 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 18:17:05.828870 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:05.828843 2556 projected.go:196] Error preparing data for projected volume kube-api-access-7kn76 for pod openshift-network-diagnostics/network-check-target-sk4z9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 18:17:05.829017 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:05.828901 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d46d24aa-b5cf-4607-84ae-53ff23de58d9-kube-api-access-7kn76 podName:d46d24aa-b5cf-4607-84ae-53ff23de58d9 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:07.828884347 +0000 UTC m=+7.527643507 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kn76" (UniqueName: "kubernetes.io/projected/d46d24aa-b5cf-4607-84ae-53ff23de58d9-kube-api-access-7kn76") pod "network-check-target-sk4z9" (UID: "d46d24aa-b5cf-4607-84ae-53ff23de58d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 18:17:05.829017 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:05.828920 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 18:17:05.829017 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:05.828987 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs podName:92c9c69e-5148-4be6-a348-7bb634c94566 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:07.828970683 +0000 UTC m=+7.527729835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs") pod "network-metrics-daemon-vn8dd" (UID: "92c9c69e-5148-4be6-a348-7bb634c94566") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 18:17:05.929277 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:05.929237 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret\") pod \"global-pull-secret-syncer-fsg86\" (UID: \"27d0cbdc-10e6-4e60-8b17-c278fe65e4ec\") " pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:05.929471 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:05.929394 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 18:17:05.929471 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:05.929457 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret podName:27d0cbdc-10e6-4e60-8b17-c278fe65e4ec nodeName:}" failed. No retries permitted until 2026-07-12 18:17:07.929438397 +0000 UTC m=+7.628197548 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret") pod "global-pull-secret-syncer-fsg86" (UID: "27d0cbdc-10e6-4e60-8b17-c278fe65e4ec") : object "kube-system"/"original-pull-secret" not registered Jul 12 18:17:05.940443 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:05.940402 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3634787d_b1de_443d_9721_bb734e755223.slice/crio-82799b1ef4c96d87a91d662234af74e8c1ce955d366a2d588a4d28ac3d78d7cb WatchSource:0}: Error finding container 82799b1ef4c96d87a91d662234af74e8c1ce955d366a2d588a4d28ac3d78d7cb: Status 404 returned error can't find the container with id 82799b1ef4c96d87a91d662234af74e8c1ce955d366a2d588a4d28ac3d78d7cb Jul 12 18:17:05.949591 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:05.949562 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb4af9d8_455a_4a29_bb79_8ba71a1b0ca6.slice/crio-0dfccd0ec0f9f7342a0a03f81b83cfbd16d9b59f0ab903f6d3a4cb9152e8df5f WatchSource:0}: Error finding container 0dfccd0ec0f9f7342a0a03f81b83cfbd16d9b59f0ab903f6d3a4cb9152e8df5f: Status 404 returned error can't find the container with id 0dfccd0ec0f9f7342a0a03f81b83cfbd16d9b59f0ab903f6d3a4cb9152e8df5f Jul 12 18:17:05.954101 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:05.954065 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda13851f0_fd0b_44aa_b1bb_f8f5e2c4cb7a.slice/crio-e10a2036b2e803bf0eae152b1bff8d5fcfe3b35975c48f0536469d1101b0d396 WatchSource:0}: Error finding container e10a2036b2e803bf0eae152b1bff8d5fcfe3b35975c48f0536469d1101b0d396: Status 404 returned error can't find the container with id e10a2036b2e803bf0eae152b1bff8d5fcfe3b35975c48f0536469d1101b0d396 Jul 12 18:17:06.250844 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:06.250514 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 18:12:04 +0000 UTC" deadline="2028-01-23 00:10:08.067686005 +0000 UTC" Jul 12 18:17:06.250844 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:06.250796 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13421h53m1.816895943s" Jul 12 18:17:06.335781 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:06.334572 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:06.335781 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:06.334697 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sk4z9" podUID="d46d24aa-b5cf-4607-84ae-53ff23de58d9" Jul 12 18:17:06.336257 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:06.336095 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:06.336257 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:06.336213 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fsg86" podUID="27d0cbdc-10e6-4e60-8b17-c278fe65e4ec" Jul 12 18:17:06.360024 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:06.359984 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.ec2.internal" event={"ID":"6d699647f03e60e64b1e1e805c709ebc","Type":"ContainerStarted","Data":"2149ec50fb5c131f6a16e796d1b43542d8e9af6c1879f7eea2a80372f3c6e2ac"} Jul 12 18:17:06.363655 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:06.363625 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8xtv" event={"ID":"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6","Type":"ContainerStarted","Data":"0dfccd0ec0f9f7342a0a03f81b83cfbd16d9b59f0ab903f6d3a4cb9152e8df5f"} Jul 12 18:17:06.367422 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:06.367397 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" event={"ID":"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a","Type":"ContainerStarted","Data":"e10a2036b2e803bf0eae152b1bff8d5fcfe3b35975c48f0536469d1101b0d396"} Jul 12 18:17:06.368889 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:06.368865 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l9vdt" event={"ID":"3634787d-b1de-443d-9721-bb734e755223","Type":"ContainerStarted","Data":"82799b1ef4c96d87a91d662234af74e8c1ce955d366a2d588a4d28ac3d78d7cb"} Jul 12 18:17:06.371869 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:06.371844 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" event={"ID":"694a2f71-426d-4555-92e1-0d2e92c359d9","Type":"ContainerStarted","Data":"ba0af89ca01b59b1338a8f0732c64e729b8f22dcf0403f14e89a5cfe6e255004"} Jul 12 18:17:06.376022 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:06.375971 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-130.ec2.internal" podStartSLOduration=3.375953884 podStartE2EDuration="3.375953884s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 18:17:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:17:06.375023253 +0000 UTC m=+6.073782422" watchObservedRunningTime="2026-07-12 18:17:06.375953884 +0000 UTC m=+6.074713054" Jul 12 18:17:07.334810 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:07.334488 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:07.334810 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:07.334643 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn8dd" podUID="92c9c69e-5148-4be6-a348-7bb634c94566" Jul 12 18:17:07.376822 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:07.376754 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.ec2.internal" event={"ID":"b590f9b194e8e45b2e34be79d9df5a64","Type":"ContainerStarted","Data":"67d51586dfea282b4a1bb34852b48de115ad4ed5d5b73a00602562c4f384f076"} Jul 12 18:17:07.848236 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:07.848024 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs\") pod \"network-metrics-daemon-vn8dd\" (UID: \"92c9c69e-5148-4be6-a348-7bb634c94566\") " pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:07.848236 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:07.848092 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kn76\" (UniqueName: \"kubernetes.io/projected/d46d24aa-b5cf-4607-84ae-53ff23de58d9-kube-api-access-7kn76\") pod \"network-check-target-sk4z9\" (UID: \"d46d24aa-b5cf-4607-84ae-53ff23de58d9\") " pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:07.848236 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:07.848215 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 18:17:07.848490 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:07.848291 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs podName:92c9c69e-5148-4be6-a348-7bb634c94566 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:11.848270108 +0000 UTC m=+11.547029267 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs") pod "network-metrics-daemon-vn8dd" (UID: "92c9c69e-5148-4be6-a348-7bb634c94566") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 18:17:07.848490 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:07.848227 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 18:17:07.848490 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:07.848331 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 18:17:07.848490 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:07.848346 2556 projected.go:196] Error preparing data for projected volume kube-api-access-7kn76 for pod openshift-network-diagnostics/network-check-target-sk4z9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 18:17:07.848490 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:07.848399 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d46d24aa-b5cf-4607-84ae-53ff23de58d9-kube-api-access-7kn76 podName:d46d24aa-b5cf-4607-84ae-53ff23de58d9 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:11.848382923 +0000 UTC m=+11.547142084 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kn76" (UniqueName: "kubernetes.io/projected/d46d24aa-b5cf-4607-84ae-53ff23de58d9-kube-api-access-7kn76") pod "network-check-target-sk4z9" (UID: "d46d24aa-b5cf-4607-84ae-53ff23de58d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 18:17:07.948818 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:07.948765 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret\") pod \"global-pull-secret-syncer-fsg86\" (UID: \"27d0cbdc-10e6-4e60-8b17-c278fe65e4ec\") " pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:07.948992 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:07.948926 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 18:17:07.948992 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:07.948985 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret podName:27d0cbdc-10e6-4e60-8b17-c278fe65e4ec nodeName:}" failed. No retries permitted until 2026-07-12 18:17:11.94896914 +0000 UTC m=+11.647728299 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret") pod "global-pull-secret-syncer-fsg86" (UID: "27d0cbdc-10e6-4e60-8b17-c278fe65e4ec") : object "kube-system"/"original-pull-secret" not registered Jul 12 18:17:08.335102 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:08.334367 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:08.335102 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:08.334527 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fsg86" podUID="27d0cbdc-10e6-4e60-8b17-c278fe65e4ec" Jul 12 18:17:08.335102 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:08.334869 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:08.335102 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:08.334992 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sk4z9" podUID="d46d24aa-b5cf-4607-84ae-53ff23de58d9" Jul 12 18:17:08.381740 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:08.381709 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.ec2.internal" event={"ID":"b590f9b194e8e45b2e34be79d9df5a64","Type":"ContainerDied","Data":"67d51586dfea282b4a1bb34852b48de115ad4ed5d5b73a00602562c4f384f076"} Jul 12 18:17:08.381902 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:08.381677 2556 generic.go:356] "Generic (PLEG): container finished" podID="b590f9b194e8e45b2e34be79d9df5a64" containerID="67d51586dfea282b4a1bb34852b48de115ad4ed5d5b73a00602562c4f384f076" exitCode=0 Jul 12 18:17:09.334443 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:09.334414 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:09.334654 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:09.334535 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn8dd" podUID="92c9c69e-5148-4be6-a348-7bb634c94566" Jul 12 18:17:10.334805 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:10.334777 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:10.335200 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:10.334788 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:10.335200 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:10.334965 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sk4z9" podUID="d46d24aa-b5cf-4607-84ae-53ff23de58d9" Jul 12 18:17:10.335200 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:10.335124 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fsg86" podUID="27d0cbdc-10e6-4e60-8b17-c278fe65e4ec" Jul 12 18:17:11.335145 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:11.335093 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:11.335564 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:11.335242 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn8dd" podUID="92c9c69e-5148-4be6-a348-7bb634c94566" Jul 12 18:17:11.881613 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:11.881517 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs\") pod \"network-metrics-daemon-vn8dd\" (UID: \"92c9c69e-5148-4be6-a348-7bb634c94566\") " pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:11.881613 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:11.881570 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kn76\" (UniqueName: \"kubernetes.io/projected/d46d24aa-b5cf-4607-84ae-53ff23de58d9-kube-api-access-7kn76\") pod \"network-check-target-sk4z9\" (UID: \"d46d24aa-b5cf-4607-84ae-53ff23de58d9\") " pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:11.881861 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:11.881686 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 18:17:11.881861 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:11.881730 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 18:17:11.881861 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:11.881751 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 18:17:11.881861 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:11.881752 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs podName:92c9c69e-5148-4be6-a348-7bb634c94566 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:19.881730245 +0000 UTC m=+19.580489401 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs") pod "network-metrics-daemon-vn8dd" (UID: "92c9c69e-5148-4be6-a348-7bb634c94566") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 18:17:11.881861 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:11.881763 2556 projected.go:196] Error preparing data for projected volume kube-api-access-7kn76 for pod openshift-network-diagnostics/network-check-target-sk4z9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 18:17:11.881861 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:11.881820 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d46d24aa-b5cf-4607-84ae-53ff23de58d9-kube-api-access-7kn76 podName:d46d24aa-b5cf-4607-84ae-53ff23de58d9 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:19.881805685 +0000 UTC m=+19.580564831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kn76" (UniqueName: "kubernetes.io/projected/d46d24aa-b5cf-4607-84ae-53ff23de58d9-kube-api-access-7kn76") pod "network-check-target-sk4z9" (UID: "d46d24aa-b5cf-4607-84ae-53ff23de58d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 18:17:11.982255 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:11.982222 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret\") pod \"global-pull-secret-syncer-fsg86\" (UID: \"27d0cbdc-10e6-4e60-8b17-c278fe65e4ec\") " pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:11.982434 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:11.982371 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 18:17:11.982434 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:11.982428 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret podName:27d0cbdc-10e6-4e60-8b17-c278fe65e4ec nodeName:}" failed. No retries permitted until 2026-07-12 18:17:19.982409714 +0000 UTC m=+19.681168878 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret") pod "global-pull-secret-syncer-fsg86" (UID: "27d0cbdc-10e6-4e60-8b17-c278fe65e4ec") : object "kube-system"/"original-pull-secret" not registered Jul 12 18:17:12.336278 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:12.335762 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:12.336278 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:12.335873 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fsg86" podUID="27d0cbdc-10e6-4e60-8b17-c278fe65e4ec" Jul 12 18:17:12.336278 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:12.335932 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:12.336278 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:12.336051 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sk4z9" podUID="d46d24aa-b5cf-4607-84ae-53ff23de58d9" Jul 12 18:17:13.334946 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:13.334834 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:13.335146 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:13.334981 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn8dd" podUID="92c9c69e-5148-4be6-a348-7bb634c94566" Jul 12 18:17:14.334922 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:14.334889 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:14.335335 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:14.335042 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sk4z9" podUID="d46d24aa-b5cf-4607-84ae-53ff23de58d9" Jul 12 18:17:14.335335 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:14.335101 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:14.335335 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:14.335204 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fsg86" podUID="27d0cbdc-10e6-4e60-8b17-c278fe65e4ec" Jul 12 18:17:15.335351 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:15.335319 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:15.335752 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:15.335455 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn8dd" podUID="92c9c69e-5148-4be6-a348-7bb634c94566" Jul 12 18:17:16.335378 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:16.335345 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:16.335835 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:16.335345 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:16.335835 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:16.335475 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fsg86" podUID="27d0cbdc-10e6-4e60-8b17-c278fe65e4ec" Jul 12 18:17:16.335835 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:16.335566 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sk4z9" podUID="d46d24aa-b5cf-4607-84ae-53ff23de58d9" Jul 12 18:17:17.334548 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:17.334518 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:17.334746 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:17.334642 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn8dd" podUID="92c9c69e-5148-4be6-a348-7bb634c94566" Jul 12 18:17:18.335313 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:18.335281 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:18.335707 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:18.335285 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:18.335707 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:18.335421 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sk4z9" podUID="d46d24aa-b5cf-4607-84ae-53ff23de58d9" Jul 12 18:17:18.335707 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:18.335497 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fsg86" podUID="27d0cbdc-10e6-4e60-8b17-c278fe65e4ec" Jul 12 18:17:19.334488 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:19.334451 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:19.334741 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:19.334595 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn8dd" podUID="92c9c69e-5148-4be6-a348-7bb634c94566" Jul 12 18:17:19.945995 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:19.945957 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs\") pod \"network-metrics-daemon-vn8dd\" (UID: \"92c9c69e-5148-4be6-a348-7bb634c94566\") " pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:19.946428 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:19.946000 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kn76\" (UniqueName: \"kubernetes.io/projected/d46d24aa-b5cf-4607-84ae-53ff23de58d9-kube-api-access-7kn76\") pod \"network-check-target-sk4z9\" (UID: \"d46d24aa-b5cf-4607-84ae-53ff23de58d9\") " pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:19.946428 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:19.946133 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 18:17:19.946428 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:19.946135 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 18:17:19.946428 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:19.946148 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 18:17:19.946428 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:19.946161 2556 projected.go:196] Error preparing data for projected volume kube-api-access-7kn76 for pod openshift-network-diagnostics/network-check-target-sk4z9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 18:17:19.946428 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:19.946213 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs podName:92c9c69e-5148-4be6-a348-7bb634c94566 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:35.946190724 +0000 UTC m=+35.644949873 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs") pod "network-metrics-daemon-vn8dd" (UID: "92c9c69e-5148-4be6-a348-7bb634c94566") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 18:17:19.946428 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:19.946232 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d46d24aa-b5cf-4607-84ae-53ff23de58d9-kube-api-access-7kn76 podName:d46d24aa-b5cf-4607-84ae-53ff23de58d9 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:35.946222082 +0000 UTC m=+35.644981233 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7kn76" (UniqueName: "kubernetes.io/projected/d46d24aa-b5cf-4607-84ae-53ff23de58d9-kube-api-access-7kn76") pod "network-check-target-sk4z9" (UID: "d46d24aa-b5cf-4607-84ae-53ff23de58d9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 18:17:20.047275 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:20.047245 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret\") pod \"global-pull-secret-syncer-fsg86\" (UID: \"27d0cbdc-10e6-4e60-8b17-c278fe65e4ec\") " pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:20.047440 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:20.047391 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 18:17:20.047535 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:20.047459 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret podName:27d0cbdc-10e6-4e60-8b17-c278fe65e4ec nodeName:}" failed. No retries permitted until 2026-07-12 18:17:36.047440822 +0000 UTC m=+35.746199975 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret") pod "global-pull-secret-syncer-fsg86" (UID: "27d0cbdc-10e6-4e60-8b17-c278fe65e4ec") : object "kube-system"/"original-pull-secret" not registered Jul 12 18:17:20.334580 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:20.334505 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:20.334718 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:20.334632 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fsg86" podUID="27d0cbdc-10e6-4e60-8b17-c278fe65e4ec" Jul 12 18:17:20.334718 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:20.334688 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:20.334818 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:20.334797 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sk4z9" podUID="d46d24aa-b5cf-4607-84ae-53ff23de58d9" Jul 12 18:17:21.334622 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:21.334592 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:21.335005 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:21.334696 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn8dd" podUID="92c9c69e-5148-4be6-a348-7bb634c94566" Jul 12 18:17:22.335996 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:22.335963 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:22.336433 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:22.336023 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:22.336433 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:22.336121 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fsg86" podUID="27d0cbdc-10e6-4e60-8b17-c278fe65e4ec" Jul 12 18:17:22.336433 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:22.336165 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sk4z9" podUID="d46d24aa-b5cf-4607-84ae-53ff23de58d9" Jul 12 18:17:23.335443 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:23.335150 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:23.335555 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:23.335533 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn8dd" podUID="92c9c69e-5148-4be6-a348-7bb634c94566" Jul 12 18:17:23.415625 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:23.415600 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-899r5" event={"ID":"61fdf430-4362-45f5-8d71-56dc20adfba3","Type":"ContainerStarted","Data":"5006078a3344326f2542bf0e8731a8b731d01a7e135b3b2f54904718c6715269"} Jul 12 18:17:23.416395 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:23.415673 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-899r5" event={"ID":"61fdf430-4362-45f5-8d71-56dc20adfba3","Type":"ContainerStarted","Data":"4b9362fbdb13e6bd2f9690b395877d45093b9f5f6049479e3c3c2fbea1e4f670"} Jul 12 18:17:23.416395 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:23.415720 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-899r5" event={"ID":"61fdf430-4362-45f5-8d71-56dc20adfba3","Type":"ContainerStarted","Data":"17824833da4f1c39595a3aafdb32dbaa28f7fad5c1e3a51049fcfd386b66ade8"} Jul 12 18:17:23.416395 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:23.415751 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-899r5" event={"ID":"61fdf430-4362-45f5-8d71-56dc20adfba3","Type":"ContainerStarted","Data":"73566c4d65b743827f3068bd71b33078250709081d000e5f9aa017ad3a084042"} Jul 12 18:17:23.417062 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:23.417035 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q2sxm" event={"ID":"b3030442-56ce-4562-89e3-dbfa9ed9be95","Type":"ContainerStarted","Data":"2d2d477954c53518ae5e19522f3efaa5d3a765910f6d04807991217bde8eb5fd"} Jul 12 18:17:23.418476 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:23.418441 2556 generic.go:356] "Generic (PLEG): container finished" podID="db4af9d8-455a-4a29-bb79-8ba71a1b0ca6" containerID="109cf2b073975c3ff6975cd1102f1bd2bbaa4b0c1a49ae90ad8611c34a2f7378" exitCode=0 Jul 12 18:17:23.418575 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:23.418520 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8xtv" event={"ID":"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6","Type":"ContainerDied","Data":"109cf2b073975c3ff6975cd1102f1bd2bbaa4b0c1a49ae90ad8611c34a2f7378"} Jul 12 18:17:23.419990 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:23.419970 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" event={"ID":"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a","Type":"ContainerStarted","Data":"6b83110ddff30584b7565ee833f8a9b1504d3d607dbf07e6a77684adfeb88687"} Jul 12 18:17:23.421475 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:23.421457 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l9vdt" event={"ID":"3634787d-b1de-443d-9721-bb734e755223","Type":"ContainerStarted","Data":"a6b7ed8ca84db1760a7b35b7fc863c212652c7f640bd14189979f95a0719c41c"} Jul 12 18:17:23.423226 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:23.423205 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.ec2.internal" event={"ID":"b590f9b194e8e45b2e34be79d9df5a64","Type":"ContainerStarted","Data":"93317b1c328a91ad8998f8cff4ab07ebbfa95cb56eafa120a64985edda422748"} Jul 12 18:17:23.424573 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:23.424553 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xghs8" event={"ID":"d2959f37-2d8d-4c33-b801-c2441982b9d3","Type":"ContainerStarted","Data":"f8ff6355b4aa7ee4da4917040abf65416a2e07d4c14ffe60af485d2fb2b1d901"} Jul 12 18:17:23.425983 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:23.425962 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-plght" event={"ID":"d273d74a-7734-44c2-ad9a-d3f7662b5ddc","Type":"ContainerStarted","Data":"39a0eebd5253b2a4884ac8cd413daa0115087d271a3748589eeabff67c5069ab"} Jul 12 18:17:23.427313 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:23.427296 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" event={"ID":"694a2f71-426d-4555-92e1-0d2e92c359d9","Type":"ContainerStarted","Data":"f14ed492c4df336c78c257800ddff65c5bda9fe48f58bf313b16cb3102f2941d"} Jul 12 18:17:23.430418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:23.430383 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-q2sxm" podStartSLOduration=7.1693748 podStartE2EDuration="21.430372421s" totalImagesPullingTime="14.260997621s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 18:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:17:23.430037655 +0000 UTC m=+23.128796822" watchObservedRunningTime="2026-07-12 18:17:23.430372421 +0000 UTC m=+23.129131588" Jul 12 18:17:23.459337 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:23.459300 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t8wcl" podStartSLOduration=4.6649533949999995 podStartE2EDuration="21.459288848s" totalImagesPullingTime="16.794335453s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 18:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:17:23.44464479 +0000 UTC m=+23.143403955" watchObservedRunningTime="2026-07-12 18:17:23.459288848 +0000 UTC m=+23.158048016" Jul 12 18:17:23.489448 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:23.489410 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xghs8" podStartSLOduration=7.249950823 podStartE2EDuration="21.489396296s" totalImagesPullingTime="14.239445473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:17:23.459407593 +0000 UTC m=+23.158166741" watchObservedRunningTime="2026-07-12 18:17:23.489396296 +0000 UTC m=+23.188155442" Jul 12 18:17:23.507589 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:23.507545 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-l9vdt" podStartSLOduration=4.586761361 podStartE2EDuration="21.50752993s" totalImagesPullingTime="16.920768569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 18:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:17:23.507143372 +0000 UTC m=+23.205902537" watchObservedRunningTime="2026-07-12 18:17:23.50752993 +0000 UTC m=+23.206289120" Jul 12 18:17:23.522202 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:23.522153 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-130.ec2.internal" podStartSLOduration=20.522134715 podStartE2EDuration="20.522134715s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 18:17:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:17:23.521426824 +0000 UTC m=+23.220185993" watchObservedRunningTime="2026-07-12 18:17:23.522134715 +0000 UTC m=+23.220893885" Jul 12 18:17:23.548596 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:23.548560 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-plght" podStartSLOduration=7.29783265 podStartE2EDuration="21.548546408s" totalImagesPullingTime="14.250713758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 18:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:17:23.548194322 +0000 UTC m=+23.246953491" watchObservedRunningTime="2026-07-12 18:17:23.548546408 +0000 UTC m=+23.247305576" Jul 12 18:17:24.335070 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:24.335038 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:24.335293 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:24.335049 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:24.335293 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:24.335171 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fsg86" podUID="27d0cbdc-10e6-4e60-8b17-c278fe65e4ec" Jul 12 18:17:24.335293 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:24.335259 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sk4z9" podUID="d46d24aa-b5cf-4607-84ae-53ff23de58d9" Jul 12 18:17:24.358097 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:24.358045 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 12 18:17:24.434521 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:24.434484 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-899r5" event={"ID":"61fdf430-4362-45f5-8d71-56dc20adfba3","Type":"ContainerStarted","Data":"b082d1b18311ca7be2dccec6537078f2cce31704fe16614b5d762cab347f7d67"} Jul 12 18:17:24.434961 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:24.434582 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-899r5" event={"ID":"61fdf430-4362-45f5-8d71-56dc20adfba3","Type":"ContainerStarted","Data":"68620a4716ecbdc2acbcfabd45fbaf9ff2e074312f8d5522aac6ef125bb908da"} Jul 12 18:17:24.437131 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:24.437096 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" event={"ID":"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a","Type":"ContainerStarted","Data":"a7c06a066531bfe90a0358aaa5b9c9d0285807989b7fc1b45a0092a54de2bda2"} Jul 12 18:17:24.438631 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:24.438596 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w65v7" event={"ID":"b088b3c1-17b7-4bce-8dc9-39b80e491ff0","Type":"ContainerStarted","Data":"07422cd623308d92c4f00dabd1d6f50c8047057dbd6e11c25d69696a22621007"} Jul 12 18:17:24.452115 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:24.452024 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-w65v7" podStartSLOduration=8.217631854 podStartE2EDuration="22.452011172s" totalImagesPullingTime="14.234379318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 18:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:17:24.451720964 +0000 UTC m=+24.150480132" watchObservedRunningTime="2026-07-12 18:17:24.452011172 +0000 UTC m=+24.150770339" Jul 12 18:17:25.272251 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:25.272132 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-12T18:17:24.358061884Z","UUID":"c155de98-7101-4095-8d0a-633e454eacef","Handler":null,"Name":"","Endpoint":""} Jul 12 18:17:25.274039 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:25.274013 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 12 18:17:25.274183 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:25.274096 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 12 18:17:25.334439 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:25.334412 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:25.334575 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:25.334513 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn8dd" podUID="92c9c69e-5148-4be6-a348-7bb634c94566" Jul 12 18:17:25.806019 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:25.805954 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xghs8" Jul 12 18:17:25.806522 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:25.806505 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xghs8" Jul 12 18:17:26.334658 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:26.334626 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:26.334810 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:26.334626 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:26.334810 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:26.334753 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fsg86" podUID="27d0cbdc-10e6-4e60-8b17-c278fe65e4ec" Jul 12 18:17:26.334810 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:26.334790 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sk4z9" podUID="d46d24aa-b5cf-4607-84ae-53ff23de58d9" Jul 12 18:17:26.446995 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:26.446946 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-899r5" event={"ID":"61fdf430-4362-45f5-8d71-56dc20adfba3","Type":"ContainerStarted","Data":"5d30905c1ff529abf1e802da346b2d7b33b0e8890702b8dbe8c8ee5b6df5780e"} Jul 12 18:17:26.449208 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:26.449182 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" event={"ID":"a13851f0-fd0b-44aa-b1bb-f8f5e2c4cb7a","Type":"ContainerStarted","Data":"3670c9dd17b3933a0129ee7e9f695e20efa0b5fe6ab5dbd22c1022712f863c6f"} Jul 12 18:17:26.449638 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:26.449617 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xghs8" Jul 12 18:17:26.449897 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:26.449880 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xghs8" Jul 12 18:17:26.466646 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:26.466601 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tws5r" podStartSLOduration=5.426131089 podStartE2EDuration="24.46658866s" totalImagesPullingTime="19.040457571s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 18:17:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:17:26.466447132 +0000 UTC m=+26.165206301" watchObservedRunningTime="2026-07-12 18:17:26.46658866 +0000 UTC m=+26.165347827" Jul 12 18:17:27.335135 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:27.335103 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:27.335602 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:27.335221 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn8dd" podUID="92c9c69e-5148-4be6-a348-7bb634c94566" Jul 12 18:17:28.335562 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:28.335368 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:28.336496 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:28.335432 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:28.336496 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:28.335647 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fsg86" podUID="27d0cbdc-10e6-4e60-8b17-c278fe65e4ec" Jul 12 18:17:28.336496 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:28.335691 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sk4z9" podUID="d46d24aa-b5cf-4607-84ae-53ff23de58d9" Jul 12 18:17:28.456866 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:28.456826 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-899r5" event={"ID":"61fdf430-4362-45f5-8d71-56dc20adfba3","Type":"ContainerStarted","Data":"8cb80a98b6cf526ada6e4bc21dbf243a75ad67ccee9795b765451287ada80d94"} Jul 12 18:17:28.457107 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:28.457063 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:28.458809 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:28.458785 2556 generic.go:356] "Generic (PLEG): container finished" podID="db4af9d8-455a-4a29-bb79-8ba71a1b0ca6" containerID="ae7751b3378c66a444461ea8738ffcf2e146143b3fc213e1a84e7b85a32ae84e" exitCode=0 Jul 12 18:17:28.458897 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:28.458863 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8xtv" event={"ID":"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6","Type":"ContainerDied","Data":"ae7751b3378c66a444461ea8738ffcf2e146143b3fc213e1a84e7b85a32ae84e"} Jul 12 18:17:28.473600 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:28.473579 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:28.481688 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:28.481649 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-899r5" podStartSLOduration=8.054914262 podStartE2EDuration="26.481635816s" totalImagesPullingTime="18.426721554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 18:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:17:28.481401957 +0000 UTC m=+28.180161127" watchObservedRunningTime="2026-07-12 18:17:28.481635816 +0000 UTC m=+28.180394984" Jul 12 18:17:29.335772 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:29.334976 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:29.335772 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:29.335369 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn8dd" podUID="92c9c69e-5148-4be6-a348-7bb634c94566" Jul 12 18:17:29.462623 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:29.462514 2556 generic.go:356] "Generic (PLEG): container finished" podID="db4af9d8-455a-4a29-bb79-8ba71a1b0ca6" containerID="edddfa7b2a1adbf25267a321847194e87c96ea558d48f5354d101e2cf7e4ceb6" exitCode=0 Jul 12 18:17:29.462623 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:29.462595 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8xtv" event={"ID":"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6","Type":"ContainerDied","Data":"edddfa7b2a1adbf25267a321847194e87c96ea558d48f5354d101e2cf7e4ceb6"} Jul 12 18:17:29.463137 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:29.463098 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:29.463240 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:29.463174 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:29.478492 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:29.478470 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:17:30.133251 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:30.133214 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vn8dd"] Jul 12 18:17:30.133407 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:30.133376 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:30.133529 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:30.133506 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn8dd" podUID="92c9c69e-5148-4be6-a348-7bb634c94566" Jul 12 18:17:30.136450 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:30.136342 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fsg86"] Jul 12 18:17:30.136585 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:30.136473 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:30.136585 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:30.136572 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fsg86" podUID="27d0cbdc-10e6-4e60-8b17-c278fe65e4ec" Jul 12 18:17:30.137433 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:30.137409 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sk4z9"] Jul 12 18:17:30.137544 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:30.137504 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:30.137612 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:30.137584 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sk4z9" podUID="d46d24aa-b5cf-4607-84ae-53ff23de58d9" Jul 12 18:17:30.467317 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:30.467250 2556 generic.go:356] "Generic (PLEG): container finished" podID="db4af9d8-455a-4a29-bb79-8ba71a1b0ca6" containerID="8b03bb0e80cae84f0b6eca8ce6c2cc64061e87a6767f2038dac14b9d1875c566" exitCode=0 Jul 12 18:17:30.467642 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:30.467336 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8xtv" event={"ID":"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6","Type":"ContainerDied","Data":"8b03bb0e80cae84f0b6eca8ce6c2cc64061e87a6767f2038dac14b9d1875c566"} Jul 12 18:17:31.335293 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:31.335261 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:31.335459 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:31.335261 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:31.335459 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:31.335397 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn8dd" podUID="92c9c69e-5148-4be6-a348-7bb634c94566" Jul 12 18:17:31.335459 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:31.335264 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:31.335613 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:31.335477 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fsg86" podUID="27d0cbdc-10e6-4e60-8b17-c278fe65e4ec" Jul 12 18:17:31.335613 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:31.335530 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sk4z9" podUID="d46d24aa-b5cf-4607-84ae-53ff23de58d9" Jul 12 18:17:33.334635 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:33.334605 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:33.335162 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:33.334605 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:33.335162 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:33.334613 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:33.335162 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:33.334730 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fsg86" podUID="27d0cbdc-10e6-4e60-8b17-c278fe65e4ec" Jul 12 18:17:33.335162 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:33.334813 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sk4z9" podUID="d46d24aa-b5cf-4607-84ae-53ff23de58d9" Jul 12 18:17:33.335162 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:33.334897 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn8dd" podUID="92c9c69e-5148-4be6-a348-7bb634c94566" Jul 12 18:17:35.335339 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.335182 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:35.335685 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.335233 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:35.335685 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:35.335417 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sk4z9" podUID="d46d24aa-b5cf-4607-84ae-53ff23de58d9" Jul 12 18:17:35.335685 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.335243 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:35.335685 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:35.335483 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fsg86" podUID="27d0cbdc-10e6-4e60-8b17-c278fe65e4ec" Jul 12 18:17:35.335685 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:35.335567 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn8dd" podUID="92c9c69e-5148-4be6-a348-7bb634c94566" Jul 12 18:17:35.446335 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.446314 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-130.ec2.internal" event="NodeReady" Jul 12 18:17:35.446441 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.446420 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 12 18:17:35.479170 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.479116 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fshtt"] Jul 12 18:17:35.482640 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.482612 2556 generic.go:356] "Generic (PLEG): container finished" podID="db4af9d8-455a-4a29-bb79-8ba71a1b0ca6" containerID="2c0c827b1cf7bc265448e91f794a8158b5d94d74d83f5898b95afed75da2f545" exitCode=0 Jul 12 18:17:35.497179 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.495002 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8xtv" event={"ID":"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6","Type":"ContainerDied","Data":"2c0c827b1cf7bc265448e91f794a8158b5d94d74d83f5898b95afed75da2f545"} Jul 12 18:17:35.497179 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.495048 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59b9cc7b5c-xxvn5"] Jul 12 18:17:35.497179 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.495096 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fshtt" Jul 12 18:17:35.500701 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.499917 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wdbcg\"" Jul 12 18:17:35.500701 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.500130 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 12 18:17:35.500701 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.500188 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 12 18:17:35.511074 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.511055 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dftms"] Jul 12 18:17:35.511188 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.511172 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.513627 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.513416 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 12 18:17:35.516514 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.515740 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 12 18:17:35.517585 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.517443 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p9vq2\"" Jul 12 18:17:35.518100 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.518062 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 12 18:17:35.522106 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.522069 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 12 18:17:35.543468 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.543443 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg"] Jul 12 18:17:35.543588 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.543554 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dftms" Jul 12 18:17:35.545967 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.545948 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 12 18:17:35.545967 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.545965 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-r6ldk\"" Jul 12 18:17:35.546159 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.545993 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 12 18:17:35.546159 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.545969 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 12 18:17:35.546159 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.546073 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 12 18:17:35.561353 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.561334 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-b2gj4"] Jul 12 18:17:35.561466 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.561452 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg" Jul 12 18:17:35.563434 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.563422 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 12 18:17:35.563613 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.563597 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mqkbk\"" Jul 12 18:17:35.563650 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.563611 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 12 18:17:35.563695 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.563664 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 12 18:17:35.564702 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.564684 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 12 18:17:35.587451 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.587435 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-xm669"] Jul 12 18:17:35.587552 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.587536 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-b2gj4" Jul 12 18:17:35.589814 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.589796 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 12 18:17:35.589814 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.589807 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 12 18:17:35.589943 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.589897 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 12 18:17:35.589997 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.589903 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-l8x62\"" Jul 12 18:17:35.590090 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.590063 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 12 18:17:35.595133 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.595116 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 12 18:17:35.609583 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.609566 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5bb454b654-mgfsz"] Jul 12 18:17:35.609680 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.609666 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-xm669" Jul 12 18:17:35.612205 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.612186 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 12 18:17:35.612314 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.612239 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 12 18:17:35.612314 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.612253 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 12 18:17:35.612314 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.612258 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 12 18:17:35.612574 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.612550 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-59mp8\"" Jul 12 18:17:35.619491 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.617671 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 12 18:17:35.634183 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.634164 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fshtt"] Jul 12 18:17:35.634280 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.634198 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg"] Jul 12 18:17:35.634280 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.634218 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-b2gj4"] Jul 12 18:17:35.634280 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.634236 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59b9cc7b5c-xxvn5"] Jul 12 18:17:35.634280 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.634256 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5bb454b654-mgfsz"] Jul 12 18:17:35.634280 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.634275 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ps4wq"] Jul 12 18:17:35.634537 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.634292 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:35.636786 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.636765 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 12 18:17:35.637064 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.637045 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kz5fn\"" Jul 12 18:17:35.637170 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.637053 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 12 18:17:35.637170 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.637114 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 12 18:17:35.637380 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.637362 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 12 18:17:35.637467 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.637402 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 12 18:17:35.637467 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.637405 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 12 18:17:35.656407 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.656390 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-j8b8n"] Jul 12 18:17:35.656529 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.656513 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ps4wq" Jul 12 18:17:35.658764 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.658729 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 12 18:17:35.658856 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.658838 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 12 18:17:35.658916 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.658838 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 12 18:17:35.658916 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.658876 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 12 18:17:35.659044 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.659022 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qnlkc\"" Jul 12 18:17:35.668574 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.668556 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f180a514-4acc-4c23-8a5a-e14a34d00f02-ca-trust-extracted\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.668664 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.668579 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7t6h\" (UniqueName: \"kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-kube-api-access-n7t6h\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.668664 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.668596 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.668664 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.668616 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-bound-sa-token\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.668791 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.668692 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70800a37-aba0-4678-9ed7-cc45c5e7ec49-serving-cert\") pod \"service-ca-operator-7695fc6c8c-dftms\" (UID: \"70800a37-aba0-4678-9ed7-cc45c5e7ec49\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dftms" Jul 12 18:17:35.668791 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.668735 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70800a37-aba0-4678-9ed7-cc45c5e7ec49-config\") pod \"service-ca-operator-7695fc6c8c-dftms\" (UID: \"70800a37-aba0-4678-9ed7-cc45c5e7ec49\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dftms" Jul 12 18:17:35.668791 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.668781 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/57408f9d-028f-4d6b-a6b2-5a8e070a2969-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-g8mzg\" (UID: \"57408f9d-028f-4d6b-a6b2-5a8e070a2969\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg" Jul 12 18:17:35.668895 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.668805 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-certificates\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.668895 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.668826 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr8dn\" (UniqueName: \"kubernetes.io/projected/57408f9d-028f-4d6b-a6b2-5a8e070a2969-kube-api-access-dr8dn\") pod \"cluster-monitoring-operator-5f7f494dd4-g8mzg\" (UID: \"57408f9d-028f-4d6b-a6b2-5a8e070a2969\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg" Jul 12 18:17:35.668895 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.668842 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db6gl\" (UniqueName: \"kubernetes.io/projected/70800a37-aba0-4678-9ed7-cc45c5e7ec49-kube-api-access-db6gl\") pod \"service-ca-operator-7695fc6c8c-dftms\" (UID: \"70800a37-aba0-4678-9ed7-cc45c5e7ec49\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dftms" Jul 12 18:17:35.669006 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.668931 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f180a514-4acc-4c23-8a5a-e14a34d00f02-trusted-ca\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.669006 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.668959 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57408f9d-028f-4d6b-a6b2-5a8e070a2969-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-g8mzg\" (UID: \"57408f9d-028f-4d6b-a6b2-5a8e070a2969\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg" Jul 12 18:17:35.669006 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.668994 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f180a514-4acc-4c23-8a5a-e14a34d00f02-installation-pull-secrets\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.669136 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.669050 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v75rr\" (UniqueName: \"kubernetes.io/projected/3d306591-de63-43a6-bd91-ee8977eb6ed1-kube-api-access-v75rr\") pod \"volume-data-source-validator-78495597f6-fshtt\" (UID: \"3d306591-de63-43a6-bd91-ee8977eb6ed1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fshtt" Jul 12 18:17:35.669136 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.669094 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f180a514-4acc-4c23-8a5a-e14a34d00f02-image-registry-private-configuration\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.678634 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.678616 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-c7q7q"] Jul 12 18:17:35.678736 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.678722 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-j8b8n" Jul 12 18:17:35.681110 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.681091 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 12 18:17:35.681110 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.681109 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 12 18:17:35.681263 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.681135 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rk8mp\"" Jul 12 18:17:35.692635 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.692614 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wdmq2"] Jul 12 18:17:35.692742 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.692730 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-c7q7q" Jul 12 18:17:35.694668 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.694652 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bbdjp\"" Jul 12 18:17:35.694882 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.694867 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 12 18:17:35.694998 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.694897 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 12 18:17:35.694998 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.694909 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 12 18:17:35.705226 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.705184 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-2r98h"] Jul 12 18:17:35.705319 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.705248 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wdmq2" Jul 12 18:17:35.707351 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.707332 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 12 18:17:35.707609 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.707592 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 12 18:17:35.707609 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.707604 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 12 18:17:35.707697 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.707687 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hwzkn\"" Jul 12 18:17:35.717012 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.716994 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-794cd8c9cf-qfxgt"] Jul 12 18:17:35.717127 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.717113 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2r98h" Jul 12 18:17:35.719237 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.719220 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 12 18:17:35.719359 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.719343 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 12 18:17:35.719411 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.719372 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-c2jv6\"" Jul 12 18:17:35.728903 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.728889 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw"] Jul 12 18:17:35.729044 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.729000 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794cd8c9cf-qfxgt" Jul 12 18:17:35.731339 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.731322 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 12 18:17:35.731339 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.731332 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 12 18:17:35.731467 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.731387 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 12 18:17:35.731467 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.731427 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 12 18:17:35.740999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.740982 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5964959f76-j4qwh"] Jul 12 18:17:35.741122 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.741099 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" Jul 12 18:17:35.743388 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.743367 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 12 18:17:35.743469 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.743390 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 12 18:17:35.743852 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.743832 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 12 18:17:35.743943 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.743923 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 12 18:17:35.757587 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.757569 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sb6tz"] Jul 12 18:17:35.757669 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.757657 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5964959f76-j4qwh" Jul 12 18:17:35.759668 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.759651 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 12 18:17:35.759739 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.759685 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-fjqnh\"" Jul 12 18:17:35.769366 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.769347 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f180a514-4acc-4c23-8a5a-e14a34d00f02-ca-trust-extracted\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.769462 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.769374 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7t6h\" (UniqueName: \"kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-kube-api-access-n7t6h\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.769462 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.769395 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3bd8be73-d59a-4c4d-945b-eff5f7563c73-config\") pod \"console-operator-7866497494-b2gj4\" (UID: \"3bd8be73-d59a-4c4d-945b-eff5f7563c73\") " pod="openshift-console-operator/console-operator-7866497494-b2gj4" Jul 12 18:17:35.769462 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.769432 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70800a37-aba0-4678-9ed7-cc45c5e7ec49-serving-cert\") pod \"service-ca-operator-7695fc6c8c-dftms\" (UID: \"70800a37-aba0-4678-9ed7-cc45c5e7ec49\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dftms" Jul 12 18:17:35.769714 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.769478 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-j8b8n\" (UID: \"888ee972-d5e3-4714-a5ee-83d604c9d2d3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-j8b8n" Jul 12 18:17:35.769714 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.769509 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rm6k\" (UniqueName: \"kubernetes.io/projected/05d80244-fc3e-45d4-a192-6385aff3addf-kube-api-access-2rm6k\") pod \"kube-storage-version-migrator-operator-799cb7f958-ps4wq\" (UID: \"05d80244-fc3e-45d4-a192-6385aff3addf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ps4wq" Jul 12 18:17:35.769714 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.769536 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05d80244-fc3e-45d4-a192-6385aff3addf-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-ps4wq\" (UID: \"05d80244-fc3e-45d4-a192-6385aff3addf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ps4wq" Jul 12 18:17:35.769714 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.769565 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr8dn\" (UniqueName: \"kubernetes.io/projected/57408f9d-028f-4d6b-a6b2-5a8e070a2969-kube-api-access-dr8dn\") pod \"cluster-monitoring-operator-5f7f494dd4-g8mzg\" (UID: \"57408f9d-028f-4d6b-a6b2-5a8e070a2969\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg" Jul 12 18:17:35.769714 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.769590 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db6gl\" (UniqueName: \"kubernetes.io/projected/70800a37-aba0-4678-9ed7-cc45c5e7ec49-kube-api-access-db6gl\") pod \"service-ca-operator-7695fc6c8c-dftms\" (UID: \"70800a37-aba0-4678-9ed7-cc45c5e7ec49\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dftms" Jul 12 18:17:35.769714 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.769616 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05d80244-fc3e-45d4-a192-6385aff3addf-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-ps4wq\" (UID: \"05d80244-fc3e-45d4-a192-6385aff3addf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ps4wq" Jul 12 18:17:35.769714 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.769648 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f180a514-4acc-4c23-8a5a-e14a34d00f02-trusted-ca\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.769714 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.769676 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/888ee972-d5e3-4714-a5ee-83d604c9d2d3-nginx-conf\") pod \"networking-console-plugin-6cf856758c-j8b8n\" (UID: \"888ee972-d5e3-4714-a5ee-83d604c9d2d3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-j8b8n" Jul 12 18:17:35.769714 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.769700 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92b6d641-802b-4005-9a45-c623d3403694-tmp\") pod \"insights-operator-68d9dd94cf-xm669\" (UID: \"92b6d641-802b-4005-9a45-c623d3403694\") " pod="openshift-insights/insights-operator-68d9dd94cf-xm669" Jul 12 18:17:35.770157 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.769724 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f180a514-4acc-4c23-8a5a-e14a34d00f02-ca-trust-extracted\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.770157 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.769724 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89cct\" (UniqueName: \"kubernetes.io/projected/76307ceb-8deb-4dcf-ac3b-0a446216a225-kube-api-access-89cct\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:35.770157 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.769800 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f180a514-4acc-4c23-8a5a-e14a34d00f02-image-registry-private-configuration\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.770157 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.769844 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-default-certificate\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:35.770157 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.769868 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92b6d641-802b-4005-9a45-c623d3403694-serving-cert\") pod \"insights-operator-68d9dd94cf-xm669\" (UID: \"92b6d641-802b-4005-9a45-c623d3403694\") " pod="openshift-insights/insights-operator-68d9dd94cf-xm669" Jul 12 18:17:35.770157 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.769893 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-metrics-certs\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:35.770157 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.769919 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76307ceb-8deb-4dcf-ac3b-0a446216a225-service-ca-bundle\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:35.770157 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.769949 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.770157 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:35.770034 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 18:17:35.770157 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:35.770048 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59b9cc7b5c-xxvn5: secret "image-registry-tls" not found Jul 12 18:17:35.770157 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770102 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-2r98h"] Jul 12 18:17:35.770157 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770139 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-xm669"] Jul 12 18:17:35.770157 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770160 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wdmq2"] Jul 12 18:17:35.770157 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:35.770163 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls podName:f180a514-4acc-4c23-8a5a-e14a34d00f02 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:36.270143056 +0000 UTC m=+35.968902221 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls") pod "image-registry-59b9cc7b5c-xxvn5" (UID: "f180a514-4acc-4c23-8a5a-e14a34d00f02") : secret "image-registry-tls" not found Jul 12 18:17:35.770756 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770179 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ps4wq"] Jul 12 18:17:35.770756 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770197 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dftms"] Jul 12 18:17:35.770756 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770230 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-j8b8n"] Jul 12 18:17:35.770756 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770305 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw"] Jul 12 18:17:35.770756 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770325 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-794cd8c9cf-qfxgt"] Jul 12 18:17:35.770756 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770352 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5964959f76-j4qwh"] Jul 12 18:17:35.770756 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770371 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sb6tz"] Jul 12 18:17:35.770756 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770395 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-c7q7q"] Jul 12 18:17:35.770756 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770401 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sb6tz" Jul 12 18:17:35.770756 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770278 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-bound-sa-token\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.770756 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770503 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70800a37-aba0-4678-9ed7-cc45c5e7ec49-config\") pod \"service-ca-operator-7695fc6c8c-dftms\" (UID: \"70800a37-aba0-4678-9ed7-cc45c5e7ec49\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dftms" Jul 12 18:17:35.770756 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770539 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/57408f9d-028f-4d6b-a6b2-5a8e070a2969-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-g8mzg\" (UID: \"57408f9d-028f-4d6b-a6b2-5a8e070a2969\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg" Jul 12 18:17:35.770756 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770597 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-stats-auth\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:35.770756 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770623 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b6d641-802b-4005-9a45-c623d3403694-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-xm669\" (UID: \"92b6d641-802b-4005-9a45-c623d3403694\") " pod="openshift-insights/insights-operator-68d9dd94cf-xm669" Jul 12 18:17:35.770756 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770667 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkjvh\" (UniqueName: \"kubernetes.io/projected/92b6d641-802b-4005-9a45-c623d3403694-kube-api-access-tkjvh\") pod \"insights-operator-68d9dd94cf-xm669\" (UID: \"92b6d641-802b-4005-9a45-c623d3403694\") " pod="openshift-insights/insights-operator-68d9dd94cf-xm669" Jul 12 18:17:35.770756 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770700 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-certificates\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.770756 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770741 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3bd8be73-d59a-4c4d-945b-eff5f7563c73-trusted-ca\") pod \"console-operator-7866497494-b2gj4\" (UID: \"3bd8be73-d59a-4c4d-945b-eff5f7563c73\") " pod="openshift-console-operator/console-operator-7866497494-b2gj4" Jul 12 18:17:35.771423 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770770 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3bd8be73-d59a-4c4d-945b-eff5f7563c73-serving-cert\") pod \"console-operator-7866497494-b2gj4\" (UID: \"3bd8be73-d59a-4c4d-945b-eff5f7563c73\") " pod="openshift-console-operator/console-operator-7866497494-b2gj4" Jul 12 18:17:35.771423 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770794 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8vnt\" (UniqueName: \"kubernetes.io/projected/3bd8be73-d59a-4c4d-945b-eff5f7563c73-kube-api-access-g8vnt\") pod \"console-operator-7866497494-b2gj4\" (UID: \"3bd8be73-d59a-4c4d-945b-eff5f7563c73\") " pod="openshift-console-operator/console-operator-7866497494-b2gj4" Jul 12 18:17:35.771423 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770834 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f180a514-4acc-4c23-8a5a-e14a34d00f02-trusted-ca\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.771423 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770843 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b6d641-802b-4005-9a45-c623d3403694-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-xm669\" (UID: \"92b6d641-802b-4005-9a45-c623d3403694\") " pod="openshift-insights/insights-operator-68d9dd94cf-xm669" Jul 12 18:17:35.771423 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770895 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57408f9d-028f-4d6b-a6b2-5a8e070a2969-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-g8mzg\" (UID: \"57408f9d-028f-4d6b-a6b2-5a8e070a2969\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg" Jul 12 18:17:35.771423 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770925 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/92b6d641-802b-4005-9a45-c623d3403694-snapshots\") pod \"insights-operator-68d9dd94cf-xm669\" (UID: \"92b6d641-802b-4005-9a45-c623d3403694\") " pod="openshift-insights/insights-operator-68d9dd94cf-xm669" Jul 12 18:17:35.771423 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.770953 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f180a514-4acc-4c23-8a5a-e14a34d00f02-installation-pull-secrets\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.771423 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.771000 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v75rr\" (UniqueName: \"kubernetes.io/projected/3d306591-de63-43a6-bd91-ee8977eb6ed1-kube-api-access-v75rr\") pod \"volume-data-source-validator-78495597f6-fshtt\" (UID: \"3d306591-de63-43a6-bd91-ee8977eb6ed1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fshtt" Jul 12 18:17:35.771423 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.771275 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70800a37-aba0-4678-9ed7-cc45c5e7ec49-config\") pod \"service-ca-operator-7695fc6c8c-dftms\" (UID: \"70800a37-aba0-4678-9ed7-cc45c5e7ec49\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dftms" Jul 12 18:17:35.771423 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.771309 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-certificates\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.771423 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:35.771377 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 12 18:17:35.771423 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:35.771423 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57408f9d-028f-4d6b-a6b2-5a8e070a2969-cluster-monitoring-operator-tls podName:57408f9d-028f-4d6b-a6b2-5a8e070a2969 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:36.271407804 +0000 UTC m=+35.970166950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/57408f9d-028f-4d6b-a6b2-5a8e070a2969-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-g8mzg" (UID: "57408f9d-028f-4d6b-a6b2-5a8e070a2969") : secret "cluster-monitoring-operator-tls" not found Jul 12 18:17:35.772024 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.772004 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/57408f9d-028f-4d6b-a6b2-5a8e070a2969-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-g8mzg\" (UID: \"57408f9d-028f-4d6b-a6b2-5a8e070a2969\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg" Jul 12 18:17:35.772822 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.772804 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 12 18:17:35.773032 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.773010 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 12 18:17:35.773156 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.772905 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h7xmt\"" Jul 12 18:17:35.774472 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.774435 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70800a37-aba0-4678-9ed7-cc45c5e7ec49-serving-cert\") pod \"service-ca-operator-7695fc6c8c-dftms\" (UID: \"70800a37-aba0-4678-9ed7-cc45c5e7ec49\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dftms" Jul 12 18:17:35.774732 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.774713 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f180a514-4acc-4c23-8a5a-e14a34d00f02-image-registry-private-configuration\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.774787 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.774728 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f180a514-4acc-4c23-8a5a-e14a34d00f02-installation-pull-secrets\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.777171 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.777148 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7t6h\" (UniqueName: \"kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-kube-api-access-n7t6h\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.778251 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.778230 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-db6gl\" (UniqueName: \"kubernetes.io/projected/70800a37-aba0-4678-9ed7-cc45c5e7ec49-kube-api-access-db6gl\") pod \"service-ca-operator-7695fc6c8c-dftms\" (UID: \"70800a37-aba0-4678-9ed7-cc45c5e7ec49\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dftms" Jul 12 18:17:35.778896 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.778875 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-bound-sa-token\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:35.778971 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.778898 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr8dn\" (UniqueName: \"kubernetes.io/projected/57408f9d-028f-4d6b-a6b2-5a8e070a2969-kube-api-access-dr8dn\") pod \"cluster-monitoring-operator-5f7f494dd4-g8mzg\" (UID: \"57408f9d-028f-4d6b-a6b2-5a8e070a2969\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg" Jul 12 18:17:35.779327 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.779311 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v75rr\" (UniqueName: \"kubernetes.io/projected/3d306591-de63-43a6-bd91-ee8977eb6ed1-kube-api-access-v75rr\") pod \"volume-data-source-validator-78495597f6-fshtt\" (UID: \"3d306591-de63-43a6-bd91-ee8977eb6ed1\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fshtt" Jul 12 18:17:35.807900 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.807876 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fshtt" Jul 12 18:17:35.853632 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.853609 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dftms" Jul 12 18:17:35.871966 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.871939 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8fb34b4a-251b-4a6e-b7b5-33cc7a4c9080-klusterlet-config\") pod \"klusterlet-addon-workmgr-794cd8c9cf-qfxgt\" (UID: \"8fb34b4a-251b-4a6e-b7b5-33cc7a4c9080\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794cd8c9cf-qfxgt" Jul 12 18:17:35.871966 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.871971 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1b6faf85-3504-427a-92ed-68183d48e409-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8485678674-2lvvw\" (UID: \"1b6faf85-3504-427a-92ed-68183d48e409\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" Jul 12 18:17:35.872179 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.871990 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45q8k\" (UniqueName: \"kubernetes.io/projected/74ee6da0-f91b-44f7-885d-eb27b77e31cd-kube-api-access-45q8k\") pod \"managed-serviceaccount-addon-agent-5964959f76-j4qwh\" (UID: \"74ee6da0-f91b-44f7-885d-eb27b77e31cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5964959f76-j4qwh" Jul 12 18:17:35.872179 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872008 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-config-volume\") pod \"dns-default-sb6tz\" (UID: \"49f40bf4-3d5d-4007-b2aa-5b8f0827e823\") " pod="openshift-dns/dns-default-sb6tz" Jul 12 18:17:35.872179 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872035 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1b6faf85-3504-427a-92ed-68183d48e409-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8485678674-2lvvw\" (UID: \"1b6faf85-3504-427a-92ed-68183d48e409\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" Jul 12 18:17:35.872179 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872055 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/345aaa00-6a0b-46e1-be63-285fed5a8614-cert\") pod \"ingress-canary-wdmq2\" (UID: \"345aaa00-6a0b-46e1-be63-285fed5a8614\") " pod="openshift-ingress-canary/ingress-canary-wdmq2" Jul 12 18:17:35.872179 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872070 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kqx4\" (UniqueName: \"kubernetes.io/projected/1b6faf85-3504-427a-92ed-68183d48e409-kube-api-access-5kqx4\") pod \"cluster-proxy-proxy-agent-8485678674-2lvvw\" (UID: \"1b6faf85-3504-427a-92ed-68183d48e409\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" Jul 12 18:17:35.872179 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872106 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-tmp-dir\") pod \"dns-default-sb6tz\" (UID: \"49f40bf4-3d5d-4007-b2aa-5b8f0827e823\") " pod="openshift-dns/dns-default-sb6tz" Jul 12 18:17:35.872179 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872141 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1b6faf85-3504-427a-92ed-68183d48e409-ca\") pod \"cluster-proxy-proxy-agent-8485678674-2lvvw\" (UID: \"1b6faf85-3504-427a-92ed-68183d48e409\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" Jul 12 18:17:35.872479 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872187 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3bd8be73-d59a-4c4d-945b-eff5f7563c73-config\") pod \"console-operator-7866497494-b2gj4\" (UID: \"3bd8be73-d59a-4c4d-945b-eff5f7563c73\") " pod="openshift-console-operator/console-operator-7866497494-b2gj4" Jul 12 18:17:35.872479 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872208 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fb34b4a-251b-4a6e-b7b5-33cc7a4c9080-tmp\") pod \"klusterlet-addon-workmgr-794cd8c9cf-qfxgt\" (UID: \"8fb34b4a-251b-4a6e-b7b5-33cc7a4c9080\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794cd8c9cf-qfxgt" Jul 12 18:17:35.872479 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872252 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b6faf85-3504-427a-92ed-68183d48e409-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8485678674-2lvvw\" (UID: \"1b6faf85-3504-427a-92ed-68183d48e409\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" Jul 12 18:17:35.872479 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872279 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-j8b8n\" (UID: \"888ee972-d5e3-4714-a5ee-83d604c9d2d3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-j8b8n" Jul 12 18:17:35.872479 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872337 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rm6k\" (UniqueName: \"kubernetes.io/projected/05d80244-fc3e-45d4-a192-6385aff3addf-kube-api-access-2rm6k\") pod \"kube-storage-version-migrator-operator-799cb7f958-ps4wq\" (UID: \"05d80244-fc3e-45d4-a192-6385aff3addf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ps4wq" Jul 12 18:17:35.872479 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872378 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-metrics-tls\") pod \"dns-default-sb6tz\" (UID: \"49f40bf4-3d5d-4007-b2aa-5b8f0827e823\") " pod="openshift-dns/dns-default-sb6tz" Jul 12 18:17:35.872479 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872404 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-c7q7q\" (UID: \"9b74ea4d-756d-4b37-87a9-ed24c4bbc2da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-c7q7q" Jul 12 18:17:35.872479 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:35.872417 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 12 18:17:35.872479 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872433 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05d80244-fc3e-45d4-a192-6385aff3addf-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-ps4wq\" (UID: \"05d80244-fc3e-45d4-a192-6385aff3addf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ps4wq" Jul 12 18:17:35.872479 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:35.872478 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert podName:888ee972-d5e3-4714-a5ee-83d604c9d2d3 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:36.372455961 +0000 UTC m=+36.071215107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-j8b8n" (UID: "888ee972-d5e3-4714-a5ee-83d604c9d2d3") : secret "networking-console-plugin-cert" not found Jul 12 18:17:35.873244 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872495 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzmbg\" (UniqueName: \"kubernetes.io/projected/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-kube-api-access-bzmbg\") pod \"cluster-samples-operator-65db858894-c7q7q\" (UID: \"9b74ea4d-756d-4b37-87a9-ed24c4bbc2da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-c7q7q" Jul 12 18:17:35.873244 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872531 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05d80244-fc3e-45d4-a192-6385aff3addf-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-ps4wq\" (UID: \"05d80244-fc3e-45d4-a192-6385aff3addf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ps4wq" Jul 12 18:17:35.873244 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872556 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz6hv\" (UniqueName: \"kubernetes.io/projected/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-kube-api-access-qz6hv\") pod \"dns-default-sb6tz\" (UID: \"49f40bf4-3d5d-4007-b2aa-5b8f0827e823\") " pod="openshift-dns/dns-default-sb6tz" Jul 12 18:17:35.873244 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872592 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/888ee972-d5e3-4714-a5ee-83d604c9d2d3-nginx-conf\") pod \"networking-console-plugin-6cf856758c-j8b8n\" (UID: \"888ee972-d5e3-4714-a5ee-83d604c9d2d3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-j8b8n" Jul 12 18:17:35.873244 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872614 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92b6d641-802b-4005-9a45-c623d3403694-tmp\") pod \"insights-operator-68d9dd94cf-xm669\" (UID: \"92b6d641-802b-4005-9a45-c623d3403694\") " pod="openshift-insights/insights-operator-68d9dd94cf-xm669" Jul 12 18:17:35.873244 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872636 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ddwb\" (UniqueName: \"kubernetes.io/projected/345aaa00-6a0b-46e1-be63-285fed5a8614-kube-api-access-6ddwb\") pod \"ingress-canary-wdmq2\" (UID: \"345aaa00-6a0b-46e1-be63-285fed5a8614\") " pod="openshift-ingress-canary/ingress-canary-wdmq2" Jul 12 18:17:35.873244 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872661 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89cct\" (UniqueName: \"kubernetes.io/projected/76307ceb-8deb-4dcf-ac3b-0a446216a225-kube-api-access-89cct\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:35.873244 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872708 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5fn4\" (UniqueName: \"kubernetes.io/projected/8fb34b4a-251b-4a6e-b7b5-33cc7a4c9080-kube-api-access-c5fn4\") pod \"klusterlet-addon-workmgr-794cd8c9cf-qfxgt\" (UID: \"8fb34b4a-251b-4a6e-b7b5-33cc7a4c9080\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794cd8c9cf-qfxgt" Jul 12 18:17:35.873244 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872743 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-default-certificate\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:35.873244 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872767 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92b6d641-802b-4005-9a45-c623d3403694-serving-cert\") pod \"insights-operator-68d9dd94cf-xm669\" (UID: \"92b6d641-802b-4005-9a45-c623d3403694\") " pod="openshift-insights/insights-operator-68d9dd94cf-xm669" Jul 12 18:17:35.873244 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872791 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/74ee6da0-f91b-44f7-885d-eb27b77e31cd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5964959f76-j4qwh\" (UID: \"74ee6da0-f91b-44f7-885d-eb27b77e31cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5964959f76-j4qwh" Jul 12 18:17:35.873244 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872817 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-metrics-certs\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:35.873244 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872845 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76307ceb-8deb-4dcf-ac3b-0a446216a225-service-ca-bundle\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:35.873244 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872887 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m24lw\" (UniqueName: \"kubernetes.io/projected/825cd750-23e2-4d29-b589-3c6979f89e51-kube-api-access-m24lw\") pod \"network-check-source-869dcfcdcd-2r98h\" (UID: \"825cd750-23e2-4d29-b589-3c6979f89e51\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2r98h" Jul 12 18:17:35.873244 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872928 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-stats-auth\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:35.874060 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.872975 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b6d641-802b-4005-9a45-c623d3403694-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-xm669\" (UID: \"92b6d641-802b-4005-9a45-c623d3403694\") " pod="openshift-insights/insights-operator-68d9dd94cf-xm669" Jul 12 18:17:35.874060 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.873002 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkjvh\" (UniqueName: \"kubernetes.io/projected/92b6d641-802b-4005-9a45-c623d3403694-kube-api-access-tkjvh\") pod \"insights-operator-68d9dd94cf-xm669\" (UID: \"92b6d641-802b-4005-9a45-c623d3403694\") " pod="openshift-insights/insights-operator-68d9dd94cf-xm669" Jul 12 18:17:35.874060 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.873031 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3bd8be73-d59a-4c4d-945b-eff5f7563c73-trusted-ca\") pod \"console-operator-7866497494-b2gj4\" (UID: \"3bd8be73-d59a-4c4d-945b-eff5f7563c73\") " pod="openshift-console-operator/console-operator-7866497494-b2gj4" Jul 12 18:17:35.874060 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.873060 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3bd8be73-d59a-4c4d-945b-eff5f7563c73-serving-cert\") pod \"console-operator-7866497494-b2gj4\" (UID: \"3bd8be73-d59a-4c4d-945b-eff5f7563c73\") " pod="openshift-console-operator/console-operator-7866497494-b2gj4" Jul 12 18:17:35.874060 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.873109 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8vnt\" (UniqueName: \"kubernetes.io/projected/3bd8be73-d59a-4c4d-945b-eff5f7563c73-kube-api-access-g8vnt\") pod \"console-operator-7866497494-b2gj4\" (UID: \"3bd8be73-d59a-4c4d-945b-eff5f7563c73\") " pod="openshift-console-operator/console-operator-7866497494-b2gj4" Jul 12 18:17:35.874060 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.873100 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/05d80244-fc3e-45d4-a192-6385aff3addf-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-ps4wq\" (UID: \"05d80244-fc3e-45d4-a192-6385aff3addf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ps4wq" Jul 12 18:17:35.874060 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:35.873161 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76307ceb-8deb-4dcf-ac3b-0a446216a225-service-ca-bundle podName:76307ceb-8deb-4dcf-ac3b-0a446216a225 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:36.373143924 +0000 UTC m=+36.071903072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/76307ceb-8deb-4dcf-ac3b-0a446216a225-service-ca-bundle") pod "router-default-5bb454b654-mgfsz" (UID: "76307ceb-8deb-4dcf-ac3b-0a446216a225") : configmap references non-existent config key: service-ca.crt Jul 12 18:17:35.874060 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.873287 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/888ee972-d5e3-4714-a5ee-83d604c9d2d3-nginx-conf\") pod \"networking-console-plugin-6cf856758c-j8b8n\" (UID: \"888ee972-d5e3-4714-a5ee-83d604c9d2d3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-j8b8n" Jul 12 18:17:35.874060 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.873306 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92b6d641-802b-4005-9a45-c623d3403694-tmp\") pod \"insights-operator-68d9dd94cf-xm669\" (UID: \"92b6d641-802b-4005-9a45-c623d3403694\") " pod="openshift-insights/insights-operator-68d9dd94cf-xm669" Jul 12 18:17:35.874060 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.873936 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b6d641-802b-4005-9a45-c623d3403694-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-xm669\" (UID: \"92b6d641-802b-4005-9a45-c623d3403694\") " pod="openshift-insights/insights-operator-68d9dd94cf-xm669" Jul 12 18:17:35.874625 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.874569 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3bd8be73-d59a-4c4d-945b-eff5f7563c73-trusted-ca\") pod \"console-operator-7866497494-b2gj4\" (UID: \"3bd8be73-d59a-4c4d-945b-eff5f7563c73\") " pod="openshift-console-operator/console-operator-7866497494-b2gj4" Jul 12 18:17:35.874702 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:35.874685 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 12 18:17:35.874765 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:35.874751 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-metrics-certs podName:76307ceb-8deb-4dcf-ac3b-0a446216a225 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:36.37473453 +0000 UTC m=+36.073493702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-metrics-certs") pod "router-default-5bb454b654-mgfsz" (UID: "76307ceb-8deb-4dcf-ac3b-0a446216a225") : secret "router-metrics-certs-default" not found Jul 12 18:17:35.874824 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.874781 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b6d641-802b-4005-9a45-c623d3403694-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-xm669\" (UID: \"92b6d641-802b-4005-9a45-c623d3403694\") " pod="openshift-insights/insights-operator-68d9dd94cf-xm669" Jul 12 18:17:35.874880 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.874821 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/92b6d641-802b-4005-9a45-c623d3403694-snapshots\") pod \"insights-operator-68d9dd94cf-xm669\" (UID: \"92b6d641-802b-4005-9a45-c623d3403694\") " pod="openshift-insights/insights-operator-68d9dd94cf-xm669" Jul 12 18:17:35.874880 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.874847 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1b6faf85-3504-427a-92ed-68183d48e409-hub\") pod \"cluster-proxy-proxy-agent-8485678674-2lvvw\" (UID: \"1b6faf85-3504-427a-92ed-68183d48e409\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" Jul 12 18:17:35.875753 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.875723 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92b6d641-802b-4005-9a45-c623d3403694-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-xm669\" (UID: \"92b6d641-802b-4005-9a45-c623d3403694\") " pod="openshift-insights/insights-operator-68d9dd94cf-xm669" Jul 12 18:17:35.876306 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.876283 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-default-certificate\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:35.876496 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.876458 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/92b6d641-802b-4005-9a45-c623d3403694-snapshots\") pod \"insights-operator-68d9dd94cf-xm669\" (UID: \"92b6d641-802b-4005-9a45-c623d3403694\") " pod="openshift-insights/insights-operator-68d9dd94cf-xm669" Jul 12 18:17:35.876665 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.876646 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05d80244-fc3e-45d4-a192-6385aff3addf-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-ps4wq\" (UID: \"05d80244-fc3e-45d4-a192-6385aff3addf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ps4wq" Jul 12 18:17:35.876928 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.876901 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92b6d641-802b-4005-9a45-c623d3403694-serving-cert\") pod \"insights-operator-68d9dd94cf-xm669\" (UID: \"92b6d641-802b-4005-9a45-c623d3403694\") " pod="openshift-insights/insights-operator-68d9dd94cf-xm669" Jul 12 18:17:35.877290 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.877269 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-stats-auth\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:35.878389 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.878366 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3bd8be73-d59a-4c4d-945b-eff5f7563c73-serving-cert\") pod \"console-operator-7866497494-b2gj4\" (UID: \"3bd8be73-d59a-4c4d-945b-eff5f7563c73\") " pod="openshift-console-operator/console-operator-7866497494-b2gj4" Jul 12 18:17:35.881119 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.881094 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rm6k\" (UniqueName: \"kubernetes.io/projected/05d80244-fc3e-45d4-a192-6385aff3addf-kube-api-access-2rm6k\") pod \"kube-storage-version-migrator-operator-799cb7f958-ps4wq\" (UID: \"05d80244-fc3e-45d4-a192-6385aff3addf\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ps4wq" Jul 12 18:17:35.881235 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.881209 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89cct\" (UniqueName: \"kubernetes.io/projected/76307ceb-8deb-4dcf-ac3b-0a446216a225-kube-api-access-89cct\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:35.882626 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.882597 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkjvh\" (UniqueName: \"kubernetes.io/projected/92b6d641-802b-4005-9a45-c623d3403694-kube-api-access-tkjvh\") pod \"insights-operator-68d9dd94cf-xm669\" (UID: \"92b6d641-802b-4005-9a45-c623d3403694\") " pod="openshift-insights/insights-operator-68d9dd94cf-xm669" Jul 12 18:17:35.883457 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.883434 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8vnt\" (UniqueName: \"kubernetes.io/projected/3bd8be73-d59a-4c4d-945b-eff5f7563c73-kube-api-access-g8vnt\") pod \"console-operator-7866497494-b2gj4\" (UID: \"3bd8be73-d59a-4c4d-945b-eff5f7563c73\") " pod="openshift-console-operator/console-operator-7866497494-b2gj4" Jul 12 18:17:35.888014 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.887993 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3bd8be73-d59a-4c4d-945b-eff5f7563c73-config\") pod \"console-operator-7866497494-b2gj4\" (UID: \"3bd8be73-d59a-4c4d-945b-eff5f7563c73\") " pod="openshift-console-operator/console-operator-7866497494-b2gj4" Jul 12 18:17:35.899702 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.899679 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-b2gj4" Jul 12 18:17:35.919453 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.919426 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-xm669" Jul 12 18:17:35.966681 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.965824 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ps4wq" Jul 12 18:17:35.979544 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.975518 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1b6faf85-3504-427a-92ed-68183d48e409-hub\") pod \"cluster-proxy-proxy-agent-8485678674-2lvvw\" (UID: \"1b6faf85-3504-427a-92ed-68183d48e409\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" Jul 12 18:17:35.979544 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.975565 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8fb34b4a-251b-4a6e-b7b5-33cc7a4c9080-klusterlet-config\") pod \"klusterlet-addon-workmgr-794cd8c9cf-qfxgt\" (UID: \"8fb34b4a-251b-4a6e-b7b5-33cc7a4c9080\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794cd8c9cf-qfxgt" Jul 12 18:17:35.979544 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.975589 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1b6faf85-3504-427a-92ed-68183d48e409-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8485678674-2lvvw\" (UID: \"1b6faf85-3504-427a-92ed-68183d48e409\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" Jul 12 18:17:35.979544 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.975614 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45q8k\" (UniqueName: \"kubernetes.io/projected/74ee6da0-f91b-44f7-885d-eb27b77e31cd-kube-api-access-45q8k\") pod \"managed-serviceaccount-addon-agent-5964959f76-j4qwh\" (UID: \"74ee6da0-f91b-44f7-885d-eb27b77e31cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5964959f76-j4qwh" Jul 12 18:17:35.979544 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.975644 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-config-volume\") pod \"dns-default-sb6tz\" (UID: \"49f40bf4-3d5d-4007-b2aa-5b8f0827e823\") " pod="openshift-dns/dns-default-sb6tz" Jul 12 18:17:35.979544 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.975673 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1b6faf85-3504-427a-92ed-68183d48e409-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8485678674-2lvvw\" (UID: \"1b6faf85-3504-427a-92ed-68183d48e409\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" Jul 12 18:17:35.979544 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.975697 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/345aaa00-6a0b-46e1-be63-285fed5a8614-cert\") pod \"ingress-canary-wdmq2\" (UID: \"345aaa00-6a0b-46e1-be63-285fed5a8614\") " pod="openshift-ingress-canary/ingress-canary-wdmq2" Jul 12 18:17:35.979544 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.975725 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kqx4\" (UniqueName: \"kubernetes.io/projected/1b6faf85-3504-427a-92ed-68183d48e409-kube-api-access-5kqx4\") pod \"cluster-proxy-proxy-agent-8485678674-2lvvw\" (UID: \"1b6faf85-3504-427a-92ed-68183d48e409\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" Jul 12 18:17:35.979544 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.975754 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-tmp-dir\") pod \"dns-default-sb6tz\" (UID: \"49f40bf4-3d5d-4007-b2aa-5b8f0827e823\") " pod="openshift-dns/dns-default-sb6tz" Jul 12 18:17:35.979544 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.975782 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1b6faf85-3504-427a-92ed-68183d48e409-ca\") pod \"cluster-proxy-proxy-agent-8485678674-2lvvw\" (UID: \"1b6faf85-3504-427a-92ed-68183d48e409\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" Jul 12 18:17:35.979544 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.975807 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fb34b4a-251b-4a6e-b7b5-33cc7a4c9080-tmp\") pod \"klusterlet-addon-workmgr-794cd8c9cf-qfxgt\" (UID: \"8fb34b4a-251b-4a6e-b7b5-33cc7a4c9080\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794cd8c9cf-qfxgt" Jul 12 18:17:35.979544 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.975847 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b6faf85-3504-427a-92ed-68183d48e409-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8485678674-2lvvw\" (UID: \"1b6faf85-3504-427a-92ed-68183d48e409\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" Jul 12 18:17:35.979544 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.975884 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-metrics-tls\") pod \"dns-default-sb6tz\" (UID: \"49f40bf4-3d5d-4007-b2aa-5b8f0827e823\") " pod="openshift-dns/dns-default-sb6tz" Jul 12 18:17:35.979544 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.975907 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-c7q7q\" (UID: \"9b74ea4d-756d-4b37-87a9-ed24c4bbc2da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-c7q7q" Jul 12 18:17:35.979544 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.975939 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzmbg\" (UniqueName: \"kubernetes.io/projected/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-kube-api-access-bzmbg\") pod \"cluster-samples-operator-65db858894-c7q7q\" (UID: \"9b74ea4d-756d-4b37-87a9-ed24c4bbc2da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-c7q7q" Jul 12 18:17:35.979544 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.975970 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz6hv\" (UniqueName: \"kubernetes.io/projected/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-kube-api-access-qz6hv\") pod \"dns-default-sb6tz\" (UID: \"49f40bf4-3d5d-4007-b2aa-5b8f0827e823\") " pod="openshift-dns/dns-default-sb6tz" Jul 12 18:17:35.980527 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.976008 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ddwb\" (UniqueName: \"kubernetes.io/projected/345aaa00-6a0b-46e1-be63-285fed5a8614-kube-api-access-6ddwb\") pod \"ingress-canary-wdmq2\" (UID: \"345aaa00-6a0b-46e1-be63-285fed5a8614\") " pod="openshift-ingress-canary/ingress-canary-wdmq2" Jul 12 18:17:35.980527 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.976043 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs\") pod \"network-metrics-daemon-vn8dd\" (UID: \"92c9c69e-5148-4be6-a348-7bb634c94566\") " pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:35.980527 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.976089 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5fn4\" (UniqueName: \"kubernetes.io/projected/8fb34b4a-251b-4a6e-b7b5-33cc7a4c9080-kube-api-access-c5fn4\") pod \"klusterlet-addon-workmgr-794cd8c9cf-qfxgt\" (UID: \"8fb34b4a-251b-4a6e-b7b5-33cc7a4c9080\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794cd8c9cf-qfxgt" Jul 12 18:17:35.980527 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.976122 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kn76\" (UniqueName: \"kubernetes.io/projected/d46d24aa-b5cf-4607-84ae-53ff23de58d9-kube-api-access-7kn76\") pod \"network-check-target-sk4z9\" (UID: \"d46d24aa-b5cf-4607-84ae-53ff23de58d9\") " pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:35.980527 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.976148 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/74ee6da0-f91b-44f7-885d-eb27b77e31cd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5964959f76-j4qwh\" (UID: \"74ee6da0-f91b-44f7-885d-eb27b77e31cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5964959f76-j4qwh" Jul 12 18:17:35.980527 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.976205 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m24lw\" (UniqueName: \"kubernetes.io/projected/825cd750-23e2-4d29-b589-3c6979f89e51-kube-api-access-m24lw\") pod \"network-check-source-869dcfcdcd-2r98h\" (UID: \"825cd750-23e2-4d29-b589-3c6979f89e51\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2r98h" Jul 12 18:17:35.980527 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.976786 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8fb34b4a-251b-4a6e-b7b5-33cc7a4c9080-tmp\") pod \"klusterlet-addon-workmgr-794cd8c9cf-qfxgt\" (UID: \"8fb34b4a-251b-4a6e-b7b5-33cc7a4c9080\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794cd8c9cf-qfxgt" Jul 12 18:17:35.980527 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:35.977002 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 18:17:35.980527 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:35.977061 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs podName:92c9c69e-5148-4be6-a348-7bb634c94566 nodeName:}" failed. No retries permitted until 2026-07-12 18:18:07.977042509 +0000 UTC m=+67.675801656 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs") pod "network-metrics-daemon-vn8dd" (UID: "92c9c69e-5148-4be6-a348-7bb634c94566") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 18:17:35.980527 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.977439 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b6faf85-3504-427a-92ed-68183d48e409-additional-service-ca\") pod \"cluster-proxy-proxy-agent-8485678674-2lvvw\" (UID: \"1b6faf85-3504-427a-92ed-68183d48e409\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" Jul 12 18:17:35.980527 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:35.977532 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 18:17:35.980527 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:35.977607 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-metrics-tls podName:49f40bf4-3d5d-4007-b2aa-5b8f0827e823 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:36.477590844 +0000 UTC m=+36.176349994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-metrics-tls") pod "dns-default-sb6tz" (UID: "49f40bf4-3d5d-4007-b2aa-5b8f0827e823") : secret "dns-default-metrics-tls" not found Jul 12 18:17:35.980527 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:35.977671 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 12 18:17:35.980527 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:35.977707 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-samples-operator-tls podName:9b74ea4d-756d-4b37-87a9-ed24c4bbc2da nodeName:}" failed. No retries permitted until 2026-07-12 18:17:36.477696093 +0000 UTC m=+36.176455254 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-samples-operator-tls") pod "cluster-samples-operator-65db858894-c7q7q" (UID: "9b74ea4d-756d-4b37-87a9-ed24c4bbc2da") : secret "samples-operator-tls" not found Jul 12 18:17:35.980527 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.979023 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-config-volume\") pod \"dns-default-sb6tz\" (UID: \"49f40bf4-3d5d-4007-b2aa-5b8f0827e823\") " pod="openshift-dns/dns-default-sb6tz" Jul 12 18:17:35.981312 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.980770 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-tmp-dir\") pod \"dns-default-sb6tz\" (UID: \"49f40bf4-3d5d-4007-b2aa-5b8f0827e823\") " pod="openshift-dns/dns-default-sb6tz" Jul 12 18:17:35.990855 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.989575 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz6hv\" (UniqueName: \"kubernetes.io/projected/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-kube-api-access-qz6hv\") pod \"dns-default-sb6tz\" (UID: \"49f40bf4-3d5d-4007-b2aa-5b8f0827e823\") " pod="openshift-dns/dns-default-sb6tz" Jul 12 18:17:35.990855 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.990222 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/74ee6da0-f91b-44f7-885d-eb27b77e31cd-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5964959f76-j4qwh\" (UID: \"74ee6da0-f91b-44f7-885d-eb27b77e31cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5964959f76-j4qwh" Jul 12 18:17:35.990855 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.990341 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/345aaa00-6a0b-46e1-be63-285fed5a8614-cert\") pod \"ingress-canary-wdmq2\" (UID: \"345aaa00-6a0b-46e1-be63-285fed5a8614\") " pod="openshift-ingress-canary/ingress-canary-wdmq2" Jul 12 18:17:35.990855 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.990766 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m24lw\" (UniqueName: \"kubernetes.io/projected/825cd750-23e2-4d29-b589-3c6979f89e51-kube-api-access-m24lw\") pod \"network-check-source-869dcfcdcd-2r98h\" (UID: \"825cd750-23e2-4d29-b589-3c6979f89e51\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2r98h" Jul 12 18:17:35.993358 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.992706 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ddwb\" (UniqueName: \"kubernetes.io/projected/345aaa00-6a0b-46e1-be63-285fed5a8614-kube-api-access-6ddwb\") pod \"ingress-canary-wdmq2\" (UID: \"345aaa00-6a0b-46e1-be63-285fed5a8614\") " pod="openshift-ingress-canary/ingress-canary-wdmq2" Jul 12 18:17:35.993358 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.992940 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/1b6faf85-3504-427a-92ed-68183d48e409-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-8485678674-2lvvw\" (UID: \"1b6faf85-3504-427a-92ed-68183d48e409\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" Jul 12 18:17:35.993358 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.992995 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1b6faf85-3504-427a-92ed-68183d48e409-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-8485678674-2lvvw\" (UID: \"1b6faf85-3504-427a-92ed-68183d48e409\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" Jul 12 18:17:35.993358 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.993186 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzmbg\" (UniqueName: \"kubernetes.io/projected/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-kube-api-access-bzmbg\") pod \"cluster-samples-operator-65db858894-c7q7q\" (UID: \"9b74ea4d-756d-4b37-87a9-ed24c4bbc2da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-c7q7q" Jul 12 18:17:35.993746 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.993580 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/1b6faf85-3504-427a-92ed-68183d48e409-ca\") pod \"cluster-proxy-proxy-agent-8485678674-2lvvw\" (UID: \"1b6faf85-3504-427a-92ed-68183d48e409\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" Jul 12 18:17:35.994533 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.994491 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kn76\" (UniqueName: \"kubernetes.io/projected/d46d24aa-b5cf-4607-84ae-53ff23de58d9-kube-api-access-7kn76\") pod \"network-check-target-sk4z9\" (UID: \"d46d24aa-b5cf-4607-84ae-53ff23de58d9\") " pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:35.995472 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.995281 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/1b6faf85-3504-427a-92ed-68183d48e409-hub\") pod \"cluster-proxy-proxy-agent-8485678674-2lvvw\" (UID: \"1b6faf85-3504-427a-92ed-68183d48e409\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" Jul 12 18:17:35.995472 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.995320 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8fb34b4a-251b-4a6e-b7b5-33cc7a4c9080-klusterlet-config\") pod \"klusterlet-addon-workmgr-794cd8c9cf-qfxgt\" (UID: \"8fb34b4a-251b-4a6e-b7b5-33cc7a4c9080\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794cd8c9cf-qfxgt" Jul 12 18:17:35.995877 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.995835 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45q8k\" (UniqueName: \"kubernetes.io/projected/74ee6da0-f91b-44f7-885d-eb27b77e31cd-kube-api-access-45q8k\") pod \"managed-serviceaccount-addon-agent-5964959f76-j4qwh\" (UID: \"74ee6da0-f91b-44f7-885d-eb27b77e31cd\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5964959f76-j4qwh" Jul 12 18:17:35.997409 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.997355 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kqx4\" (UniqueName: \"kubernetes.io/projected/1b6faf85-3504-427a-92ed-68183d48e409-kube-api-access-5kqx4\") pod \"cluster-proxy-proxy-agent-8485678674-2lvvw\" (UID: \"1b6faf85-3504-427a-92ed-68183d48e409\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" Jul 12 18:17:35.997516 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:35.997501 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5fn4\" (UniqueName: \"kubernetes.io/projected/8fb34b4a-251b-4a6e-b7b5-33cc7a4c9080-kube-api-access-c5fn4\") pod \"klusterlet-addon-workmgr-794cd8c9cf-qfxgt\" (UID: \"8fb34b4a-251b-4a6e-b7b5-33cc7a4c9080\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794cd8c9cf-qfxgt" Jul 12 18:17:36.036787 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.036704 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fshtt"] Jul 12 18:17:36.043141 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:36.043110 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d306591_de63_43a6_bd91_ee8977eb6ed1.slice/crio-ff289bcfff33cb57e50e286f9bf68f98e421bbd8b62db9d6d2c8e42b9bff3f13 WatchSource:0}: Error finding container ff289bcfff33cb57e50e286f9bf68f98e421bbd8b62db9d6d2c8e42b9bff3f13: Status 404 returned error can't find the container with id ff289bcfff33cb57e50e286f9bf68f98e421bbd8b62db9d6d2c8e42b9bff3f13 Jul 12 18:17:36.065156 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.062978 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wdmq2" Jul 12 18:17:36.066392 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.066326 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2r98h" Jul 12 18:17:36.074677 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.074652 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794cd8c9cf-qfxgt" Jul 12 18:17:36.077612 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.077519 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dftms"] Jul 12 18:17:36.077677 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.077656 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret\") pod \"global-pull-secret-syncer-fsg86\" (UID: \"27d0cbdc-10e6-4e60-8b17-c278fe65e4ec\") " pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:36.077805 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:36.077789 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 18:17:36.077874 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:36.077862 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret podName:27d0cbdc-10e6-4e60-8b17-c278fe65e4ec nodeName:}" failed. No retries permitted until 2026-07-12 18:18:08.077842244 +0000 UTC m=+67.776601395 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret") pod "global-pull-secret-syncer-fsg86" (UID: "27d0cbdc-10e6-4e60-8b17-c278fe65e4ec") : object "kube-system"/"original-pull-secret" not registered Jul 12 18:17:36.080662 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:36.080623 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70800a37_aba0_4678_9ed7_cc45c5e7ec49.slice/crio-4a5733e82d1b6ae37a0798a494363c24899bbe29427216e80d4d7dd2a87a7643 WatchSource:0}: Error finding container 4a5733e82d1b6ae37a0798a494363c24899bbe29427216e80d4d7dd2a87a7643: Status 404 returned error can't find the container with id 4a5733e82d1b6ae37a0798a494363c24899bbe29427216e80d4d7dd2a87a7643 Jul 12 18:17:36.106443 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.106412 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-b2gj4"] Jul 12 18:17:36.109820 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.109740 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" Jul 12 18:17:36.111282 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:36.111055 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bd8be73_d59a_4c4d_945b_eff5f7563c73.slice/crio-08ad6e2c0a9b0c3bd977c00f03e5bcf7add0a7b5384b7b2f882d7882a94d6497 WatchSource:0}: Error finding container 08ad6e2c0a9b0c3bd977c00f03e5bcf7add0a7b5384b7b2f882d7882a94d6497: Status 404 returned error can't find the container with id 08ad6e2c0a9b0c3bd977c00f03e5bcf7add0a7b5384b7b2f882d7882a94d6497 Jul 12 18:17:36.114621 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.114436 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5964959f76-j4qwh" Jul 12 18:17:36.137309 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.135295 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-xm669"] Jul 12 18:17:36.139728 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:36.139687 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92b6d641_802b_4005_9a45_c623d3403694.slice/crio-87e10bba7080cd3398a424309f31f1bd81647d23f4ee77f5d4239b59012f22fa WatchSource:0}: Error finding container 87e10bba7080cd3398a424309f31f1bd81647d23f4ee77f5d4239b59012f22fa: Status 404 returned error can't find the container with id 87e10bba7080cd3398a424309f31f1bd81647d23f4ee77f5d4239b59012f22fa Jul 12 18:17:36.140430 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.140356 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ps4wq"] Jul 12 18:17:36.145678 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:36.145658 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05d80244_fc3e_45d4_a192_6385aff3addf.slice/crio-e781da038a1067371d8e042963658cab189e66782aa1dc443c42a978384a2d30 WatchSource:0}: Error finding container e781da038a1067371d8e042963658cab189e66782aa1dc443c42a978384a2d30: Status 404 returned error can't find the container with id e781da038a1067371d8e042963658cab189e66782aa1dc443c42a978384a2d30 Jul 12 18:17:36.255332 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.255262 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wdmq2"] Jul 12 18:17:36.280013 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.279868 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:36.280013 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.279936 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57408f9d-028f-4d6b-a6b2-5a8e070a2969-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-g8mzg\" (UID: \"57408f9d-028f-4d6b-a6b2-5a8e070a2969\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg" Jul 12 18:17:36.280258 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:36.280068 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 18:17:36.280258 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:36.280102 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59b9cc7b5c-xxvn5: secret "image-registry-tls" not found Jul 12 18:17:36.280258 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:36.280168 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls podName:f180a514-4acc-4c23-8a5a-e14a34d00f02 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:37.280145992 +0000 UTC m=+36.978905144 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls") pod "image-registry-59b9cc7b5c-xxvn5" (UID: "f180a514-4acc-4c23-8a5a-e14a34d00f02") : secret "image-registry-tls" not found Jul 12 18:17:36.280604 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:36.280545 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 12 18:17:36.280772 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:36.280757 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57408f9d-028f-4d6b-a6b2-5a8e070a2969-cluster-monitoring-operator-tls podName:57408f9d-028f-4d6b-a6b2-5a8e070a2969 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:37.280736402 +0000 UTC m=+36.979495572 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/57408f9d-028f-4d6b-a6b2-5a8e070a2969-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-g8mzg" (UID: "57408f9d-028f-4d6b-a6b2-5a8e070a2969") : secret "cluster-monitoring-operator-tls" not found Jul 12 18:17:36.297066 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.296382 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-2r98h"] Jul 12 18:17:36.299289 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:36.299254 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod825cd750_23e2_4d29_b589_3c6979f89e51.slice/crio-b7dc8e5dcdc17aac25f9e2d13a8c4caa57dc8907447d00453a3b423c60fa87df WatchSource:0}: Error finding container b7dc8e5dcdc17aac25f9e2d13a8c4caa57dc8907447d00453a3b423c60fa87df: Status 404 returned error can't find the container with id b7dc8e5dcdc17aac25f9e2d13a8c4caa57dc8907447d00453a3b423c60fa87df Jul 12 18:17:36.320908 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.320878 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5964959f76-j4qwh"] Jul 12 18:17:36.326277 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:36.326241 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74ee6da0_f91b_44f7_885d_eb27b77e31cd.slice/crio-4762506a08035aa15b4c33e287000cf2160909e14b377bc0f0e95300e2953ed9 WatchSource:0}: Error finding container 4762506a08035aa15b4c33e287000cf2160909e14b377bc0f0e95300e2953ed9: Status 404 returned error can't find the container with id 4762506a08035aa15b4c33e287000cf2160909e14b377bc0f0e95300e2953ed9 Jul 12 18:17:36.352688 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.352619 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-794cd8c9cf-qfxgt"] Jul 12 18:17:36.355337 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:36.355308 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fb34b4a_251b_4a6e_b7b5_33cc7a4c9080.slice/crio-a6fc92d3145a46d77dbfabcb867720da4b1ff7721898904af1ce944e45301975 WatchSource:0}: Error finding container a6fc92d3145a46d77dbfabcb867720da4b1ff7721898904af1ce944e45301975: Status 404 returned error can't find the container with id a6fc92d3145a46d77dbfabcb867720da4b1ff7721898904af1ce944e45301975 Jul 12 18:17:36.367882 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.367854 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw"] Jul 12 18:17:36.371057 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:36.371035 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b6faf85_3504_427a_92ed_68183d48e409.slice/crio-3554810f408542270865314fc8a7f6666a71a6401b14483a9c88da9475c6b130 WatchSource:0}: Error finding container 3554810f408542270865314fc8a7f6666a71a6401b14483a9c88da9475c6b130: Status 404 returned error can't find the container with id 3554810f408542270865314fc8a7f6666a71a6401b14483a9c88da9475c6b130 Jul 12 18:17:36.381419 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.381393 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-j8b8n\" (UID: \"888ee972-d5e3-4714-a5ee-83d604c9d2d3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-j8b8n" Jul 12 18:17:36.381495 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.381464 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-metrics-certs\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:36.381495 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.381488 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76307ceb-8deb-4dcf-ac3b-0a446216a225-service-ca-bundle\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:36.381567 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:36.381531 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 12 18:17:36.381606 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:36.381584 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert podName:888ee972-d5e3-4714-a5ee-83d604c9d2d3 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:37.381570096 +0000 UTC m=+37.080329242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-j8b8n" (UID: "888ee972-d5e3-4714-a5ee-83d604c9d2d3") : secret "networking-console-plugin-cert" not found Jul 12 18:17:36.381606 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:36.381601 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 12 18:17:36.381673 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:36.381614 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76307ceb-8deb-4dcf-ac3b-0a446216a225-service-ca-bundle podName:76307ceb-8deb-4dcf-ac3b-0a446216a225 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:37.381599215 +0000 UTC m=+37.080358367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/76307ceb-8deb-4dcf-ac3b-0a446216a225-service-ca-bundle") pod "router-default-5bb454b654-mgfsz" (UID: "76307ceb-8deb-4dcf-ac3b-0a446216a225") : configmap references non-existent config key: service-ca.crt Jul 12 18:17:36.381673 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:36.381638 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-metrics-certs podName:76307ceb-8deb-4dcf-ac3b-0a446216a225 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:37.381627602 +0000 UTC m=+37.080386771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-metrics-certs") pod "router-default-5bb454b654-mgfsz" (UID: "76307ceb-8deb-4dcf-ac3b-0a446216a225") : secret "router-metrics-certs-default" not found Jul 12 18:17:36.482796 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.482758 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-metrics-tls\") pod \"dns-default-sb6tz\" (UID: \"49f40bf4-3d5d-4007-b2aa-5b8f0827e823\") " pod="openshift-dns/dns-default-sb6tz" Jul 12 18:17:36.482796 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.482798 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-c7q7q\" (UID: \"9b74ea4d-756d-4b37-87a9-ed24c4bbc2da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-c7q7q" Jul 12 18:17:36.483041 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:36.482872 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 18:17:36.483041 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:36.482888 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 12 18:17:36.483041 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:36.482928 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-metrics-tls podName:49f40bf4-3d5d-4007-b2aa-5b8f0827e823 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:37.482913718 +0000 UTC m=+37.181672863 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-metrics-tls") pod "dns-default-sb6tz" (UID: "49f40bf4-3d5d-4007-b2aa-5b8f0827e823") : secret "dns-default-metrics-tls" not found Jul 12 18:17:36.483041 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:36.482942 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-samples-operator-tls podName:9b74ea4d-756d-4b37-87a9-ed24c4bbc2da nodeName:}" failed. No retries permitted until 2026-07-12 18:17:37.482935575 +0000 UTC m=+37.181694721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-samples-operator-tls") pod "cluster-samples-operator-65db858894-c7q7q" (UID: "9b74ea4d-756d-4b37-87a9-ed24c4bbc2da") : secret "samples-operator-tls" not found Jul 12 18:17:36.487630 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.487603 2556 generic.go:356] "Generic (PLEG): container finished" podID="db4af9d8-455a-4a29-bb79-8ba71a1b0ca6" containerID="08561e10cc6bf125149c29ea990760423874a3eb4a74bf45a9fa5d8537af49f5" exitCode=0 Jul 12 18:17:36.487756 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.487679 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8xtv" event={"ID":"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6","Type":"ContainerDied","Data":"08561e10cc6bf125149c29ea990760423874a3eb4a74bf45a9fa5d8537af49f5"} Jul 12 18:17:36.488774 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.488753 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" event={"ID":"1b6faf85-3504-427a-92ed-68183d48e409","Type":"ContainerStarted","Data":"3554810f408542270865314fc8a7f6666a71a6401b14483a9c88da9475c6b130"} Jul 12 18:17:36.489878 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.489859 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ps4wq" event={"ID":"05d80244-fc3e-45d4-a192-6385aff3addf","Type":"ContainerStarted","Data":"e781da038a1067371d8e042963658cab189e66782aa1dc443c42a978384a2d30"} Jul 12 18:17:36.491114 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.491003 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dftms" event={"ID":"70800a37-aba0-4678-9ed7-cc45c5e7ec49","Type":"ContainerStarted","Data":"4a5733e82d1b6ae37a0798a494363c24899bbe29427216e80d4d7dd2a87a7643"} Jul 12 18:17:36.492018 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.491999 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794cd8c9cf-qfxgt" event={"ID":"8fb34b4a-251b-4a6e-b7b5-33cc7a4c9080","Type":"ContainerStarted","Data":"a6fc92d3145a46d77dbfabcb867720da4b1ff7721898904af1ce944e45301975"} Jul 12 18:17:36.492945 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.492929 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xm669" event={"ID":"92b6d641-802b-4005-9a45-c623d3403694","Type":"ContainerStarted","Data":"87e10bba7080cd3398a424309f31f1bd81647d23f4ee77f5d4239b59012f22fa"} Jul 12 18:17:36.494029 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.493999 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wdmq2" event={"ID":"345aaa00-6a0b-46e1-be63-285fed5a8614","Type":"ContainerStarted","Data":"50b256d0b12508ee6ad39f23a214de933f4a5287f4d6a77900d15dd800a26aa7"} Jul 12 18:17:36.495018 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.495000 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-b2gj4" event={"ID":"3bd8be73-d59a-4c4d-945b-eff5f7563c73","Type":"ContainerStarted","Data":"08ad6e2c0a9b0c3bd977c00f03e5bcf7add0a7b5384b7b2f882d7882a94d6497"} Jul 12 18:17:36.496006 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.495986 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fshtt" event={"ID":"3d306591-de63-43a6-bd91-ee8977eb6ed1","Type":"ContainerStarted","Data":"ff289bcfff33cb57e50e286f9bf68f98e421bbd8b62db9d6d2c8e42b9bff3f13"} Jul 12 18:17:36.496988 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.496968 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5964959f76-j4qwh" event={"ID":"74ee6da0-f91b-44f7-885d-eb27b77e31cd","Type":"ContainerStarted","Data":"4762506a08035aa15b4c33e287000cf2160909e14b377bc0f0e95300e2953ed9"} Jul 12 18:17:36.498013 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:36.497995 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2r98h" event={"ID":"825cd750-23e2-4d29-b589-3c6979f89e51","Type":"ContainerStarted","Data":"b7dc8e5dcdc17aac25f9e2d13a8c4caa57dc8907447d00453a3b423c60fa87df"} Jul 12 18:17:37.291275 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:37.291237 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:37.291457 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:37.291314 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57408f9d-028f-4d6b-a6b2-5a8e070a2969-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-g8mzg\" (UID: \"57408f9d-028f-4d6b-a6b2-5a8e070a2969\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg" Jul 12 18:17:37.291568 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:37.291550 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 12 18:17:37.291630 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:37.291625 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57408f9d-028f-4d6b-a6b2-5a8e070a2969-cluster-monitoring-operator-tls podName:57408f9d-028f-4d6b-a6b2-5a8e070a2969 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:39.291603239 +0000 UTC m=+38.990362399 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/57408f9d-028f-4d6b-a6b2-5a8e070a2969-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-g8mzg" (UID: "57408f9d-028f-4d6b-a6b2-5a8e070a2969") : secret "cluster-monitoring-operator-tls" not found Jul 12 18:17:37.292053 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:37.292034 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 18:17:37.292157 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:37.292057 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59b9cc7b5c-xxvn5: secret "image-registry-tls" not found Jul 12 18:17:37.292157 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:37.292116 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls podName:f180a514-4acc-4c23-8a5a-e14a34d00f02 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:39.292099201 +0000 UTC m=+38.990858351 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls") pod "image-registry-59b9cc7b5c-xxvn5" (UID: "f180a514-4acc-4c23-8a5a-e14a34d00f02") : secret "image-registry-tls" not found Jul 12 18:17:37.335403 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:37.335368 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:37.335862 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:37.335841 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:17:37.336335 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:37.336316 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:17:37.339998 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:37.339794 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 12 18:17:37.342112 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:37.341661 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 12 18:17:37.342112 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:37.341896 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hb5mg\"" Jul 12 18:17:37.342112 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:37.342060 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p9cbp\"" Jul 12 18:17:37.352329 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:37.352151 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:37.392458 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:37.392429 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-metrics-certs\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:37.392821 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:37.392476 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76307ceb-8deb-4dcf-ac3b-0a446216a225-service-ca-bundle\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:37.392821 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:37.392603 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-j8b8n\" (UID: \"888ee972-d5e3-4714-a5ee-83d604c9d2d3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-j8b8n" Jul 12 18:17:37.392821 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:37.392813 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 12 18:17:37.392963 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:37.392877 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert podName:888ee972-d5e3-4714-a5ee-83d604c9d2d3 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:39.392857167 +0000 UTC m=+39.091616316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-j8b8n" (UID: "888ee972-d5e3-4714-a5ee-83d604c9d2d3") : secret "networking-console-plugin-cert" not found Jul 12 18:17:37.393147 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:37.393128 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76307ceb-8deb-4dcf-ac3b-0a446216a225-service-ca-bundle podName:76307ceb-8deb-4dcf-ac3b-0a446216a225 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:39.393112157 +0000 UTC m=+39.091871307 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/76307ceb-8deb-4dcf-ac3b-0a446216a225-service-ca-bundle") pod "router-default-5bb454b654-mgfsz" (UID: "76307ceb-8deb-4dcf-ac3b-0a446216a225") : configmap references non-existent config key: service-ca.crt Jul 12 18:17:37.393243 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:37.393212 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 12 18:17:37.393399 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:37.393285 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-metrics-certs podName:76307ceb-8deb-4dcf-ac3b-0a446216a225 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:39.39327213 +0000 UTC m=+39.092031277 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-metrics-certs") pod "router-default-5bb454b654-mgfsz" (UID: "76307ceb-8deb-4dcf-ac3b-0a446216a225") : secret "router-metrics-certs-default" not found Jul 12 18:17:37.494291 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:37.494258 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-metrics-tls\") pod \"dns-default-sb6tz\" (UID: \"49f40bf4-3d5d-4007-b2aa-5b8f0827e823\") " pod="openshift-dns/dns-default-sb6tz" Jul 12 18:17:37.494517 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:37.494301 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-c7q7q\" (UID: \"9b74ea4d-756d-4b37-87a9-ed24c4bbc2da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-c7q7q" Jul 12 18:17:37.495413 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:37.495391 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 12 18:17:37.495534 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:37.495458 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-samples-operator-tls podName:9b74ea4d-756d-4b37-87a9-ed24c4bbc2da nodeName:}" failed. No retries permitted until 2026-07-12 18:17:39.495438042 +0000 UTC m=+39.194197201 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-samples-operator-tls") pod "cluster-samples-operator-65db858894-c7q7q" (UID: "9b74ea4d-756d-4b37-87a9-ed24c4bbc2da") : secret "samples-operator-tls" not found Jul 12 18:17:37.495892 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:37.495873 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 18:17:37.496031 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:37.495926 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-metrics-tls podName:49f40bf4-3d5d-4007-b2aa-5b8f0827e823 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:39.495909853 +0000 UTC m=+39.194669016 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-metrics-tls") pod "dns-default-sb6tz" (UID: "49f40bf4-3d5d-4007-b2aa-5b8f0827e823") : secret "dns-default-metrics-tls" not found Jul 12 18:17:37.527180 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:37.527147 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j8xtv" event={"ID":"db4af9d8-455a-4a29-bb79-8ba71a1b0ca6","Type":"ContainerStarted","Data":"afd71fb053d5fda2f63be51afe1ae3eb9f9d8eacafd933a9fea7153f3ccb9842"} Jul 12 18:17:37.553339 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:37.553232 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j8xtv" podStartSLOduration=8.647958632 podStartE2EDuration="35.553210771s" totalImagesPullingTime="26.905252139s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 18:17:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:17:37.552341263 +0000 UTC m=+37.251100431" watchObservedRunningTime="2026-07-12 18:17:37.553210771 +0000 UTC m=+37.251969940" Jul 12 18:17:38.157517 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:38.157277 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sk4z9"] Jul 12 18:17:38.231058 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:17:38.231013 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd46d24aa_b5cf_4607_84ae_53ff23de58d9.slice/crio-f3d255acb3f7d3d940b2bd32289e47ca7001e90f9014d05c7cd4b314af4f6c95 WatchSource:0}: Error finding container f3d255acb3f7d3d940b2bd32289e47ca7001e90f9014d05c7cd4b314af4f6c95: Status 404 returned error can't find the container with id f3d255acb3f7d3d940b2bd32289e47ca7001e90f9014d05c7cd4b314af4f6c95 Jul 12 18:17:38.541248 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:38.541165 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sk4z9" event={"ID":"d46d24aa-b5cf-4607-84ae-53ff23de58d9","Type":"ContainerStarted","Data":"f3d255acb3f7d3d940b2bd32289e47ca7001e90f9014d05c7cd4b314af4f6c95"} Jul 12 18:17:38.582701 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:38.582657 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fshtt" event={"ID":"3d306591-de63-43a6-bd91-ee8977eb6ed1","Type":"ContainerStarted","Data":"f85a09d101c9a311cfcef3f581e75831d7b4e89809b1f3da69271cfb44cd545d"} Jul 12 18:17:38.600190 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:38.599195 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-fshtt" podStartSLOduration=29.407850813 podStartE2EDuration="31.599173779s" totalImagesPullingTime="2.191322966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:17:38.59914057 +0000 UTC m=+38.297899738" watchObservedRunningTime="2026-07-12 18:17:38.599173779 +0000 UTC m=+38.297932948" Jul 12 18:17:39.315924 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:39.315681 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:39.316109 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:39.315980 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57408f9d-028f-4d6b-a6b2-5a8e070a2969-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-g8mzg\" (UID: \"57408f9d-028f-4d6b-a6b2-5a8e070a2969\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg" Jul 12 18:17:39.316249 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:39.316170 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 12 18:17:39.316249 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:39.316235 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57408f9d-028f-4d6b-a6b2-5a8e070a2969-cluster-monitoring-operator-tls podName:57408f9d-028f-4d6b-a6b2-5a8e070a2969 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:43.316215407 +0000 UTC m=+43.014974557 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/57408f9d-028f-4d6b-a6b2-5a8e070a2969-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-g8mzg" (UID: "57408f9d-028f-4d6b-a6b2-5a8e070a2969") : secret "cluster-monitoring-operator-tls" not found Jul 12 18:17:39.316672 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:39.316650 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 18:17:39.316672 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:39.316673 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59b9cc7b5c-xxvn5: secret "image-registry-tls" not found Jul 12 18:17:39.316796 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:39.316721 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls podName:f180a514-4acc-4c23-8a5a-e14a34d00f02 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:43.316705566 +0000 UTC m=+43.015464726 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls") pod "image-registry-59b9cc7b5c-xxvn5" (UID: "f180a514-4acc-4c23-8a5a-e14a34d00f02") : secret "image-registry-tls" not found Jul 12 18:17:39.416987 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:39.416949 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-j8b8n\" (UID: \"888ee972-d5e3-4714-a5ee-83d604c9d2d3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-j8b8n" Jul 12 18:17:39.417175 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:39.417056 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-metrics-certs\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:39.417175 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:39.417108 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76307ceb-8deb-4dcf-ac3b-0a446216a225-service-ca-bundle\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:39.417336 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:39.417318 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76307ceb-8deb-4dcf-ac3b-0a446216a225-service-ca-bundle podName:76307ceb-8deb-4dcf-ac3b-0a446216a225 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:43.417297286 +0000 UTC m=+43.116056455 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/76307ceb-8deb-4dcf-ac3b-0a446216a225-service-ca-bundle") pod "router-default-5bb454b654-mgfsz" (UID: "76307ceb-8deb-4dcf-ac3b-0a446216a225") : configmap references non-existent config key: service-ca.crt Jul 12 18:17:39.417773 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:39.417753 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 12 18:17:39.417858 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:39.417809 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert podName:888ee972-d5e3-4714-a5ee-83d604c9d2d3 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:43.417793893 +0000 UTC m=+43.116553042 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-j8b8n" (UID: "888ee972-d5e3-4714-a5ee-83d604c9d2d3") : secret "networking-console-plugin-cert" not found Jul 12 18:17:39.417925 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:39.417870 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 12 18:17:39.417925 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:39.417902 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-metrics-certs podName:76307ceb-8deb-4dcf-ac3b-0a446216a225 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:43.417892624 +0000 UTC m=+43.116651770 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-metrics-certs") pod "router-default-5bb454b654-mgfsz" (UID: "76307ceb-8deb-4dcf-ac3b-0a446216a225") : secret "router-metrics-certs-default" not found Jul 12 18:17:39.518214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:39.517804 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-metrics-tls\") pod \"dns-default-sb6tz\" (UID: \"49f40bf4-3d5d-4007-b2aa-5b8f0827e823\") " pod="openshift-dns/dns-default-sb6tz" Jul 12 18:17:39.518214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:39.517850 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-c7q7q\" (UID: \"9b74ea4d-756d-4b37-87a9-ed24c4bbc2da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-c7q7q" Jul 12 18:17:39.518214 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:39.518072 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 12 18:17:39.518214 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:39.518117 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 18:17:39.518214 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:39.518163 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-samples-operator-tls podName:9b74ea4d-756d-4b37-87a9-ed24c4bbc2da nodeName:}" failed. No retries permitted until 2026-07-12 18:17:43.518142785 +0000 UTC m=+43.216901951 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-samples-operator-tls") pod "cluster-samples-operator-65db858894-c7q7q" (UID: "9b74ea4d-756d-4b37-87a9-ed24c4bbc2da") : secret "samples-operator-tls" not found Jul 12 18:17:39.518214 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:39.518187 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-metrics-tls podName:49f40bf4-3d5d-4007-b2aa-5b8f0827e823 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:43.518176294 +0000 UTC m=+43.216935440 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-metrics-tls") pod "dns-default-sb6tz" (UID: "49f40bf4-3d5d-4007-b2aa-5b8f0827e823") : secret "dns-default-metrics-tls" not found Jul 12 18:17:43.358992 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:43.358951 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57408f9d-028f-4d6b-a6b2-5a8e070a2969-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-g8mzg\" (UID: \"57408f9d-028f-4d6b-a6b2-5a8e070a2969\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg" Jul 12 18:17:43.359651 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:43.359149 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 12 18:17:43.359651 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:43.359236 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:43.359651 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:43.359252 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57408f9d-028f-4d6b-a6b2-5a8e070a2969-cluster-monitoring-operator-tls podName:57408f9d-028f-4d6b-a6b2-5a8e070a2969 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:51.359229613 +0000 UTC m=+51.057988782 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/57408f9d-028f-4d6b-a6b2-5a8e070a2969-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-g8mzg" (UID: "57408f9d-028f-4d6b-a6b2-5a8e070a2969") : secret "cluster-monitoring-operator-tls" not found Jul 12 18:17:43.359651 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:43.359338 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 18:17:43.359651 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:43.359354 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59b9cc7b5c-xxvn5: secret "image-registry-tls" not found Jul 12 18:17:43.359651 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:43.359401 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls podName:f180a514-4acc-4c23-8a5a-e14a34d00f02 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:51.359386293 +0000 UTC m=+51.058145441 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls") pod "image-registry-59b9cc7b5c-xxvn5" (UID: "f180a514-4acc-4c23-8a5a-e14a34d00f02") : secret "image-registry-tls" not found Jul 12 18:17:43.460741 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:43.460700 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76307ceb-8deb-4dcf-ac3b-0a446216a225-service-ca-bundle\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:43.460936 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:43.460856 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-j8b8n\" (UID: \"888ee972-d5e3-4714-a5ee-83d604c9d2d3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-j8b8n" Jul 12 18:17:43.460936 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:43.460913 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76307ceb-8deb-4dcf-ac3b-0a446216a225-service-ca-bundle podName:76307ceb-8deb-4dcf-ac3b-0a446216a225 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:51.460889028 +0000 UTC m=+51.159648175 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/76307ceb-8deb-4dcf-ac3b-0a446216a225-service-ca-bundle") pod "router-default-5bb454b654-mgfsz" (UID: "76307ceb-8deb-4dcf-ac3b-0a446216a225") : configmap references non-existent config key: service-ca.crt Jul 12 18:17:43.461058 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:43.460975 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 12 18:17:43.461058 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:43.461024 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-metrics-certs\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:43.461187 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:43.461099 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert podName:888ee972-d5e3-4714-a5ee-83d604c9d2d3 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:51.461069626 +0000 UTC m=+51.159828773 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-j8b8n" (UID: "888ee972-d5e3-4714-a5ee-83d604c9d2d3") : secret "networking-console-plugin-cert" not found Jul 12 18:17:43.461187 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:43.461107 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 12 18:17:43.461187 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:43.461151 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-metrics-certs podName:76307ceb-8deb-4dcf-ac3b-0a446216a225 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:51.461135448 +0000 UTC m=+51.159894600 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-metrics-certs") pod "router-default-5bb454b654-mgfsz" (UID: "76307ceb-8deb-4dcf-ac3b-0a446216a225") : secret "router-metrics-certs-default" not found Jul 12 18:17:43.561718 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:43.561676 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-metrics-tls\") pod \"dns-default-sb6tz\" (UID: \"49f40bf4-3d5d-4007-b2aa-5b8f0827e823\") " pod="openshift-dns/dns-default-sb6tz" Jul 12 18:17:43.561718 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:43.561720 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-c7q7q\" (UID: \"9b74ea4d-756d-4b37-87a9-ed24c4bbc2da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-c7q7q" Jul 12 18:17:43.561907 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:43.561817 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 12 18:17:43.561907 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:43.561818 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 18:17:43.561907 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:43.561872 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-samples-operator-tls podName:9b74ea4d-756d-4b37-87a9-ed24c4bbc2da nodeName:}" failed. No retries permitted until 2026-07-12 18:17:51.561858415 +0000 UTC m=+51.260617562 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-samples-operator-tls") pod "cluster-samples-operator-65db858894-c7q7q" (UID: "9b74ea4d-756d-4b37-87a9-ed24c4bbc2da") : secret "samples-operator-tls" not found Jul 12 18:17:43.561907 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:43.561886 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-metrics-tls podName:49f40bf4-3d5d-4007-b2aa-5b8f0827e823 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:51.561880303 +0000 UTC m=+51.260639448 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-metrics-tls") pod "dns-default-sb6tz" (UID: "49f40bf4-3d5d-4007-b2aa-5b8f0827e823") : secret "dns-default-metrics-tls" not found Jul 12 18:17:50.634331 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:50.634290 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2r98h" event={"ID":"825cd750-23e2-4d29-b589-3c6979f89e51","Type":"ContainerStarted","Data":"9f9a0d54f8f9a3bb882bcae437369e2084ce46c35464b989d862618758d778a9"} Jul 12 18:17:50.637833 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:50.636669 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" event={"ID":"1b6faf85-3504-427a-92ed-68183d48e409","Type":"ContainerStarted","Data":"676327213b2eb7f43b3a968fa2ad39e41277444f0ddbe7cb49afbd9a22d1b5c7"} Jul 12 18:17:50.651443 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:50.650340 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ps4wq" event={"ID":"05d80244-fc3e-45d4-a192-6385aff3addf","Type":"ContainerStarted","Data":"506e54585ec104728b9e3753bdffd5eeb2927f8022562cb60f782f95a8b25051"} Jul 12 18:17:50.651443 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:50.651387 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-2r98h" podStartSLOduration=29.61343659 podStartE2EDuration="43.651368868s" totalImagesPullingTime="14.037932278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:17:50.650414755 +0000 UTC m=+50.349173923" watchObservedRunningTime="2026-07-12 18:17:50.651368868 +0000 UTC m=+50.350128032" Jul 12 18:17:50.655266 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:50.654674 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dftms" event={"ID":"70800a37-aba0-4678-9ed7-cc45c5e7ec49","Type":"ContainerStarted","Data":"dc892431e432f6f450b47c4c4d64856bd3a58197a264fe12c3f93c09af1ff87d"} Jul 12 18:17:50.657380 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:50.656688 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xm669" event={"ID":"92b6d641-802b-4005-9a45-c623d3403694","Type":"ContainerStarted","Data":"5466af4ffa9b133309966e2087a6757e0306f65aebbf2255030d74d73f7ac189"} Jul 12 18:17:50.659164 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:50.658902 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wdmq2" event={"ID":"345aaa00-6a0b-46e1-be63-285fed5a8614","Type":"ContainerStarted","Data":"68b9e96b6da38cc58e4213bf0bbf48868b1a8acae9234f4da842c1dbf1dd799a"} Jul 12 18:17:50.662125 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:50.661698 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/0.log" Jul 12 18:17:50.662125 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:50.661732 2556 generic.go:356] "Generic (PLEG): container finished" podID="3bd8be73-d59a-4c4d-945b-eff5f7563c73" containerID="42874bd7d080ebb8a9a25ba15e462766ba24e2c861e800beaffa341b6032cc62" exitCode=255 Jul 12 18:17:50.662125 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:50.661767 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-b2gj4" event={"ID":"3bd8be73-d59a-4c4d-945b-eff5f7563c73","Type":"ContainerDied","Data":"42874bd7d080ebb8a9a25ba15e462766ba24e2c861e800beaffa341b6032cc62"} Jul 12 18:17:50.662125 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:50.662037 2556 scope.go:117] "RemoveContainer" containerID="42874bd7d080ebb8a9a25ba15e462766ba24e2c861e800beaffa341b6032cc62" Jul 12 18:17:50.675025 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:50.674977 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ps4wq" podStartSLOduration=29.528304779 podStartE2EDuration="43.67495599s" totalImagesPullingTime="14.146651211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:17:50.673895542 +0000 UTC m=+50.372654714" watchObservedRunningTime="2026-07-12 18:17:50.67495599 +0000 UTC m=+50.373715159" Jul 12 18:17:50.692435 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:50.691165 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dftms" podStartSLOduration=29.468108403 podStartE2EDuration="43.691143709s" totalImagesPullingTime="14.223035306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:17:50.690434475 +0000 UTC m=+50.389193656" watchObservedRunningTime="2026-07-12 18:17:50.691143709 +0000 UTC m=+50.389902879" Jul 12 18:17:50.774997 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:50.774943 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-xm669" podStartSLOduration=29.621725848 podStartE2EDuration="43.774923814s" totalImagesPullingTime="14.153197966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:17:50.718248929 +0000 UTC m=+50.417008089" watchObservedRunningTime="2026-07-12 18:17:50.774923814 +0000 UTC m=+50.473682986" Jul 12 18:17:50.792888 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:50.792834 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wdmq2" podStartSLOduration=2.349765767 podStartE2EDuration="15.792810706s" totalImagesPullingTime="13.443044939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:17:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:17:50.79190656 +0000 UTC m=+50.490665729" watchObservedRunningTime="2026-07-12 18:17:50.792810706 +0000 UTC m=+50.491569876" Jul 12 18:17:51.435275 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.435234 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:17:51.435481 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.435311 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57408f9d-028f-4d6b-a6b2-5a8e070a2969-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-g8mzg\" (UID: \"57408f9d-028f-4d6b-a6b2-5a8e070a2969\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg" Jul 12 18:17:51.435481 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:51.435423 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 12 18:17:51.435481 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:51.435451 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59b9cc7b5c-xxvn5: secret "image-registry-tls" not found Jul 12 18:17:51.435644 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:51.435482 2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 12 18:17:51.435644 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:51.435514 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls podName:f180a514-4acc-4c23-8a5a-e14a34d00f02 nodeName:}" failed. No retries permitted until 2026-07-12 18:18:07.43549237 +0000 UTC m=+67.134251522 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls") pod "image-registry-59b9cc7b5c-xxvn5" (UID: "f180a514-4acc-4c23-8a5a-e14a34d00f02") : secret "image-registry-tls" not found Jul 12 18:17:51.435644 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:51.435547 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/57408f9d-028f-4d6b-a6b2-5a8e070a2969-cluster-monitoring-operator-tls podName:57408f9d-028f-4d6b-a6b2-5a8e070a2969 nodeName:}" failed. No retries permitted until 2026-07-12 18:18:07.435528692 +0000 UTC m=+67.134287843 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/57408f9d-028f-4d6b-a6b2-5a8e070a2969-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-g8mzg" (UID: "57408f9d-028f-4d6b-a6b2-5a8e070a2969") : secret "cluster-monitoring-operator-tls" not found Jul 12 18:17:51.536245 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.536191 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-j8b8n\" (UID: \"888ee972-d5e3-4714-a5ee-83d604c9d2d3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-j8b8n" Jul 12 18:17:51.536446 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.536307 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-metrics-certs\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:51.536446 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.536335 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76307ceb-8deb-4dcf-ac3b-0a446216a225-service-ca-bundle\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:17:51.536446 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:51.536361 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 12 18:17:51.536446 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:51.536437 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert podName:888ee972-d5e3-4714-a5ee-83d604c9d2d3 nodeName:}" failed. No retries permitted until 2026-07-12 18:18:07.536416719 +0000 UTC m=+67.235175873 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-j8b8n" (UID: "888ee972-d5e3-4714-a5ee-83d604c9d2d3") : secret "networking-console-plugin-cert" not found Jul 12 18:17:51.536652 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:51.536525 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/76307ceb-8deb-4dcf-ac3b-0a446216a225-service-ca-bundle podName:76307ceb-8deb-4dcf-ac3b-0a446216a225 nodeName:}" failed. No retries permitted until 2026-07-12 18:18:07.53650956 +0000 UTC m=+67.235268711 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/76307ceb-8deb-4dcf-ac3b-0a446216a225-service-ca-bundle") pod "router-default-5bb454b654-mgfsz" (UID: "76307ceb-8deb-4dcf-ac3b-0a446216a225") : configmap references non-existent config key: service-ca.crt Jul 12 18:17:51.536652 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:51.536595 2556 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 12 18:17:51.536652 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:51.536628 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-metrics-certs podName:76307ceb-8deb-4dcf-ac3b-0a446216a225 nodeName:}" failed. No retries permitted until 2026-07-12 18:18:07.536617711 +0000 UTC m=+67.235376863 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-metrics-certs") pod "router-default-5bb454b654-mgfsz" (UID: "76307ceb-8deb-4dcf-ac3b-0a446216a225") : secret "router-metrics-certs-default" not found Jul 12 18:17:51.637570 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.637524 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-metrics-tls\") pod \"dns-default-sb6tz\" (UID: \"49f40bf4-3d5d-4007-b2aa-5b8f0827e823\") " pod="openshift-dns/dns-default-sb6tz" Jul 12 18:17:51.638044 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.637576 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-c7q7q\" (UID: \"9b74ea4d-756d-4b37-87a9-ed24c4bbc2da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-c7q7q" Jul 12 18:17:51.638044 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:51.637701 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 12 18:17:51.638044 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:51.637755 2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 12 18:17:51.638044 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:51.637779 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-metrics-tls podName:49f40bf4-3d5d-4007-b2aa-5b8f0827e823 nodeName:}" failed. No retries permitted until 2026-07-12 18:18:07.63775757 +0000 UTC m=+67.336516721 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-metrics-tls") pod "dns-default-sb6tz" (UID: "49f40bf4-3d5d-4007-b2aa-5b8f0827e823") : secret "dns-default-metrics-tls" not found Jul 12 18:17:51.638044 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:51.637829 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-samples-operator-tls podName:9b74ea4d-756d-4b37-87a9-ed24c4bbc2da nodeName:}" failed. No retries permitted until 2026-07-12 18:18:07.637811074 +0000 UTC m=+67.336570230 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-samples-operator-tls") pod "cluster-samples-operator-65db858894-c7q7q" (UID: "9b74ea4d-756d-4b37-87a9-ed24c4bbc2da") : secret "samples-operator-tls" not found Jul 12 18:17:51.668448 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.668367 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/1.log" Jul 12 18:17:51.668872 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.668848 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/0.log" Jul 12 18:17:51.668999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.668895 2556 generic.go:356] "Generic (PLEG): container finished" podID="3bd8be73-d59a-4c4d-945b-eff5f7563c73" containerID="1ad1982f44b91630947c92d7c1e701d59b9d02491afe9ce0115b099d6c1d0d89" exitCode=255 Jul 12 18:17:51.668999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.668989 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-b2gj4" event={"ID":"3bd8be73-d59a-4c4d-945b-eff5f7563c73","Type":"ContainerDied","Data":"1ad1982f44b91630947c92d7c1e701d59b9d02491afe9ce0115b099d6c1d0d89"} Jul 12 18:17:51.669144 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.669040 2556 scope.go:117] "RemoveContainer" containerID="42874bd7d080ebb8a9a25ba15e462766ba24e2c861e800beaffa341b6032cc62" Jul 12 18:17:51.669662 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.669417 2556 scope.go:117] "RemoveContainer" containerID="1ad1982f44b91630947c92d7c1e701d59b9d02491afe9ce0115b099d6c1d0d89" Jul 12 18:17:51.669662 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:51.669614 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-b2gj4_openshift-console-operator(3bd8be73-d59a-4c4d-945b-eff5f7563c73)\"" pod="openshift-console-operator/console-operator-7866497494-b2gj4" podUID="3bd8be73-d59a-4c4d-945b-eff5f7563c73" Jul 12 18:17:51.671104 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.671062 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5964959f76-j4qwh" event={"ID":"74ee6da0-f91b-44f7-885d-eb27b77e31cd","Type":"ContainerStarted","Data":"4741ca1c171e7f258c6af9b0172ba833728ee981a8bd0e70cbeec2850f58fa46"} Jul 12 18:17:51.673986 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.673964 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" event={"ID":"1b6faf85-3504-427a-92ed-68183d48e409","Type":"ContainerStarted","Data":"9469edf67673f2a29e5359654f111e7f5accde34da1194ce0eba7427b7c14aee"} Jul 12 18:17:51.674110 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.674001 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" event={"ID":"1b6faf85-3504-427a-92ed-68183d48e409","Type":"ContainerStarted","Data":"ed4b53c640490576cfbdf648e1da691536ab5211b56b9a932d8be470d00f17d8"} Jul 12 18:17:51.675674 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.675643 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794cd8c9cf-qfxgt" event={"ID":"8fb34b4a-251b-4a6e-b7b5-33cc7a4c9080","Type":"ContainerStarted","Data":"3f51dc00a6678ef2e9f386dd233eb9b0cb5dd8b68d0b6fee1d0b09012d1ebb06"} Jul 12 18:17:51.676117 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.676048 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794cd8c9cf-qfxgt" Jul 12 18:17:51.678188 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.678149 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sk4z9" event={"ID":"d46d24aa-b5cf-4607-84ae-53ff23de58d9","Type":"ContainerStarted","Data":"4883264f60a1029b671020e7caa002dc035f41c482086ee1f80721399973e168"} Jul 12 18:17:51.678643 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.678582 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794cd8c9cf-qfxgt" Jul 12 18:17:51.678643 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.678617 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:17:51.709442 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.709385 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" podStartSLOduration=17.743509083 podStartE2EDuration="31.709368907s" totalImagesPullingTime="13.965859824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:17:51.708404261 +0000 UTC m=+51.407163429" watchObservedRunningTime="2026-07-12 18:17:51.709368907 +0000 UTC m=+51.408128075" Jul 12 18:17:51.725694 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.725636 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5964959f76-j4qwh" podStartSLOduration=17.707095839 podStartE2EDuration="31.72561512s" totalImagesPullingTime="14.018519281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:17:51.724411175 +0000 UTC m=+51.423170355" watchObservedRunningTime="2026-07-12 18:17:51.72561512 +0000 UTC m=+51.424374288" Jul 12 18:17:51.745708 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.745655 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sk4z9" podStartSLOduration=37.642673153 podStartE2EDuration="49.74563525s" totalImagesPullingTime="12.102962097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:17:51.744445209 +0000 UTC m=+51.443204374" watchObservedRunningTime="2026-07-12 18:17:51.74563525 +0000 UTC m=+51.444394419" Jul 12 18:17:51.759434 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:51.759379 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-794cd8c9cf-qfxgt" podStartSLOduration=17.774469733 podStartE2EDuration="31.759363092s" totalImagesPullingTime="13.984893359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:17:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:17:51.758320299 +0000 UTC m=+51.457079471" watchObservedRunningTime="2026-07-12 18:17:51.759363092 +0000 UTC m=+51.458122260" Jul 12 18:17:52.684068 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:52.684040 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/1.log" Jul 12 18:17:52.684657 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:52.684636 2556 scope.go:117] "RemoveContainer" containerID="1ad1982f44b91630947c92d7c1e701d59b9d02491afe9ce0115b099d6c1d0d89" Jul 12 18:17:52.684808 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:52.684789 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-b2gj4_openshift-console-operator(3bd8be73-d59a-4c4d-945b-eff5f7563c73)\"" pod="openshift-console-operator/console-operator-7866497494-b2gj4" podUID="3bd8be73-d59a-4c4d-945b-eff5f7563c73" Jul 12 18:17:53.120662 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:53.120620 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9dh25"] Jul 12 18:17:53.162359 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:53.162319 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9dh25"] Jul 12 18:17:53.162543 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:53.162449 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:17:53.164981 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:53.164947 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 12 18:17:53.165129 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:53.165006 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 12 18:17:53.165129 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:53.165013 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9cwfc\"" Jul 12 18:17:53.253833 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:53.253789 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6225002-0cda-48bf-bf49-b2899fc7add2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:17:53.254012 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:53.253921 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6225002-0cda-48bf-bf49-b2899fc7add2-data-volume\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:17:53.254012 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:53.254006 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6225002-0cda-48bf-bf49-b2899fc7add2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:17:53.254191 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:53.254054 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6225002-0cda-48bf-bf49-b2899fc7add2-crio-socket\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:17:53.254191 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:53.254109 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt92r\" (UniqueName: \"kubernetes.io/projected/c6225002-0cda-48bf-bf49-b2899fc7add2-kube-api-access-pt92r\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:17:53.354780 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:53.354740 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6225002-0cda-48bf-bf49-b2899fc7add2-data-volume\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:17:53.354983 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:53.354921 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6225002-0cda-48bf-bf49-b2899fc7add2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:17:53.354983 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:53.354977 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6225002-0cda-48bf-bf49-b2899fc7add2-crio-socket\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:17:53.355139 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:53.355020 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt92r\" (UniqueName: \"kubernetes.io/projected/c6225002-0cda-48bf-bf49-b2899fc7add2-kube-api-access-pt92r\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:17:53.355139 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:53.355046 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c6225002-0cda-48bf-bf49-b2899fc7add2-crio-socket\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:17:53.355139 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:53.355134 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6225002-0cda-48bf-bf49-b2899fc7add2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:17:53.355280 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:53.355146 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 18:17:53.355280 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:53.355196 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c6225002-0cda-48bf-bf49-b2899fc7add2-data-volume\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:17:53.355280 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:53.355206 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6225002-0cda-48bf-bf49-b2899fc7add2-kube-rbac-proxy-cm podName:c6225002-0cda-48bf-bf49-b2899fc7add2 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:53.855186574 +0000 UTC m=+53.553945735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6225002-0cda-48bf-bf49-b2899fc7add2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9dh25" (UID: "c6225002-0cda-48bf-bf49-b2899fc7add2") : configmap "kube-rbac-proxy" not found Jul 12 18:17:53.355280 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:53.355262 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 18:17:53.355460 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:53.355315 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6225002-0cda-48bf-bf49-b2899fc7add2-insights-runtime-extractor-tls podName:c6225002-0cda-48bf-bf49-b2899fc7add2 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:53.855300647 +0000 UTC m=+53.554059796 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6225002-0cda-48bf-bf49-b2899fc7add2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9dh25" (UID: "c6225002-0cda-48bf-bf49-b2899fc7add2") : secret "insights-runtime-extractor-tls" not found Jul 12 18:17:53.366596 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:53.366566 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt92r\" (UniqueName: \"kubernetes.io/projected/c6225002-0cda-48bf-bf49-b2899fc7add2-kube-api-access-pt92r\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:17:53.859712 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:53.859670 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6225002-0cda-48bf-bf49-b2899fc7add2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:17:53.860191 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:53.859780 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6225002-0cda-48bf-bf49-b2899fc7add2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:17:53.860191 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:53.859791 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 18:17:53.860191 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:53.859854 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6225002-0cda-48bf-bf49-b2899fc7add2-kube-rbac-proxy-cm podName:c6225002-0cda-48bf-bf49-b2899fc7add2 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:54.859838639 +0000 UTC m=+54.558597784 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6225002-0cda-48bf-bf49-b2899fc7add2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9dh25" (UID: "c6225002-0cda-48bf-bf49-b2899fc7add2") : configmap "kube-rbac-proxy" not found Jul 12 18:17:53.860191 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:53.859880 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 18:17:53.860191 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:53.859925 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6225002-0cda-48bf-bf49-b2899fc7add2-insights-runtime-extractor-tls podName:c6225002-0cda-48bf-bf49-b2899fc7add2 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:54.859910522 +0000 UTC m=+54.558669686 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6225002-0cda-48bf-bf49-b2899fc7add2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9dh25" (UID: "c6225002-0cda-48bf-bf49-b2899fc7add2") : secret "insights-runtime-extractor-tls" not found Jul 12 18:17:54.868526 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:54.868484 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6225002-0cda-48bf-bf49-b2899fc7add2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:17:54.868919 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:54.868603 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6225002-0cda-48bf-bf49-b2899fc7add2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:17:54.868919 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:54.868641 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 18:17:54.868919 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:54.868699 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 18:17:54.868919 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:54.868711 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6225002-0cda-48bf-bf49-b2899fc7add2-insights-runtime-extractor-tls podName:c6225002-0cda-48bf-bf49-b2899fc7add2 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:56.868695716 +0000 UTC m=+56.567454861 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6225002-0cda-48bf-bf49-b2899fc7add2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9dh25" (UID: "c6225002-0cda-48bf-bf49-b2899fc7add2") : secret "insights-runtime-extractor-tls" not found Jul 12 18:17:54.868919 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:54.868756 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6225002-0cda-48bf-bf49-b2899fc7add2-kube-rbac-proxy-cm podName:c6225002-0cda-48bf-bf49-b2899fc7add2 nodeName:}" failed. No retries permitted until 2026-07-12 18:17:56.868742508 +0000 UTC m=+56.567501654 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6225002-0cda-48bf-bf49-b2899fc7add2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9dh25" (UID: "c6225002-0cda-48bf-bf49-b2899fc7add2") : configmap "kube-rbac-proxy" not found Jul 12 18:17:55.320319 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:55.320246 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q2sxm_b3030442-56ce-4562-89e3-dbfa9ed9be95/dns-node-resolver/0.log" Jul 12 18:17:55.900401 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:55.900368 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-b2gj4" Jul 12 18:17:55.900980 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:55.900427 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-b2gj4" Jul 12 18:17:55.900980 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:55.900779 2556 scope.go:117] "RemoveContainer" containerID="1ad1982f44b91630947c92d7c1e701d59b9d02491afe9ce0115b099d6c1d0d89" Jul 12 18:17:55.900980 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:55.900926 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-b2gj4_openshift-console-operator(3bd8be73-d59a-4c4d-945b-eff5f7563c73)\"" pod="openshift-console-operator/console-operator-7866497494-b2gj4" podUID="3bd8be73-d59a-4c4d-945b-eff5f7563c73" Jul 12 18:17:56.719566 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:56.719541 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-plght_d273d74a-7734-44c2-ad9a-d3f7662b5ddc/node-ca/0.log" Jul 12 18:17:56.885834 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:56.885791 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6225002-0cda-48bf-bf49-b2899fc7add2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:17:56.886006 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:56.885914 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6225002-0cda-48bf-bf49-b2899fc7add2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:17:56.886006 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:56.885955 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 18:17:56.886102 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:56.886019 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6225002-0cda-48bf-bf49-b2899fc7add2-insights-runtime-extractor-tls podName:c6225002-0cda-48bf-bf49-b2899fc7add2 nodeName:}" failed. No retries permitted until 2026-07-12 18:18:00.886001788 +0000 UTC m=+60.584760934 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6225002-0cda-48bf-bf49-b2899fc7add2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9dh25" (UID: "c6225002-0cda-48bf-bf49-b2899fc7add2") : secret "insights-runtime-extractor-tls" not found Jul 12 18:17:56.886102 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:56.886046 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 18:17:56.886180 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:17:56.886127 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6225002-0cda-48bf-bf49-b2899fc7add2-kube-rbac-proxy-cm podName:c6225002-0cda-48bf-bf49-b2899fc7add2 nodeName:}" failed. No retries permitted until 2026-07-12 18:18:00.886115255 +0000 UTC m=+60.584874405 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6225002-0cda-48bf-bf49-b2899fc7add2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9dh25" (UID: "c6225002-0cda-48bf-bf49-b2899fc7add2") : configmap "kube-rbac-proxy" not found Jul 12 18:17:57.118962 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:57.118935 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wdmq2_345aaa00-6a0b-46e1-be63-285fed5a8614/serve-healthcheck-canary/0.log" Jul 12 18:17:57.919495 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:17:57.919465 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-ps4wq_05d80244-fc3e-45d4-a192-6385aff3addf/kube-storage-version-migrator-operator/0.log" Jul 12 18:18:00.924493 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:00.924449 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6225002-0cda-48bf-bf49-b2899fc7add2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:18:00.924937 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:00.924600 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6225002-0cda-48bf-bf49-b2899fc7add2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:18:00.924937 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:18:00.924616 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 18:18:00.924937 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:18:00.924684 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6225002-0cda-48bf-bf49-b2899fc7add2-insights-runtime-extractor-tls podName:c6225002-0cda-48bf-bf49-b2899fc7add2 nodeName:}" failed. No retries permitted until 2026-07-12 18:18:08.924665199 +0000 UTC m=+68.623424369 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6225002-0cda-48bf-bf49-b2899fc7add2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9dh25" (UID: "c6225002-0cda-48bf-bf49-b2899fc7add2") : secret "insights-runtime-extractor-tls" not found Jul 12 18:18:00.924937 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:18:00.924725 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 12 18:18:00.924937 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:18:00.924790 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c6225002-0cda-48bf-bf49-b2899fc7add2-kube-rbac-proxy-cm podName:c6225002-0cda-48bf-bf49-b2899fc7add2 nodeName:}" failed. No retries permitted until 2026-07-12 18:18:08.924776826 +0000 UTC m=+68.623535972 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c6225002-0cda-48bf-bf49-b2899fc7add2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9dh25" (UID: "c6225002-0cda-48bf-bf49-b2899fc7add2") : configmap "kube-rbac-proxy" not found Jul 12 18:18:01.480787 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:01.480749 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-899r5" Jul 12 18:18:07.335176 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.335138 2556 scope.go:117] "RemoveContainer" containerID="1ad1982f44b91630947c92d7c1e701d59b9d02491afe9ce0115b099d6c1d0d89" Jul 12 18:18:07.480446 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.480409 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:18:07.480637 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.480553 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57408f9d-028f-4d6b-a6b2-5a8e070a2969-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-g8mzg\" (UID: \"57408f9d-028f-4d6b-a6b2-5a8e070a2969\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg" Jul 12 18:18:07.482872 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.482840 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls\") pod \"image-registry-59b9cc7b5c-xxvn5\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:18:07.482999 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.482978 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/57408f9d-028f-4d6b-a6b2-5a8e070a2969-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-g8mzg\" (UID: \"57408f9d-028f-4d6b-a6b2-5a8e070a2969\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg" Jul 12 18:18:07.581397 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.581360 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-metrics-certs\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:18:07.581397 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.581398 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76307ceb-8deb-4dcf-ac3b-0a446216a225-service-ca-bundle\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:18:07.581646 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.581467 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-j8b8n\" (UID: \"888ee972-d5e3-4714-a5ee-83d604c9d2d3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-j8b8n" Jul 12 18:18:07.581646 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:18:07.581591 2556 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 12 18:18:07.581743 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:18:07.581654 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert podName:888ee972-d5e3-4714-a5ee-83d604c9d2d3 nodeName:}" failed. No retries permitted until 2026-07-12 18:18:39.581641266 +0000 UTC m=+99.280400413 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-j8b8n" (UID: "888ee972-d5e3-4714-a5ee-83d604c9d2d3") : secret "networking-console-plugin-cert" not found Jul 12 18:18:07.582046 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.582026 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76307ceb-8deb-4dcf-ac3b-0a446216a225-service-ca-bundle\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:18:07.583763 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.583742 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76307ceb-8deb-4dcf-ac3b-0a446216a225-metrics-certs\") pod \"router-default-5bb454b654-mgfsz\" (UID: \"76307ceb-8deb-4dcf-ac3b-0a446216a225\") " pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:18:07.633787 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.633753 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p9vq2\"" Jul 12 18:18:07.641812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.641786 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:18:07.676251 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.676225 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mqkbk\"" Jul 12 18:18:07.681861 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.681831 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-metrics-tls\") pod \"dns-default-sb6tz\" (UID: \"49f40bf4-3d5d-4007-b2aa-5b8f0827e823\") " pod="openshift-dns/dns-default-sb6tz" Jul 12 18:18:07.682002 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.681867 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-c7q7q\" (UID: \"9b74ea4d-756d-4b37-87a9-ed24c4bbc2da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-c7q7q" Jul 12 18:18:07.684143 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.684117 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/49f40bf4-3d5d-4007-b2aa-5b8f0827e823-metrics-tls\") pod \"dns-default-sb6tz\" (UID: \"49f40bf4-3d5d-4007-b2aa-5b8f0827e823\") " pod="openshift-dns/dns-default-sb6tz" Jul 12 18:18:07.684256 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.684177 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg" Jul 12 18:18:07.684455 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.684431 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b74ea4d-756d-4b37-87a9-ed24c4bbc2da-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-c7q7q\" (UID: \"9b74ea4d-756d-4b37-87a9-ed24c4bbc2da\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-c7q7q" Jul 12 18:18:07.740442 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.740413 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/2.log" Jul 12 18:18:07.740944 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.740922 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/1.log" Jul 12 18:18:07.741068 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.740963 2556 generic.go:356] "Generic (PLEG): container finished" podID="3bd8be73-d59a-4c4d-945b-eff5f7563c73" containerID="c942911c73c51353fb9ebb652e213c8d74c4d2b8c864afb536f6ab1db7b85c86" exitCode=255 Jul 12 18:18:07.741068 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.741033 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-b2gj4" event={"ID":"3bd8be73-d59a-4c4d-945b-eff5f7563c73","Type":"ContainerDied","Data":"c942911c73c51353fb9ebb652e213c8d74c4d2b8c864afb536f6ab1db7b85c86"} Jul 12 18:18:07.741207 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.741130 2556 scope.go:117] "RemoveContainer" containerID="1ad1982f44b91630947c92d7c1e701d59b9d02491afe9ce0115b099d6c1d0d89" Jul 12 18:18:07.741670 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.741537 2556 scope.go:117] "RemoveContainer" containerID="c942911c73c51353fb9ebb652e213c8d74c4d2b8c864afb536f6ab1db7b85c86" Jul 12 18:18:07.741833 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:18:07.741749 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-b2gj4_openshift-console-operator(3bd8be73-d59a-4c4d-945b-eff5f7563c73)\"" pod="openshift-console-operator/console-operator-7866497494-b2gj4" podUID="3bd8be73-d59a-4c4d-945b-eff5f7563c73" Jul 12 18:18:07.744475 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.744454 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-kz5fn\"" Jul 12 18:18:07.752922 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.752662 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:18:07.814113 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.814074 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59b9cc7b5c-xxvn5"] Jul 12 18:18:07.816521 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:18:07.816490 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf180a514_4acc_4c23_8a5a_e14a34d00f02.slice/crio-3d16dec4266759f6c64f55f949e614eee6d59e303b26b82210309cd98b5a0b9a WatchSource:0}: Error finding container 3d16dec4266759f6c64f55f949e614eee6d59e303b26b82210309cd98b5a0b9a: Status 404 returned error can't find the container with id 3d16dec4266759f6c64f55f949e614eee6d59e303b26b82210309cd98b5a0b9a Jul 12 18:18:07.857981 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.857744 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-bbdjp\"" Jul 12 18:18:07.865867 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.865845 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-c7q7q" Jul 12 18:18:07.875342 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.875318 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg"] Jul 12 18:18:07.878388 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:18:07.878361 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57408f9d_028f_4d6b_a6b2_5a8e070a2969.slice/crio-84dfcb913bbd392df3d6d79c273d0b332f88d56893145c1d11ae170eab2661cc WatchSource:0}: Error finding container 84dfcb913bbd392df3d6d79c273d0b332f88d56893145c1d11ae170eab2661cc: Status 404 returned error can't find the container with id 84dfcb913bbd392df3d6d79c273d0b332f88d56893145c1d11ae170eab2661cc Jul 12 18:18:07.921909 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.921791 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-h7xmt\"" Jul 12 18:18:07.931648 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.931589 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sb6tz" Jul 12 18:18:07.935365 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.935342 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5bb454b654-mgfsz"] Jul 12 18:18:07.940766 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:18:07.940711 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76307ceb_8deb_4dcf_ac3b_0a446216a225.slice/crio-0b6ac819b2881ee7c0fe7f0270ec678e39d4fdb045eb1d40044c91f29924a2cc WatchSource:0}: Error finding container 0b6ac819b2881ee7c0fe7f0270ec678e39d4fdb045eb1d40044c91f29924a2cc: Status 404 returned error can't find the container with id 0b6ac819b2881ee7c0fe7f0270ec678e39d4fdb045eb1d40044c91f29924a2cc Jul 12 18:18:07.985901 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.985793 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs\") pod \"network-metrics-daemon-vn8dd\" (UID: \"92c9c69e-5148-4be6-a348-7bb634c94566\") " pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:18:07.988321 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:07.988296 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 12 18:18:08.001057 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.001014 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/92c9c69e-5148-4be6-a348-7bb634c94566-metrics-certs\") pod \"network-metrics-daemon-vn8dd\" (UID: \"92c9c69e-5148-4be6-a348-7bb634c94566\") " pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:18:08.018840 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.018785 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-c7q7q"] Jul 12 18:18:08.086910 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.086879 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret\") pod \"global-pull-secret-syncer-fsg86\" (UID: \"27d0cbdc-10e6-4e60-8b17-c278fe65e4ec\") " pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:18:08.089299 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.089277 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 12 18:18:08.093127 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.093099 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sb6tz"] Jul 12 18:18:08.096851 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:18:08.096825 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49f40bf4_3d5d_4007_b2aa_5b8f0827e823.slice/crio-0a9ca63bac91c27111ad7f031ada1be0fc878d80c478b252192c1f66a2aabe62 WatchSource:0}: Error finding container 0a9ca63bac91c27111ad7f031ada1be0fc878d80c478b252192c1f66a2aabe62: Status 404 returned error can't find the container with id 0a9ca63bac91c27111ad7f031ada1be0fc878d80c478b252192c1f66a2aabe62 Jul 12 18:18:08.099791 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.099769 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27d0cbdc-10e6-4e60-8b17-c278fe65e4ec-original-pull-secret\") pod \"global-pull-secret-syncer-fsg86\" (UID: \"27d0cbdc-10e6-4e60-8b17-c278fe65e4ec\") " pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:18:08.267490 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.267407 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-p9cbp\"" Jul 12 18:18:08.272261 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.272231 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fsg86" Jul 12 18:18:08.275257 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.275229 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn8dd" Jul 12 18:18:08.412812 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.412781 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vn8dd"] Jul 12 18:18:08.415067 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:18:08.415032 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c9c69e_5148_4be6_a348_7bb634c94566.slice/crio-69dbdac44d2258b83ecbcffa52c9187cbbd5dfb10a6e9ca652e38c5827f9ab43 WatchSource:0}: Error finding container 69dbdac44d2258b83ecbcffa52c9187cbbd5dfb10a6e9ca652e38c5827f9ab43: Status 404 returned error can't find the container with id 69dbdac44d2258b83ecbcffa52c9187cbbd5dfb10a6e9ca652e38c5827f9ab43 Jul 12 18:18:08.431597 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.431521 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fsg86"] Jul 12 18:18:08.436282 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:18:08.436243 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27d0cbdc_10e6_4e60_8b17_c278fe65e4ec.slice/crio-f5162e414ab0bb3bddcfa77653c029708ef1c657ae0c5c6576f6e7221a90fc8f WatchSource:0}: Error finding container f5162e414ab0bb3bddcfa77653c029708ef1c657ae0c5c6576f6e7221a90fc8f: Status 404 returned error can't find the container with id f5162e414ab0bb3bddcfa77653c029708ef1c657ae0c5c6576f6e7221a90fc8f Jul 12 18:18:08.748275 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.748236 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vn8dd" event={"ID":"92c9c69e-5148-4be6-a348-7bb634c94566","Type":"ContainerStarted","Data":"69dbdac44d2258b83ecbcffa52c9187cbbd5dfb10a6e9ca652e38c5827f9ab43"} Jul 12 18:18:08.750423 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.750387 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fsg86" event={"ID":"27d0cbdc-10e6-4e60-8b17-c278fe65e4ec","Type":"ContainerStarted","Data":"f5162e414ab0bb3bddcfa77653c029708ef1c657ae0c5c6576f6e7221a90fc8f"} Jul 12 18:18:08.753069 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.752543 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5bb454b654-mgfsz" event={"ID":"76307ceb-8deb-4dcf-ac3b-0a446216a225","Type":"ContainerStarted","Data":"f80eb306ed133817e005e33e2e3cc3a78da39315defb7089d59fbe1b3eda9024"} Jul 12 18:18:08.753069 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.752587 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5bb454b654-mgfsz" event={"ID":"76307ceb-8deb-4dcf-ac3b-0a446216a225","Type":"ContainerStarted","Data":"0b6ac819b2881ee7c0fe7f0270ec678e39d4fdb045eb1d40044c91f29924a2cc"} Jul 12 18:18:08.753069 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.753033 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:18:08.755499 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.755405 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-c7q7q" event={"ID":"9b74ea4d-756d-4b37-87a9-ed24c4bbc2da","Type":"ContainerStarted","Data":"1c6350bd93777b01036c25f90ef0f01d7827de170c46c717878697045ff4778d"} Jul 12 18:18:08.755789 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.755753 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:18:08.757526 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.757468 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sb6tz" event={"ID":"49f40bf4-3d5d-4007-b2aa-5b8f0827e823","Type":"ContainerStarted","Data":"0a9ca63bac91c27111ad7f031ada1be0fc878d80c478b252192c1f66a2aabe62"} Jul 12 18:18:08.759911 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.759869 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" event={"ID":"f180a514-4acc-4c23-8a5a-e14a34d00f02","Type":"ContainerStarted","Data":"9153d298e2088cd5e6d2016444d67d074df2ab6910a051b3540033555c7782d9"} Jul 12 18:18:08.759911 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.759909 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" event={"ID":"f180a514-4acc-4c23-8a5a-e14a34d00f02","Type":"ContainerStarted","Data":"3d16dec4266759f6c64f55f949e614eee6d59e303b26b82210309cd98b5a0b9a"} Jul 12 18:18:08.760512 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.760439 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:18:08.762998 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.762979 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/2.log" Jul 12 18:18:08.764447 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.764424 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg" event={"ID":"57408f9d-028f-4d6b-a6b2-5a8e070a2969","Type":"ContainerStarted","Data":"84dfcb913bbd392df3d6d79c273d0b332f88d56893145c1d11ae170eab2661cc"} Jul 12 18:18:08.771146 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.770653 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5bb454b654-mgfsz" podStartSLOduration=61.770634823 podStartE2EDuration="1m1.770634823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:17:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:18:08.769318757 +0000 UTC m=+68.468077927" watchObservedRunningTime="2026-07-12 18:18:08.770634823 +0000 UTC m=+68.469393996" Jul 12 18:18:08.788274 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.786494 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" podStartSLOduration=66.786478754 podStartE2EDuration="1m6.786478754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:17:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:18:08.785971332 +0000 UTC m=+68.484730500" watchObservedRunningTime="2026-07-12 18:18:08.786478754 +0000 UTC m=+68.485237923" Jul 12 18:18:08.996627 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.995470 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6225002-0cda-48bf-bf49-b2899fc7add2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:18:08.996627 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.995605 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6225002-0cda-48bf-bf49-b2899fc7add2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:18:08.996627 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:08.996234 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c6225002-0cda-48bf-bf49-b2899fc7add2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:18:08.996627 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:18:08.996352 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 12 18:18:08.996627 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:18:08.996418 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6225002-0cda-48bf-bf49-b2899fc7add2-insights-runtime-extractor-tls podName:c6225002-0cda-48bf-bf49-b2899fc7add2 nodeName:}" failed. No retries permitted until 2026-07-12 18:18:24.996398907 +0000 UTC m=+84.695158055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c6225002-0cda-48bf-bf49-b2899fc7add2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9dh25" (UID: "c6225002-0cda-48bf-bf49-b2899fc7add2") : secret "insights-runtime-extractor-tls" not found Jul 12 18:18:09.768815 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:09.768752 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:18:09.770149 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:09.770121 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5bb454b654-mgfsz" Jul 12 18:18:11.782863 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:11.782757 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-c7q7q" event={"ID":"9b74ea4d-756d-4b37-87a9-ed24c4bbc2da","Type":"ContainerStarted","Data":"3174d22170ca3c207d5f7130fdd776c9f7fb236a702f2f165de40cbad5e1e068"} Jul 12 18:18:11.782863 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:11.782857 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-c7q7q" event={"ID":"9b74ea4d-756d-4b37-87a9-ed24c4bbc2da","Type":"ContainerStarted","Data":"e6691724c0a63da3516945e31c1504216c6db94e3005cdcbd1e280e650932561"} Jul 12 18:18:11.784627 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:11.784601 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sb6tz" event={"ID":"49f40bf4-3d5d-4007-b2aa-5b8f0827e823","Type":"ContainerStarted","Data":"dbf37e5337b7ff172adc86270d200aa7aad3edcfcf02801099c4911777b20906"} Jul 12 18:18:11.784755 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:11.784652 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sb6tz" Jul 12 18:18:11.784755 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:11.784677 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sb6tz" event={"ID":"49f40bf4-3d5d-4007-b2aa-5b8f0827e823","Type":"ContainerStarted","Data":"57ce4401e0e5b7abd15e3c03806544b293504d901166d6acd13727293074ff90"} Jul 12 18:18:11.786258 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:11.786232 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg" event={"ID":"57408f9d-028f-4d6b-a6b2-5a8e070a2969","Type":"ContainerStarted","Data":"8cec4bec801d305917a0b15818b3e211c142635bf11e42cbeb85b167d6799c11"} Jul 12 18:18:11.788061 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:11.788034 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vn8dd" event={"ID":"92c9c69e-5148-4be6-a348-7bb634c94566","Type":"ContainerStarted","Data":"da51b828f9d3637329b34e3c1f3b8c2eed98d68e66928156be7eeb890a641f22"} Jul 12 18:18:11.788158 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:11.788095 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vn8dd" event={"ID":"92c9c69e-5148-4be6-a348-7bb634c94566","Type":"ContainerStarted","Data":"4afe6a4c1b7dc4391296271644a300c1ef4ef4fddb582fb75cabdb03db59680f"} Jul 12 18:18:11.799953 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:11.799912 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-c7q7q" podStartSLOduration=60.699337208 podStartE2EDuration="1m3.799895097s" totalImagesPullingTime="3.100557889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:17:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:18:11.797840914 +0000 UTC m=+71.496600081" watchObservedRunningTime="2026-07-12 18:18:11.799895097 +0000 UTC m=+71.498654264" Jul 12 18:18:11.812970 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:11.812818 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sb6tz" podStartSLOduration=33.741684537 podStartE2EDuration="36.812800806s" totalImagesPullingTime="3.071116269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:17:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:18:11.812124238 +0000 UTC m=+71.510883403" watchObservedRunningTime="2026-07-12 18:18:11.812800806 +0000 UTC m=+71.511559978" Jul 12 18:18:11.826603 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:11.826555 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vn8dd" podStartSLOduration=67.08024958 podStartE2EDuration="1m9.826540412s" totalImagesPullingTime="2.746290832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:18:11.82603005 +0000 UTC m=+71.524789210" watchObservedRunningTime="2026-07-12 18:18:11.826540412 +0000 UTC m=+71.525299579" Jul 12 18:18:11.840106 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:11.840044 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-g8mzg" podStartSLOduration=61.557465175 podStartE2EDuration="1m4.840026794s" totalImagesPullingTime="3.282561619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:18:11.839054231 +0000 UTC m=+71.537813400" watchObservedRunningTime="2026-07-12 18:18:11.840026794 +0000 UTC m=+71.538785965" Jul 12 18:18:13.797858 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:13.797777 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fsg86" event={"ID":"27d0cbdc-10e6-4e60-8b17-c278fe65e4ec","Type":"ContainerStarted","Data":"12de17f490fcd3d65fc90a985e6047c9bc4abff2ee0880e58e37a6ab0fcd9769"} Jul 12 18:18:13.812821 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:13.812770 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fsg86" podStartSLOduration=66.847697548 podStartE2EDuration="1m11.812755171s" totalImagesPullingTime="4.965057623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 18:17:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:18:13.812257133 +0000 UTC m=+73.511016301" watchObservedRunningTime="2026-07-12 18:18:13.812755171 +0000 UTC m=+73.511514339" Jul 12 18:18:15.900087 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:15.900047 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-b2gj4" Jul 12 18:18:15.900484 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:15.900131 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-b2gj4" Jul 12 18:18:15.900484 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:15.900474 2556 scope.go:117] "RemoveContainer" containerID="c942911c73c51353fb9ebb652e213c8d74c4d2b8c864afb536f6ab1db7b85c86" Jul 12 18:18:15.900643 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:18:15.900625 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-7866497494-b2gj4_openshift-console-operator(3bd8be73-d59a-4c4d-945b-eff5f7563c73)\"" pod="openshift-console-operator/console-operator-7866497494-b2gj4" podUID="3bd8be73-d59a-4c4d-945b-eff5f7563c73" Jul 12 18:18:21.795802 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:21.795769 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sb6tz" Jul 12 18:18:23.689601 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:23.689568 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sk4z9" Jul 12 18:18:25.028117 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:25.028058 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6225002-0cda-48bf-bf49-b2899fc7add2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:18:25.030437 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:25.030413 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c6225002-0cda-48bf-bf49-b2899fc7add2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dh25\" (UID: \"c6225002-0cda-48bf-bf49-b2899fc7add2\") " pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:18:25.274595 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:25.274563 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9cwfc\"" Jul 12 18:18:25.283352 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:25.283296 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9dh25" Jul 12 18:18:25.439477 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:25.439425 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9dh25"] Jul 12 18:18:25.443234 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:18:25.443203 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6225002_0cda_48bf_bf49_b2899fc7add2.slice/crio-d40f0374d844d366e9a29a636fa51664d8492171466d0f8f18a681326f666d40 WatchSource:0}: Error finding container d40f0374d844d366e9a29a636fa51664d8492171466d0f8f18a681326f666d40: Status 404 returned error can't find the container with id d40f0374d844d366e9a29a636fa51664d8492171466d0f8f18a681326f666d40 Jul 12 18:18:25.846296 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:25.846214 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9dh25" event={"ID":"c6225002-0cda-48bf-bf49-b2899fc7add2","Type":"ContainerStarted","Data":"d40f0374d844d366e9a29a636fa51664d8492171466d0f8f18a681326f666d40"} Jul 12 18:18:27.647630 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:27.647593 2556 patch_prober.go:28] interesting pod/image-registry-59b9cc7b5c-xxvn5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 12 18:18:27.648040 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:27.647666 2556 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" podUID="f180a514-4acc-4c23-8a5a-e14a34d00f02" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 12 18:18:28.335384 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:28.335354 2556 scope.go:117] "RemoveContainer" containerID="c942911c73c51353fb9ebb652e213c8d74c4d2b8c864afb536f6ab1db7b85c86" Jul 12 18:18:29.869915 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:29.869878 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9dh25" event={"ID":"c6225002-0cda-48bf-bf49-b2899fc7add2","Type":"ContainerStarted","Data":"b02d7211440d697d7c84a85931a02ee5679ce82563576ff2e9c265a8b150918f"} Jul 12 18:18:29.870400 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:29.869973 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9dh25" event={"ID":"c6225002-0cda-48bf-bf49-b2899fc7add2","Type":"ContainerStarted","Data":"b65033f64c4791fc31683f8ed1b807ca6443c32ebf434e5f49612ec69a07bd06"} Jul 12 18:18:29.872050 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:29.872028 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/2.log" Jul 12 18:18:29.872200 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:29.872111 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-b2gj4" event={"ID":"3bd8be73-d59a-4c4d-945b-eff5f7563c73","Type":"ContainerStarted","Data":"2d9973cbcb04e13ffaf43495b2a79552e669aae29c75810b4fd463a6aba8f54c"} Jul 12 18:18:29.872734 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:29.872675 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-b2gj4" Jul 12 18:18:29.878329 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:29.878310 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-b2gj4" Jul 12 18:18:29.892519 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:29.892413 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-b2gj4" podStartSLOduration=68.711706439 podStartE2EDuration="1m22.892396837s" totalImagesPullingTime="14.180690398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:17:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:18:29.891975898 +0000 UTC m=+89.590735067" watchObservedRunningTime="2026-07-12 18:18:29.892396837 +0000 UTC m=+89.591156006" Jul 12 18:18:30.192724 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.192642 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4n92p"] Jul 12 18:18:30.195515 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.195494 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.197970 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.197945 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 12 18:18:30.198169 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.198149 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ss2pq\"" Jul 12 18:18:30.199157 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.198955 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 12 18:18:30.199157 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.198956 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 12 18:18:30.199157 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.199125 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 12 18:18:30.272441 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.272406 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d086db08-cb29-48ef-9b01-38476f8732f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.272652 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.272453 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d086db08-cb29-48ef-9b01-38476f8732f0-metrics-client-ca\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.272652 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.272497 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d086db08-cb29-48ef-9b01-38476f8732f0-node-exporter-wtmp\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.272652 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.272558 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d086db08-cb29-48ef-9b01-38476f8732f0-root\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.272652 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.272631 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d086db08-cb29-48ef-9b01-38476f8732f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.272863 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.272662 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d086db08-cb29-48ef-9b01-38476f8732f0-sys\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.272863 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.272686 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d086db08-cb29-48ef-9b01-38476f8732f0-node-exporter-textfile\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.272863 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.272794 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlszk\" (UniqueName: \"kubernetes.io/projected/d086db08-cb29-48ef-9b01-38476f8732f0-kube-api-access-wlszk\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.272863 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.272830 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d086db08-cb29-48ef-9b01-38476f8732f0-node-exporter-tls\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.373952 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.373910 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d086db08-cb29-48ef-9b01-38476f8732f0-node-exporter-wtmp\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.373952 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.373953 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d086db08-cb29-48ef-9b01-38476f8732f0-root\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.374226 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.374001 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d086db08-cb29-48ef-9b01-38476f8732f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.374226 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.374031 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d086db08-cb29-48ef-9b01-38476f8732f0-sys\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.374226 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.374055 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d086db08-cb29-48ef-9b01-38476f8732f0-node-exporter-textfile\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.374226 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.374129 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d086db08-cb29-48ef-9b01-38476f8732f0-root\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.374226 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.374154 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlszk\" (UniqueName: \"kubernetes.io/projected/d086db08-cb29-48ef-9b01-38476f8732f0-kube-api-access-wlszk\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.374226 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.374182 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d086db08-cb29-48ef-9b01-38476f8732f0-node-exporter-tls\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.374514 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.374255 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d086db08-cb29-48ef-9b01-38476f8732f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.374514 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.374287 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d086db08-cb29-48ef-9b01-38476f8732f0-metrics-client-ca\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.374514 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.374343 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d086db08-cb29-48ef-9b01-38476f8732f0-sys\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.374514 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.374180 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d086db08-cb29-48ef-9b01-38476f8732f0-node-exporter-wtmp\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.374514 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.374419 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d086db08-cb29-48ef-9b01-38476f8732f0-node-exporter-textfile\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.374893 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.374870 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d086db08-cb29-48ef-9b01-38476f8732f0-metrics-client-ca\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.374951 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.374893 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d086db08-cb29-48ef-9b01-38476f8732f0-node-exporter-accelerators-collector-config\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.376856 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.376832 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d086db08-cb29-48ef-9b01-38476f8732f0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.376979 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.376891 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d086db08-cb29-48ef-9b01-38476f8732f0-node-exporter-tls\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.382952 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.382926 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlszk\" (UniqueName: \"kubernetes.io/projected/d086db08-cb29-48ef-9b01-38476f8732f0-kube-api-access-wlszk\") pod \"node-exporter-4n92p\" (UID: \"d086db08-cb29-48ef-9b01-38476f8732f0\") " pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.507089 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.506996 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4n92p" Jul 12 18:18:30.518651 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:18:30.518610 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd086db08_cb29_48ef_9b01_38476f8732f0.slice/crio-1fc111e4fc33efc3e075735702064d6170ae262049f779c0618360584927a652 WatchSource:0}: Error finding container 1fc111e4fc33efc3e075735702064d6170ae262049f779c0618360584927a652: Status 404 returned error can't find the container with id 1fc111e4fc33efc3e075735702064d6170ae262049f779c0618360584927a652 Jul 12 18:18:30.782503 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.782416 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:18:30.882319 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:30.882278 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4n92p" event={"ID":"d086db08-cb29-48ef-9b01-38476f8732f0","Type":"ContainerStarted","Data":"1fc111e4fc33efc3e075735702064d6170ae262049f779c0618360584927a652"} Jul 12 18:18:32.891231 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:32.891192 2556 generic.go:356] "Generic (PLEG): container finished" podID="d086db08-cb29-48ef-9b01-38476f8732f0" containerID="e02c1bc53233e4ecc1cffb444e082fef08a742defea0f1d3c2d59723d6813030" exitCode=0 Jul 12 18:18:32.891640 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:32.891275 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4n92p" event={"ID":"d086db08-cb29-48ef-9b01-38476f8732f0","Type":"ContainerDied","Data":"e02c1bc53233e4ecc1cffb444e082fef08a742defea0f1d3c2d59723d6813030"} Jul 12 18:18:32.893328 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:32.893303 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9dh25" event={"ID":"c6225002-0cda-48bf-bf49-b2899fc7add2","Type":"ContainerStarted","Data":"f12cd30b9e8446096e45dbe54b01e36faee5338e73537ba313c0a88b8758e6e2"} Jul 12 18:18:32.924567 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:32.924519 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9dh25" podStartSLOduration=33.083008514 podStartE2EDuration="39.924501087s" totalImagesPullingTime="6.841492573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 18:17:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:18:32.923712197 +0000 UTC m=+92.622471366" watchObservedRunningTime="2026-07-12 18:18:32.924501087 +0000 UTC m=+92.623260255" Jul 12 18:18:33.899564 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:33.899529 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4n92p" event={"ID":"d086db08-cb29-48ef-9b01-38476f8732f0","Type":"ContainerStarted","Data":"5a4bc416651d45560e04c782cad8e67e7812a7faa52c8ce886a035d02935f8cb"} Jul 12 18:18:33.899942 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:33.899590 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4n92p" event={"ID":"d086db08-cb29-48ef-9b01-38476f8732f0","Type":"ContainerStarted","Data":"6334fb8f0241db50df6eb43cc5c59449eb0080ae4e83aa9eb5c0cd9c914c7016"} Jul 12 18:18:33.919092 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:33.919038 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4n92p" podStartSLOduration=1.955855515 podStartE2EDuration="3.919019893s" totalImagesPullingTime="1.900395853s" totalInitContainerRuntime="62.768525ms" isStatefulPod=true podCreationTimestamp="2026-07-12 18:18:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:18:33.91705571 +0000 UTC m=+93.615814878" watchObservedRunningTime="2026-07-12 18:18:33.919019893 +0000 UTC m=+93.617779060" Jul 12 18:18:39.655271 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:39.655229 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-j8b8n\" (UID: \"888ee972-d5e3-4714-a5ee-83d604c9d2d3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-j8b8n" Jul 12 18:18:39.657702 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:39.657675 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/888ee972-d5e3-4714-a5ee-83d604c9d2d3-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-j8b8n\" (UID: \"888ee972-d5e3-4714-a5ee-83d604c9d2d3\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-j8b8n" Jul 12 18:18:39.952463 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:39.952380 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rk8mp\"" Jul 12 18:18:39.960430 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:39.960407 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-j8b8n" Jul 12 18:18:40.102000 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:40.101967 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-j8b8n"] Jul 12 18:18:40.105212 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:18:40.105191 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod888ee972_d5e3_4714_a5ee_83d604c9d2d3.slice/crio-32ab3ad8dff9a974d682f8de6c8eb297c754ff37e7e083a4bb698fa077756558 WatchSource:0}: Error finding container 32ab3ad8dff9a974d682f8de6c8eb297c754ff37e7e083a4bb698fa077756558: Status 404 returned error can't find the container with id 32ab3ad8dff9a974d682f8de6c8eb297c754ff37e7e083a4bb698fa077756558 Jul 12 18:18:40.110353 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:40.110312 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59b9cc7b5c-xxvn5"] Jul 12 18:18:40.926874 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:40.926837 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-j8b8n" event={"ID":"888ee972-d5e3-4714-a5ee-83d604c9d2d3","Type":"ContainerStarted","Data":"32ab3ad8dff9a974d682f8de6c8eb297c754ff37e7e083a4bb698fa077756558"} Jul 12 18:18:41.933151 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:41.933115 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-j8b8n" event={"ID":"888ee972-d5e3-4714-a5ee-83d604c9d2d3","Type":"ContainerStarted","Data":"d8edf0c46496c0abfd3f67eadd78cd12590745d1c08edd825b3e387770645d2c"} Jul 12 18:18:41.948482 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:41.948385 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-j8b8n" podStartSLOduration=84.362519624 podStartE2EDuration="1m25.948369033s" totalImagesPullingTime="1.585849409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:17:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:18:41.947169358 +0000 UTC m=+101.645928529" watchObservedRunningTime="2026-07-12 18:18:41.948369033 +0000 UTC m=+101.647128201" Jul 12 18:18:57.993021 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:57.992982 2556 generic.go:356] "Generic (PLEG): container finished" podID="70800a37-aba0-4678-9ed7-cc45c5e7ec49" containerID="dc892431e432f6f450b47c4c4d64856bd3a58197a264fe12c3f93c09af1ff87d" exitCode=0 Jul 12 18:18:57.993441 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:57.993037 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dftms" event={"ID":"70800a37-aba0-4678-9ed7-cc45c5e7ec49","Type":"ContainerDied","Data":"dc892431e432f6f450b47c4c4d64856bd3a58197a264fe12c3f93c09af1ff87d"} Jul 12 18:18:57.993441 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:57.993419 2556 scope.go:117] "RemoveContainer" containerID="dc892431e432f6f450b47c4c4d64856bd3a58197a264fe12c3f93c09af1ff87d" Jul 12 18:18:58.998529 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:18:58.998495 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dftms" event={"ID":"70800a37-aba0-4678-9ed7-cc45c5e7ec49","Type":"ContainerStarted","Data":"7e7140a7b8b0dd2630dc4e622d9b7aca890625c99b37fe00055a797afb101126"} Jul 12 18:19:05.132319 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.132274 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" podUID="f180a514-4acc-4c23-8a5a-e14a34d00f02" containerName="registry" containerID="cri-o://9153d298e2088cd5e6d2016444d67d074df2ab6910a051b3540033555c7782d9" gracePeriod=30 Jul 12 18:19:05.390046 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.389988 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:19:05.468225 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.468189 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f180a514-4acc-4c23-8a5a-e14a34d00f02-image-registry-private-configuration\") pod \"f180a514-4acc-4c23-8a5a-e14a34d00f02\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " Jul 12 18:19:05.468225 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.468232 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f180a514-4acc-4c23-8a5a-e14a34d00f02-trusted-ca\") pod \"f180a514-4acc-4c23-8a5a-e14a34d00f02\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " Jul 12 18:19:05.468432 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.468259 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7t6h\" (UniqueName: \"kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-kube-api-access-n7t6h\") pod \"f180a514-4acc-4c23-8a5a-e14a34d00f02\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " Jul 12 18:19:05.468432 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.468297 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls\") pod \"f180a514-4acc-4c23-8a5a-e14a34d00f02\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " Jul 12 18:19:05.468432 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.468331 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-bound-sa-token\") pod \"f180a514-4acc-4c23-8a5a-e14a34d00f02\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " Jul 12 18:19:05.468432 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.468361 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f180a514-4acc-4c23-8a5a-e14a34d00f02-ca-trust-extracted\") pod \"f180a514-4acc-4c23-8a5a-e14a34d00f02\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " Jul 12 18:19:05.468432 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.468413 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f180a514-4acc-4c23-8a5a-e14a34d00f02-installation-pull-secrets\") pod \"f180a514-4acc-4c23-8a5a-e14a34d00f02\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " Jul 12 18:19:05.468671 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.468445 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-certificates\") pod \"f180a514-4acc-4c23-8a5a-e14a34d00f02\" (UID: \"f180a514-4acc-4c23-8a5a-e14a34d00f02\") " Jul 12 18:19:05.469369 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.469293 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f180a514-4acc-4c23-8a5a-e14a34d00f02" (UID: "f180a514-4acc-4c23-8a5a-e14a34d00f02"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 18:19:05.469369 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.469325 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f180a514-4acc-4c23-8a5a-e14a34d00f02-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f180a514-4acc-4c23-8a5a-e14a34d00f02" (UID: "f180a514-4acc-4c23-8a5a-e14a34d00f02"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 18:19:05.471161 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.471109 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f180a514-4acc-4c23-8a5a-e14a34d00f02" (UID: "f180a514-4acc-4c23-8a5a-e14a34d00f02"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 18:19:05.471415 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.471383 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-kube-api-access-n7t6h" (OuterVolumeSpecName: "kube-api-access-n7t6h") pod "f180a514-4acc-4c23-8a5a-e14a34d00f02" (UID: "f180a514-4acc-4c23-8a5a-e14a34d00f02"). InnerVolumeSpecName "kube-api-access-n7t6h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 18:19:05.471511 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.471423 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f180a514-4acc-4c23-8a5a-e14a34d00f02-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f180a514-4acc-4c23-8a5a-e14a34d00f02" (UID: "f180a514-4acc-4c23-8a5a-e14a34d00f02"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 18:19:05.471511 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.471481 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f180a514-4acc-4c23-8a5a-e14a34d00f02" (UID: "f180a514-4acc-4c23-8a5a-e14a34d00f02"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 18:19:05.471511 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.471493 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f180a514-4acc-4c23-8a5a-e14a34d00f02-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f180a514-4acc-4c23-8a5a-e14a34d00f02" (UID: "f180a514-4acc-4c23-8a5a-e14a34d00f02"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 18:19:05.479523 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.479493 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f180a514-4acc-4c23-8a5a-e14a34d00f02-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f180a514-4acc-4c23-8a5a-e14a34d00f02" (UID: "f180a514-4acc-4c23-8a5a-e14a34d00f02"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 18:19:05.569201 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.569163 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-tls\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:19:05.569201 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.569191 2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-bound-sa-token\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:19:05.569201 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.569200 2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f180a514-4acc-4c23-8a5a-e14a34d00f02-ca-trust-extracted\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:19:05.569201 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.569209 2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f180a514-4acc-4c23-8a5a-e14a34d00f02-installation-pull-secrets\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:19:05.569455 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.569217 2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f180a514-4acc-4c23-8a5a-e14a34d00f02-registry-certificates\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:19:05.569455 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.569227 2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f180a514-4acc-4c23-8a5a-e14a34d00f02-image-registry-private-configuration\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:19:05.569455 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.569235 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f180a514-4acc-4c23-8a5a-e14a34d00f02-trusted-ca\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:19:05.569455 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:05.569261 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7t6h\" (UniqueName: \"kubernetes.io/projected/f180a514-4acc-4c23-8a5a-e14a34d00f02-kube-api-access-n7t6h\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:19:06.024997 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:06.024961 2556 generic.go:356] "Generic (PLEG): container finished" podID="f180a514-4acc-4c23-8a5a-e14a34d00f02" containerID="9153d298e2088cd5e6d2016444d67d074df2ab6910a051b3540033555c7782d9" exitCode=0 Jul 12 18:19:06.025188 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:06.025005 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" Jul 12 18:19:06.025188 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:06.025045 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" event={"ID":"f180a514-4acc-4c23-8a5a-e14a34d00f02","Type":"ContainerDied","Data":"9153d298e2088cd5e6d2016444d67d074df2ab6910a051b3540033555c7782d9"} Jul 12 18:19:06.025188 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:06.025109 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59b9cc7b5c-xxvn5" event={"ID":"f180a514-4acc-4c23-8a5a-e14a34d00f02","Type":"ContainerDied","Data":"3d16dec4266759f6c64f55f949e614eee6d59e303b26b82210309cd98b5a0b9a"} Jul 12 18:19:06.025188 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:06.025131 2556 scope.go:117] "RemoveContainer" containerID="9153d298e2088cd5e6d2016444d67d074df2ab6910a051b3540033555c7782d9" Jul 12 18:19:06.037503 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:06.037484 2556 scope.go:117] "RemoveContainer" containerID="9153d298e2088cd5e6d2016444d67d074df2ab6910a051b3540033555c7782d9" Jul 12 18:19:06.037838 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:19:06.037816 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9153d298e2088cd5e6d2016444d67d074df2ab6910a051b3540033555c7782d9\": container with ID starting with 9153d298e2088cd5e6d2016444d67d074df2ab6910a051b3540033555c7782d9 not found: ID does not exist" containerID="9153d298e2088cd5e6d2016444d67d074df2ab6910a051b3540033555c7782d9" Jul 12 18:19:06.037884 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:06.037846 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9153d298e2088cd5e6d2016444d67d074df2ab6910a051b3540033555c7782d9"} err="failed to get container status \"9153d298e2088cd5e6d2016444d67d074df2ab6910a051b3540033555c7782d9\": rpc error: code = NotFound desc = could not find container \"9153d298e2088cd5e6d2016444d67d074df2ab6910a051b3540033555c7782d9\": container with ID starting with 9153d298e2088cd5e6d2016444d67d074df2ab6910a051b3540033555c7782d9 not found: ID does not exist" Jul 12 18:19:06.048092 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:06.048047 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59b9cc7b5c-xxvn5"] Jul 12 18:19:06.051384 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:06.051362 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59b9cc7b5c-xxvn5"] Jul 12 18:19:06.339614 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:06.339587 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f180a514-4acc-4c23-8a5a-e14a34d00f02" path="/var/lib/kubelet/pods/f180a514-4acc-4c23-8a5a-e14a34d00f02/volumes" Jul 12 18:19:07.030527 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:07.030490 2556 generic.go:356] "Generic (PLEG): container finished" podID="92b6d641-802b-4005-9a45-c623d3403694" containerID="5466af4ffa9b133309966e2087a6757e0306f65aebbf2255030d74d73f7ac189" exitCode=0 Jul 12 18:19:07.030731 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:07.030541 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xm669" event={"ID":"92b6d641-802b-4005-9a45-c623d3403694","Type":"ContainerDied","Data":"5466af4ffa9b133309966e2087a6757e0306f65aebbf2255030d74d73f7ac189"} Jul 12 18:19:07.030945 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:07.030928 2556 scope.go:117] "RemoveContainer" containerID="5466af4ffa9b133309966e2087a6757e0306f65aebbf2255030d74d73f7ac189" Jul 12 18:19:08.036473 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:08.036436 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-xm669" event={"ID":"92b6d641-802b-4005-9a45-c623d3403694","Type":"ContainerStarted","Data":"cf99772b16235a44f5adbbf031eec72a60a95a1e64562d41ffec13e7e6ed5fa8"} Jul 12 18:19:11.048802 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:11.048764 2556 generic.go:356] "Generic (PLEG): container finished" podID="05d80244-fc3e-45d4-a192-6385aff3addf" containerID="506e54585ec104728b9e3753bdffd5eeb2927f8022562cb60f782f95a8b25051" exitCode=0 Jul 12 18:19:11.049245 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:11.048836 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ps4wq" event={"ID":"05d80244-fc3e-45d4-a192-6385aff3addf","Type":"ContainerDied","Data":"506e54585ec104728b9e3753bdffd5eeb2927f8022562cb60f782f95a8b25051"} Jul 12 18:19:11.049245 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:11.049162 2556 scope.go:117] "RemoveContainer" containerID="506e54585ec104728b9e3753bdffd5eeb2927f8022562cb60f782f95a8b25051" Jul 12 18:19:12.054878 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:12.054843 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-ps4wq" event={"ID":"05d80244-fc3e-45d4-a192-6385aff3addf","Type":"ContainerStarted","Data":"a2a00d506e57a00c44b3e61c0c6b6b5f10242a418ffe81a68c421eb1230d8c90"} Jul 12 18:19:16.110817 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:16.110782 2556 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" podUID="1b6faf85-3504-427a-92ed-68183d48e409" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 12 18:19:26.110817 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:26.110781 2556 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" podUID="1b6faf85-3504-427a-92ed-68183d48e409" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 12 18:19:36.111116 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:36.111060 2556 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" podUID="1b6faf85-3504-427a-92ed-68183d48e409" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 12 18:19:36.111508 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:36.111155 2556 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" Jul 12 18:19:36.111615 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:36.111599 2556 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"9469edf67673f2a29e5359654f111e7f5accde34da1194ce0eba7427b7c14aee"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 12 18:19:36.111653 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:36.111634 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" podUID="1b6faf85-3504-427a-92ed-68183d48e409" containerName="service-proxy" containerID="cri-o://9469edf67673f2a29e5359654f111e7f5accde34da1194ce0eba7427b7c14aee" gracePeriod=30 Jul 12 18:19:37.149928 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:37.149896 2556 generic.go:356] "Generic (PLEG): container finished" podID="1b6faf85-3504-427a-92ed-68183d48e409" containerID="9469edf67673f2a29e5359654f111e7f5accde34da1194ce0eba7427b7c14aee" exitCode=2 Jul 12 18:19:37.150400 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:37.149965 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" event={"ID":"1b6faf85-3504-427a-92ed-68183d48e409","Type":"ContainerDied","Data":"9469edf67673f2a29e5359654f111e7f5accde34da1194ce0eba7427b7c14aee"} Jul 12 18:19:37.150400 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:19:37.150011 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-8485678674-2lvvw" event={"ID":"1b6faf85-3504-427a-92ed-68183d48e409","Type":"ContainerStarted","Data":"01debe0d953a1bff810a0746854521352e16a5234ed808529d3ea6d1a14bf47d"} Jul 12 18:22:02.210111 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:22:02.209189 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/2.log" Jul 12 18:22:02.217050 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:22:02.217025 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/2.log" Jul 12 18:22:02.226288 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:22:02.226264 2556 kubelet.go:1648] "Image garbage collection succeeded" Jul 12 18:23:00.704427 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.704354 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh"] Jul 12 18:23:00.704816 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.704669 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f180a514-4acc-4c23-8a5a-e14a34d00f02" containerName="registry" Jul 12 18:23:00.704816 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.704681 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="f180a514-4acc-4c23-8a5a-e14a34d00f02" containerName="registry" Jul 12 18:23:00.704816 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.704727 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="f180a514-4acc-4c23-8a5a-e14a34d00f02" containerName="registry" Jul 12 18:23:00.707583 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.707567 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" Jul 12 18:23:00.712753 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.712732 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 12 18:23:00.712887 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.712789 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 12 18:23:00.713883 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.713848 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 12 18:23:00.714004 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.713947 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-l2kpp\"" Jul 12 18:23:00.715781 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.715757 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 12 18:23:00.738591 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.738566 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh"] Jul 12 18:23:00.836961 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.836933 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c600f07c-bcd0-4a60-a20e-ce8b8609f2f5-manifests\") pod \"opendatahub-operator-controller-manager-db78fd4c7-krndh\" (UID: \"c600f07c-bcd0-4a60-a20e-ce8b8609f2f5\") " pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" Jul 12 18:23:00.836961 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.836964 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c600f07c-bcd0-4a60-a20e-ce8b8609f2f5-webhook-cert\") pod \"opendatahub-operator-controller-manager-db78fd4c7-krndh\" (UID: \"c600f07c-bcd0-4a60-a20e-ce8b8609f2f5\") " pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" Jul 12 18:23:00.837188 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.837001 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kz9z\" (UniqueName: \"kubernetes.io/projected/c600f07c-bcd0-4a60-a20e-ce8b8609f2f5-kube-api-access-8kz9z\") pod \"opendatahub-operator-controller-manager-db78fd4c7-krndh\" (UID: \"c600f07c-bcd0-4a60-a20e-ce8b8609f2f5\") " pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" Jul 12 18:23:00.837188 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.837100 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c600f07c-bcd0-4a60-a20e-ce8b8609f2f5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-db78fd4c7-krndh\" (UID: \"c600f07c-bcd0-4a60-a20e-ce8b8609f2f5\") " pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" Jul 12 18:23:00.837188 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.837132 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c600f07c-bcd0-4a60-a20e-ce8b8609f2f5-tmp\") pod \"opendatahub-operator-controller-manager-db78fd4c7-krndh\" (UID: \"c600f07c-bcd0-4a60-a20e-ce8b8609f2f5\") " pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" Jul 12 18:23:00.938100 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.938051 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kz9z\" (UniqueName: \"kubernetes.io/projected/c600f07c-bcd0-4a60-a20e-ce8b8609f2f5-kube-api-access-8kz9z\") pod \"opendatahub-operator-controller-manager-db78fd4c7-krndh\" (UID: \"c600f07c-bcd0-4a60-a20e-ce8b8609f2f5\") " pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" Jul 12 18:23:00.938261 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.938121 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c600f07c-bcd0-4a60-a20e-ce8b8609f2f5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-db78fd4c7-krndh\" (UID: \"c600f07c-bcd0-4a60-a20e-ce8b8609f2f5\") " pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" Jul 12 18:23:00.938261 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.938154 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c600f07c-bcd0-4a60-a20e-ce8b8609f2f5-tmp\") pod \"opendatahub-operator-controller-manager-db78fd4c7-krndh\" (UID: \"c600f07c-bcd0-4a60-a20e-ce8b8609f2f5\") " pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" Jul 12 18:23:00.938261 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.938190 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c600f07c-bcd0-4a60-a20e-ce8b8609f2f5-manifests\") pod \"opendatahub-operator-controller-manager-db78fd4c7-krndh\" (UID: \"c600f07c-bcd0-4a60-a20e-ce8b8609f2f5\") " pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" Jul 12 18:23:00.938261 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.938217 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c600f07c-bcd0-4a60-a20e-ce8b8609f2f5-webhook-cert\") pod \"opendatahub-operator-controller-manager-db78fd4c7-krndh\" (UID: \"c600f07c-bcd0-4a60-a20e-ce8b8609f2f5\") " pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" Jul 12 18:23:00.938669 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.938641 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c600f07c-bcd0-4a60-a20e-ce8b8609f2f5-manifests\") pod \"opendatahub-operator-controller-manager-db78fd4c7-krndh\" (UID: \"c600f07c-bcd0-4a60-a20e-ce8b8609f2f5\") " pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" Jul 12 18:23:00.940396 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.940368 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c600f07c-bcd0-4a60-a20e-ce8b8609f2f5-tmp\") pod \"opendatahub-operator-controller-manager-db78fd4c7-krndh\" (UID: \"c600f07c-bcd0-4a60-a20e-ce8b8609f2f5\") " pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" Jul 12 18:23:00.940483 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.940470 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c600f07c-bcd0-4a60-a20e-ce8b8609f2f5-webhook-cert\") pod \"opendatahub-operator-controller-manager-db78fd4c7-krndh\" (UID: \"c600f07c-bcd0-4a60-a20e-ce8b8609f2f5\") " pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" Jul 12 18:23:00.940678 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.940658 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c600f07c-bcd0-4a60-a20e-ce8b8609f2f5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-db78fd4c7-krndh\" (UID: \"c600f07c-bcd0-4a60-a20e-ce8b8609f2f5\") " pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" Jul 12 18:23:00.946571 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:00.946548 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kz9z\" (UniqueName: \"kubernetes.io/projected/c600f07c-bcd0-4a60-a20e-ce8b8609f2f5-kube-api-access-8kz9z\") pod \"opendatahub-operator-controller-manager-db78fd4c7-krndh\" (UID: \"c600f07c-bcd0-4a60-a20e-ce8b8609f2f5\") " pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" Jul 12 18:23:01.018483 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:01.018420 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" Jul 12 18:23:01.152779 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:01.152702 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh"] Jul 12 18:23:01.159149 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:23:01.159116 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc600f07c_bcd0_4a60_a20e_ce8b8609f2f5.slice/crio-6c21826eebf2a43316cb01ee93b55c2a76b6d5f52015d3481cf573aeba2160d5 WatchSource:0}: Error finding container 6c21826eebf2a43316cb01ee93b55c2a76b6d5f52015d3481cf573aeba2160d5: Status 404 returned error can't find the container with id 6c21826eebf2a43316cb01ee93b55c2a76b6d5f52015d3481cf573aeba2160d5 Jul 12 18:23:01.161513 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:01.161494 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 18:23:01.902734 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:01.902692 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" event={"ID":"c600f07c-bcd0-4a60-a20e-ce8b8609f2f5","Type":"ContainerStarted","Data":"6c21826eebf2a43316cb01ee93b55c2a76b6d5f52015d3481cf573aeba2160d5"} Jul 12 18:23:04.916954 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:04.916912 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" event={"ID":"c600f07c-bcd0-4a60-a20e-ce8b8609f2f5","Type":"ContainerStarted","Data":"bdd6fe6470b3dafb8fd1411dea3eac6824beef43bf1fd1b1a215886d03020180"} Jul 12 18:23:05.923127 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:05.923067 2556 generic.go:356] "Generic (PLEG): container finished" podID="c600f07c-bcd0-4a60-a20e-ce8b8609f2f5" containerID="bdd6fe6470b3dafb8fd1411dea3eac6824beef43bf1fd1b1a215886d03020180" exitCode=0 Jul 12 18:23:05.923488 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:05.923126 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" event={"ID":"c600f07c-bcd0-4a60-a20e-ce8b8609f2f5","Type":"ContainerDied","Data":"bdd6fe6470b3dafb8fd1411dea3eac6824beef43bf1fd1b1a215886d03020180"} Jul 12 18:23:06.928922 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:06.928889 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" event={"ID":"c600f07c-bcd0-4a60-a20e-ce8b8609f2f5","Type":"ContainerStarted","Data":"08038465c8eee80a0181942eb9f42c1fd655c43b7b8347989f2cb3f192bad103"} Jul 12 18:23:06.929298 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:06.928987 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" Jul 12 18:23:06.960529 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:06.960483 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" podStartSLOduration=2.611351113 podStartE2EDuration="6.960468888s" totalImagesPullingTime="3.288038376s" totalInitContainerRuntime="1.061079399s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:23:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:23:06.959365351 +0000 UTC m=+366.658124533" watchObservedRunningTime="2026-07-12 18:23:06.960468888 +0000 UTC m=+366.659228054" Jul 12 18:23:17.935904 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:17.935876 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-db78fd4c7-krndh" Jul 12 18:23:20.251815 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:20.251782 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7bd558f979-mpsmk"] Jul 12 18:23:20.260678 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:20.260654 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bd558f979-mpsmk" Jul 12 18:23:20.263786 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:20.263765 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9px9r\"" Jul 12 18:23:20.264517 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:20.264499 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 12 18:23:20.264613 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:20.264564 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 12 18:23:20.270138 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:20.270119 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bd558f979-mpsmk"] Jul 12 18:23:20.391428 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:20.391397 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/299419f5-7d14-42fa-b8a1-6b2efb363ca0-tls-certs\") pod \"kube-auth-proxy-7bd558f979-mpsmk\" (UID: \"299419f5-7d14-42fa-b8a1-6b2efb363ca0\") " pod="openshift-ingress/kube-auth-proxy-7bd558f979-mpsmk" Jul 12 18:23:20.391565 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:20.391446 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/299419f5-7d14-42fa-b8a1-6b2efb363ca0-tmp\") pod \"kube-auth-proxy-7bd558f979-mpsmk\" (UID: \"299419f5-7d14-42fa-b8a1-6b2efb363ca0\") " pod="openshift-ingress/kube-auth-proxy-7bd558f979-mpsmk" Jul 12 18:23:20.391618 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:20.391559 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t478q\" (UniqueName: \"kubernetes.io/projected/299419f5-7d14-42fa-b8a1-6b2efb363ca0-kube-api-access-t478q\") pod \"kube-auth-proxy-7bd558f979-mpsmk\" (UID: \"299419f5-7d14-42fa-b8a1-6b2efb363ca0\") " pod="openshift-ingress/kube-auth-proxy-7bd558f979-mpsmk" Jul 12 18:23:20.492120 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:20.492091 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/299419f5-7d14-42fa-b8a1-6b2efb363ca0-tls-certs\") pod \"kube-auth-proxy-7bd558f979-mpsmk\" (UID: \"299419f5-7d14-42fa-b8a1-6b2efb363ca0\") " pod="openshift-ingress/kube-auth-proxy-7bd558f979-mpsmk" Jul 12 18:23:20.492120 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:20.492124 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/299419f5-7d14-42fa-b8a1-6b2efb363ca0-tmp\") pod \"kube-auth-proxy-7bd558f979-mpsmk\" (UID: \"299419f5-7d14-42fa-b8a1-6b2efb363ca0\") " pod="openshift-ingress/kube-auth-proxy-7bd558f979-mpsmk" Jul 12 18:23:20.492269 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:20.492230 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t478q\" (UniqueName: \"kubernetes.io/projected/299419f5-7d14-42fa-b8a1-6b2efb363ca0-kube-api-access-t478q\") pod \"kube-auth-proxy-7bd558f979-mpsmk\" (UID: \"299419f5-7d14-42fa-b8a1-6b2efb363ca0\") " pod="openshift-ingress/kube-auth-proxy-7bd558f979-mpsmk" Jul 12 18:23:20.494176 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:20.494151 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/299419f5-7d14-42fa-b8a1-6b2efb363ca0-tmp\") pod \"kube-auth-proxy-7bd558f979-mpsmk\" (UID: \"299419f5-7d14-42fa-b8a1-6b2efb363ca0\") " pod="openshift-ingress/kube-auth-proxy-7bd558f979-mpsmk" Jul 12 18:23:20.494483 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:20.494463 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/299419f5-7d14-42fa-b8a1-6b2efb363ca0-tls-certs\") pod \"kube-auth-proxy-7bd558f979-mpsmk\" (UID: \"299419f5-7d14-42fa-b8a1-6b2efb363ca0\") " pod="openshift-ingress/kube-auth-proxy-7bd558f979-mpsmk" Jul 12 18:23:20.502443 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:20.502394 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t478q\" (UniqueName: \"kubernetes.io/projected/299419f5-7d14-42fa-b8a1-6b2efb363ca0-kube-api-access-t478q\") pod \"kube-auth-proxy-7bd558f979-mpsmk\" (UID: \"299419f5-7d14-42fa-b8a1-6b2efb363ca0\") " pod="openshift-ingress/kube-auth-proxy-7bd558f979-mpsmk" Jul 12 18:23:20.570339 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:20.570316 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bd558f979-mpsmk" Jul 12 18:23:20.701185 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:20.701161 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bd558f979-mpsmk"] Jul 12 18:23:20.703606 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:23:20.703581 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod299419f5_7d14_42fa_b8a1_6b2efb363ca0.slice/crio-747abb1ec60ab719bb93b6b8b5038e772fecd3195d1d100efaf742033eeb248d WatchSource:0}: Error finding container 747abb1ec60ab719bb93b6b8b5038e772fecd3195d1d100efaf742033eeb248d: Status 404 returned error can't find the container with id 747abb1ec60ab719bb93b6b8b5038e772fecd3195d1d100efaf742033eeb248d Jul 12 18:23:20.988463 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:20.988432 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bd558f979-mpsmk" event={"ID":"299419f5-7d14-42fa-b8a1-6b2efb363ca0","Type":"ContainerStarted","Data":"747abb1ec60ab719bb93b6b8b5038e772fecd3195d1d100efaf742033eeb248d"} Jul 12 18:23:24.005317 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:24.005277 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bd558f979-mpsmk" event={"ID":"299419f5-7d14-42fa-b8a1-6b2efb363ca0","Type":"ContainerStarted","Data":"fb19c18a9eb80a011c21d46db7f59fd05f819def4e98a04577a2d89f0706a8b0"} Jul 12 18:23:24.020443 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:24.020397 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7bd558f979-mpsmk" podStartSLOduration=1.7506625439999999 podStartE2EDuration="4.020382234s" totalImagesPullingTime="2.26971969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:23:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:23:24.019675203 +0000 UTC m=+383.718434372" watchObservedRunningTime="2026-07-12 18:23:24.020382234 +0000 UTC m=+383.719141400" Jul 12 18:23:26.786668 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:26.786632 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-9757cf8df-qgmnd"] Jul 12 18:23:26.789911 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:26.789891 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9757cf8df-qgmnd" Jul 12 18:23:26.793202 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:26.793175 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 12 18:23:26.793327 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:26.793224 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 12 18:23:26.793327 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:26.793201 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 12 18:23:26.793327 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:26.793180 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 12 18:23:26.793534 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:26.793336 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-b44qt\"" Jul 12 18:23:26.793534 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:26.793387 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 12 18:23:26.799831 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:26.799811 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9757cf8df-qgmnd"] Jul 12 18:23:26.943009 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:26.942983 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dc7e3394-8b71-4284-b11f-343b940c3332-manager-config\") pod \"lws-controller-manager-9757cf8df-qgmnd\" (UID: \"dc7e3394-8b71-4284-b11f-343b940c3332\") " pod="openshift-lws-operator/lws-controller-manager-9757cf8df-qgmnd" Jul 12 18:23:26.943133 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:26.943014 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc7e3394-8b71-4284-b11f-343b940c3332-metrics-cert\") pod \"lws-controller-manager-9757cf8df-qgmnd\" (UID: \"dc7e3394-8b71-4284-b11f-343b940c3332\") " pod="openshift-lws-operator/lws-controller-manager-9757cf8df-qgmnd" Jul 12 18:23:26.943133 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:26.943040 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc7e3394-8b71-4284-b11f-343b940c3332-cert\") pod \"lws-controller-manager-9757cf8df-qgmnd\" (UID: \"dc7e3394-8b71-4284-b11f-343b940c3332\") " pod="openshift-lws-operator/lws-controller-manager-9757cf8df-qgmnd" Jul 12 18:23:26.943133 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:26.943114 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v8sw\" (UniqueName: \"kubernetes.io/projected/dc7e3394-8b71-4284-b11f-343b940c3332-kube-api-access-2v8sw\") pod \"lws-controller-manager-9757cf8df-qgmnd\" (UID: \"dc7e3394-8b71-4284-b11f-343b940c3332\") " pod="openshift-lws-operator/lws-controller-manager-9757cf8df-qgmnd" Jul 12 18:23:27.044031 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:27.043966 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc7e3394-8b71-4284-b11f-343b940c3332-cert\") pod \"lws-controller-manager-9757cf8df-qgmnd\" (UID: \"dc7e3394-8b71-4284-b11f-343b940c3332\") " pod="openshift-lws-operator/lws-controller-manager-9757cf8df-qgmnd" Jul 12 18:23:27.044031 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:27.044010 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v8sw\" (UniqueName: \"kubernetes.io/projected/dc7e3394-8b71-4284-b11f-343b940c3332-kube-api-access-2v8sw\") pod \"lws-controller-manager-9757cf8df-qgmnd\" (UID: \"dc7e3394-8b71-4284-b11f-343b940c3332\") " pod="openshift-lws-operator/lws-controller-manager-9757cf8df-qgmnd" Jul 12 18:23:27.044227 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:27.044069 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dc7e3394-8b71-4284-b11f-343b940c3332-manager-config\") pod \"lws-controller-manager-9757cf8df-qgmnd\" (UID: \"dc7e3394-8b71-4284-b11f-343b940c3332\") " pod="openshift-lws-operator/lws-controller-manager-9757cf8df-qgmnd" Jul 12 18:23:27.044227 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:27.044130 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc7e3394-8b71-4284-b11f-343b940c3332-metrics-cert\") pod \"lws-controller-manager-9757cf8df-qgmnd\" (UID: \"dc7e3394-8b71-4284-b11f-343b940c3332\") " pod="openshift-lws-operator/lws-controller-manager-9757cf8df-qgmnd" Jul 12 18:23:27.044770 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:27.044750 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/dc7e3394-8b71-4284-b11f-343b940c3332-manager-config\") pod \"lws-controller-manager-9757cf8df-qgmnd\" (UID: \"dc7e3394-8b71-4284-b11f-343b940c3332\") " pod="openshift-lws-operator/lws-controller-manager-9757cf8df-qgmnd" Jul 12 18:23:27.046404 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:27.046369 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/dc7e3394-8b71-4284-b11f-343b940c3332-cert\") pod \"lws-controller-manager-9757cf8df-qgmnd\" (UID: \"dc7e3394-8b71-4284-b11f-343b940c3332\") " pod="openshift-lws-operator/lws-controller-manager-9757cf8df-qgmnd" Jul 12 18:23:27.046564 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:27.046547 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc7e3394-8b71-4284-b11f-343b940c3332-metrics-cert\") pod \"lws-controller-manager-9757cf8df-qgmnd\" (UID: \"dc7e3394-8b71-4284-b11f-343b940c3332\") " pod="openshift-lws-operator/lws-controller-manager-9757cf8df-qgmnd" Jul 12 18:23:27.050945 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:27.050927 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v8sw\" (UniqueName: \"kubernetes.io/projected/dc7e3394-8b71-4284-b11f-343b940c3332-kube-api-access-2v8sw\") pod \"lws-controller-manager-9757cf8df-qgmnd\" (UID: \"dc7e3394-8b71-4284-b11f-343b940c3332\") " pod="openshift-lws-operator/lws-controller-manager-9757cf8df-qgmnd" Jul 12 18:23:27.098770 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:27.098745 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-9757cf8df-qgmnd" Jul 12 18:23:27.223515 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:27.223484 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-9757cf8df-qgmnd"] Jul 12 18:23:27.226655 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:23:27.226626 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7e3394_8b71_4284_b11f_343b940c3332.slice/crio-aa8febe97c01c6f2f487f7f13455991b01d1b4ec34e1c5d474434d95611215c3 WatchSource:0}: Error finding container aa8febe97c01c6f2f487f7f13455991b01d1b4ec34e1c5d474434d95611215c3: Status 404 returned error can't find the container with id aa8febe97c01c6f2f487f7f13455991b01d1b4ec34e1c5d474434d95611215c3 Jul 12 18:23:28.025274 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:28.025204 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9757cf8df-qgmnd" event={"ID":"dc7e3394-8b71-4284-b11f-343b940c3332","Type":"ContainerStarted","Data":"aa8febe97c01c6f2f487f7f13455991b01d1b4ec34e1c5d474434d95611215c3"} Jul 12 18:23:30.035288 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:30.035248 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-9757cf8df-qgmnd" event={"ID":"dc7e3394-8b71-4284-b11f-343b940c3332","Type":"ContainerStarted","Data":"633052b7c2b8315e55511b3708bb87a4822aa6ff1680ccb0f412d89f774a0b3c"} Jul 12 18:23:30.035663 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:30.035387 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-9757cf8df-qgmnd" Jul 12 18:23:30.054063 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:30.054016 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-9757cf8df-qgmnd" podStartSLOduration=1.7452937560000001 podStartE2EDuration="4.054003336s" totalImagesPullingTime="2.30870958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:23:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:23:30.052835036 +0000 UTC m=+389.751594203" watchObservedRunningTime="2026-07-12 18:23:30.054003336 +0000 UTC m=+389.752762503" Jul 12 18:23:41.040940 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:23:41.040902 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-9757cf8df-qgmnd" Jul 12 18:25:58.928259 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:25:58.928178 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-6vglt"] Jul 12 18:25:58.931245 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:25:58.931229 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6vglt" Jul 12 18:25:58.934088 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:25:58.934052 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 12 18:25:58.934088 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:25:58.934069 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6gsx6\"" Jul 12 18:25:58.934832 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:25:58.934819 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 12 18:25:58.945007 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:25:58.944983 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6vglt"] Jul 12 18:25:59.088551 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:25:59.088521 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crw5x\" (UniqueName: \"kubernetes.io/projected/731d72e6-a6cd-4a13-9905-1d1befd454ee-kube-api-access-crw5x\") pod \"authorino-58cd955675-6vglt\" (UID: \"731d72e6-a6cd-4a13-9905-1d1befd454ee\") " pod="kuadrant-system/authorino-58cd955675-6vglt" Jul 12 18:25:59.189233 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:25:59.189139 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crw5x\" (UniqueName: \"kubernetes.io/projected/731d72e6-a6cd-4a13-9905-1d1befd454ee-kube-api-access-crw5x\") pod \"authorino-58cd955675-6vglt\" (UID: \"731d72e6-a6cd-4a13-9905-1d1befd454ee\") " pod="kuadrant-system/authorino-58cd955675-6vglt" Jul 12 18:25:59.196640 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:25:59.196617 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crw5x\" (UniqueName: \"kubernetes.io/projected/731d72e6-a6cd-4a13-9905-1d1befd454ee-kube-api-access-crw5x\") pod \"authorino-58cd955675-6vglt\" (UID: \"731d72e6-a6cd-4a13-9905-1d1befd454ee\") " pod="kuadrant-system/authorino-58cd955675-6vglt" Jul 12 18:25:59.246181 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:25:59.246147 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6vglt" Jul 12 18:25:59.369053 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:25:59.369019 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6vglt"] Jul 12 18:25:59.372299 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:25:59.372272 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod731d72e6_a6cd_4a13_9905_1d1befd454ee.slice/crio-fd2527b1edea643409c1186b0c89f459651b79f130506da77fc01caf6697c7a4 WatchSource:0}: Error finding container fd2527b1edea643409c1186b0c89f459651b79f130506da77fc01caf6697c7a4: Status 404 returned error can't find the container with id fd2527b1edea643409c1186b0c89f459651b79f130506da77fc01caf6697c7a4 Jul 12 18:25:59.647263 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:25:59.647224 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6vglt" event={"ID":"731d72e6-a6cd-4a13-9905-1d1befd454ee","Type":"ContainerStarted","Data":"fd2527b1edea643409c1186b0c89f459651b79f130506da77fc01caf6697c7a4"} Jul 12 18:26:02.663192 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:02.663155 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6vglt" event={"ID":"731d72e6-a6cd-4a13-9905-1d1befd454ee","Type":"ContainerStarted","Data":"a907433141dcfd312b9a25873de4a7ef565d3467069570e98a88ea3f4aaa9207"} Jul 12 18:26:02.677317 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:02.677271 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-6vglt" podStartSLOduration=1.720484921 podStartE2EDuration="4.677253161s" totalImagesPullingTime="2.95676824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:25:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:26:02.676650253 +0000 UTC m=+542.375409422" watchObservedRunningTime="2026-07-12 18:26:02.677253161 +0000 UTC m=+542.376012327" Jul 12 18:26:04.210758 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:04.210722 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6vglt"] Jul 12 18:26:04.671303 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:04.671261 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-6vglt" podUID="731d72e6-a6cd-4a13-9905-1d1befd454ee" containerName="authorino" containerID="cri-o://a907433141dcfd312b9a25873de4a7ef565d3467069570e98a88ea3f4aaa9207" gracePeriod=30 Jul 12 18:26:04.915477 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:04.915452 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6vglt" Jul 12 18:26:05.044419 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:05.044327 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crw5x\" (UniqueName: \"kubernetes.io/projected/731d72e6-a6cd-4a13-9905-1d1befd454ee-kube-api-access-crw5x\") pod \"731d72e6-a6cd-4a13-9905-1d1befd454ee\" (UID: \"731d72e6-a6cd-4a13-9905-1d1befd454ee\") " Jul 12 18:26:05.046522 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:05.046493 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/731d72e6-a6cd-4a13-9905-1d1befd454ee-kube-api-access-crw5x" (OuterVolumeSpecName: "kube-api-access-crw5x") pod "731d72e6-a6cd-4a13-9905-1d1befd454ee" (UID: "731d72e6-a6cd-4a13-9905-1d1befd454ee"). InnerVolumeSpecName "kube-api-access-crw5x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 18:26:05.145228 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:05.145193 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crw5x\" (UniqueName: \"kubernetes.io/projected/731d72e6-a6cd-4a13-9905-1d1befd454ee-kube-api-access-crw5x\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:26:05.676946 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:05.676910 2556 generic.go:356] "Generic (PLEG): container finished" podID="731d72e6-a6cd-4a13-9905-1d1befd454ee" containerID="a907433141dcfd312b9a25873de4a7ef565d3467069570e98a88ea3f4aaa9207" exitCode=0 Jul 12 18:26:05.677434 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:05.676953 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6vglt" Jul 12 18:26:05.677434 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:05.676989 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6vglt" event={"ID":"731d72e6-a6cd-4a13-9905-1d1befd454ee","Type":"ContainerDied","Data":"a907433141dcfd312b9a25873de4a7ef565d3467069570e98a88ea3f4aaa9207"} Jul 12 18:26:05.677434 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:05.677030 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6vglt" event={"ID":"731d72e6-a6cd-4a13-9905-1d1befd454ee","Type":"ContainerDied","Data":"fd2527b1edea643409c1186b0c89f459651b79f130506da77fc01caf6697c7a4"} Jul 12 18:26:05.677434 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:05.677046 2556 scope.go:117] "RemoveContainer" containerID="a907433141dcfd312b9a25873de4a7ef565d3467069570e98a88ea3f4aaa9207" Jul 12 18:26:05.685270 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:05.685253 2556 scope.go:117] "RemoveContainer" containerID="a907433141dcfd312b9a25873de4a7ef565d3467069570e98a88ea3f4aaa9207" Jul 12 18:26:05.685498 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:26:05.685483 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a907433141dcfd312b9a25873de4a7ef565d3467069570e98a88ea3f4aaa9207\": container with ID starting with a907433141dcfd312b9a25873de4a7ef565d3467069570e98a88ea3f4aaa9207 not found: ID does not exist" containerID="a907433141dcfd312b9a25873de4a7ef565d3467069570e98a88ea3f4aaa9207" Jul 12 18:26:05.685534 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:05.685507 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a907433141dcfd312b9a25873de4a7ef565d3467069570e98a88ea3f4aaa9207"} err="failed to get container status \"a907433141dcfd312b9a25873de4a7ef565d3467069570e98a88ea3f4aaa9207\": rpc error: code = NotFound desc = could not find container \"a907433141dcfd312b9a25873de4a7ef565d3467069570e98a88ea3f4aaa9207\": container with ID starting with a907433141dcfd312b9a25873de4a7ef565d3467069570e98a88ea3f4aaa9207 not found: ID does not exist" Jul 12 18:26:05.695858 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:05.695831 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6vglt"] Jul 12 18:26:05.701480 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:05.701454 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-6vglt"] Jul 12 18:26:06.339679 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:06.339650 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="731d72e6-a6cd-4a13-9905-1d1befd454ee" path="/var/lib/kubelet/pods/731d72e6-a6cd-4a13-9905-1d1befd454ee/volumes" Jul 12 18:26:26.831408 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:26.831372 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f5zks"] Jul 12 18:26:26.831836 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:26.831646 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="731d72e6-a6cd-4a13-9905-1d1befd454ee" containerName="authorino" Jul 12 18:26:26.831836 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:26.831656 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="731d72e6-a6cd-4a13-9905-1d1befd454ee" containerName="authorino" Jul 12 18:26:26.831836 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:26.831714 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="731d72e6-a6cd-4a13-9905-1d1befd454ee" containerName="authorino" Jul 12 18:26:26.834692 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:26.834677 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-f5zks" Jul 12 18:26:26.841816 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:26.837163 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-6gsx6\"" Jul 12 18:26:26.841816 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:26.838203 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 12 18:26:26.842434 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:26.842246 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 12 18:26:26.845004 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:26.844981 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f5zks"] Jul 12 18:26:26.907688 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:26.907661 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlf9b\" (UniqueName: \"kubernetes.io/projected/c31771c3-9b95-4476-97a2-7141ba486cd2-kube-api-access-rlf9b\") pod \"authorino-5d4b67c446-f5zks\" (UID: \"c31771c3-9b95-4476-97a2-7141ba486cd2\") " pod="kuadrant-system/authorino-5d4b67c446-f5zks" Jul 12 18:26:27.008288 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.008253 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlf9b\" (UniqueName: \"kubernetes.io/projected/c31771c3-9b95-4476-97a2-7141ba486cd2-kube-api-access-rlf9b\") pod \"authorino-5d4b67c446-f5zks\" (UID: \"c31771c3-9b95-4476-97a2-7141ba486cd2\") " pod="kuadrant-system/authorino-5d4b67c446-f5zks" Jul 12 18:26:27.015848 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.015821 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlf9b\" (UniqueName: \"kubernetes.io/projected/c31771c3-9b95-4476-97a2-7141ba486cd2-kube-api-access-rlf9b\") pod \"authorino-5d4b67c446-f5zks\" (UID: \"c31771c3-9b95-4476-97a2-7141ba486cd2\") " pod="kuadrant-system/authorino-5d4b67c446-f5zks" Jul 12 18:26:27.056392 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.056367 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f5zks"] Jul 12 18:26:27.056606 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.056595 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-f5zks" Jul 12 18:26:27.078484 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.078460 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-665d875d8c-jsn66"] Jul 12 18:26:27.080643 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.080627 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-665d875d8c-jsn66" Jul 12 18:26:27.090974 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.090954 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-665d875d8c-jsn66"] Jul 12 18:26:27.109102 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.109048 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgzz7\" (UniqueName: \"kubernetes.io/projected/50ef99b4-09d9-4f47-9f9c-fe0d140c56f8-kube-api-access-dgzz7\") pod \"authorino-665d875d8c-jsn66\" (UID: \"50ef99b4-09d9-4f47-9f9c-fe0d140c56f8\") " pod="kuadrant-system/authorino-665d875d8c-jsn66" Jul 12 18:26:27.174262 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.174233 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-665d875d8c-jsn66"] Jul 12 18:26:27.174528 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:26:27.174504 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-dgzz7], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-665d875d8c-jsn66" podUID="50ef99b4-09d9-4f47-9f9c-fe0d140c56f8" Jul 12 18:26:27.180136 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.180106 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f5zks"] Jul 12 18:26:27.184063 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:26:27.184035 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc31771c3_9b95_4476_97a2_7141ba486cd2.slice/crio-6da15673a1ddb7698bf5f522c8b5f48fcd8c4e8bb18ba91d6b5d92fbb68a28f7 WatchSource:0}: Error finding container 6da15673a1ddb7698bf5f522c8b5f48fcd8c4e8bb18ba91d6b5d92fbb68a28f7: Status 404 returned error can't find the container with id 6da15673a1ddb7698bf5f522c8b5f48fcd8c4e8bb18ba91d6b5d92fbb68a28f7 Jul 12 18:26:27.204672 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.204650 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56cc84556c-sqgd8"] Jul 12 18:26:27.207133 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.207066 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56cc84556c-sqgd8" Jul 12 18:26:27.209491 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.209473 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 12 18:26:27.209572 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.209498 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgzz7\" (UniqueName: \"kubernetes.io/projected/50ef99b4-09d9-4f47-9f9c-fe0d140c56f8-kube-api-access-dgzz7\") pod \"authorino-665d875d8c-jsn66\" (UID: \"50ef99b4-09d9-4f47-9f9c-fe0d140c56f8\") " pod="kuadrant-system/authorino-665d875d8c-jsn66" Jul 12 18:26:27.215448 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.215426 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56cc84556c-sqgd8"] Jul 12 18:26:27.218442 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.218422 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgzz7\" (UniqueName: \"kubernetes.io/projected/50ef99b4-09d9-4f47-9f9c-fe0d140c56f8-kube-api-access-dgzz7\") pod \"authorino-665d875d8c-jsn66\" (UID: \"50ef99b4-09d9-4f47-9f9c-fe0d140c56f8\") " pod="kuadrant-system/authorino-665d875d8c-jsn66" Jul 12 18:26:27.310382 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.310350 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/30153732-7c22-4f44-8a90-66d982d27408-tls-cert\") pod \"authorino-56cc84556c-sqgd8\" (UID: \"30153732-7c22-4f44-8a90-66d982d27408\") " pod="kuadrant-system/authorino-56cc84556c-sqgd8" Jul 12 18:26:27.310382 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.310383 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njbh8\" (UniqueName: \"kubernetes.io/projected/30153732-7c22-4f44-8a90-66d982d27408-kube-api-access-njbh8\") pod \"authorino-56cc84556c-sqgd8\" (UID: \"30153732-7c22-4f44-8a90-66d982d27408\") " pod="kuadrant-system/authorino-56cc84556c-sqgd8" Jul 12 18:26:27.411132 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.411054 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/30153732-7c22-4f44-8a90-66d982d27408-tls-cert\") pod \"authorino-56cc84556c-sqgd8\" (UID: \"30153732-7c22-4f44-8a90-66d982d27408\") " pod="kuadrant-system/authorino-56cc84556c-sqgd8" Jul 12 18:26:27.411132 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.411107 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njbh8\" (UniqueName: \"kubernetes.io/projected/30153732-7c22-4f44-8a90-66d982d27408-kube-api-access-njbh8\") pod \"authorino-56cc84556c-sqgd8\" (UID: \"30153732-7c22-4f44-8a90-66d982d27408\") " pod="kuadrant-system/authorino-56cc84556c-sqgd8" Jul 12 18:26:27.413448 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.413425 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/30153732-7c22-4f44-8a90-66d982d27408-tls-cert\") pod \"authorino-56cc84556c-sqgd8\" (UID: \"30153732-7c22-4f44-8a90-66d982d27408\") " pod="kuadrant-system/authorino-56cc84556c-sqgd8" Jul 12 18:26:27.417909 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.417891 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njbh8\" (UniqueName: \"kubernetes.io/projected/30153732-7c22-4f44-8a90-66d982d27408-kube-api-access-njbh8\") pod \"authorino-56cc84556c-sqgd8\" (UID: \"30153732-7c22-4f44-8a90-66d982d27408\") " pod="kuadrant-system/authorino-56cc84556c-sqgd8" Jul 12 18:26:27.516390 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.516337 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56cc84556c-sqgd8" Jul 12 18:26:27.650428 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.650391 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56cc84556c-sqgd8"] Jul 12 18:26:27.653000 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:26:27.652975 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30153732_7c22_4f44_8a90_66d982d27408.slice/crio-23eebf076e522236ea736d7daf8a57b6542da8bac217b375a25b840c5994b986 WatchSource:0}: Error finding container 23eebf076e522236ea736d7daf8a57b6542da8bac217b375a25b840c5994b986: Status 404 returned error can't find the container with id 23eebf076e522236ea736d7daf8a57b6542da8bac217b375a25b840c5994b986 Jul 12 18:26:27.768052 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.767980 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-f5zks" event={"ID":"c31771c3-9b95-4476-97a2-7141ba486cd2","Type":"ContainerStarted","Data":"069813ba57dfcf914c572d59677cae06fbc44f24b3eea7c7a149e2e48706be46"} Jul 12 18:26:27.768052 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.768019 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-f5zks" event={"ID":"c31771c3-9b95-4476-97a2-7141ba486cd2","Type":"ContainerStarted","Data":"6da15673a1ddb7698bf5f522c8b5f48fcd8c4e8bb18ba91d6b5d92fbb68a28f7"} Jul 12 18:26:27.768052 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.768036 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-f5zks" podUID="c31771c3-9b95-4476-97a2-7141ba486cd2" containerName="authorino" containerID="cri-o://069813ba57dfcf914c572d59677cae06fbc44f24b3eea7c7a149e2e48706be46" gracePeriod=30 Jul 12 18:26:27.769271 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.769250 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-665d875d8c-jsn66" Jul 12 18:26:27.769404 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.769275 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56cc84556c-sqgd8" event={"ID":"30153732-7c22-4f44-8a90-66d982d27408","Type":"ContainerStarted","Data":"23eebf076e522236ea736d7daf8a57b6542da8bac217b375a25b840c5994b986"} Jul 12 18:26:27.775071 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.775050 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-665d875d8c-jsn66" Jul 12 18:26:27.783258 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.783220 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-f5zks" podStartSLOduration=1.473978544 podStartE2EDuration="1.783205905s" totalImagesPullingTime="309.227361ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:26:27.781182787 +0000 UTC m=+567.479941945" watchObservedRunningTime="2026-07-12 18:26:27.783205905 +0000 UTC m=+567.481965071" Jul 12 18:26:27.814595 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.814569 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dgzz7\" (UniqueName: \"kubernetes.io/projected/50ef99b4-09d9-4f47-9f9c-fe0d140c56f8-kube-api-access-dgzz7\") pod \"50ef99b4-09d9-4f47-9f9c-fe0d140c56f8\" (UID: \"50ef99b4-09d9-4f47-9f9c-fe0d140c56f8\") " Jul 12 18:26:27.816490 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.816463 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50ef99b4-09d9-4f47-9f9c-fe0d140c56f8-kube-api-access-dgzz7" (OuterVolumeSpecName: "kube-api-access-dgzz7") pod "50ef99b4-09d9-4f47-9f9c-fe0d140c56f8" (UID: "50ef99b4-09d9-4f47-9f9c-fe0d140c56f8"). InnerVolumeSpecName "kube-api-access-dgzz7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 18:26:27.915635 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:27.915605 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dgzz7\" (UniqueName: \"kubernetes.io/projected/50ef99b4-09d9-4f47-9f9c-fe0d140c56f8-kube-api-access-dgzz7\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:26:28.002379 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:28.002358 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-f5zks" Jul 12 18:26:28.016341 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:28.016323 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlf9b\" (UniqueName: \"kubernetes.io/projected/c31771c3-9b95-4476-97a2-7141ba486cd2-kube-api-access-rlf9b\") pod \"c31771c3-9b95-4476-97a2-7141ba486cd2\" (UID: \"c31771c3-9b95-4476-97a2-7141ba486cd2\") " Jul 12 18:26:28.018499 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:28.018474 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c31771c3-9b95-4476-97a2-7141ba486cd2-kube-api-access-rlf9b" (OuterVolumeSpecName: "kube-api-access-rlf9b") pod "c31771c3-9b95-4476-97a2-7141ba486cd2" (UID: "c31771c3-9b95-4476-97a2-7141ba486cd2"). InnerVolumeSpecName "kube-api-access-rlf9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 18:26:28.117562 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:28.117533 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlf9b\" (UniqueName: \"kubernetes.io/projected/c31771c3-9b95-4476-97a2-7141ba486cd2-kube-api-access-rlf9b\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:26:28.774264 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:28.774179 2556 generic.go:356] "Generic (PLEG): container finished" podID="c31771c3-9b95-4476-97a2-7141ba486cd2" containerID="069813ba57dfcf914c572d59677cae06fbc44f24b3eea7c7a149e2e48706be46" exitCode=0 Jul 12 18:26:28.774264 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:28.774217 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-f5zks" Jul 12 18:26:28.774481 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:28.774260 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-f5zks" event={"ID":"c31771c3-9b95-4476-97a2-7141ba486cd2","Type":"ContainerDied","Data":"069813ba57dfcf914c572d59677cae06fbc44f24b3eea7c7a149e2e48706be46"} Jul 12 18:26:28.774481 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:28.774295 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-f5zks" event={"ID":"c31771c3-9b95-4476-97a2-7141ba486cd2","Type":"ContainerDied","Data":"6da15673a1ddb7698bf5f522c8b5f48fcd8c4e8bb18ba91d6b5d92fbb68a28f7"} Jul 12 18:26:28.774481 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:28.774313 2556 scope.go:117] "RemoveContainer" containerID="069813ba57dfcf914c572d59677cae06fbc44f24b3eea7c7a149e2e48706be46" Jul 12 18:26:28.775888 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:28.775870 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-665d875d8c-jsn66" Jul 12 18:26:28.776002 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:28.775924 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56cc84556c-sqgd8" event={"ID":"30153732-7c22-4f44-8a90-66d982d27408","Type":"ContainerStarted","Data":"408e7792588667e4a14222d904a8c4231b534f76c1e375ab68e017d821687e4b"} Jul 12 18:26:28.782933 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:28.782916 2556 scope.go:117] "RemoveContainer" containerID="069813ba57dfcf914c572d59677cae06fbc44f24b3eea7c7a149e2e48706be46" Jul 12 18:26:28.783209 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:26:28.783184 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"069813ba57dfcf914c572d59677cae06fbc44f24b3eea7c7a149e2e48706be46\": container with ID starting with 069813ba57dfcf914c572d59677cae06fbc44f24b3eea7c7a149e2e48706be46 not found: ID does not exist" containerID="069813ba57dfcf914c572d59677cae06fbc44f24b3eea7c7a149e2e48706be46" Jul 12 18:26:28.783257 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:28.783216 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"069813ba57dfcf914c572d59677cae06fbc44f24b3eea7c7a149e2e48706be46"} err="failed to get container status \"069813ba57dfcf914c572d59677cae06fbc44f24b3eea7c7a149e2e48706be46\": rpc error: code = NotFound desc = could not find container \"069813ba57dfcf914c572d59677cae06fbc44f24b3eea7c7a149e2e48706be46\": container with ID starting with 069813ba57dfcf914c572d59677cae06fbc44f24b3eea7c7a149e2e48706be46 not found: ID does not exist" Jul 12 18:26:28.793969 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:28.793932 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-56cc84556c-sqgd8" podStartSLOduration=1.447724024 podStartE2EDuration="1.793921156s" totalImagesPullingTime="346.197132ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:26:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:26:28.793168303 +0000 UTC m=+568.491927470" watchObservedRunningTime="2026-07-12 18:26:28.793921156 +0000 UTC m=+568.492680345" Jul 12 18:26:28.807962 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:28.807940 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f5zks"] Jul 12 18:26:28.810113 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:28.810068 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-f5zks"] Jul 12 18:26:28.831517 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:28.831486 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-665d875d8c-jsn66"] Jul 12 18:26:28.837289 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:28.837266 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-665d875d8c-jsn66"] Jul 12 18:26:30.339472 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:30.339439 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50ef99b4-09d9-4f47-9f9c-fe0d140c56f8" path="/var/lib/kubelet/pods/50ef99b4-09d9-4f47-9f9c-fe0d140c56f8/volumes" Jul 12 18:26:30.339821 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:26:30.339648 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c31771c3-9b95-4476-97a2-7141ba486cd2" path="/var/lib/kubelet/pods/c31771c3-9b95-4476-97a2-7141ba486cd2/volumes" Jul 12 18:27:02.243153 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:02.243126 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/2.log" Jul 12 18:27:02.245217 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:02.245197 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/2.log" Jul 12 18:27:53.630189 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.630153 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh"] Jul 12 18:27:53.630619 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.630464 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c31771c3-9b95-4476-97a2-7141ba486cd2" containerName="authorino" Jul 12 18:27:53.630619 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.630476 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c31771c3-9b95-4476-97a2-7141ba486cd2" containerName="authorino" Jul 12 18:27:53.630619 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.630539 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c31771c3-9b95-4476-97a2-7141ba486cd2" containerName="authorino" Jul 12 18:27:53.633323 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.633307 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:27:53.636655 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.636630 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zf69s\"" Jul 12 18:27:53.636974 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.636953 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 12 18:27:53.637639 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.637621 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 12 18:27:53.637729 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.637709 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 12 18:27:53.648956 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.648932 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh"] Jul 12 18:27:53.668365 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.668215 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nwgvh\" (UID: \"b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:27:53.668365 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.668266 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nwgvh\" (UID: \"b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:27:53.668365 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.668313 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nwgvh\" (UID: \"b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:27:53.668365 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.668353 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j5xj\" (UniqueName: \"kubernetes.io/projected/b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24-kube-api-access-2j5xj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nwgvh\" (UID: \"b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:27:53.668729 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.668476 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nwgvh\" (UID: \"b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:27:53.668729 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.668521 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nwgvh\" (UID: \"b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:27:53.768937 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.768896 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nwgvh\" (UID: \"b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:27:53.768937 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.768944 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j5xj\" (UniqueName: \"kubernetes.io/projected/b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24-kube-api-access-2j5xj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nwgvh\" (UID: \"b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:27:53.769209 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.768971 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nwgvh\" (UID: \"b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:27:53.769209 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.768998 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nwgvh\" (UID: \"b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:27:53.769209 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.769019 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nwgvh\" (UID: \"b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:27:53.769209 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.769131 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nwgvh\" (UID: \"b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:27:53.769434 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.769413 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nwgvh\" (UID: \"b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:27:53.769492 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.769441 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nwgvh\" (UID: \"b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:27:53.769537 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.769510 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nwgvh\" (UID: \"b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:27:53.771360 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.771332 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nwgvh\" (UID: \"b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:27:53.771582 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.771566 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nwgvh\" (UID: \"b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:27:53.781125 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.781073 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j5xj\" (UniqueName: \"kubernetes.io/projected/b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24-kube-api-access-2j5xj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nwgvh\" (UID: \"b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:27:53.943185 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:53.943101 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:27:54.089816 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:54.089785 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh"] Jul 12 18:27:54.092529 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:27:54.092500 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1a79cfc_c45f_4c7d_92d8_a22b34b4ef24.slice/crio-20caacf874334f61eb0ed39a4c6d2fe4c0b5018f758da9d4e3c3aa370814c52f WatchSource:0}: Error finding container 20caacf874334f61eb0ed39a4c6d2fe4c0b5018f758da9d4e3c3aa370814c52f: Status 404 returned error can't find the container with id 20caacf874334f61eb0ed39a4c6d2fe4c0b5018f758da9d4e3c3aa370814c52f Jul 12 18:27:54.131975 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:54.131939 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" event={"ID":"b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24","Type":"ContainerStarted","Data":"20caacf874334f61eb0ed39a4c6d2fe4c0b5018f758da9d4e3c3aa370814c52f"} Jul 12 18:27:56.144676 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:56.144621 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" event={"ID":"b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24","Type":"ContainerStarted","Data":"1b7af60bf038d0006385814bf02284889c52dc9857abe8de00e3c44212018d40"} Jul 12 18:27:56.185398 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:27:56.185341 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" podStartSLOduration=2.193881665 podStartE2EDuration="3.185321726s" totalImagesPullingTime="991.440061ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:27:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:27:56.184331499 +0000 UTC m=+655.883090666" watchObservedRunningTime="2026-07-12 18:27:56.185321726 +0000 UTC m=+655.884080894" Jul 12 18:28:03.943481 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:03.943430 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:28:03.943881 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:03.943533 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:28:03.955720 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:03.955695 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:28:04.188142 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:04.188110 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nwgvh" Jul 12 18:28:06.077607 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.077580 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r"] Jul 12 18:28:06.083864 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.083846 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:06.086886 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.086866 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 12 18:28:06.095271 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.095243 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r"] Jul 12 18:28:06.170405 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.170364 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r\" (UID: \"7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:06.170560 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.170418 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r\" (UID: \"7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:06.170560 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.170495 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r\" (UID: \"7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:06.170560 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.170530 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r\" (UID: \"7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:06.170560 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.170549 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8vk5\" (UniqueName: \"kubernetes.io/projected/7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2-kube-api-access-c8vk5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r\" (UID: \"7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:06.170693 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.170570 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r\" (UID: \"7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:06.271986 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.271953 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r\" (UID: \"7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:06.272173 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.272002 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r\" (UID: \"7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:06.272173 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.272050 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r\" (UID: \"7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:06.272173 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.272110 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r\" (UID: \"7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:06.272173 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.272137 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8vk5\" (UniqueName: \"kubernetes.io/projected/7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2-kube-api-access-c8vk5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r\" (UID: \"7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:06.272173 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.272160 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r\" (UID: \"7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:06.272460 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.272435 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r\" (UID: \"7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:06.272585 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.272484 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r\" (UID: \"7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:06.272585 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.272504 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r\" (UID: \"7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:06.274431 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.274409 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r\" (UID: \"7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:06.274680 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.274665 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r\" (UID: \"7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:06.281460 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.281435 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8vk5\" (UniqueName: \"kubernetes.io/projected/7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2-kube-api-access-c8vk5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r\" (UID: \"7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:06.394157 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.394131 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:06.529858 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.529822 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r"] Jul 12 18:28:06.532758 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:28:06.532730 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f38c7c4_2e3b_4e1a_b5f3_9d8a197f17e2.slice/crio-ff3a526ea7d648d115d02a3758f3963ce413803fb363d4e24a2e9ccb12ed441a WatchSource:0}: Error finding container ff3a526ea7d648d115d02a3758f3963ce413803fb363d4e24a2e9ccb12ed441a: Status 404 returned error can't find the container with id ff3a526ea7d648d115d02a3758f3963ce413803fb363d4e24a2e9ccb12ed441a Jul 12 18:28:06.534308 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:06.534287 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 18:28:07.191155 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:07.191120 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" event={"ID":"7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2","Type":"ContainerStarted","Data":"50652eb998d287e2d35de0e049c635210fb3498c5f54d67a3cd3362f966fcb70"} Jul 12 18:28:07.191548 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:07.191180 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" event={"ID":"7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2","Type":"ContainerStarted","Data":"ff3a526ea7d648d115d02a3758f3963ce413803fb363d4e24a2e9ccb12ed441a"} Jul 12 18:28:07.209820 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:07.209769 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" podStartSLOduration=1.040392079 podStartE2EDuration="1.20975239s" totalImagesPullingTime="169.360311ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:28:07.20846076 +0000 UTC m=+666.907219930" watchObservedRunningTime="2026-07-12 18:28:07.20975239 +0000 UTC m=+666.908511558" Jul 12 18:28:16.394911 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:16.394873 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:16.395469 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:16.394941 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:16.407786 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:16.407763 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:17.250870 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:17.250838 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r" Jul 12 18:28:19.991478 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:19.991445 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq"] Jul 12 18:28:19.995392 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:19.995366 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:19.997806 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:19.997784 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 12 18:28:20.007024 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:20.007002 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq"] Jul 12 18:28:20.088684 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:20.088643 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9571fbbf-7cc3-4175-9693-a5bfafc6e13d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq\" (UID: \"9571fbbf-7cc3-4175-9693-a5bfafc6e13d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:20.088867 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:20.088695 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb86d\" (UniqueName: \"kubernetes.io/projected/9571fbbf-7cc3-4175-9693-a5bfafc6e13d-kube-api-access-wb86d\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq\" (UID: \"9571fbbf-7cc3-4175-9693-a5bfafc6e13d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:20.088867 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:20.088732 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9571fbbf-7cc3-4175-9693-a5bfafc6e13d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq\" (UID: \"9571fbbf-7cc3-4175-9693-a5bfafc6e13d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:20.088867 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:20.088751 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9571fbbf-7cc3-4175-9693-a5bfafc6e13d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq\" (UID: \"9571fbbf-7cc3-4175-9693-a5bfafc6e13d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:20.088867 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:20.088769 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9571fbbf-7cc3-4175-9693-a5bfafc6e13d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq\" (UID: \"9571fbbf-7cc3-4175-9693-a5bfafc6e13d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:20.088867 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:20.088786 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9571fbbf-7cc3-4175-9693-a5bfafc6e13d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq\" (UID: \"9571fbbf-7cc3-4175-9693-a5bfafc6e13d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:20.190153 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:20.190116 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb86d\" (UniqueName: \"kubernetes.io/projected/9571fbbf-7cc3-4175-9693-a5bfafc6e13d-kube-api-access-wb86d\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq\" (UID: \"9571fbbf-7cc3-4175-9693-a5bfafc6e13d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:20.190336 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:20.190161 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9571fbbf-7cc3-4175-9693-a5bfafc6e13d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq\" (UID: \"9571fbbf-7cc3-4175-9693-a5bfafc6e13d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:20.190336 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:20.190181 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9571fbbf-7cc3-4175-9693-a5bfafc6e13d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq\" (UID: \"9571fbbf-7cc3-4175-9693-a5bfafc6e13d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:20.190336 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:20.190310 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9571fbbf-7cc3-4175-9693-a5bfafc6e13d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq\" (UID: \"9571fbbf-7cc3-4175-9693-a5bfafc6e13d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:20.190585 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:20.190341 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9571fbbf-7cc3-4175-9693-a5bfafc6e13d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq\" (UID: \"9571fbbf-7cc3-4175-9693-a5bfafc6e13d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:20.190585 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:20.190445 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9571fbbf-7cc3-4175-9693-a5bfafc6e13d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq\" (UID: \"9571fbbf-7cc3-4175-9693-a5bfafc6e13d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:20.190689 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:20.190604 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9571fbbf-7cc3-4175-9693-a5bfafc6e13d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq\" (UID: \"9571fbbf-7cc3-4175-9693-a5bfafc6e13d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:20.190767 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:20.190745 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9571fbbf-7cc3-4175-9693-a5bfafc6e13d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq\" (UID: \"9571fbbf-7cc3-4175-9693-a5bfafc6e13d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:20.190805 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:20.190795 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9571fbbf-7cc3-4175-9693-a5bfafc6e13d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq\" (UID: \"9571fbbf-7cc3-4175-9693-a5bfafc6e13d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:20.192517 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:20.192498 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9571fbbf-7cc3-4175-9693-a5bfafc6e13d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq\" (UID: \"9571fbbf-7cc3-4175-9693-a5bfafc6e13d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:20.192783 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:20.192764 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9571fbbf-7cc3-4175-9693-a5bfafc6e13d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq\" (UID: \"9571fbbf-7cc3-4175-9693-a5bfafc6e13d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:20.198557 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:20.198533 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb86d\" (UniqueName: \"kubernetes.io/projected/9571fbbf-7cc3-4175-9693-a5bfafc6e13d-kube-api-access-wb86d\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq\" (UID: \"9571fbbf-7cc3-4175-9693-a5bfafc6e13d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:20.305141 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:20.305033 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:20.447989 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:20.446199 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq"] Jul 12 18:28:20.449696 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:28:20.449661 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9571fbbf_7cc3_4175_9693_a5bfafc6e13d.slice/crio-f3ce16751225cdec0fa0e6a1a3fd81b4de215187a0b505a344fb8341273a9db0 WatchSource:0}: Error finding container f3ce16751225cdec0fa0e6a1a3fd81b4de215187a0b505a344fb8341273a9db0: Status 404 returned error can't find the container with id f3ce16751225cdec0fa0e6a1a3fd81b4de215187a0b505a344fb8341273a9db0 Jul 12 18:28:21.257512 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:21.257474 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" event={"ID":"9571fbbf-7cc3-4175-9693-a5bfafc6e13d","Type":"ContainerStarted","Data":"d8c91ecd226e948a69a32d134e880a542c7f8b046fb2e755359cae5d84b5d028"} Jul 12 18:28:21.257855 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:21.257520 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" event={"ID":"9571fbbf-7cc3-4175-9693-a5bfafc6e13d","Type":"ContainerStarted","Data":"f3ce16751225cdec0fa0e6a1a3fd81b4de215187a0b505a344fb8341273a9db0"} Jul 12 18:28:21.275354 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:21.275310 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" podStartSLOduration=2.118911824 podStartE2EDuration="2.275294163s" totalImagesPullingTime="156.382339ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:28:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:28:21.273328499 +0000 UTC m=+680.972087691" watchObservedRunningTime="2026-07-12 18:28:21.275294163 +0000 UTC m=+680.974053332" Jul 12 18:28:30.305672 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:30.305645 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:30.306132 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:30.305682 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:30.317926 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:30.317898 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:28:31.310602 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:28:31.310572 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq" Jul 12 18:29:26.284450 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:29:26.284418 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56cc84556c-sqgd8"] Jul 12 18:29:26.284977 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:29:26.284598 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-56cc84556c-sqgd8" podUID="30153732-7c22-4f44-8a90-66d982d27408" containerName="authorino" containerID="cri-o://408e7792588667e4a14222d904a8c4231b534f76c1e375ab68e017d821687e4b" gracePeriod=30 Jul 12 18:29:26.532039 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:29:26.532012 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56cc84556c-sqgd8" Jul 12 18:29:26.533198 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:29:26.533172 2556 generic.go:356] "Generic (PLEG): container finished" podID="30153732-7c22-4f44-8a90-66d982d27408" containerID="408e7792588667e4a14222d904a8c4231b534f76c1e375ab68e017d821687e4b" exitCode=0 Jul 12 18:29:26.533312 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:29:26.533242 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56cc84556c-sqgd8" event={"ID":"30153732-7c22-4f44-8a90-66d982d27408","Type":"ContainerDied","Data":"408e7792588667e4a14222d904a8c4231b534f76c1e375ab68e017d821687e4b"} Jul 12 18:29:26.533312 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:29:26.533278 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56cc84556c-sqgd8" event={"ID":"30153732-7c22-4f44-8a90-66d982d27408","Type":"ContainerDied","Data":"23eebf076e522236ea736d7daf8a57b6542da8bac217b375a25b840c5994b986"} Jul 12 18:29:26.533312 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:29:26.533295 2556 scope.go:117] "RemoveContainer" containerID="408e7792588667e4a14222d904a8c4231b534f76c1e375ab68e017d821687e4b" Jul 12 18:29:26.541023 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:29:26.541002 2556 scope.go:117] "RemoveContainer" containerID="408e7792588667e4a14222d904a8c4231b534f76c1e375ab68e017d821687e4b" Jul 12 18:29:26.541294 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:29:26.541280 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"408e7792588667e4a14222d904a8c4231b534f76c1e375ab68e017d821687e4b\": container with ID starting with 408e7792588667e4a14222d904a8c4231b534f76c1e375ab68e017d821687e4b not found: ID does not exist" containerID="408e7792588667e4a14222d904a8c4231b534f76c1e375ab68e017d821687e4b" Jul 12 18:29:26.541346 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:29:26.541301 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"408e7792588667e4a14222d904a8c4231b534f76c1e375ab68e017d821687e4b"} err="failed to get container status \"408e7792588667e4a14222d904a8c4231b534f76c1e375ab68e017d821687e4b\": rpc error: code = NotFound desc = could not find container \"408e7792588667e4a14222d904a8c4231b534f76c1e375ab68e017d821687e4b\": container with ID starting with 408e7792588667e4a14222d904a8c4231b534f76c1e375ab68e017d821687e4b not found: ID does not exist" Jul 12 18:29:26.652219 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:29:26.652191 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/30153732-7c22-4f44-8a90-66d982d27408-tls-cert\") pod \"30153732-7c22-4f44-8a90-66d982d27408\" (UID: \"30153732-7c22-4f44-8a90-66d982d27408\") " Jul 12 18:29:26.652352 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:29:26.652268 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njbh8\" (UniqueName: \"kubernetes.io/projected/30153732-7c22-4f44-8a90-66d982d27408-kube-api-access-njbh8\") pod \"30153732-7c22-4f44-8a90-66d982d27408\" (UID: \"30153732-7c22-4f44-8a90-66d982d27408\") " Jul 12 18:29:26.654186 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:29:26.654157 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30153732-7c22-4f44-8a90-66d982d27408-kube-api-access-njbh8" (OuterVolumeSpecName: "kube-api-access-njbh8") pod "30153732-7c22-4f44-8a90-66d982d27408" (UID: "30153732-7c22-4f44-8a90-66d982d27408"). InnerVolumeSpecName "kube-api-access-njbh8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 18:29:26.661925 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:29:26.661901 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30153732-7c22-4f44-8a90-66d982d27408-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "30153732-7c22-4f44-8a90-66d982d27408" (UID: "30153732-7c22-4f44-8a90-66d982d27408"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 18:29:26.753313 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:29:26.753284 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njbh8\" (UniqueName: \"kubernetes.io/projected/30153732-7c22-4f44-8a90-66d982d27408-kube-api-access-njbh8\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:29:26.753313 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:29:26.753308 2556 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/30153732-7c22-4f44-8a90-66d982d27408-tls-cert\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:29:27.539134 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:29:27.539106 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56cc84556c-sqgd8" Jul 12 18:29:27.559105 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:29:27.559068 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56cc84556c-sqgd8"] Jul 12 18:29:27.563710 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:29:27.563686 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56cc84556c-sqgd8"] Jul 12 18:29:28.340360 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:29:28.340330 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30153732-7c22-4f44-8a90-66d982d27408" path="/var/lib/kubelet/pods/30153732-7c22-4f44-8a90-66d982d27408/volumes" Jul 12 18:32:02.271648 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:32:02.271563 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/2.log" Jul 12 18:32:02.272164 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:32:02.271708 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/2.log" Jul 12 18:37:02.296943 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:37:02.296907 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/2.log" Jul 12 18:37:02.297709 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:37:02.297690 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/2.log" Jul 12 18:42:02.322291 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:42:02.322257 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/2.log" Jul 12 18:42:02.324697 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:42:02.324363 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/2.log" Jul 12 18:46:03.780673 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:03.780637 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r"] Jul 12 18:46:03.781171 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:03.780937 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30153732-7c22-4f44-8a90-66d982d27408" containerName="authorino" Jul 12 18:46:03.781171 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:03.780947 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="30153732-7c22-4f44-8a90-66d982d27408" containerName="authorino" Jul 12 18:46:03.781171 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:03.781018 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="30153732-7c22-4f44-8a90-66d982d27408" containerName="authorino" Jul 12 18:46:03.783929 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:03.783911 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:03.786363 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:03.786337 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0328d158\"/\"kube-root-ca.crt\"" Jul 12 18:46:03.787283 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:03.787260 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-0328d158\"/\"openshift-service-ca.crt\"" Jul 12 18:46:03.787375 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:03.787305 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0328d158\"/\"default-dockercfg-sbvk2\"" Jul 12 18:46:03.787375 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:03.787357 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-0328d158\"/\"e2e-lifecycle-model-0328d158-kserve-self-signed-certs\"" Jul 12 18:46:03.793225 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:03.793202 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r"] Jul 12 18:46:03.949418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:03.949383 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-dshm\") pod \"e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:03.949418 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:03.949418 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-model-cache\") pod \"e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:03.949668 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:03.949439 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r7tb\" (UniqueName: \"kubernetes.io/projected/6506da37-9394-4ef1-bc3a-923083deaf69-kube-api-access-8r7tb\") pod \"e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:03.949668 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:03.949552 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6506da37-9394-4ef1-bc3a-923083deaf69-tls-certs\") pod \"e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:03.949668 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:03.949584 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-tmp-dir\") pod \"e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:03.949668 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:03.949646 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-home\") pod \"e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:04.050931 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:04.050843 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6506da37-9394-4ef1-bc3a-923083deaf69-tls-certs\") pod \"e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:04.050931 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:04.050882 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-tmp-dir\") pod \"e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:04.051187 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:04.050986 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-home\") pod \"e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:04.051187 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:04.051045 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-dshm\") pod \"e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:04.051187 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:04.051064 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-model-cache\") pod \"e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:04.051335 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:04.051190 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r7tb\" (UniqueName: \"kubernetes.io/projected/6506da37-9394-4ef1-bc3a-923083deaf69-kube-api-access-8r7tb\") pod \"e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:04.051335 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:04.051274 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-tmp-dir\") pod \"e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:04.051441 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:04.051346 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-home\") pod \"e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:04.051492 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:04.051444 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-model-cache\") pod \"e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:04.053228 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:04.053207 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-dshm\") pod \"e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:04.053420 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:04.053402 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6506da37-9394-4ef1-bc3a-923083deaf69-tls-certs\") pod \"e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:04.059524 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:04.059502 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r7tb\" (UniqueName: \"kubernetes.io/projected/6506da37-9394-4ef1-bc3a-923083deaf69-kube-api-access-8r7tb\") pod \"e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:04.093440 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:04.093405 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:04.230477 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:04.230442 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r"] Jul 12 18:46:04.234063 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:46:04.234037 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6506da37_9394_4ef1_bc3a_923083deaf69.slice/crio-d1e709d5a06a47b63673446fccae073db29b16db94d059dbbb463868306aa171 WatchSource:0}: Error finding container d1e709d5a06a47b63673446fccae073db29b16db94d059dbbb463868306aa171: Status 404 returned error can't find the container with id d1e709d5a06a47b63673446fccae073db29b16db94d059dbbb463868306aa171 Jul 12 18:46:04.782397 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:04.782356 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" event={"ID":"6506da37-9394-4ef1-bc3a-923083deaf69","Type":"ContainerStarted","Data":"b482c06ac4332ff4323186b5e01db57457976b77bfae418137e708507b116db6"} Jul 12 18:46:04.782397 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:04.782400 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" event={"ID":"6506da37-9394-4ef1-bc3a-923083deaf69","Type":"ContainerStarted","Data":"d1e709d5a06a47b63673446fccae073db29b16db94d059dbbb463868306aa171"} Jul 12 18:46:04.798480 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:04.798405 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" podStartSLOduration=1.798389577 podStartE2EDuration="1.798389577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:46:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:46:04.79798438 +0000 UTC m=+1744.496743547" watchObservedRunningTime="2026-07-12 18:46:04.798389577 +0000 UTC m=+1744.497148782" Jul 12 18:46:14.093767 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:14.093730 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:14.094210 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:14.093781 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:14.105843 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:14.105824 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:14.837021 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:14.836988 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:38.417704 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:38.417662 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r"] Jul 12 18:46:53.438468 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.438396 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" podUID="6506da37-9394-4ef1-bc3a-923083deaf69" containerName="main" containerID="cri-o://b482c06ac4332ff4323186b5e01db57457976b77bfae418137e708507b116db6" gracePeriod=45 Jul 12 18:46:53.696278 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.696219 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:53.857842 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.857803 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-dshm\") pod \"6506da37-9394-4ef1-bc3a-923083deaf69\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " Jul 12 18:46:53.857842 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.857845 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-tmp-dir\") pod \"6506da37-9394-4ef1-bc3a-923083deaf69\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " Jul 12 18:46:53.858115 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.857872 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-home\") pod \"6506da37-9394-4ef1-bc3a-923083deaf69\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " Jul 12 18:46:53.858115 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.858021 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8r7tb\" (UniqueName: \"kubernetes.io/projected/6506da37-9394-4ef1-bc3a-923083deaf69-kube-api-access-8r7tb\") pod \"6506da37-9394-4ef1-bc3a-923083deaf69\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " Jul 12 18:46:53.858241 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.858154 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-model-cache\") pod \"6506da37-9394-4ef1-bc3a-923083deaf69\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " Jul 12 18:46:53.858241 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.858183 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-home" (OuterVolumeSpecName: "home") pod "6506da37-9394-4ef1-bc3a-923083deaf69" (UID: "6506da37-9394-4ef1-bc3a-923083deaf69"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 18:46:53.858241 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.858191 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6506da37-9394-4ef1-bc3a-923083deaf69" (UID: "6506da37-9394-4ef1-bc3a-923083deaf69"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 18:46:53.858241 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.858214 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6506da37-9394-4ef1-bc3a-923083deaf69-tls-certs\") pod \"6506da37-9394-4ef1-bc3a-923083deaf69\" (UID: \"6506da37-9394-4ef1-bc3a-923083deaf69\") " Jul 12 18:46:53.858421 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.858344 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-model-cache" (OuterVolumeSpecName: "model-cache") pod "6506da37-9394-4ef1-bc3a-923083deaf69" (UID: "6506da37-9394-4ef1-bc3a-923083deaf69"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 18:46:53.858537 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.858513 2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-model-cache\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:46:53.858537 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.858539 2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-tmp-dir\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:46:53.858718 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.858549 2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-home\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:46:53.860230 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.860203 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-dshm" (OuterVolumeSpecName: "dshm") pod "6506da37-9394-4ef1-bc3a-923083deaf69" (UID: "6506da37-9394-4ef1-bc3a-923083deaf69"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 18:46:53.860230 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.860215 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6506da37-9394-4ef1-bc3a-923083deaf69-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6506da37-9394-4ef1-bc3a-923083deaf69" (UID: "6506da37-9394-4ef1-bc3a-923083deaf69"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 18:46:53.860344 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.860272 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6506da37-9394-4ef1-bc3a-923083deaf69-kube-api-access-8r7tb" (OuterVolumeSpecName: "kube-api-access-8r7tb") pod "6506da37-9394-4ef1-bc3a-923083deaf69" (UID: "6506da37-9394-4ef1-bc3a-923083deaf69"). InnerVolumeSpecName "kube-api-access-8r7tb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 18:46:53.959190 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.959109 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8r7tb\" (UniqueName: \"kubernetes.io/projected/6506da37-9394-4ef1-bc3a-923083deaf69-kube-api-access-8r7tb\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:46:53.959190 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.959136 2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6506da37-9394-4ef1-bc3a-923083deaf69-tls-certs\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:46:53.959190 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.959145 2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6506da37-9394-4ef1-bc3a-923083deaf69-dshm\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:46:53.997141 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.997071 2556 generic.go:356] "Generic (PLEG): container finished" podID="6506da37-9394-4ef1-bc3a-923083deaf69" containerID="b482c06ac4332ff4323186b5e01db57457976b77bfae418137e708507b116db6" exitCode=0 Jul 12 18:46:53.997141 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.997137 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" Jul 12 18:46:53.997329 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.997156 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" event={"ID":"6506da37-9394-4ef1-bc3a-923083deaf69","Type":"ContainerDied","Data":"b482c06ac4332ff4323186b5e01db57457976b77bfae418137e708507b116db6"} Jul 12 18:46:53.997329 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.997202 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r" event={"ID":"6506da37-9394-4ef1-bc3a-923083deaf69","Type":"ContainerDied","Data":"d1e709d5a06a47b63673446fccae073db29b16db94d059dbbb463868306aa171"} Jul 12 18:46:53.997329 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:53.997221 2556 scope.go:117] "RemoveContainer" containerID="b482c06ac4332ff4323186b5e01db57457976b77bfae418137e708507b116db6" Jul 12 18:46:54.005833 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:54.005817 2556 scope.go:117] "RemoveContainer" containerID="b482c06ac4332ff4323186b5e01db57457976b77bfae418137e708507b116db6" Jul 12 18:46:54.006105 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:46:54.006062 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b482c06ac4332ff4323186b5e01db57457976b77bfae418137e708507b116db6\": container with ID starting with b482c06ac4332ff4323186b5e01db57457976b77bfae418137e708507b116db6 not found: ID does not exist" containerID="b482c06ac4332ff4323186b5e01db57457976b77bfae418137e708507b116db6" Jul 12 18:46:54.006170 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:54.006115 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b482c06ac4332ff4323186b5e01db57457976b77bfae418137e708507b116db6"} err="failed to get container status \"b482c06ac4332ff4323186b5e01db57457976b77bfae418137e708507b116db6\": rpc error: code = NotFound desc = could not find container \"b482c06ac4332ff4323186b5e01db57457976b77bfae418137e708507b116db6\": container with ID starting with b482c06ac4332ff4323186b5e01db57457976b77bfae418137e708507b116db6 not found: ID does not exist" Jul 12 18:46:54.017648 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:54.017625 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r"] Jul 12 18:46:54.021457 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:54.021433 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-0328d158/e2e-lifecycle-model-0328d158-kserve-5c58cc4bb7-4qd8r"] Jul 12 18:46:54.340983 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:46:54.340947 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6506da37-9394-4ef1-bc3a-923083deaf69" path="/var/lib/kubelet/pods/6506da37-9394-4ef1-bc3a-923083deaf69/volumes" Jul 12 18:47:02.352318 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:47:02.352291 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/2.log" Jul 12 18:47:02.354887 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:47:02.354020 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/2.log" Jul 12 18:48:44.904232 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:44.904194 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4"] Jul 12 18:48:44.904734 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:44.904519 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6506da37-9394-4ef1-bc3a-923083deaf69" containerName="main" Jul 12 18:48:44.904734 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:44.904531 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6506da37-9394-4ef1-bc3a-923083deaf69" containerName="main" Jul 12 18:48:44.904734 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:44.904590 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6506da37-9394-4ef1-bc3a-923083deaf69" containerName="main" Jul 12 18:48:44.907593 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:44.907579 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:44.909867 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:44.909837 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-14e82f\"/\"openshift-service-ca.crt\"" Jul 12 18:48:44.910004 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:44.909884 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-14e82f\"/\"test-model-14e82f-kserve-self-signed-certs\"" Jul 12 18:48:44.910797 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:44.910783 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-14e82f\"/\"kube-root-ca.crt\"" Jul 12 18:48:44.910887 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:44.910788 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-14e82f\"/\"default-dockercfg-8c5hh\"" Jul 12 18:48:44.916843 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:44.916824 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4"] Jul 12 18:48:45.042532 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.042492 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg7zq\" (UniqueName: \"kubernetes.io/projected/95119197-7bde-451e-b82d-03aedd93803c-kube-api-access-tg7zq\") pod \"test-model-14e82f-kserve-787994d66f-pn2h4\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:45.042532 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.042535 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-model-cache\") pod \"test-model-14e82f-kserve-787994d66f-pn2h4\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:45.042741 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.042558 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-tmp-dir\") pod \"test-model-14e82f-kserve-787994d66f-pn2h4\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:45.042741 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.042578 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95119197-7bde-451e-b82d-03aedd93803c-tls-certs\") pod \"test-model-14e82f-kserve-787994d66f-pn2h4\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:45.042741 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.042600 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-home\") pod \"test-model-14e82f-kserve-787994d66f-pn2h4\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:45.042741 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.042621 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-dshm\") pod \"test-model-14e82f-kserve-787994d66f-pn2h4\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:45.143994 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.143964 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg7zq\" (UniqueName: \"kubernetes.io/projected/95119197-7bde-451e-b82d-03aedd93803c-kube-api-access-tg7zq\") pod \"test-model-14e82f-kserve-787994d66f-pn2h4\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:45.144214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.144001 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-model-cache\") pod \"test-model-14e82f-kserve-787994d66f-pn2h4\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:45.144214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.144030 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-tmp-dir\") pod \"test-model-14e82f-kserve-787994d66f-pn2h4\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:45.144214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.144044 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95119197-7bde-451e-b82d-03aedd93803c-tls-certs\") pod \"test-model-14e82f-kserve-787994d66f-pn2h4\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:45.144214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.144060 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-home\") pod \"test-model-14e82f-kserve-787994d66f-pn2h4\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:45.144214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.144104 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-dshm\") pod \"test-model-14e82f-kserve-787994d66f-pn2h4\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:45.144459 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.144443 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-model-cache\") pod \"test-model-14e82f-kserve-787994d66f-pn2h4\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:45.144542 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.144518 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-home\") pod \"test-model-14e82f-kserve-787994d66f-pn2h4\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:45.144542 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.144532 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-tmp-dir\") pod \"test-model-14e82f-kserve-787994d66f-pn2h4\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:45.146261 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.146239 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-dshm\") pod \"test-model-14e82f-kserve-787994d66f-pn2h4\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:45.146522 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.146505 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95119197-7bde-451e-b82d-03aedd93803c-tls-certs\") pod \"test-model-14e82f-kserve-787994d66f-pn2h4\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:45.150877 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.150855 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg7zq\" (UniqueName: \"kubernetes.io/projected/95119197-7bde-451e-b82d-03aedd93803c-kube-api-access-tg7zq\") pod \"test-model-14e82f-kserve-787994d66f-pn2h4\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:45.217681 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.217610 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:45.352942 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.352919 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4"] Jul 12 18:48:45.355088 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:48:45.355041 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95119197_7bde_451e_b82d_03aedd93803c.slice/crio-457c6e2a1e429e450acdcf47b08ea4aa4955ad6ba7774fd38608f2949bac7d74 WatchSource:0}: Error finding container 457c6e2a1e429e450acdcf47b08ea4aa4955ad6ba7774fd38608f2949bac7d74: Status 404 returned error can't find the container with id 457c6e2a1e429e450acdcf47b08ea4aa4955ad6ba7774fd38608f2949bac7d74 Jul 12 18:48:45.460519 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.460483 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" event={"ID":"95119197-7bde-451e-b82d-03aedd93803c","Type":"ContainerStarted","Data":"155769db44a7327c25f4b1426c331c99bc53b0d8da79ea9cf35b8873cda3f073"} Jul 12 18:48:45.460519 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.460525 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" event={"ID":"95119197-7bde-451e-b82d-03aedd93803c","Type":"ContainerStarted","Data":"457c6e2a1e429e450acdcf47b08ea4aa4955ad6ba7774fd38608f2949bac7d74"} Jul 12 18:48:45.476871 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:45.476774 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" podStartSLOduration=1.476758861 podStartE2EDuration="1.476758861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:48:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:48:45.476011513 +0000 UTC m=+1905.174770680" watchObservedRunningTime="2026-07-12 18:48:45.476758861 +0000 UTC m=+1905.175518026" Jul 12 18:48:55.218693 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:55.218649 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:55.219103 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:55.218706 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:55.230754 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:55.230724 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:48:55.516873 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:48:55.516799 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:49:12.767302 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.767265 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68"] Jul 12 18:49:12.770464 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.770439 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:12.772674 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.772657 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-89494f\"/\"openshift-service-ca.crt\"" Jul 12 18:49:12.773705 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.773691 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-89494f\"/\"kube-root-ca.crt\"" Jul 12 18:49:12.773776 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.773702 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-89494f\"/\"default-dockercfg-nq6vv\"" Jul 12 18:49:12.773776 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.773750 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-89494f\"/\"test-model-89494f-kserve-self-signed-certs\"" Jul 12 18:49:12.779778 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.779749 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68"] Jul 12 18:49:12.883867 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.883833 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-tmp-dir\") pod \"test-model-89494f-kserve-695df96549-gjv68\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:12.884038 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.883871 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ckwmc\" (UniqueName: \"kubernetes.io/projected/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-kube-api-access-ckwmc\") pod \"test-model-89494f-kserve-695df96549-gjv68\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:12.884038 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.883902 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-home\") pod \"test-model-89494f-kserve-695df96549-gjv68\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:12.884038 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.883983 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-model-cache\") pod \"test-model-89494f-kserve-695df96549-gjv68\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:12.884038 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.884007 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-tls-certs\") pod \"test-model-89494f-kserve-695df96549-gjv68\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:12.884191 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.884065 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-dshm\") pod \"test-model-89494f-kserve-695df96549-gjv68\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:12.984868 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.984840 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-tmp-dir\") pod \"test-model-89494f-kserve-695df96549-gjv68\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:12.984985 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.984879 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ckwmc\" (UniqueName: \"kubernetes.io/projected/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-kube-api-access-ckwmc\") pod \"test-model-89494f-kserve-695df96549-gjv68\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:12.984985 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.984896 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-home\") pod \"test-model-89494f-kserve-695df96549-gjv68\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:12.984985 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.984914 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-model-cache\") pod \"test-model-89494f-kserve-695df96549-gjv68\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:12.984985 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.984929 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-tls-certs\") pod \"test-model-89494f-kserve-695df96549-gjv68\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:12.984985 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.984978 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-dshm\") pod \"test-model-89494f-kserve-695df96549-gjv68\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:12.985327 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.985301 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-tmp-dir\") pod \"test-model-89494f-kserve-695df96549-gjv68\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:12.985394 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.985331 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-model-cache\") pod \"test-model-89494f-kserve-695df96549-gjv68\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:12.985394 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.985370 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-home\") pod \"test-model-89494f-kserve-695df96549-gjv68\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:12.987171 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.987146 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-dshm\") pod \"test-model-89494f-kserve-695df96549-gjv68\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:12.987417 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.987399 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-tls-certs\") pod \"test-model-89494f-kserve-695df96549-gjv68\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:12.992023 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:12.992003 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ckwmc\" (UniqueName: \"kubernetes.io/projected/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-kube-api-access-ckwmc\") pod \"test-model-89494f-kserve-695df96549-gjv68\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:13.079742 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:13.079660 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:13.205756 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:13.205724 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68"] Jul 12 18:49:13.208908 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:49:13.208885 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75404aee_6d4e_4c9a_a2d6_3c05b9dc767e.slice/crio-dfa7f07484f340dc141f053d2b5c149a165eeee73ce740bd765c9bef0f891945 WatchSource:0}: Error finding container dfa7f07484f340dc141f053d2b5c149a165eeee73ce740bd765c9bef0f891945: Status 404 returned error can't find the container with id dfa7f07484f340dc141f053d2b5c149a165eeee73ce740bd765c9bef0f891945 Jul 12 18:49:13.584214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:13.584177 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" event={"ID":"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e","Type":"ContainerStarted","Data":"edfc397bfd3719161f099c6d654a8bd9c8285dd540241add55ebb8cd7260f882"} Jul 12 18:49:13.584214 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:13.584221 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" event={"ID":"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e","Type":"ContainerStarted","Data":"dfa7f07484f340dc141f053d2b5c149a165eeee73ce740bd765c9bef0f891945"} Jul 12 18:49:13.600232 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:13.600186 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" podStartSLOduration=1.600169332 podStartE2EDuration="1.600169332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:49:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:49:13.598366589 +0000 UTC m=+1933.297125756" watchObservedRunningTime="2026-07-12 18:49:13.600169332 +0000 UTC m=+1933.298928498" Jul 12 18:49:23.079854 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:23.079820 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:23.080343 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:23.079866 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:23.092231 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:23.092210 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:23.638912 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:23.638882 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:29.867652 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:29.867621 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4"] Jul 12 18:49:30.813158 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:30.813130 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68"] Jul 12 18:49:44.887360 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:44.887308 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" podUID="95119197-7bde-451e-b82d-03aedd93803c" containerName="main" containerID="cri-o://155769db44a7327c25f4b1426c331c99bc53b0d8da79ea9cf35b8873cda3f073" gracePeriod=45 Jul 12 18:49:45.134377 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.134348 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:49:45.223144 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.223059 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-dshm\") pod \"95119197-7bde-451e-b82d-03aedd93803c\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " Jul 12 18:49:45.223144 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.223117 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-tmp-dir\") pod \"95119197-7bde-451e-b82d-03aedd93803c\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " Jul 12 18:49:45.223314 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.223161 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tg7zq\" (UniqueName: \"kubernetes.io/projected/95119197-7bde-451e-b82d-03aedd93803c-kube-api-access-tg7zq\") pod \"95119197-7bde-451e-b82d-03aedd93803c\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " Jul 12 18:49:45.223314 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.223212 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95119197-7bde-451e-b82d-03aedd93803c-tls-certs\") pod \"95119197-7bde-451e-b82d-03aedd93803c\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " Jul 12 18:49:45.223314 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.223235 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-home\") pod \"95119197-7bde-451e-b82d-03aedd93803c\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " Jul 12 18:49:45.223314 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.223279 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-model-cache\") pod \"95119197-7bde-451e-b82d-03aedd93803c\" (UID: \"95119197-7bde-451e-b82d-03aedd93803c\") " Jul 12 18:49:45.223550 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.223435 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "95119197-7bde-451e-b82d-03aedd93803c" (UID: "95119197-7bde-451e-b82d-03aedd93803c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 18:49:45.223550 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.223480 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-home" (OuterVolumeSpecName: "home") pod "95119197-7bde-451e-b82d-03aedd93803c" (UID: "95119197-7bde-451e-b82d-03aedd93803c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 18:49:45.223656 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.223598 2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-tmp-dir\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:49:45.223656 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.223617 2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-home\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:49:45.223656 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.223613 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-model-cache" (OuterVolumeSpecName: "model-cache") pod "95119197-7bde-451e-b82d-03aedd93803c" (UID: "95119197-7bde-451e-b82d-03aedd93803c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 18:49:45.225288 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.225268 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-dshm" (OuterVolumeSpecName: "dshm") pod "95119197-7bde-451e-b82d-03aedd93803c" (UID: "95119197-7bde-451e-b82d-03aedd93803c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 18:49:45.225376 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.225288 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95119197-7bde-451e-b82d-03aedd93803c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "95119197-7bde-451e-b82d-03aedd93803c" (UID: "95119197-7bde-451e-b82d-03aedd93803c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 18:49:45.225417 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.225371 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95119197-7bde-451e-b82d-03aedd93803c-kube-api-access-tg7zq" (OuterVolumeSpecName: "kube-api-access-tg7zq") pod "95119197-7bde-451e-b82d-03aedd93803c" (UID: "95119197-7bde-451e-b82d-03aedd93803c"). InnerVolumeSpecName "kube-api-access-tg7zq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 18:49:45.324721 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.324693 2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-dshm\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:49:45.324721 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.324718 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tg7zq\" (UniqueName: \"kubernetes.io/projected/95119197-7bde-451e-b82d-03aedd93803c-kube-api-access-tg7zq\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:49:45.324899 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.324729 2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95119197-7bde-451e-b82d-03aedd93803c-tls-certs\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:49:45.324899 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.324737 2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95119197-7bde-451e-b82d-03aedd93803c-model-cache\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:49:45.723918 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.723885 2556 generic.go:356] "Generic (PLEG): container finished" podID="95119197-7bde-451e-b82d-03aedd93803c" containerID="155769db44a7327c25f4b1426c331c99bc53b0d8da79ea9cf35b8873cda3f073" exitCode=0 Jul 12 18:49:45.724146 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.723935 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" Jul 12 18:49:45.724146 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.723942 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" event={"ID":"95119197-7bde-451e-b82d-03aedd93803c","Type":"ContainerDied","Data":"155769db44a7327c25f4b1426c331c99bc53b0d8da79ea9cf35b8873cda3f073"} Jul 12 18:49:45.724146 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.724035 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4" event={"ID":"95119197-7bde-451e-b82d-03aedd93803c","Type":"ContainerDied","Data":"457c6e2a1e429e450acdcf47b08ea4aa4955ad6ba7774fd38608f2949bac7d74"} Jul 12 18:49:45.724146 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.724051 2556 scope.go:117] "RemoveContainer" containerID="155769db44a7327c25f4b1426c331c99bc53b0d8da79ea9cf35b8873cda3f073" Jul 12 18:49:45.732845 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.732825 2556 scope.go:117] "RemoveContainer" containerID="155769db44a7327c25f4b1426c331c99bc53b0d8da79ea9cf35b8873cda3f073" Jul 12 18:49:45.733100 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:49:45.733064 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"155769db44a7327c25f4b1426c331c99bc53b0d8da79ea9cf35b8873cda3f073\": container with ID starting with 155769db44a7327c25f4b1426c331c99bc53b0d8da79ea9cf35b8873cda3f073 not found: ID does not exist" containerID="155769db44a7327c25f4b1426c331c99bc53b0d8da79ea9cf35b8873cda3f073" Jul 12 18:49:45.733186 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.733112 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"155769db44a7327c25f4b1426c331c99bc53b0d8da79ea9cf35b8873cda3f073"} err="failed to get container status \"155769db44a7327c25f4b1426c331c99bc53b0d8da79ea9cf35b8873cda3f073\": rpc error: code = NotFound desc = could not find container \"155769db44a7327c25f4b1426c331c99bc53b0d8da79ea9cf35b8873cda3f073\": container with ID starting with 155769db44a7327c25f4b1426c331c99bc53b0d8da79ea9cf35b8873cda3f073 not found: ID does not exist" Jul 12 18:49:45.743342 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.743320 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4"] Jul 12 18:49:45.746566 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.746545 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-14e82f/test-model-14e82f-kserve-787994d66f-pn2h4"] Jul 12 18:49:45.832616 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:45.832580 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" podUID="75404aee-6d4e-4c9a-a2d6-3c05b9dc767e" containerName="main" containerID="cri-o://edfc397bfd3719161f099c6d654a8bd9c8285dd540241add55ebb8cd7260f882" gracePeriod=45 Jul 12 18:49:46.076469 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.076442 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:46.130150 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.130120 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-tls-certs\") pod \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " Jul 12 18:49:46.130294 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.130191 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ckwmc\" (UniqueName: \"kubernetes.io/projected/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-kube-api-access-ckwmc\") pod \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " Jul 12 18:49:46.130294 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.130221 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-home\") pod \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " Jul 12 18:49:46.130294 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.130267 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-model-cache\") pod \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " Jul 12 18:49:46.130443 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.130297 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-dshm\") pod \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " Jul 12 18:49:46.130443 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.130341 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-tmp-dir\") pod \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\" (UID: \"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e\") " Jul 12 18:49:46.130553 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.130534 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-home" (OuterVolumeSpecName: "home") pod "75404aee-6d4e-4c9a-a2d6-3c05b9dc767e" (UID: "75404aee-6d4e-4c9a-a2d6-3c05b9dc767e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 18:49:46.130647 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.130627 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-model-cache" (OuterVolumeSpecName: "model-cache") pod "75404aee-6d4e-4c9a-a2d6-3c05b9dc767e" (UID: "75404aee-6d4e-4c9a-a2d6-3c05b9dc767e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 18:49:46.130758 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.130739 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "75404aee-6d4e-4c9a-a2d6-3c05b9dc767e" (UID: "75404aee-6d4e-4c9a-a2d6-3c05b9dc767e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 18:49:46.132825 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.132800 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-dshm" (OuterVolumeSpecName: "dshm") pod "75404aee-6d4e-4c9a-a2d6-3c05b9dc767e" (UID: "75404aee-6d4e-4c9a-a2d6-3c05b9dc767e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 18:49:46.132935 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.132850 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "75404aee-6d4e-4c9a-a2d6-3c05b9dc767e" (UID: "75404aee-6d4e-4c9a-a2d6-3c05b9dc767e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 18:49:46.132935 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.132868 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-kube-api-access-ckwmc" (OuterVolumeSpecName: "kube-api-access-ckwmc") pod "75404aee-6d4e-4c9a-a2d6-3c05b9dc767e" (UID: "75404aee-6d4e-4c9a-a2d6-3c05b9dc767e"). InnerVolumeSpecName "kube-api-access-ckwmc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 18:49:46.231897 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.231862 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ckwmc\" (UniqueName: \"kubernetes.io/projected/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-kube-api-access-ckwmc\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:49:46.231897 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.231889 2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-home\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:49:46.231897 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.231900 2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-model-cache\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:49:46.232139 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.231908 2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-dshm\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:49:46.232139 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.231936 2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-tmp-dir\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:49:46.232139 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.231943 2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e-tls-certs\") on node \"ip-10-0-141-130.ec2.internal\" DevicePath \"\"" Jul 12 18:49:46.339756 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.339725 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95119197-7bde-451e-b82d-03aedd93803c" path="/var/lib/kubelet/pods/95119197-7bde-451e-b82d-03aedd93803c/volumes" Jul 12 18:49:46.730490 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.730402 2556 generic.go:356] "Generic (PLEG): container finished" podID="75404aee-6d4e-4c9a-a2d6-3c05b9dc767e" containerID="edfc397bfd3719161f099c6d654a8bd9c8285dd540241add55ebb8cd7260f882" exitCode=0 Jul 12 18:49:46.730490 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.730452 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" Jul 12 18:49:46.730633 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.730487 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" event={"ID":"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e","Type":"ContainerDied","Data":"edfc397bfd3719161f099c6d654a8bd9c8285dd540241add55ebb8cd7260f882"} Jul 12 18:49:46.730633 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.730530 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68" event={"ID":"75404aee-6d4e-4c9a-a2d6-3c05b9dc767e","Type":"ContainerDied","Data":"dfa7f07484f340dc141f053d2b5c149a165eeee73ce740bd765c9bef0f891945"} Jul 12 18:49:46.730633 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.730548 2556 scope.go:117] "RemoveContainer" containerID="edfc397bfd3719161f099c6d654a8bd9c8285dd540241add55ebb8cd7260f882" Jul 12 18:49:46.739036 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.739018 2556 scope.go:117] "RemoveContainer" containerID="edfc397bfd3719161f099c6d654a8bd9c8285dd540241add55ebb8cd7260f882" Jul 12 18:49:46.739340 ip-10-0-141-130 kubenswrapper[2556]: E0712 18:49:46.739318 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edfc397bfd3719161f099c6d654a8bd9c8285dd540241add55ebb8cd7260f882\": container with ID starting with edfc397bfd3719161f099c6d654a8bd9c8285dd540241add55ebb8cd7260f882 not found: ID does not exist" containerID="edfc397bfd3719161f099c6d654a8bd9c8285dd540241add55ebb8cd7260f882" Jul 12 18:49:46.739448 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.739344 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edfc397bfd3719161f099c6d654a8bd9c8285dd540241add55ebb8cd7260f882"} err="failed to get container status \"edfc397bfd3719161f099c6d654a8bd9c8285dd540241add55ebb8cd7260f882\": rpc error: code = NotFound desc = could not find container \"edfc397bfd3719161f099c6d654a8bd9c8285dd540241add55ebb8cd7260f882\": container with ID starting with edfc397bfd3719161f099c6d654a8bd9c8285dd540241add55ebb8cd7260f882 not found: ID does not exist" Jul 12 18:49:46.752718 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.752696 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68"] Jul 12 18:49:46.755992 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:46.755970 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-89494f/test-model-89494f-kserve-695df96549-gjv68"] Jul 12 18:49:48.340294 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:49:48.340264 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75404aee-6d4e-4c9a-a2d6-3c05b9dc767e" path="/var/lib/kubelet/pods/75404aee-6d4e-4c9a-a2d6-3c05b9dc767e/volumes" Jul 12 18:52:02.379703 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:52:02.379592 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/2.log" Jul 12 18:52:02.382777 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:52:02.381948 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/2.log" Jul 12 18:54:37.287997 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:37.287969 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-db78fd4c7-krndh_c600f07c-bcd0-4a60-a20e-ce8b8609f2f5/copy-manifests/0.log" Jul 12 18:54:37.294865 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:37.294847 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-db78fd4c7-krndh_c600f07c-bcd0-4a60-a20e-ce8b8609f2f5/manager/0.log" Jul 12 18:54:39.983362 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:39.983329 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bd558f979-mpsmk_299419f5-7d14-42fa-b8a1-6b2efb363ca0/kube-auth-proxy/0.log" Jul 12 18:54:40.536109 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:40.536067 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bb454b654-mgfsz_76307ceb-8deb-4dcf-ac3b-0a446216a225/router/0.log" Jul 12 18:54:41.091253 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:41.091216 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-nwgvh_b1a79cfc-c45f-4c7d-92d8-a22b34b4ef24/main/0.log" Jul 12 18:54:41.199358 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:41.199326 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbsdg4r_7f38c7c4-2e3b-4e1a-b5f3-9d8a197f17e2/main/0.log" Jul 12 18:54:41.415880 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:41.415811 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-r2tcq_9571fbbf-7cc3-4175-9693-a5bfafc6e13d/main/0.log" Jul 12 18:54:45.277607 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:45.277571 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lcvxn/must-gather-cpkx9"] Jul 12 18:54:45.277957 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:45.277892 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95119197-7bde-451e-b82d-03aedd93803c" containerName="main" Jul 12 18:54:45.277957 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:45.277902 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="95119197-7bde-451e-b82d-03aedd93803c" containerName="main" Jul 12 18:54:45.277957 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:45.277923 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75404aee-6d4e-4c9a-a2d6-3c05b9dc767e" containerName="main" Jul 12 18:54:45.277957 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:45.277928 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="75404aee-6d4e-4c9a-a2d6-3c05b9dc767e" containerName="main" Jul 12 18:54:45.278106 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:45.277979 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="75404aee-6d4e-4c9a-a2d6-3c05b9dc767e" containerName="main" Jul 12 18:54:45.278106 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:45.277988 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="95119197-7bde-451e-b82d-03aedd93803c" containerName="main" Jul 12 18:54:45.280846 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:45.280830 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lcvxn/must-gather-cpkx9" Jul 12 18:54:45.283196 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:45.283177 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lcvxn\"/\"kube-root-ca.crt\"" Jul 12 18:54:45.283301 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:45.283226 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lcvxn\"/\"openshift-service-ca.crt\"" Jul 12 18:54:45.284147 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:45.284126 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lcvxn\"/\"default-dockercfg-flgp8\"" Jul 12 18:54:45.290148 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:45.290126 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lcvxn/must-gather-cpkx9"] Jul 12 18:54:45.417383 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:45.417340 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/754fce07-4150-47f4-8197-5863f2e5a71e-must-gather-output\") pod \"must-gather-cpkx9\" (UID: \"754fce07-4150-47f4-8197-5863f2e5a71e\") " pod="openshift-must-gather-lcvxn/must-gather-cpkx9" Jul 12 18:54:45.417383 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:45.417381 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w85d\" (UniqueName: \"kubernetes.io/projected/754fce07-4150-47f4-8197-5863f2e5a71e-kube-api-access-4w85d\") pod \"must-gather-cpkx9\" (UID: \"754fce07-4150-47f4-8197-5863f2e5a71e\") " pod="openshift-must-gather-lcvxn/must-gather-cpkx9" Jul 12 18:54:45.518127 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:45.518093 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/754fce07-4150-47f4-8197-5863f2e5a71e-must-gather-output\") pod \"must-gather-cpkx9\" (UID: \"754fce07-4150-47f4-8197-5863f2e5a71e\") " pod="openshift-must-gather-lcvxn/must-gather-cpkx9" Jul 12 18:54:45.518127 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:45.518130 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w85d\" (UniqueName: \"kubernetes.io/projected/754fce07-4150-47f4-8197-5863f2e5a71e-kube-api-access-4w85d\") pod \"must-gather-cpkx9\" (UID: \"754fce07-4150-47f4-8197-5863f2e5a71e\") " pod="openshift-must-gather-lcvxn/must-gather-cpkx9" Jul 12 18:54:45.518433 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:45.518414 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/754fce07-4150-47f4-8197-5863f2e5a71e-must-gather-output\") pod \"must-gather-cpkx9\" (UID: \"754fce07-4150-47f4-8197-5863f2e5a71e\") " pod="openshift-must-gather-lcvxn/must-gather-cpkx9" Jul 12 18:54:45.525705 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:45.525675 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w85d\" (UniqueName: \"kubernetes.io/projected/754fce07-4150-47f4-8197-5863f2e5a71e-kube-api-access-4w85d\") pod \"must-gather-cpkx9\" (UID: \"754fce07-4150-47f4-8197-5863f2e5a71e\") " pod="openshift-must-gather-lcvxn/must-gather-cpkx9" Jul 12 18:54:45.590748 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:45.590722 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lcvxn/must-gather-cpkx9" Jul 12 18:54:45.722581 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:45.722550 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lcvxn/must-gather-cpkx9"] Jul 12 18:54:45.725946 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:54:45.725918 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod754fce07_4150_47f4_8197_5863f2e5a71e.slice/crio-d5467eb51c4039d07173e2d85c176ae64fc0a229cf06aa9e6e2b7e6521c92a6d WatchSource:0}: Error finding container d5467eb51c4039d07173e2d85c176ae64fc0a229cf06aa9e6e2b7e6521c92a6d: Status 404 returned error can't find the container with id d5467eb51c4039d07173e2d85c176ae64fc0a229cf06aa9e6e2b7e6521c92a6d Jul 12 18:54:45.728138 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:45.728120 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 18:54:45.986211 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:45.986127 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lcvxn/must-gather-cpkx9" event={"ID":"754fce07-4150-47f4-8197-5863f2e5a71e","Type":"ContainerStarted","Data":"d5467eb51c4039d07173e2d85c176ae64fc0a229cf06aa9e6e2b7e6521c92a6d"} Jul 12 18:54:46.993443 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:46.993409 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lcvxn/must-gather-cpkx9" event={"ID":"754fce07-4150-47f4-8197-5863f2e5a71e","Type":"ContainerStarted","Data":"99b6bd9dd39f2e2719f70a6f62e059e062ce53a670aaea084f68fa9786071b92"} Jul 12 18:54:46.993799 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:46.993452 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lcvxn/must-gather-cpkx9" event={"ID":"754fce07-4150-47f4-8197-5863f2e5a71e","Type":"ContainerStarted","Data":"98ca8a378652fcd2a64c616a05f1f902f555b6d31a4ccf88dcc9e699b2db2b10"} Jul 12 18:54:48.007433 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:48.007408 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fsg86_27d0cbdc-10e6-4e60-8b17-c278fe65e4ec/global-pull-secret-syncer/0.log" Jul 12 18:54:48.141806 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:48.141774 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xghs8_d2959f37-2d8d-4c33-b801-c2441982b9d3/konnectivity-agent/0.log" Jul 12 18:54:48.177601 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:48.177570 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-130.ec2.internal_6d699647f03e60e64b1e1e805c709ebc/haproxy/0.log" Jul 12 18:54:55.275329 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:55.275291 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-g8mzg_57408f9d-028f-4d6b-a6b2-5a8e070a2969/cluster-monitoring-operator/0.log" Jul 12 18:54:55.526461 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:55.526388 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4n92p_d086db08-cb29-48ef-9b01-38476f8732f0/node-exporter/0.log" Jul 12 18:54:55.545981 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:55.545953 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4n92p_d086db08-cb29-48ef-9b01-38476f8732f0/kube-rbac-proxy/0.log" Jul 12 18:54:55.565058 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:55.565031 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4n92p_d086db08-cb29-48ef-9b01-38476f8732f0/init-textfile/0.log" Jul 12 18:54:57.258913 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.258886 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-j8b8n_888ee972-d5e3-4714-a5ee-83d604c9d2d3/networking-console-plugin/0.log" Jul 12 18:54:57.530854 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.530731 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lcvxn/must-gather-cpkx9" podStartSLOduration=11.73047533 podStartE2EDuration="12.530707347s" totalImagesPullingTime="800.232017ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 18:54:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:54:47.008518447 +0000 UTC m=+2266.707277615" watchObservedRunningTime="2026-07-12 18:54:57.530707347 +0000 UTC m=+2277.229466516" Jul 12 18:54:57.532242 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.532208 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b"] Jul 12 18:54:57.538069 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.538043 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b" Jul 12 18:54:57.545832 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.545806 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b"] Jul 12 18:54:57.638038 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.638000 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5274t\" (UniqueName: \"kubernetes.io/projected/58e7e30f-a94d-4be1-86a2-e393447283f4-kube-api-access-5274t\") pod \"perf-node-gather-daemonset-2fw5b\" (UID: \"58e7e30f-a94d-4be1-86a2-e393447283f4\") " pod="openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b" Jul 12 18:54:57.638331 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.638309 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58e7e30f-a94d-4be1-86a2-e393447283f4-podres\") pod \"perf-node-gather-daemonset-2fw5b\" (UID: \"58e7e30f-a94d-4be1-86a2-e393447283f4\") " pod="openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b" Jul 12 18:54:57.638472 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.638459 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58e7e30f-a94d-4be1-86a2-e393447283f4-proc\") pod \"perf-node-gather-daemonset-2fw5b\" (UID: \"58e7e30f-a94d-4be1-86a2-e393447283f4\") " pod="openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b" Jul 12 18:54:57.638594 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.638581 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58e7e30f-a94d-4be1-86a2-e393447283f4-lib-modules\") pod \"perf-node-gather-daemonset-2fw5b\" (UID: \"58e7e30f-a94d-4be1-86a2-e393447283f4\") " pod="openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b" Jul 12 18:54:57.638731 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.638719 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58e7e30f-a94d-4be1-86a2-e393447283f4-sys\") pod \"perf-node-gather-daemonset-2fw5b\" (UID: \"58e7e30f-a94d-4be1-86a2-e393447283f4\") " pod="openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b" Jul 12 18:54:57.739963 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.739925 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58e7e30f-a94d-4be1-86a2-e393447283f4-proc\") pod \"perf-node-gather-daemonset-2fw5b\" (UID: \"58e7e30f-a94d-4be1-86a2-e393447283f4\") " pod="openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b" Jul 12 18:54:57.740203 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.740179 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/58e7e30f-a94d-4be1-86a2-e393447283f4-proc\") pod \"perf-node-gather-daemonset-2fw5b\" (UID: \"58e7e30f-a94d-4be1-86a2-e393447283f4\") " pod="openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b" Jul 12 18:54:57.740315 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.740220 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58e7e30f-a94d-4be1-86a2-e393447283f4-lib-modules\") pod \"perf-node-gather-daemonset-2fw5b\" (UID: \"58e7e30f-a94d-4be1-86a2-e393447283f4\") " pod="openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b" Jul 12 18:54:57.740315 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.740293 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58e7e30f-a94d-4be1-86a2-e393447283f4-sys\") pod \"perf-node-gather-daemonset-2fw5b\" (UID: \"58e7e30f-a94d-4be1-86a2-e393447283f4\") " pod="openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b" Jul 12 18:54:57.740421 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.740334 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5274t\" (UniqueName: \"kubernetes.io/projected/58e7e30f-a94d-4be1-86a2-e393447283f4-kube-api-access-5274t\") pod \"perf-node-gather-daemonset-2fw5b\" (UID: \"58e7e30f-a94d-4be1-86a2-e393447283f4\") " pod="openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b" Jul 12 18:54:57.740421 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.740368 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58e7e30f-a94d-4be1-86a2-e393447283f4-podres\") pod \"perf-node-gather-daemonset-2fw5b\" (UID: \"58e7e30f-a94d-4be1-86a2-e393447283f4\") " pod="openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b" Jul 12 18:54:57.740421 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.740401 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58e7e30f-a94d-4be1-86a2-e393447283f4-sys\") pod \"perf-node-gather-daemonset-2fw5b\" (UID: \"58e7e30f-a94d-4be1-86a2-e393447283f4\") " pod="openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b" Jul 12 18:54:57.740524 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.740393 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/58e7e30f-a94d-4be1-86a2-e393447283f4-lib-modules\") pod \"perf-node-gather-daemonset-2fw5b\" (UID: \"58e7e30f-a94d-4be1-86a2-e393447283f4\") " pod="openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b" Jul 12 18:54:57.740524 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.740497 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/58e7e30f-a94d-4be1-86a2-e393447283f4-podres\") pod \"perf-node-gather-daemonset-2fw5b\" (UID: \"58e7e30f-a94d-4be1-86a2-e393447283f4\") " pod="openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b" Jul 12 18:54:57.748290 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.748264 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5274t\" (UniqueName: \"kubernetes.io/projected/58e7e30f-a94d-4be1-86a2-e393447283f4-kube-api-access-5274t\") pod \"perf-node-gather-daemonset-2fw5b\" (UID: \"58e7e30f-a94d-4be1-86a2-e393447283f4\") " pod="openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b" Jul 12 18:54:57.852484 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.852459 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/2.log" Jul 12 18:54:57.858089 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.858053 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b2gj4_3bd8be73-d59a-4c4d-945b-eff5f7563c73/console-operator/3.log" Jul 12 18:54:57.858794 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:57.858769 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b" Jul 12 18:54:58.047460 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:58.047422 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b"] Jul 12 18:54:58.052690 ip-10-0-141-130 kubenswrapper[2556]: W0712 18:54:58.052666 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod58e7e30f_a94d_4be1_86a2_e393447283f4.slice/crio-3830da1d6fcefa6402f1c209879340ca66fa3b57e55ddb2678b3f6a9f65678b3 WatchSource:0}: Error finding container 3830da1d6fcefa6402f1c209879340ca66fa3b57e55ddb2678b3f6a9f65678b3: Status 404 returned error can't find the container with id 3830da1d6fcefa6402f1c209879340ca66fa3b57e55ddb2678b3f6a9f65678b3 Jul 12 18:54:58.065113 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:58.065067 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b" event={"ID":"58e7e30f-a94d-4be1-86a2-e393447283f4","Type":"ContainerStarted","Data":"3830da1d6fcefa6402f1c209879340ca66fa3b57e55ddb2678b3f6a9f65678b3"} Jul 12 18:54:58.921992 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:58.921959 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-fshtt_3d306591-de63-43a6-bd91-ee8977eb6ed1/volume-data-source-validator/0.log" Jul 12 18:54:59.071043 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:59.071005 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b" event={"ID":"58e7e30f-a94d-4be1-86a2-e393447283f4","Type":"ContainerStarted","Data":"3ff3ca7546b3f31329aa495a46dc9edfaa206d7ad9119735731b8c360b4670b9"} Jul 12 18:54:59.071245 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:59.071116 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b" Jul 12 18:54:59.086005 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:59.085942 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b" podStartSLOduration=2.085923516 podStartE2EDuration="2.085923516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 18:54:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 18:54:59.084049014 +0000 UTC m=+2278.782808192" watchObservedRunningTime="2026-07-12 18:54:59.085923516 +0000 UTC m=+2278.784682685" Jul 12 18:54:59.869069 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:59.869035 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sb6tz_49f40bf4-3d5d-4007-b2aa-5b8f0827e823/dns/0.log" Jul 12 18:54:59.887048 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:59.887014 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sb6tz_49f40bf4-3d5d-4007-b2aa-5b8f0827e823/kube-rbac-proxy/0.log" Jul 12 18:54:59.945986 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:54:59.945954 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q2sxm_b3030442-56ce-4562-89e3-dbfa9ed9be95/dns-node-resolver/0.log" Jul 12 18:55:00.531060 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:00.531030 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-plght_d273d74a-7734-44c2-ad9a-d3f7662b5ddc/node-ca/0.log" Jul 12 18:55:01.587894 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:01.587859 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bd558f979-mpsmk_299419f5-7d14-42fa-b8a1-6b2efb363ca0/kube-auth-proxy/0.log" Jul 12 18:55:01.762715 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:01.762689 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bb454b654-mgfsz_76307ceb-8deb-4dcf-ac3b-0a446216a225/router/0.log" Jul 12 18:55:02.432511 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:02.432483 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wdmq2_345aaa00-6a0b-46e1-be63-285fed5a8614/serve-healthcheck-canary/0.log" Jul 12 18:55:02.883383 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:02.883343 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-xm669_92b6d641-802b-4005-9a45-c623d3403694/insights-operator/0.log" Jul 12 18:55:02.885566 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:02.885545 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-xm669_92b6d641-802b-4005-9a45-c623d3403694/insights-operator/1.log" Jul 12 18:55:03.020424 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:03.020393 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9dh25_c6225002-0cda-48bf-bf49-b2899fc7add2/kube-rbac-proxy/0.log" Jul 12 18:55:03.037553 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:03.037525 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9dh25_c6225002-0cda-48bf-bf49-b2899fc7add2/exporter/0.log" Jul 12 18:55:03.056961 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:03.056930 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9dh25_c6225002-0cda-48bf-bf49-b2899fc7add2/extractor/0.log" Jul 12 18:55:05.089024 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:05.088997 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lcvxn/perf-node-gather-daemonset-2fw5b" Jul 12 18:55:05.406736 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:05.406622 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-db78fd4c7-krndh_c600f07c-bcd0-4a60-a20e-ce8b8609f2f5/manager/0.log" Jul 12 18:55:05.424245 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:05.424216 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-db78fd4c7-krndh_c600f07c-bcd0-4a60-a20e-ce8b8609f2f5/copy-manifests/0.log" Jul 12 18:55:06.809010 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:06.808929 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-9757cf8df-qgmnd_dc7e3394-8b71-4284-b11f-343b940c3332/manager/0.log" Jul 12 18:55:08.228605 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:08.228577 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bd558f979-mpsmk_299419f5-7d14-42fa-b8a1-6b2efb363ca0/kube-auth-proxy/0.log" Jul 12 18:55:08.363581 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:08.363539 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bb454b654-mgfsz_76307ceb-8deb-4dcf-ac3b-0a446216a225/router/0.log" Jul 12 18:55:09.735210 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:09.735182 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bd558f979-mpsmk_299419f5-7d14-42fa-b8a1-6b2efb363ca0/kube-auth-proxy/0.log" Jul 12 18:55:09.889205 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:09.889171 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5bb454b654-mgfsz_76307ceb-8deb-4dcf-ac3b-0a446216a225/router/0.log" Jul 12 18:55:12.070855 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:12.070825 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-ps4wq_05d80244-fc3e-45d4-a192-6385aff3addf/kube-storage-version-migrator-operator/1.log" Jul 12 18:55:12.071662 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:12.071642 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-ps4wq_05d80244-fc3e-45d4-a192-6385aff3addf/kube-storage-version-migrator-operator/0.log" Jul 12 18:55:13.049028 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:13.048999 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8xtv_db4af9d8-455a-4a29-bb79-8ba71a1b0ca6/kube-multus-additional-cni-plugins/0.log" Jul 12 18:55:13.067444 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:13.067410 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8xtv_db4af9d8-455a-4a29-bb79-8ba71a1b0ca6/egress-router-binary-copy/0.log" Jul 12 18:55:13.086253 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:13.086226 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8xtv_db4af9d8-455a-4a29-bb79-8ba71a1b0ca6/cni-plugins/0.log" Jul 12 18:55:13.103962 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:13.103939 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8xtv_db4af9d8-455a-4a29-bb79-8ba71a1b0ca6/bond-cni-plugin/0.log" Jul 12 18:55:13.121063 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:13.121043 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8xtv_db4af9d8-455a-4a29-bb79-8ba71a1b0ca6/routeoverride-cni/0.log" Jul 12 18:55:13.139906 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:13.139888 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8xtv_db4af9d8-455a-4a29-bb79-8ba71a1b0ca6/whereabouts-cni-bincopy/0.log" Jul 12 18:55:13.156437 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:13.156410 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j8xtv_db4af9d8-455a-4a29-bb79-8ba71a1b0ca6/whereabouts-cni/0.log" Jul 12 18:55:13.314341 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:13.314270 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-l9vdt_3634787d-b1de-443d-9721-bb734e755223/kube-multus/0.log" Jul 12 18:55:13.465882 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:13.465856 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vn8dd_92c9c69e-5148-4be6-a348-7bb634c94566/network-metrics-daemon/0.log" Jul 12 18:55:13.483031 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:13.483007 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vn8dd_92c9c69e-5148-4be6-a348-7bb634c94566/kube-rbac-proxy/0.log" Jul 12 18:55:14.247472 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:14.247401 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-899r5_61fdf430-4362-45f5-8d71-56dc20adfba3/ovn-controller/0.log" Jul 12 18:55:14.262040 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:14.262020 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-899r5_61fdf430-4362-45f5-8d71-56dc20adfba3/ovn-acl-logging/0.log" Jul 12 18:55:14.281129 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:14.281108 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-899r5_61fdf430-4362-45f5-8d71-56dc20adfba3/kube-rbac-proxy-node/0.log" Jul 12 18:55:14.300858 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:14.300833 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-899r5_61fdf430-4362-45f5-8d71-56dc20adfba3/kube-rbac-proxy-ovn-metrics/0.log" Jul 12 18:55:14.315523 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:14.315497 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-899r5_61fdf430-4362-45f5-8d71-56dc20adfba3/northd/0.log" Jul 12 18:55:14.337224 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:14.337195 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-899r5_61fdf430-4362-45f5-8d71-56dc20adfba3/nbdb/0.log" Jul 12 18:55:14.354904 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:14.354876 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-899r5_61fdf430-4362-45f5-8d71-56dc20adfba3/sbdb/0.log" Jul 12 18:55:14.407205 ip-10-0-141-130 kubenswrapper[2556]: I0712 18:55:14.407172 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-899r5_61fdf430-4362-45f5-8d71-56dc20adfba3/ovnkube-controller/0.log"