Jul 13 20:16:57.594172 ip-10-0-134-97 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 13 20:16:57.594183 ip-10-0-134-97 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 13 20:16:57.594190 ip-10-0-134-97 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 13 20:16:57.594407 ip-10-0-134-97 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 13 20:17:07.843396 ip-10-0-134-97 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 13 20:17:07.843414 ip-10-0-134-97 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 1ad8ab22247a4d1cb372cab47a64a900 --
Jul 13 20:18:42.136643 ip-10-0-134-97 systemd[1]: Starting Kubernetes Kubelet...
Jul 13 20:18:42.698515 ip-10-0-134-97 kubenswrapper[2588]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 20:18:42.698515 ip-10-0-134-97 kubenswrapper[2588]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 13 20:18:42.698515 ip-10-0-134-97 kubenswrapper[2588]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 20:18:42.698515 ip-10-0-134-97 kubenswrapper[2588]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 13 20:18:42.698515 ip-10-0-134-97 kubenswrapper[2588]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 13 20:18:42.698515 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.586221    2588 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 13 20:18:42.698515 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596764    2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 20:18:42.698515 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596782    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 20:18:42.698515 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596786    2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 20:18:42.698515 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596790    2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 20:18:42.698515 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596792    2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 20:18:42.698515 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596795    2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 20:18:42.698515 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596798    2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 20:18:42.698515 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596802    2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 20:18:42.712928 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596804    2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 20:18:42.712928 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596807    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 20:18:42.712928 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596810    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 20:18:42.712928 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596812    2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 20:18:42.712928 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596815    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 20:18:42.712928 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596818    2588 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 20:18:42.712928 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596821    2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 20:18:42.712928 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596823    2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 20:18:42.712928 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596826    2588 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 20:18:42.712928 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596828    2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 20:18:42.712928 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596831    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 20:18:42.712928 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596834    2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 20:18:42.712928 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596836    2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 20:18:42.712928 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596839    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 20:18:42.712928 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596842    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 20:18:42.712928 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596844    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 20:18:42.712928 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596847    2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 20:18:42.712928 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596850    2588 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 20:18:42.712928 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596852    2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 20:18:42.712928 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596862    2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 20:18:42.669355 ip-10-0-134-97 systemd[1]: Started Kubernetes Kubelet.
Jul 13 20:18:42.715184 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596865    2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 20:18:42.715184 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596867    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 20:18:42.715184 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596869    2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 20:18:42.715184 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596872    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 20:18:42.715184 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596875    2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 20:18:42.715184 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596878    2588 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 20:18:42.715184 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596880    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 20:18:42.715184 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596883    2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 20:18:42.715184 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596885    2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 20:18:42.715184 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596888    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 20:18:42.715184 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596890    2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 20:18:42.715184 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596893    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 20:18:42.715184 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596896    2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 20:18:42.715184 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596900    2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 20:18:42.715184 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596902    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 20:18:42.715184 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596905    2588 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 20:18:42.715184 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596908    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 20:18:42.715184 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596911    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 20:18:42.715184 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596914    2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 20:18:42.715184 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596917    2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 20:18:42.717921 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596920    2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 20:18:42.717921 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596922    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 20:18:42.717921 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596925    2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 20:18:42.717921 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596928    2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 20:18:42.717921 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596931    2588 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 20:18:42.717921 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596934    2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 20:18:42.717921 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596938    2588 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 20:18:42.717921 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596940    2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 20:18:42.717921 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596943    2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 20:18:42.717921 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596945    2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 20:18:42.717921 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596948    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 20:18:42.717921 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596951    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 20:18:42.717921 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596954    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 20:18:42.717921 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596957    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 20:18:42.717921 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596960    2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 20:18:42.717921 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596963    2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 20:18:42.717921 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596966    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 20:18:42.717921 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596968    2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 20:18:42.717921 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596971    2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 20:18:42.717921 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596973    2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 20:18:42.731589 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596976    2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 20:18:42.731589 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596978    2588 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 20:18:42.731589 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596981    2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 20:18:42.731589 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596983    2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 20:18:42.731589 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596986    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 20:18:42.731589 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596989    2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 20:18:42.731589 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596992    2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 20:18:42.731589 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.596995    2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 20:18:42.731589 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597000    2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 20:18:42.731589 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597004    2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 20:18:42.731589 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597008    2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 20:18:42.731589 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597012    2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 20:18:42.731589 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597015    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 20:18:42.731589 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597019    2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 20:18:42.731589 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597022    2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 20:18:42.731589 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597026    2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 20:18:42.731589 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597029    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 20:18:42.731589 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597032    2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 20:18:42.733295 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597035    2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 20:18:42.733295 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597038    2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 20:18:42.733295 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597040    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 20:18:42.733295 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597043    2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 20:18:42.733295 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597046    2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 20:18:42.733295 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597050    2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 20:18:42.733295 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597052    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 20:18:42.733295 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597055    2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 20:18:42.733295 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597057    2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 20:18:42.733295 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597060    2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 20:18:42.733295 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597063    2588 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 20:18:42.733295 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597065    2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 20:18:42.733295 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.597068    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 20:18:42.733295 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598709    2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 20:18:42.733295 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598718    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 20:18:42.733295 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598722    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 20:18:42.733295 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598725    2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 20:18:42.733295 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598728    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 20:18:42.733295 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598732    2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 20:18:42.733295 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598735    2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 20:18:42.734430 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598738    2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 20:18:42.734430 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598741    2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 20:18:42.734430 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598744    2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 20:18:42.734430 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598747    2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 20:18:42.734430 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598750    2588 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 20:18:42.734430 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598753    2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 20:18:42.734430 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598756    2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 20:18:42.734430 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598759    2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 20:18:42.734430 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598762    2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 20:18:42.734430 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598765    2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 20:18:42.734430 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598769    2588 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 20:18:42.734430 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598773    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 20:18:42.734430 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598775    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 20:18:42.734430 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598779    2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 20:18:42.734430 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598783    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 20:18:42.734430 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598786    2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 20:18:42.734430 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598789    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 20:18:42.734430 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598791    2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 20:18:42.734430 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598794    2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 20:18:42.734430 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598797    2588 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 20:18:42.736836 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598799    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 20:18:42.736836 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598802    2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 20:18:42.736836 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598805    2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 20:18:42.736836 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598809    2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 20:18:42.736836 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598812    2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 20:18:42.736836 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598815    2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 20:18:42.736836 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598819    2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 20:18:42.736836 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598822    2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 20:18:42.736836 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598825    2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 20:18:42.736836 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598828    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 20:18:42.736836 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598831    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 20:18:42.736836 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598834    2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 20:18:42.736836 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598837    2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 20:18:42.736836 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598840    2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 20:18:42.736836 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598842    2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 20:18:42.736836 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598846    2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 20:18:42.736836 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598848    2588 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 20:18:42.736836 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598851    2588 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 20:18:42.736836 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598854    2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 20:18:42.736836 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598857    2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 20:18:42.904215 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598859    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 20:18:42.904215 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598862    2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 20:18:42.904215 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598864    2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 20:18:42.904215 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598874    2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 20:18:42.904215 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598876    2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 20:18:42.904215 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598881    2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 20:18:42.904215 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598884    2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 20:18:42.904215 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598887    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 20:18:42.904215 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598890    2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 20:18:42.904215 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598893    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 20:18:42.904215 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598895    2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 20:18:42.904215 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598898    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 20:18:42.904215 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598901    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 20:18:42.904215 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598903    2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 20:18:42.904215 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598906    2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 20:18:42.904215 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598909    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 20:18:42.904215 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598911    2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 20:18:42.904215 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598915    2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 20:18:42.904215 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598918    2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 20:18:42.904215 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598920    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 20:18:42.905790 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598923    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 20:18:42.905790 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598925    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 20:18:42.905790 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598930    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 20:18:42.905790 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598933    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 20:18:42.905790 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598936    2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 20:18:42.905790 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598938    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 20:18:42.905790 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598941    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 20:18:42.905790 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598943    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 20:18:42.905790 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598946    2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 20:18:42.905790 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598949    2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 20:18:42.905790 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598951    2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 20:18:42.905790 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598954    2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 20:18:42.905790 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598956    2588 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 20:18:42.905790 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598959    2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 20:18:42.905790 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598962    2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 20:18:42.905790 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598964    2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 20:18:42.905790 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598967    2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 20:18:42.905790 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598971    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 20:18:42.905790 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598974    2588 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 20:18:42.905790 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598977    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 20:18:42.907181 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598979    2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 20:18:42.907181 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598982    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 20:18:42.907181 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598984    2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 20:18:42.907181 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598986    2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 20:18:42.907181 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598989    2588 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 20:18:42.907181 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598991    2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 20:18:42.907181 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598994    2588 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 20:18:42.907181 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598996    2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 20:18:42.907181 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.598999    2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 20:18:42.907181 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599002    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 20:18:42.907181 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599005    2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 20:18:42.907181 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599009    2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 20:18:42.907181 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599404    2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 20:18:42.907181 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599409    2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 20:18:42.907181 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599415    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 20:18:42.907181 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599418    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 20:18:42.907181 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599421    2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 20:18:42.907181 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599424    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 20:18:42.907181 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599426    2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 20:18:42.909288 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599429    2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 20:18:42.909288 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599431    2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 20:18:42.909288 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599434    2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 20:18:42.909288 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599437    2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 20:18:42.909288 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599439    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 20:18:42.909288 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599442    2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 20:18:42.909288 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599444    2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 20:18:42.909288 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599447    2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 20:18:42.909288 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599449    2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 20:18:42.909288 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599452    2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 20:18:42.909288 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599456    2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 20:18:42.909288 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599459    2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 20:18:42.909288 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599462    2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 20:18:42.909288 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599464    2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 20:18:42.909288 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599467    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 20:18:42.909288 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599470    2588 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 20:18:42.909288 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599472    2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 20:18:42.909288 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599475    2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 20:18:42.909288 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599478    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 20:18:42.909288 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599480    2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 20:18:42.910744 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599483    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 20:18:42.910744 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599486    2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 20:18:42.910744 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599488    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 20:18:42.910744 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599491    2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 20:18:42.910744 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599493    2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 20:18:42.910744 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599496    2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 20:18:42.910744 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599498    2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 20:18:42.910744 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599502    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 20:18:42.910744 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599505    2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 20:18:42.910744 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599507    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 20:18:42.910744 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599510    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 20:18:42.910744 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599512    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 20:18:42.910744 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599515    2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 20:18:42.910744 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599518    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 20:18:42.910744 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599521    2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 20:18:42.910744 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599523    2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 20:18:42.910744 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599526    2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 20:18:42.910744 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599529    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 20:18:42.910744 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599532    2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 20:18:42.910744 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599536    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 20:18:42.913777 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599539    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 20:18:42.913777 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599541    2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 20:18:42.913777 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599546    2588 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 20:18:42.913777 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599548    2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 20:18:42.913777 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599551    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 20:18:42.913777 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599553    2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 20:18:42.913777 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599556    2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 20:18:42.913777 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599558    2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 20:18:42.913777 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599562    2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 20:18:42.913777 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599566    2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 20:18:42.913777 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599569    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 20:18:42.913777 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599571    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 20:18:42.913777 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599574    2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 20:18:42.913777 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599577    2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 20:18:42.913777 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599579    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 20:18:42.913777 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599582    2588 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 20:18:42.913777 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599585    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 20:18:42.913777 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599591    2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 20:18:42.913777 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599594    2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 20:18:42.916129 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599598    2588 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 20:18:42.916129 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599601    2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 20:18:42.916129 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599604    2588 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 20:18:42.916129 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599607    2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 20:18:42.916129 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599610    2588 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 20:18:42.916129 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599612    2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 20:18:42.916129 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599615    2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 20:18:42.916129 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599618    2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 20:18:42.916129 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599620    2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 20:18:42.916129 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599623    2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 20:18:42.916129 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599625    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 20:18:42.916129 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599628    2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 20:18:42.916129 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599630    2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 20:18:42.916129 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599633    2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 20:18:42.916129 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599635    2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 20:18:42.916129 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599639    2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 20:18:42.916129 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599642    2588 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 20:18:42.916129 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599644    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 20:18:42.916129 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599647    2588 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 20:18:42.916129 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599649    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 20:18:42.918185 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599652    2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 20:18:42.918185 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599654    2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 20:18:42.918185 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599657    2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 20:18:42.918185 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599659    2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 20:18:42.918185 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599662    2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 20:18:42.918185 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599664    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 20:18:42.918185 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599667    2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 20:18:42.918185 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599669    2588 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 20:18:42.918185 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599672    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 20:18:42.918185 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599674    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 20:18:42.918185 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599677    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 20:18:42.918185 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599679    2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 20:18:42.918185 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.599683    2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 20:18:42.918185 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599751    2588 flags.go:64] FLAG: --address="0.0.0.0"
Jul 13 20:18:42.918185 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599758    2588 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 13 20:18:42.918185 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599764    2588 flags.go:64] FLAG: --anonymous-auth="true"
Jul 13 20:18:42.918185 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599769    2588 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 13 20:18:42.918185 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599772    2588 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 13 20:18:42.918185 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599776    2588 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 13 20:18:42.918185 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599779    2588 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 13 20:18:42.918185 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599783    2588 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599787    2588 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599789    2588 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599793    2588 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599796    2588 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599799    2588 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599802    2588 flags.go:64] FLAG: --cgroup-root=""
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599807    2588 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599809    2588 flags.go:64] FLAG: --client-ca-file=""
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599813    2588 flags.go:64] FLAG: --cloud-provider="external"
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599816    2588 flags.go:64] FLAG: --cluster-dns="[]"
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599820    2588 flags.go:64] FLAG: --cluster-domain=""
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599823    2588 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599826    2588 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599829    2588 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599832    2588 flags.go:64] FLAG: --container-log-max-files="5"
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599836    2588 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599839    2588 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599842    2588 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599845    2588 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599848    2588 flags.go:64] FLAG: --contention-profiling="false"
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599851    2588 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599854    2588 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599857    2588 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 13 20:18:42.920903 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599861    2588 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599865    2588 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599868    2588 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599871    2588 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599874    2588 flags.go:64] FLAG: --enable-load-reader="false"
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599876    2588 flags.go:64] FLAG: --enable-server="true"
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599879    2588 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599884    2588 flags.go:64] FLAG: --event-burst="100"
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599888    2588 flags.go:64] FLAG: --event-qps="50"
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599890    2588 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599893    2588 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599896    2588 flags.go:64] FLAG: --eviction-hard=""
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599900    2588 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599903    2588 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599906    2588 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599910    2588 flags.go:64] FLAG: --eviction-soft=""
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599913    2588 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599916    2588 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599919    2588 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599922    2588 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599925    2588 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599928    2588 flags.go:64] FLAG: --fail-swap-on="true"
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599930    2588 flags.go:64] FLAG: --feature-gates=""
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599934    2588 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599937    2588 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 13 20:18:42.922077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599940    2588 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599943    2588 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599946    2588 flags.go:64] FLAG: --healthz-port="10248"
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599949    2588 flags.go:64] FLAG: --help="false"
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599951    2588 flags.go:64] FLAG: --hostname-override="ip-10-0-134-97.ec2.internal"
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599954    2588 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599957    2588 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599961    2588 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599965    2588 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599969    2588 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599972    2588 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599974    2588 flags.go:64] FLAG: --image-service-endpoint=""
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599977    2588 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599980    2588 flags.go:64] FLAG: --kube-api-burst="100"
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599983    2588 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599986    2588 flags.go:64] FLAG: --kube-api-qps="50"
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599989    2588 flags.go:64] FLAG: --kube-reserved=""
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599991    2588 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599994    2588 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.599997    2588 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600000    2588 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600003    2588 flags.go:64] FLAG: --lock-file=""
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600007    2588 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600010    2588 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 13 20:18:42.923223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600012    2588 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600018    2588 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600021    2588 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600024    2588 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600027    2588 flags.go:64] FLAG: --logging-format="text"
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600030    2588 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600033    2588 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600036    2588 flags.go:64] FLAG: --manifest-url=""
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600039    2588 flags.go:64] FLAG: --manifest-url-header=""
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600043    2588 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600045    2588 flags.go:64] FLAG: --max-open-files="1000000"
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600049    2588 flags.go:64] FLAG: --max-pods="110"
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600052    2588 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600055    2588 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600058    2588 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600062    2588 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600065    2588 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600068    2588 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600071    2588 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600079    2588 flags.go:64] FLAG: --node-status-max-images="50"
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600082    2588 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600085    2588 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600088    2588 flags.go:64] FLAG: --pod-cidr=""
Jul 13 20:18:42.924273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600090    2588 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600096    2588 flags.go:64] FLAG: --pod-manifest-path=""
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600098    2588 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600102    2588 flags.go:64] FLAG: --pods-per-core="0"
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600104    2588 flags.go:64] FLAG: --port="10250"
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600107    2588 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600110    2588 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c86b8304efb59210"
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600115    2588 flags.go:64] FLAG: --qos-reserved=""
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600118    2588 flags.go:64] FLAG: --read-only-port="10255"
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600121    2588 flags.go:64] FLAG: --register-node="true"
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600124    2588 flags.go:64] FLAG: --register-with-taints=""
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600127    2588 flags.go:64] FLAG: --registry-burst="10"
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600131    2588 flags.go:64] FLAG: --registry-qps="5"
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600133    2588 flags.go:64] FLAG: --reserved-cpus=""
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600136    2588 flags.go:64] FLAG: --reserved-memory=""
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600140    2588 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600143    2588 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600146    2588 flags.go:64] FLAG: --rotate-certificates="false"
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600148    2588 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600151    2588 flags.go:64] FLAG: --runonce="false"
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600154    2588 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600157    2588 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600160    2588 flags.go:64] FLAG: --seccomp-default="false"
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600163    2588 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600165    2588 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600169    2588 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 13 20:18:42.928777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600172    2588 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600175    2588 flags.go:64] FLAG: --storage-driver-password="root"
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600178    2588 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600181    2588 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600184    2588 flags.go:64] FLAG: --storage-driver-user="root"
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600186    2588 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600189    2588 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600192    2588 flags.go:64] FLAG: --system-cgroups=""
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600195    2588 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600200    2588 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600203    2588 flags.go:64] FLAG: --tls-cert-file=""
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600205    2588 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600209    2588 flags.go:64] FLAG: --tls-min-version=""
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600213    2588 flags.go:64] FLAG: --tls-private-key-file=""
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600216    2588 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600219    2588 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600222    2588 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600225    2588 flags.go:64] FLAG: --v="2"
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600228    2588 flags.go:64] FLAG: --version="false"
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600233    2588 flags.go:64] FLAG: --vmodule=""
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600237    2588 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.600240    2588 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600351    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600354    2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 20:18:42.930071 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600357    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 20:18:42.937608 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600373    2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 20:18:42.937608 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600376    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 20:18:42.937608 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600379    2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 20:18:42.937608 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600381    2588 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 20:18:42.937608 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600384    2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 20:18:42.937608 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600387    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 20:18:42.937608 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600391    2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 20:18:42.937608 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600393    2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 20:18:42.937608 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600396    2588 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 20:18:42.937608 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600399    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 20:18:42.937608 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600402    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 20:18:42.937608 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600405    2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 20:18:42.937608 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600408    2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 20:18:42.937608 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600410    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 20:18:42.937608 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600413    2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 20:18:42.937608 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600416    2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 20:18:42.937608 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600418    2588 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 20:18:42.937608 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600421    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 20:18:42.937608 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600423    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 20:18:42.937608 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600426    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 20:18:42.938700 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600430    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 20:18:42.938700 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600433    2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 20:18:42.938700 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600435    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 20:18:42.938700 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600438    2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 20:18:42.938700 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600441    2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 20:18:42.938700 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600443    2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 20:18:42.938700 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600446    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 20:18:42.938700 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600449    2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 20:18:42.938700 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600452    2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 20:18:42.938700 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600455    2588 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 20:18:42.938700 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600457    2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 20:18:42.938700 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600460    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 20:18:42.938700 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600463    2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 20:18:42.938700 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600465    2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 20:18:42.938700 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600468    2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 20:18:42.938700 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600470    2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 20:18:42.938700 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600473    2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 20:18:42.938700 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600475    2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 20:18:42.938700 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600480    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 20:18:42.938700 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600482    2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 20:18:42.939767 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600485    2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 20:18:42.939767 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600488    2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 20:18:42.939767 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600490    2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 20:18:42.939767 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600493    2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 20:18:42.939767 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600497    2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 20:18:42.939767 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600501    2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 20:18:42.939767 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600505    2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 20:18:42.939767 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600509    2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 20:18:42.939767 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600513    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 20:18:42.939767 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600516    2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 20:18:42.939767 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600519    2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 20:18:42.939767 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600522    2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 20:18:42.939767 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600526    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 20:18:42.939767 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600529    2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 20:18:42.939767 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600531    2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 20:18:42.939767 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600534    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 20:18:42.939767 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600536    2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 20:18:42.939767 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600539    2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 20:18:42.939767 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600542    2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 20:18:42.940640 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600544    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 20:18:42.940640 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600550    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 20:18:42.940640 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600553    2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 20:18:42.940640 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600556    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 20:18:42.940640 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600560    2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 20:18:42.940640 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600564    2588 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 20:18:42.940640 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600566    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 20:18:42.940640 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600569    2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 20:18:42.940640 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600572    2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 20:18:42.940640 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600574    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 20:18:42.940640 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600577    2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 20:18:42.940640 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600581    2588 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 20:18:42.940640 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600583    2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 20:18:42.940640 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600586    2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 20:18:42.940640 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600589    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 20:18:42.940640 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600592    2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 20:18:42.940640 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600594    2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 20:18:42.940640 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600597    2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 20:18:42.940640 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600600    2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 20:18:42.940640 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600602    2588 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 20:18:42.941505 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600605    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 20:18:42.941505 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600607    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 20:18:42.941505 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600610    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 20:18:42.941505 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600612    2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 20:18:42.941505 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600615    2588 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 20:18:42.941505 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600619    2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 20:18:42.941505 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600621    2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 20:18:42.941505 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600624    2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 20:18:42.941505 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600626    2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 20:18:42.941505 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600629    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 20:18:42.941505 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600632    2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 20:18:42.941505 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600635    2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 20:18:42.941505 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600638    2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 20:18:42.941505 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600640    2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 20:18:42.941505 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600644    2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 20:18:42.941505 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600646    2588 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 20:18:42.941505 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.600649    2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 20:18:42.942390 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.602137    2588 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 20:18:42.942390 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.609091    2588 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 13 20:18:42.942390 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.609106    2588 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 13 20:18:42.942390 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.609126    2588 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 13 20:18:42.942390 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.609135    2588 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 13 20:18:42.942390 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609191    2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 20:18:42.942390 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609196    2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 20:18:42.942390 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609199    2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 20:18:42.942390 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609202    2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 20:18:42.942390 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609206    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 20:18:42.942390 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609209    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 20:18:42.942390 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609211    2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 20:18:42.942390 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609214    2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 20:18:42.942390 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609217    2588 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 20:18:42.942390 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609220    2588 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 20:18:42.943048 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609223    2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 20:18:42.943048 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609227    2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 20:18:42.943048 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609230    2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 20:18:42.943048 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609233    2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 20:18:42.943048 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609236    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 20:18:42.943048 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609238    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 20:18:42.943048 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609241    2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 20:18:42.943048 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609243    2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 20:18:42.943048 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609246    2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 20:18:42.943048 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609248    2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 20:18:42.943048 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609251    2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 20:18:42.943048 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609254    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 20:18:42.943048 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609256    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 20:18:42.943048 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609258    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 20:18:42.943048 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609261    2588 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 20:18:42.943048 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609264    2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 20:18:42.943048 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609266    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 20:18:42.943048 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609270    2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 20:18:42.943048 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609276    2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 20:18:42.943915 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609281    2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 20:18:42.943915 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609284    2588 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 20:18:42.943915 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609288    2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 20:18:42.943915 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609291    2588 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 20:18:42.943915 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609294    2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 20:18:42.943915 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609297    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 20:18:42.943915 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609300    2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 20:18:42.943915 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609302    2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 20:18:42.943915 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609305    2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 20:18:42.943915 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609308    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 20:18:42.943915 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609311    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 20:18:42.943915 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609313    2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 20:18:42.943915 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609316    2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 20:18:42.943915 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609319    2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 20:18:42.943915 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609321    2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 20:18:42.943915 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609324    2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 20:18:42.943915 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609326    2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 20:18:42.943915 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609329    2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 20:18:42.943915 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609332    2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 20:18:42.943915 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609335    2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 20:18:42.944926 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609337    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 20:18:42.944926 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609340    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 20:18:42.944926 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609342    2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 20:18:42.944926 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609345    2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 20:18:42.944926 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609347    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 20:18:42.944926 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609350    2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 20:18:42.944926 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609352    2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 20:18:42.944926 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609355    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 20:18:42.944926 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609357    2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 20:18:42.944926 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609377    2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 20:18:42.944926 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609383    2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 20:18:42.944926 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609387    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 20:18:42.944926 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609390    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 20:18:42.944926 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609393    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 20:18:42.944926 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609396    2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 20:18:42.944926 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609399    2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 20:18:42.944926 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609402    2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 20:18:42.944926 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609404    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 20:18:42.944926 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609407    2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 20:18:42.944926 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609410    2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 20:18:42.945995 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609412    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 20:18:42.945995 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609415    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 20:18:42.945995 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609418    2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 20:18:42.945995 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609420    2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 20:18:42.945995 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609423    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 20:18:42.945995 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609425    2588 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 20:18:42.945995 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609428    2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 20:18:42.945995 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609431    2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 20:18:42.945995 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609434    2588 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 20:18:42.945995 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609436    2588 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 20:18:42.945995 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609439    2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 20:18:42.945995 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609441    2588 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 20:18:42.945995 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609444    2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 20:18:42.945995 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609446    2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 20:18:42.945995 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609449    2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 20:18:42.945995 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609452    2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 20:18:42.945995 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609454    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 20:18:42.945995 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609457    2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 20:18:42.945995 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609459    2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 20:18:42.945995 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609462    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 20:18:42.946879 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609465    2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 20:18:42.946879 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609467    2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 20:18:42.946879 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609470    2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 20:18:42.946879 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609474    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 20:18:42.946879 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609476    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 20:18:42.946879 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609479    2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 20:18:42.946879 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609482    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 20:18:42.946879 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609485    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 20:18:42.946879 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609488    2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 20:18:42.946879 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609492    2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 20:18:42.946879 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.609497    2588 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 20:18:42.946879 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609640    2588 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 13 20:18:42.946879 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609645    2588 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 13 20:18:42.946879 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609649    2588 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 13 20:18:42.947536 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609651    2588 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 13 20:18:42.947536 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609654    2588 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 13 20:18:42.947536 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609657    2588 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 13 20:18:42.947536 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609660    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 13 20:18:42.947536 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609663    2588 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 13 20:18:42.947536 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609666    2588 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 13 20:18:42.947536 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609669    2588 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 13 20:18:42.947536 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609671    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 13 20:18:42.947536 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609673    2588 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 13 20:18:42.947536 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609676    2588 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 13 20:18:42.947536 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609679    2588 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 13 20:18:42.947536 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609681    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 13 20:18:42.947536 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609684    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 13 20:18:42.947536 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609686    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 13 20:18:42.947536 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609689    2588 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 13 20:18:42.947536 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609692    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 13 20:18:42.947536 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609695    2588 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 13 20:18:42.947536 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609697    2588 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 13 20:18:42.947536 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609700    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 13 20:18:42.947536 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609703    2588 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 13 20:18:42.948400 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609707    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 13 20:18:42.948400 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609710    2588 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 13 20:18:42.948400 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609714    2588 feature_gate.go:328] unrecognized feature gate: Example2
Jul 13 20:18:42.948400 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609716    2588 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 13 20:18:42.948400 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609719    2588 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 13 20:18:42.948400 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609722    2588 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 13 20:18:42.948400 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609725    2588 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 13 20:18:42.948400 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609727    2588 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 13 20:18:42.948400 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609730    2588 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 13 20:18:42.948400 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609734    2588 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 13 20:18:42.948400 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609737    2588 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 13 20:18:42.948400 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609740    2588 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 13 20:18:42.948400 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609743    2588 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 13 20:18:42.948400 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609746    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 13 20:18:42.948400 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609748    2588 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 13 20:18:42.948400 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609751    2588 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 13 20:18:42.948400 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609753    2588 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 13 20:18:42.948400 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609756    2588 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 13 20:18:42.948400 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609759    2588 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 13 20:18:42.949253 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609762    2588 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 13 20:18:42.949253 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609765    2588 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 13 20:18:42.949253 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609768    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 13 20:18:42.949253 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609770    2588 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 13 20:18:42.949253 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609773    2588 feature_gate.go:328] unrecognized feature gate: Example
Jul 13 20:18:42.949253 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609776    2588 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 13 20:18:42.949253 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609778    2588 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 13 20:18:42.949253 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609782    2588 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 13 20:18:42.949253 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609785    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 13 20:18:42.949253 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609788    2588 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 13 20:18:42.949253 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609791    2588 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 13 20:18:42.949253 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609793    2588 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 13 20:18:42.949253 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609797    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 13 20:18:42.949253 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609802    2588 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 13 20:18:42.949253 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609805    2588 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 13 20:18:42.949253 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609809    2588 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 13 20:18:42.949253 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609811    2588 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 13 20:18:42.949253 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609814    2588 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 13 20:18:42.949253 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609816    2588 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 13 20:18:42.950113 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609819    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 13 20:18:42.950113 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609822    2588 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 13 20:18:42.950113 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609825    2588 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 13 20:18:42.950113 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609827    2588 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 13 20:18:42.950113 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609829    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 13 20:18:42.950113 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609832    2588 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 13 20:18:42.950113 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609835    2588 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 13 20:18:42.950113 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609837    2588 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 13 20:18:42.950113 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609840    2588 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 13 20:18:42.950113 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609843    2588 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 13 20:18:42.950113 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609845    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 13 20:18:42.950113 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609848    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 13 20:18:42.950113 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609850    2588 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 13 20:18:42.950113 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609853    2588 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 13 20:18:42.950113 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609855    2588 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 13 20:18:42.950113 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609858    2588 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 13 20:18:42.950113 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609860    2588 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 13 20:18:42.950113 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609863    2588 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 13 20:18:42.950113 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609866    2588 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 13 20:18:42.950113 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609868    2588 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 13 20:18:42.950997 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609870    2588 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 13 20:18:42.950997 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609873    2588 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 13 20:18:42.950997 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609875    2588 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 13 20:18:42.950997 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609878    2588 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 13 20:18:42.950997 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609880    2588 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 13 20:18:42.950997 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609883    2588 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 13 20:18:42.950997 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609887    2588 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 13 20:18:42.950997 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609889    2588 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 13 20:18:42.950997 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609893    2588 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 13 20:18:42.950997 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609896    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 13 20:18:42.950997 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609898    2588 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 13 20:18:42.950997 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609901    2588 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 13 20:18:42.950997 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609904    2588 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 13 20:18:42.950997 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609907    2588 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 13 20:18:42.950997 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609910    2588 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 13 20:18:42.950997 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609912    2588 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 13 20:18:42.950997 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609915    2588 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 13 20:18:42.950997 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:42.609918    2588 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 13 20:18:42.951875 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.609922    2588 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 13 20:18:42.951875 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.610025    2588 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 13 20:18:42.951875 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.612399    2588 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 13 20:18:42.951875 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.614104    2588 server.go:1019] "Starting client certificate rotation"
Jul 13 20:18:42.951875 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.614203    2588 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 20:18:42.951875 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.614237    2588 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 13 20:18:42.951875 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.616908    2588 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 20:18:42.951875 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.620351    2588 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 13 20:18:42.951875 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.634343    2588 log.go:25] "Validated CRI v1 runtime API"
Jul 13 20:18:42.951875 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.636811    2588 log.go:25] "Validated CRI v1 image API"
Jul 13 20:18:42.951875 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.637598    2588 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 13 20:18:42.951875 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.640241    2588 fs.go:135] Filesystem UUIDs: map[4ed3a6e2-5b5f-45d8-b0ae-7b1c98a9ba2f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8678236a-8546-4623-ba09-5201c21a852b:/dev/nvme0n1p3]
Jul 13 20:18:42.952531 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.640259    2588 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 13 20:18:42.952741 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.645943    2588 manager.go:216] Machine: {Timestamp:2026-07-13 20:18:42.644518039 +0000 UTC m=+0.379169219 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098078 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21f02e62975c8750a4ae66e6339798 SystemUUID:ec21f02e-6297-5c87-50a4-ae66e6339798 BootID:1ad8ab22-247a-4d1c-b372-cab47a64a900 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4b:bc:e1:64:9d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4b:bc:e1:64:9d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:29:ce:e8:4b:6c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 13 20:18:42.952741 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.646050    2588 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 13 20:18:42.952741 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.646128    2588 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 13 20:18:42.952741 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.649286    2588 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 20:18:42.952741 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.649685    2588 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 13 20:18:42.952741 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.649710    2588 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-97.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 13 20:18:42.952741 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.650517    2588 topology_manager.go:138] "Creating topology manager with none policy"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.650528    2588 container_manager_linux.go:309] "Creating device plugin manager"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.650535    2588 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.650550    2588 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.652349    2588 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.657290    2588 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.657432    2588 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.657460    2588 kubelet.go:486] "Attempting to sync node with API server"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.657488    2588 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.657504    2588 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.657514    2588 kubelet.go:398] "Adding apiserver pod source"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.657523    2588 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.657959    2588 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.657973    2588 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.660247    2588 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.662867    2588 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.662895    2588 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.663060    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.663083    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.663098    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.663110    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.663123    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.663136    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.663658    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.663667    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.663673    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.663678    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.663691    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.663717    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.664565    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.664578    2588 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.667328    2588 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-97.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.668418    2588 server.go:1268] "Started kubelet"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:42.668478    2588 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:42.668419    2588 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-97.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.668650    2588 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.668675    2588 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.668935    2588 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.670484    2588 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 13 20:18:43.142998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.674829    2588 server.go:310] "Adding debug handlers to kubelet server"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:42.676669    2588 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:42.679435    2588 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-97.ec2.internal.18c1f2d4ad2df518  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-97.ec2.internal,UID:ip-10-0-134-97.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-97.ec2.internal,},FirstTimestamp:2026-07-13 20:18:42.667885848 +0000 UTC m=+0.402537027,LastTimestamp:2026-07-13 20:18:42.667885848 +0000 UTC m=+0.402537027,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-97.ec2.internal,}"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.682342    2588 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.682372    2588 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:42.682486    2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-97.ec2.internal\" not found"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.683142    2588 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.683144    2588 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.683168    2588 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.683229    2588 reconstruct.go:97] "Volume reconstruction finished"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.683240    2588 reconciler.go:29] "Reconciler: start to sync state"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.683884    2588 factory.go:55] Registering systemd factory
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.683900    2588 factory.go:223] Registration of the systemd container factory successfully
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.684067    2588 factory.go:153] Registering CRI-O factory
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.684081    2588 factory.go:223] Registration of the crio container factory successfully
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.684142    2588 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.684165    2588 factory.go:103] Registering Raw factory
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.684181    2588 manager.go:1196] Started watching for new ooms in manager
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.685286    2588 manager.go:349] Starting recovery of all containers
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.690675    2588 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:42.692393    2588 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-97.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:42.692557    2588 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.696008    2588 manager.go:354] Recovery completed
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.703033    2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.704554    2588 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nbjn8"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.705065    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.705090    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.705099    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientPID"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.705650    2588 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.705661    2588 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.705677    2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.705683    2588 state_mem.go:36] "Initialized new in-memory state store"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.707912    2588 policy_none.go:49] "None policy: Start"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.707926    2588 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 13 20:18:43.144767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.707936    2588 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.708741    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.708765    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.708779    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientPID"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.709963    2588 policy_none.go:47] "Start"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.711143    2588 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nbjn8"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:42.717761    2588 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-97.ec2.internal.18c1f2d4af6572c3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-97.ec2.internal,UID:ip-10-0-134-97.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-97.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-97.ec2.internal,},FirstTimestamp:2026-07-13 20:18:42.705076931 +0000 UTC m=+0.439728110,LastTimestamp:2026-07-13 20:18:42.705076931 +0000 UTC m=+0.439728110,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-97.ec2.internal,}"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.758991    2588 manager.go:337] "Starting Device Plugin manager"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:42.759020    2588 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.759030    2588 server.go:87] "Starting device plugin registration server"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.759285    2588 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.759296    2588 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.759401    2588 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.759504    2588 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.759515    2588 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:42.760096    2588 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:42.760151    2588 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-97.ec2.internal\" not found"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.766905    2588 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2626 into the system container \"/system.slice\": <nil>"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.860176    2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.861186    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.861213    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.861224    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientPID"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.861251    2588 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-97.ec2.internal"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.872148    2588 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-97.ec2.internal"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:42.872170    2588 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-97.ec2.internal\": node \"ip-10-0-134-97.ec2.internal\" not found"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:42.913179    2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-97.ec2.internal\" not found"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.963564    2588 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.963599    2588 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.963622    2588 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:42.963662    2588 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:42.965950    2588 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 20:18:43.145824 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:43.014296    2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-97.ec2.internal\" not found"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.064437    2588 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-97.ec2.internal"]
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.064515    2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.068193    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.068222    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.068235    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientPID"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.070650    2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.070778    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.070807    2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.071458    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.071472    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.071496    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.071507    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientPID"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.071477    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.071570    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientPID"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.073696    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-97.ec2.internal"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.073715    2588 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.074388    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientMemory"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.074410    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasNoDiskPressure"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.074420    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeHasSufficientPID"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.084416    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a9c3f301318acedb08c2b2e07e74f71f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal\" (UID: \"a9c3f301318acedb08c2b2e07e74f71f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.084439    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9c3f301318acedb08c2b2e07e74f71f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal\" (UID: \"a9c3f301318acedb08c2b2e07e74f71f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.084456    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b74d540315bcd62d8ef3b8967ccadd0-config\") pod \"kube-apiserver-proxy-ip-10-0-134-97.ec2.internal\" (UID: \"4b74d540315bcd62d8ef3b8967ccadd0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-97.ec2.internal"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:43.100924    2588 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-97.ec2.internal\" not found" node="ip-10-0-134-97.ec2.internal"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:43.105245    2588 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-97.ec2.internal\" not found" node="ip-10-0-134-97.ec2.internal"
Jul 13 20:18:43.381215 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:43.114401    2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-97.ec2.internal\" not found"
Jul 13 20:18:43.382610 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.185277    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a9c3f301318acedb08c2b2e07e74f71f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal\" (UID: \"a9c3f301318acedb08c2b2e07e74f71f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal"
Jul 13 20:18:43.382610 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.185313    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9c3f301318acedb08c2b2e07e74f71f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal\" (UID: \"a9c3f301318acedb08c2b2e07e74f71f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal"
Jul 13 20:18:43.382610 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.185331    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b74d540315bcd62d8ef3b8967ccadd0-config\") pod \"kube-apiserver-proxy-ip-10-0-134-97.ec2.internal\" (UID: \"4b74d540315bcd62d8ef3b8967ccadd0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-97.ec2.internal"
Jul 13 20:18:43.382610 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.185394    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a9c3f301318acedb08c2b2e07e74f71f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal\" (UID: \"a9c3f301318acedb08c2b2e07e74f71f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal"
Jul 13 20:18:43.382610 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.185406    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a9c3f301318acedb08c2b2e07e74f71f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal\" (UID: \"a9c3f301318acedb08c2b2e07e74f71f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal"
Jul 13 20:18:43.382610 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.185399    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4b74d540315bcd62d8ef3b8967ccadd0-config\") pod \"kube-apiserver-proxy-ip-10-0-134-97.ec2.internal\" (UID: \"4b74d540315bcd62d8ef3b8967ccadd0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-97.ec2.internal"
Jul 13 20:18:43.382610 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:43.215412    2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-97.ec2.internal\" not found"
Jul 13 20:18:43.382610 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:43.316085    2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-97.ec2.internal\" not found"
Jul 13 20:18:43.631757 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.402542    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal"
Jul 13 20:18:43.631757 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.408343    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-97.ec2.internal"
Jul 13 20:18:43.631757 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:43.416964    2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-97.ec2.internal\" not found"
Jul 13 20:18:43.631757 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:43.517677    2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-97.ec2.internal\" not found"
Jul 13 20:18:43.631757 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.613723    2588 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 13 20:18:43.631757 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.613882    2588 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 13 20:18:43.631757 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:43.618157    2588 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-97.ec2.internal\" not found"
Jul 13 20:18:43.892483 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.710940    2588 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 20:18:43.892483 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.716323    2588 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 20:13:42 +0000 UTC" deadline="2028-04-21 22:16:49.76315543 +0000 UTC"
Jul 13 20:18:43.892483 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.716362    2588 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15553h58m6.046797105s"
Jul 13 20:18:43.892483 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.783089    2588 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-97.ec2.internal"
Jul 13 20:18:43.892483 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.786015    2588 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 20:18:43.892483 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.794450    2588 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 20:18:43.892483 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.795851    2588 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal"
Jul 13 20:18:43.892483 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:43.809576    2588 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 13 20:18:44.183773 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:44.084197    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b74d540315bcd62d8ef3b8967ccadd0.slice/crio-8cf5eff4c57c9609340bd60efad11a47465331df380216e763812759755dd65b WatchSource:0}: Error finding container 8cf5eff4c57c9609340bd60efad11a47465331df380216e763812759755dd65b: Status 404 returned error can't find the container with id 8cf5eff4c57c9609340bd60efad11a47465331df380216e763812759755dd65b
Jul 13 20:18:44.183773 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:44.084433    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9c3f301318acedb08c2b2e07e74f71f.slice/crio-b05e72200bbe4a95c7e1871ef5488150b5ffca720645a0b025c2abdb114e761e WatchSource:0}: Error finding container b05e72200bbe4a95c7e1871ef5488150b5ffca720645a0b025c2abdb114e761e: Status 404 returned error can't find the container with id b05e72200bbe4a95c7e1871ef5488150b5ffca720645a0b025c2abdb114e761e
Jul 13 20:18:44.183773 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.088633    2588 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 20:18:44.464919 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.225461    2588 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.661429    2588 apiserver.go:52] "Watching apiserver"
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.669446    2588 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.670614    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-q5tv4","openshift-network-diagnostics/network-check-target-tzvwk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp","openshift-dns/node-resolver-mr5jv","openshift-image-registry/node-ca-wfdvr","openshift-multus/network-metrics-daemon-ccnrf","openshift-network-operator/iptables-alerter-sr8qj","openshift-ovn-kubernetes/ovnkube-node-c9wsz","kube-system/global-pull-secret-syncer-nr99r","kube-system/konnectivity-agent-8whzd","kube-system/kube-apiserver-proxy-ip-10-0-134-97.ec2.internal","openshift-cluster-node-tuning-operator/tuned-52zwb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal","openshift-multus/multus-additional-cni-plugins-prx69"]
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.673329    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.675742    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:44.675828    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tzvwk" podUID="cd43f8e0-f611-4cf2-9a46-95f57f1ae944"
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.676643    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-q47vc\""
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.676719    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.676719    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.676889    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.677086    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.678260    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.680527    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mr5jv"
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.681028    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.681039    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mp72q\""
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.681026    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.681333    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.682969    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wfdvr"
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.683136    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.683143    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.683275    2588 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.683402    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rckvq\""
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.685486    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:44.685567    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccnrf" podUID="3c22ea6b-3598-4451-8520-e5f11a335825"
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.685957    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 13 20:18:44.694011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.685985    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 13 20:18:44.696010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.685997    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 13 20:18:44.696010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.686493    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-x2nks\""
Jul 13 20:18:44.696010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.687864    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sr8qj"
Jul 13 20:18:44.696010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.691560    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.696010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.691608    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 13 20:18:44.696010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.691658    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 13 20:18:44.696010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.692069    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5k5qk\""
Jul 13 20:18:44.696010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.693196    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 13 20:18:44.696010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.693868    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c85bf135-1b33-4b7b-8984-588d51190322-tmp-dir\") pod \"node-resolver-mr5jv\" (UID: \"c85bf135-1b33-4b7b-8984-588d51190322\") " pod="openshift-dns/node-resolver-mr5jv"
Jul 13 20:18:44.696010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.693906    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlts2\" (UniqueName: \"kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2\") pod \"network-check-target-tzvwk\" (UID: \"cd43f8e0-f611-4cf2-9a46-95f57f1ae944\") " pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:18:44.696010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.693942    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48sg7\" (UniqueName: \"kubernetes.io/projected/3c22ea6b-3598-4451-8520-e5f11a335825-kube-api-access-48sg7\") pod \"network-metrics-daemon-ccnrf\" (UID: \"3c22ea6b-3598-4451-8520-e5f11a335825\") " pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:18:44.696010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.693975    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-host-run-netns\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.696010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.694006    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk6wh\" (UniqueName: \"kubernetes.io/projected/577929d2-ea07-42d9-bed7-da50c01da81e-kube-api-access-kk6wh\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.696010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.694039    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7332f350-4608-4ad0-a3dd-9327c757e50a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gs6wp\" (UID: \"7332f350-4608-4ad0-a3dd-9327c757e50a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:44.696010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.694070    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7332f350-4608-4ad0-a3dd-9327c757e50a-registration-dir\") pod \"aws-ebs-csi-driver-node-gs6wp\" (UID: \"7332f350-4608-4ad0-a3dd-9327c757e50a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:44.696010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.694192    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs4bh\" (UniqueName: \"kubernetes.io/projected/358913e2-9ddb-4fef-9767-e811c7bbf7bb-kube-api-access-zs4bh\") pod \"node-ca-wfdvr\" (UID: \"358913e2-9ddb-4fef-9767-e811c7bbf7bb\") " pod="openshift-image-registry/node-ca-wfdvr"
Jul 13 20:18:44.696010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.694252    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/577929d2-ea07-42d9-bed7-da50c01da81e-cni-binary-copy\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.696010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.694382    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7332f350-4608-4ad0-a3dd-9327c757e50a-etc-selinux\") pod \"aws-ebs-csi-driver-node-gs6wp\" (UID: \"7332f350-4608-4ad0-a3dd-9327c757e50a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:44.697147 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.694466    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-os-release\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.697147 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.694502    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-host-run-multus-certs\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.697147 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.694547    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-cnibin\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.697147 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.694606    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-host-var-lib-kubelet\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.697147 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.694649    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7332f350-4608-4ad0-a3dd-9327c757e50a-sys-fs\") pod \"aws-ebs-csi-driver-node-gs6wp\" (UID: \"7332f350-4608-4ad0-a3dd-9327c757e50a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:44.697147 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.694759    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/358913e2-9ddb-4fef-9767-e811c7bbf7bb-host\") pod \"node-ca-wfdvr\" (UID: \"358913e2-9ddb-4fef-9767-e811c7bbf7bb\") " pod="openshift-image-registry/node-ca-wfdvr"
Jul 13 20:18:44.697147 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.694802    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/358913e2-9ddb-4fef-9767-e811c7bbf7bb-serviceca\") pod \"node-ca-wfdvr\" (UID: \"358913e2-9ddb-4fef-9767-e811c7bbf7bb\") " pod="openshift-image-registry/node-ca-wfdvr"
Jul 13 20:18:44.697147 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.694842    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-host-run-k8s-cni-cncf-io\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.697147 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.694898    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/577929d2-ea07-42d9-bed7-da50c01da81e-multus-daemon-config\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.697147 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.694933    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-host-var-lib-cni-bin\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.697147 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.695007    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 13 20:18:44.697147 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.695066    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 13 20:18:44.697147 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.695009    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-multus-conf-dir\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.697147 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.695116    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-etc-kubernetes\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.697147 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.695163    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxj6l\" (UniqueName: \"kubernetes.io/projected/c85bf135-1b33-4b7b-8984-588d51190322-kube-api-access-mxj6l\") pod \"node-resolver-mr5jv\" (UID: \"c85bf135-1b33-4b7b-8984-588d51190322\") " pod="openshift-dns/node-resolver-mr5jv"
Jul 13 20:18:44.698786 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.695203    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhn4h\" (UniqueName: \"kubernetes.io/projected/7332f350-4608-4ad0-a3dd-9327c757e50a-kube-api-access-jhn4h\") pod \"aws-ebs-csi-driver-node-gs6wp\" (UID: \"7332f350-4608-4ad0-a3dd-9327c757e50a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:44.698786 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.695228    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c85bf135-1b33-4b7b-8984-588d51190322-hosts-file\") pod \"node-resolver-mr5jv\" (UID: \"c85bf135-1b33-4b7b-8984-588d51190322\") " pod="openshift-dns/node-resolver-mr5jv"
Jul 13 20:18:44.698786 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.695271    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs\") pod \"network-metrics-daemon-ccnrf\" (UID: \"3c22ea6b-3598-4451-8520-e5f11a335825\") " pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:18:44.698786 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.695311    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-hostroot\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.698786 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.695346    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7332f350-4608-4ad0-a3dd-9327c757e50a-socket-dir\") pod \"aws-ebs-csi-driver-node-gs6wp\" (UID: \"7332f350-4608-4ad0-a3dd-9327c757e50a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:44.698786 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.695379    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7332f350-4608-4ad0-a3dd-9327c757e50a-device-dir\") pod \"aws-ebs-csi-driver-node-gs6wp\" (UID: \"7332f350-4608-4ad0-a3dd-9327c757e50a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:44.698786 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.695351    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:18:44.698786 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.695432    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-system-cni-dir\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.698786 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:44.695479    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr99r" podUID="5c7c41b8-6279-424c-90c8-ef75fcee26d6"
Jul 13 20:18:44.698786 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.695494    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-multus-cni-dir\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.698786 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.695530    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-multus-socket-dir-parent\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.698786 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.695570    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-host-var-lib-cni-multus\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.698786 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.695956    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 13 20:18:44.698786 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.695962    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k9xwq\""
Jul 13 20:18:44.698786 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.696221    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 13 20:18:44.698786 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.696422    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 13 20:18:44.698786 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.696476    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 13 20:18:44.698786 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.697840    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8whzd"
Jul 13 20:18:44.700946 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.700518    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.702132 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.701181    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 13 20:18:44.702132 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.701582    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 13 20:18:44.702132 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.701872    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tbzbj\""
Jul 13 20:18:44.703859 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.703047    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:44.705671 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.705105    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 13 20:18:44.705671 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.705169    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nxspx\""
Jul 13 20:18:44.705671 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.705339    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 13 20:18:44.705671 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.705361    2588 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 13 20:18:44.705671 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.705594    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 13 20:18:44.705671 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.705600    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 13 20:18:44.707098 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.706004    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t7d52\""
Jul 13 20:18:44.849302 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.725726    2588 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dnwbx"
Jul 13 20:18:44.849302 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.735226    2588 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dnwbx"
Jul 13 20:18:44.849302 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.784159    2588 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 13 20:18:44.849302 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796094    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-host-var-lib-kubelet\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.849302 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796135    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/21e62c48-f530-485c-9eac-f69d4272aa21-konnectivity-ca\") pod \"konnectivity-agent-8whzd\" (UID: \"21e62c48-f530-485c-9eac-f69d4272aa21\") " pod="kube-system/konnectivity-agent-8whzd"
Jul 13 20:18:44.849302 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796164    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-host-run-ovn-kubernetes\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.849302 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796190    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-host-cni-bin\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.849302 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796214    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-etc-sysconfig\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.849302 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796241    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4b6c1a3c-3aad-41b9-b398-9b46b6019651-etc-tuned\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.849302 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796267    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j96ms\" (UniqueName: \"kubernetes.io/projected/4b6c1a3c-3aad-41b9-b398-9b46b6019651-kube-api-access-j96ms\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.849302 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796204    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-host-var-lib-kubelet\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.849302 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796299    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7332f350-4608-4ad0-a3dd-9327c757e50a-sys-fs\") pod \"aws-ebs-csi-driver-node-gs6wp\" (UID: \"7332f350-4608-4ad0-a3dd-9327c757e50a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:44.849302 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796352    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-host-run-k8s-cni-cncf-io\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.849302 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796364    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7332f350-4608-4ad0-a3dd-9327c757e50a-sys-fs\") pod \"aws-ebs-csi-driver-node-gs6wp\" (UID: \"7332f350-4608-4ad0-a3dd-9327c757e50a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:44.849302 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796398    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c811846-0dc1-4c86-82b3-8aa8225eecdb-iptables-alerter-script\") pod \"iptables-alerter-sr8qj\" (UID: \"4c811846-0dc1-4c86-82b3-8aa8225eecdb\") " pod="openshift-network-operator/iptables-alerter-sr8qj"
Jul 13 20:18:44.849302 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796429    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rn89q\" (UniqueName: \"kubernetes.io/projected/4c811846-0dc1-4c86-82b3-8aa8225eecdb-kube-api-access-rn89q\") pod \"iptables-alerter-sr8qj\" (UID: \"4c811846-0dc1-4c86-82b3-8aa8225eecdb\") " pod="openshift-network-operator/iptables-alerter-sr8qj"
Jul 13 20:18:44.850373 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796437    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-host-run-k8s-cni-cncf-io\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.850373 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796456    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-host-kubelet\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.850373 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796493    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-env-overrides\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.850373 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796526    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwmw2\" (UniqueName: \"kubernetes.io/projected/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-kube-api-access-rwmw2\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.850373 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796562    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/676788ea-de46-4eed-a864-097546d0d81e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:44.850373 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796596    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-etc-kubernetes\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.850373 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796631    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c811846-0dc1-4c86-82b3-8aa8225eecdb-host-slash\") pod \"iptables-alerter-sr8qj\" (UID: \"4c811846-0dc1-4c86-82b3-8aa8225eecdb\") " pod="openshift-network-operator/iptables-alerter-sr8qj"
Jul 13 20:18:44.850373 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796648    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-etc-kubernetes\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.850373 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796716    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-host-slash\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.850373 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796749    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-run-systemd\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.850373 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796786    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-lib-modules\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.850373 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796812    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxj6l\" (UniqueName: \"kubernetes.io/projected/c85bf135-1b33-4b7b-8984-588d51190322-kube-api-access-mxj6l\") pod \"node-resolver-mr5jv\" (UID: \"c85bf135-1b33-4b7b-8984-588d51190322\") " pod="openshift-dns/node-resolver-mr5jv"
Jul 13 20:18:44.850373 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.796925    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhn4h\" (UniqueName: \"kubernetes.io/projected/7332f350-4608-4ad0-a3dd-9327c757e50a-kube-api-access-jhn4h\") pod \"aws-ebs-csi-driver-node-gs6wp\" (UID: \"7332f350-4608-4ad0-a3dd-9327c757e50a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:44.850373 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797070    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c85bf135-1b33-4b7b-8984-588d51190322-hosts-file\") pod \"node-resolver-mr5jv\" (UID: \"c85bf135-1b33-4b7b-8984-588d51190322\") " pod="openshift-dns/node-resolver-mr5jv"
Jul 13 20:18:44.851282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797130    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c85bf135-1b33-4b7b-8984-588d51190322-hosts-file\") pod \"node-resolver-mr5jv\" (UID: \"c85bf135-1b33-4b7b-8984-588d51190322\") " pod="openshift-dns/node-resolver-mr5jv"
Jul 13 20:18:44.851282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797175    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs\") pod \"network-metrics-daemon-ccnrf\" (UID: \"3c22ea6b-3598-4451-8520-e5f11a335825\") " pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:18:44.851282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797253    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-hostroot\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.851282 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:44.797265    2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:18:44.851282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797283    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-run-ovn\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.851282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797310    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-ovnkube-config\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.851282 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:44.797339    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs podName:3c22ea6b-3598-4451-8520-e5f11a335825 nodeName:}" failed. No retries permitted until 2026-07-13 20:18:45.297317479 +0000 UTC m=+3.031968668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs") pod "network-metrics-daemon-ccnrf" (UID: "3c22ea6b-3598-4451-8520-e5f11a335825") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:18:44.851282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797352    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-hostroot\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.851282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797419    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-multus-cni-dir\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.851282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797456    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-host-var-lib-cni-multus\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.851282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797482    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-run-openvswitch\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.851282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797507    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-ovn-node-metrics-cert\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.851282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797544    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-etc-systemd\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.851282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797569    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-var-lib-kubelet\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.855503 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797571    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-host-var-lib-cni-multus\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.855503 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797612    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b6c1a3c-3aad-41b9-b398-9b46b6019651-tmp\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.855503 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797633    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/676788ea-de46-4eed-a864-097546d0d81e-os-release\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:44.855503 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797654    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-log-socket\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.855503 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797678    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlts2\" (UniqueName: \"kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2\") pod \"network-check-target-tzvwk\" (UID: \"cd43f8e0-f611-4cf2-9a46-95f57f1ae944\") " pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:18:44.855503 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797707    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48sg7\" (UniqueName: \"kubernetes.io/projected/3c22ea6b-3598-4451-8520-e5f11a335825-kube-api-access-48sg7\") pod \"network-metrics-daemon-ccnrf\" (UID: \"3c22ea6b-3598-4451-8520-e5f11a335825\") " pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:18:44.855503 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797729    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk6wh\" (UniqueName: \"kubernetes.io/projected/577929d2-ea07-42d9-bed7-da50c01da81e-kube-api-access-kk6wh\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.855503 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797770    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5c7c41b8-6279-424c-90c8-ef75fcee26d6-kubelet-config\") pod \"global-pull-secret-syncer-nr99r\" (UID: \"5c7c41b8-6279-424c-90c8-ef75fcee26d6\") " pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:18:44.855503 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797787    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-multus-cni-dir\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.855503 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797806    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-var-lib-openvswitch\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.855503 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797863    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7332f350-4608-4ad0-a3dd-9327c757e50a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gs6wp\" (UID: \"7332f350-4608-4ad0-a3dd-9327c757e50a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:44.855503 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797910    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7332f350-4608-4ad0-a3dd-9327c757e50a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gs6wp\" (UID: \"7332f350-4608-4ad0-a3dd-9327c757e50a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:44.855503 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797943    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs4bh\" (UniqueName: \"kubernetes.io/projected/358913e2-9ddb-4fef-9767-e811c7bbf7bb-kube-api-access-zs4bh\") pod \"node-ca-wfdvr\" (UID: \"358913e2-9ddb-4fef-9767-e811c7bbf7bb\") " pod="openshift-image-registry/node-ca-wfdvr"
Jul 13 20:18:44.855503 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.797990    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/577929d2-ea07-42d9-bed7-da50c01da81e-cni-binary-copy\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.856650 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798081    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mwmc\" (UniqueName: \"kubernetes.io/projected/676788ea-de46-4eed-a864-097546d0d81e-kube-api-access-8mwmc\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:44.856650 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798127    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7332f350-4608-4ad0-a3dd-9327c757e50a-etc-selinux\") pod \"aws-ebs-csi-driver-node-gs6wp\" (UID: \"7332f350-4608-4ad0-a3dd-9327c757e50a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:44.856650 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798155    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-os-release\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.856650 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798218    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-host-run-multus-certs\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.856650 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798258    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-ovnkube-script-lib\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.856650 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798285    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-etc-modprobe-d\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.856650 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798302    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-host-run-multus-certs\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.856650 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798259    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-os-release\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.856650 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798308    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-cnibin\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.856650 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798350    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7332f350-4608-4ad0-a3dd-9327c757e50a-etc-selinux\") pod \"aws-ebs-csi-driver-node-gs6wp\" (UID: \"7332f350-4608-4ad0-a3dd-9327c757e50a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:44.856650 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798392    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-node-log\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.856650 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798425    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/676788ea-de46-4eed-a864-097546d0d81e-cnibin\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:44.856650 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798373    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-cnibin\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.856650 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798451    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/676788ea-de46-4eed-a864-097546d0d81e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:44.857761 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798517    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/358913e2-9ddb-4fef-9767-e811c7bbf7bb-host\") pod \"node-ca-wfdvr\" (UID: \"358913e2-9ddb-4fef-9767-e811c7bbf7bb\") " pod="openshift-image-registry/node-ca-wfdvr"
Jul 13 20:18:44.857761 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798568    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/358913e2-9ddb-4fef-9767-e811c7bbf7bb-host\") pod \"node-ca-wfdvr\" (UID: \"358913e2-9ddb-4fef-9767-e811c7bbf7bb\") " pod="openshift-image-registry/node-ca-wfdvr"
Jul 13 20:18:44.857761 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798666    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/577929d2-ea07-42d9-bed7-da50c01da81e-cni-binary-copy\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.857761 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798780    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/358913e2-9ddb-4fef-9767-e811c7bbf7bb-serviceca\") pod \"node-ca-wfdvr\" (UID: \"358913e2-9ddb-4fef-9767-e811c7bbf7bb\") " pod="openshift-image-registry/node-ca-wfdvr"
Jul 13 20:18:44.857761 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798812    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/577929d2-ea07-42d9-bed7-da50c01da81e-multus-daemon-config\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.857761 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798844    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.857761 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798871    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-etc-kubernetes\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.857761 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798903    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-etc-sysctl-conf\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.857761 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798929    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-sys\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.857761 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798956    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-host-var-lib-cni-bin\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.857761 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.798980    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-multus-conf-dir\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.857761 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799034    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-multus-conf-dir\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.857761 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799034    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-host-var-lib-cni-bin\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.857761 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799058    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-host-run-netns\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.857761 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799092    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7332f350-4608-4ad0-a3dd-9327c757e50a-socket-dir\") pod \"aws-ebs-csi-driver-node-gs6wp\" (UID: \"7332f350-4608-4ad0-a3dd-9327c757e50a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:44.859788 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799117    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7332f350-4608-4ad0-a3dd-9327c757e50a-device-dir\") pod \"aws-ebs-csi-driver-node-gs6wp\" (UID: \"7332f350-4608-4ad0-a3dd-9327c757e50a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:44.859788 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799149    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-system-cni-dir\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.859788 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799175    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-multus-socket-dir-parent\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.859788 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799202    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/21e62c48-f530-485c-9eac-f69d4272aa21-agent-certs\") pod \"konnectivity-agent-8whzd\" (UID: \"21e62c48-f530-485c-9eac-f69d4272aa21\") " pod="kube-system/konnectivity-agent-8whzd"
Jul 13 20:18:44.859788 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799230    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-etc-openvswitch\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.859788 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799270    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-etc-sysctl-d\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.859788 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799299    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-run\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.859788 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799317    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-multus-socket-dir-parent\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.859788 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799329    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c85bf135-1b33-4b7b-8984-588d51190322-tmp-dir\") pod \"node-resolver-mr5jv\" (UID: \"c85bf135-1b33-4b7b-8984-588d51190322\") " pod="openshift-dns/node-resolver-mr5jv"
Jul 13 20:18:44.859788 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799335    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/358913e2-9ddb-4fef-9767-e811c7bbf7bb-serviceca\") pod \"node-ca-wfdvr\" (UID: \"358913e2-9ddb-4fef-9767-e811c7bbf7bb\") " pod="openshift-image-registry/node-ca-wfdvr"
Jul 13 20:18:44.859788 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799318    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7332f350-4608-4ad0-a3dd-9327c757e50a-socket-dir\") pod \"aws-ebs-csi-driver-node-gs6wp\" (UID: \"7332f350-4608-4ad0-a3dd-9327c757e50a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:44.859788 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799395    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-host-run-netns\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.859788 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799424    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/577929d2-ea07-42d9-bed7-da50c01da81e-multus-daemon-config\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.859788 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799426    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-host\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.859788 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799461    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-host-run-netns\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.860707 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799479    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/676788ea-de46-4eed-a864-097546d0d81e-cni-binary-copy\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:44.860707 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799482    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7332f350-4608-4ad0-a3dd-9327c757e50a-device-dir\") pod \"aws-ebs-csi-driver-node-gs6wp\" (UID: \"7332f350-4608-4ad0-a3dd-9327c757e50a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:44.860707 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799532    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/577929d2-ea07-42d9-bed7-da50c01da81e-system-cni-dir\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.860707 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799536    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7332f350-4608-4ad0-a3dd-9327c757e50a-registration-dir\") pod \"aws-ebs-csi-driver-node-gs6wp\" (UID: \"7332f350-4608-4ad0-a3dd-9327c757e50a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:44.860707 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799582    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-systemd-units\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.860707 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799622    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-host-cni-netd\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.860707 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799634    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c85bf135-1b33-4b7b-8984-588d51190322-tmp-dir\") pod \"node-resolver-mr5jv\" (UID: \"c85bf135-1b33-4b7b-8984-588d51190322\") " pod="openshift-dns/node-resolver-mr5jv"
Jul 13 20:18:44.860707 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799646    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5c7c41b8-6279-424c-90c8-ef75fcee26d6-dbus\") pod \"global-pull-secret-syncer-nr99r\" (UID: \"5c7c41b8-6279-424c-90c8-ef75fcee26d6\") " pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:18:44.860707 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799674    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret\") pod \"global-pull-secret-syncer-nr99r\" (UID: \"5c7c41b8-6279-424c-90c8-ef75fcee26d6\") " pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:18:44.860707 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799587    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7332f350-4608-4ad0-a3dd-9327c757e50a-registration-dir\") pod \"aws-ebs-csi-driver-node-gs6wp\" (UID: \"7332f350-4608-4ad0-a3dd-9327c757e50a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:44.860707 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799700    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/676788ea-de46-4eed-a864-097546d0d81e-system-cni-dir\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:44.860707 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.799725    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/676788ea-de46-4eed-a864-097546d0d81e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:44.860707 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.804737    2588 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 13 20:18:44.860707 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:44.807023    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 20:18:44.860707 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:44.807042    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 20:18:44.861425 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:44.807054    2588 projected.go:196] Error preparing data for projected volume kube-api-access-dlts2 for pod openshift-network-diagnostics/network-check-target-tzvwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:18:44.861425 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:44.807138    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2 podName:cd43f8e0-f611-4cf2-9a46-95f57f1ae944 nodeName:}" failed. No retries permitted until 2026-07-13 20:18:45.307119234 +0000 UTC m=+3.041770417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dlts2" (UniqueName: "kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2") pod "network-check-target-tzvwk" (UID: "cd43f8e0-f611-4cf2-9a46-95f57f1ae944") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:18:44.861425 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.808976    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48sg7\" (UniqueName: \"kubernetes.io/projected/3c22ea6b-3598-4451-8520-e5f11a335825-kube-api-access-48sg7\") pod \"network-metrics-daemon-ccnrf\" (UID: \"3c22ea6b-3598-4451-8520-e5f11a335825\") " pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:18:44.861425 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.809010    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxj6l\" (UniqueName: \"kubernetes.io/projected/c85bf135-1b33-4b7b-8984-588d51190322-kube-api-access-mxj6l\") pod \"node-resolver-mr5jv\" (UID: \"c85bf135-1b33-4b7b-8984-588d51190322\") " pod="openshift-dns/node-resolver-mr5jv"
Jul 13 20:18:44.861425 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.809055    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs4bh\" (UniqueName: \"kubernetes.io/projected/358913e2-9ddb-4fef-9767-e811c7bbf7bb-kube-api-access-zs4bh\") pod \"node-ca-wfdvr\" (UID: \"358913e2-9ddb-4fef-9767-e811c7bbf7bb\") " pod="openshift-image-registry/node-ca-wfdvr"
Jul 13 20:18:44.861425 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.809127    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhn4h\" (UniqueName: \"kubernetes.io/projected/7332f350-4608-4ad0-a3dd-9327c757e50a-kube-api-access-jhn4h\") pod \"aws-ebs-csi-driver-node-gs6wp\" (UID: \"7332f350-4608-4ad0-a3dd-9327c757e50a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:44.861425 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.809558    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk6wh\" (UniqueName: \"kubernetes.io/projected/577929d2-ea07-42d9-bed7-da50c01da81e-kube-api-access-kk6wh\") pod \"multus-q5tv4\" (UID: \"577929d2-ea07-42d9-bed7-da50c01da81e\") " pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:44.975720 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.899997    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.975720 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900034    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-etc-kubernetes\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.975720 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900092    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-etc-kubernetes\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.975720 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900097    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.975720 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900143    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-etc-sysctl-conf\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.975720 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900173    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-sys\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.975720 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900193    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-host-run-netns\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.975720 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900221    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/21e62c48-f530-485c-9eac-f69d4272aa21-agent-certs\") pod \"konnectivity-agent-8whzd\" (UID: \"21e62c48-f530-485c-9eac-f69d4272aa21\") " pod="kube-system/konnectivity-agent-8whzd"
Jul 13 20:18:44.975720 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900276    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-sys\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.975720 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900278    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-host-run-netns\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.975720 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900298    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-etc-sysctl-conf\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.975720 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900324    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-etc-openvswitch\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.975720 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900353    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-etc-sysctl-d\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.975720 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900390    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-run\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.975720 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900449    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-run\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.994797 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900435    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-etc-openvswitch\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.994797 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900474    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-host\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.994797 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900496    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/676788ea-de46-4eed-a864-097546d0d81e-cni-binary-copy\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:44.994797 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900515    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-systemd-units\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.994797 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900528    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-etc-sysctl-d\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.994797 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900539    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-host-cni-netd\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.994797 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900560    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5c7c41b8-6279-424c-90c8-ef75fcee26d6-dbus\") pod \"global-pull-secret-syncer-nr99r\" (UID: \"5c7c41b8-6279-424c-90c8-ef75fcee26d6\") " pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:18:44.994797 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900577    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret\") pod \"global-pull-secret-syncer-nr99r\" (UID: \"5c7c41b8-6279-424c-90c8-ef75fcee26d6\") " pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:18:44.994797 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900585    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-systemd-units\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.994797 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900597    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/676788ea-de46-4eed-a864-097546d0d81e-system-cni-dir\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:44.994797 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900635    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-host\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.994797 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900624    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/676788ea-de46-4eed-a864-097546d0d81e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:44.994797 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900667    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5c7c41b8-6279-424c-90c8-ef75fcee26d6-dbus\") pod \"global-pull-secret-syncer-nr99r\" (UID: \"5c7c41b8-6279-424c-90c8-ef75fcee26d6\") " pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:18:44.994797 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900689    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/21e62c48-f530-485c-9eac-f69d4272aa21-konnectivity-ca\") pod \"konnectivity-agent-8whzd\" (UID: \"21e62c48-f530-485c-9eac-f69d4272aa21\") " pod="kube-system/konnectivity-agent-8whzd"
Jul 13 20:18:44.996179 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900721    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-host-cni-netd\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.996179 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900722    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-host-run-ovn-kubernetes\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.996179 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900753    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-host-run-ovn-kubernetes\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.996179 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900757    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-host-cni-bin\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.996179 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900787    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-etc-sysconfig\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.996179 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900815    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4b6c1a3c-3aad-41b9-b398-9b46b6019651-etc-tuned\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.996179 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900842    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j96ms\" (UniqueName: \"kubernetes.io/projected/4b6c1a3c-3aad-41b9-b398-9b46b6019651-kube-api-access-j96ms\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:44.996179 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900871    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c811846-0dc1-4c86-82b3-8aa8225eecdb-iptables-alerter-script\") pod \"iptables-alerter-sr8qj\" (UID: \"4c811846-0dc1-4c86-82b3-8aa8225eecdb\") " pod="openshift-network-operator/iptables-alerter-sr8qj"
Jul 13 20:18:44.996179 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900896    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rn89q\" (UniqueName: \"kubernetes.io/projected/4c811846-0dc1-4c86-82b3-8aa8225eecdb-kube-api-access-rn89q\") pod \"iptables-alerter-sr8qj\" (UID: \"4c811846-0dc1-4c86-82b3-8aa8225eecdb\") " pod="openshift-network-operator/iptables-alerter-sr8qj"
Jul 13 20:18:44.996179 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900920    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-host-kubelet\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.996179 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900944    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-env-overrides\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.996179 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900968    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwmw2\" (UniqueName: \"kubernetes.io/projected/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-kube-api-access-rwmw2\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:44.996179 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.900992    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/676788ea-de46-4eed-a864-097546d0d81e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:44.996179 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901047    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-host-cni-bin\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.001096 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901047    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/676788ea-de46-4eed-a864-097546d0d81e-cni-binary-copy\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:45.001096 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901054    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/676788ea-de46-4eed-a864-097546d0d81e-system-cni-dir\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:45.001096 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901076    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-host-kubelet\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.001096 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901113    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-etc-sysconfig\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:45.001096 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901337    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/21e62c48-f530-485c-9eac-f69d4272aa21-konnectivity-ca\") pod \"konnectivity-agent-8whzd\" (UID: \"21e62c48-f530-485c-9eac-f69d4272aa21\") " pod="kube-system/konnectivity-agent-8whzd"
Jul 13 20:18:45.001096 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:44.901429    2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 20:18:45.001096 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:44.901532    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret podName:5c7c41b8-6279-424c-90c8-ef75fcee26d6 nodeName:}" failed. No retries permitted until 2026-07-13 20:18:45.401513234 +0000 UTC m=+3.136164419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret") pod "global-pull-secret-syncer-nr99r" (UID: "5c7c41b8-6279-424c-90c8-ef75fcee26d6") : object "kube-system"/"original-pull-secret" not registered
Jul 13 20:18:45.001096 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901599    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-env-overrides\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.001096 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901622    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/676788ea-de46-4eed-a864-097546d0d81e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:45.001096 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901641    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c811846-0dc1-4c86-82b3-8aa8225eecdb-host-slash\") pod \"iptables-alerter-sr8qj\" (UID: \"4c811846-0dc1-4c86-82b3-8aa8225eecdb\") " pod="openshift-network-operator/iptables-alerter-sr8qj"
Jul 13 20:18:45.001096 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901672    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-host-slash\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.001096 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901701    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c811846-0dc1-4c86-82b3-8aa8225eecdb-host-slash\") pod \"iptables-alerter-sr8qj\" (UID: \"4c811846-0dc1-4c86-82b3-8aa8225eecdb\") " pod="openshift-network-operator/iptables-alerter-sr8qj"
Jul 13 20:18:45.001096 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901703    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-run-systemd\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.001096 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901743    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-run-systemd\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.002098 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901738    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4c811846-0dc1-4c86-82b3-8aa8225eecdb-iptables-alerter-script\") pod \"iptables-alerter-sr8qj\" (UID: \"4c811846-0dc1-4c86-82b3-8aa8225eecdb\") " pod="openshift-network-operator/iptables-alerter-sr8qj"
Jul 13 20:18:45.002098 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901767    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-host-slash\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.002098 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901756    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-lib-modules\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:45.002098 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901840    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-run-ovn\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.002098 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901852    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/676788ea-de46-4eed-a864-097546d0d81e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:45.002098 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901867    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-ovnkube-config\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.002098 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901871    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-lib-modules\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:45.002098 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901893    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-run-openvswitch\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.002098 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901923    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-ovn-node-metrics-cert\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.002098 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901950    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-etc-systemd\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:45.002098 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901977    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-var-lib-kubelet\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:45.002098 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901902    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-run-ovn\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.002098 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.902000    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b6c1a3c-3aad-41b9-b398-9b46b6019651-tmp\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:45.002098 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.902026    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/676788ea-de46-4eed-a864-097546d0d81e-os-release\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:45.002098 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.902050    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-log-socket\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.003282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.902091    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5c7c41b8-6279-424c-90c8-ef75fcee26d6-kubelet-config\") pod \"global-pull-secret-syncer-nr99r\" (UID: \"5c7c41b8-6279-424c-90c8-ef75fcee26d6\") " pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:18:45.003282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.902141    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-var-lib-openvswitch\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.003282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.902172    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mwmc\" (UniqueName: \"kubernetes.io/projected/676788ea-de46-4eed-a864-097546d0d81e-kube-api-access-8mwmc\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:45.003282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.902208    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-ovnkube-script-lib\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.003282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.902235    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-etc-modprobe-d\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:45.003282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.902261    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-node-log\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.003282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.902286    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/676788ea-de46-4eed-a864-097546d0d81e-cnibin\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:45.003282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.902314    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/676788ea-de46-4eed-a864-097546d0d81e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:45.003282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.902352    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-log-socket\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.003282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.902380    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-ovnkube-config\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.003282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.901949    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-run-openvswitch\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.003282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.902525    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/676788ea-de46-4eed-a864-097546d0d81e-os-release\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:45.003282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.902561    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-etc-modprobe-d\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:45.003282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.902602    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-node-log\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.004920 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.902576    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-var-lib-kubelet\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:45.004920 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.902650    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-var-lib-openvswitch\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.004920 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.902657    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/676788ea-de46-4eed-a864-097546d0d81e-cnibin\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:45.004920 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.902703    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5c7c41b8-6279-424c-90c8-ef75fcee26d6-kubelet-config\") pod \"global-pull-secret-syncer-nr99r\" (UID: \"5c7c41b8-6279-424c-90c8-ef75fcee26d6\") " pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:18:45.004920 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.902986    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-ovnkube-script-lib\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.004920 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.903049    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4b6c1a3c-3aad-41b9-b398-9b46b6019651-etc-systemd\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:45.004920 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.903248    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/21e62c48-f530-485c-9eac-f69d4272aa21-agent-certs\") pod \"konnectivity-agent-8whzd\" (UID: \"21e62c48-f530-485c-9eac-f69d4272aa21\") " pod="kube-system/konnectivity-agent-8whzd"
Jul 13 20:18:45.004920 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.904204    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4b6c1a3c-3aad-41b9-b398-9b46b6019651-etc-tuned\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:45.004920 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.904478    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/676788ea-de46-4eed-a864-097546d0d81e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:45.004920 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.905102    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b6c1a3c-3aad-41b9-b398-9b46b6019651-tmp\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:45.004920 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.905667    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-ovn-node-metrics-cert\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.004920 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.914392    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rn89q\" (UniqueName: \"kubernetes.io/projected/4c811846-0dc1-4c86-82b3-8aa8225eecdb-kube-api-access-rn89q\") pod \"iptables-alerter-sr8qj\" (UID: \"4c811846-0dc1-4c86-82b3-8aa8225eecdb\") " pod="openshift-network-operator/iptables-alerter-sr8qj"
Jul 13 20:18:45.004920 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.914685    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwmw2\" (UniqueName: \"kubernetes.io/projected/a41a03c6-83f4-4f6d-9624-cc390f7cf1af-kube-api-access-rwmw2\") pod \"ovnkube-node-c9wsz\" (UID: \"a41a03c6-83f4-4f6d-9624-cc390f7cf1af\") " pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.004920 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.915371    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j96ms\" (UniqueName: \"kubernetes.io/projected/4b6c1a3c-3aad-41b9-b398-9b46b6019651-kube-api-access-j96ms\") pod \"tuned-52zwb\" (UID: \"4b6c1a3c-3aad-41b9-b398-9b46b6019651\") " pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:45.006539 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.915409    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mwmc\" (UniqueName: \"kubernetes.io/projected/676788ea-de46-4eed-a864-097546d0d81e-kube-api-access-8mwmc\") pod \"multus-additional-cni-plugins-prx69\" (UID: \"676788ea-de46-4eed-a864-097546d0d81e\") " pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:45.006539 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:44.933260    2588 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 13 20:18:45.006539 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:45.000394    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp"
Jul 13 20:18:45.006539 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:45.000574    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q5tv4"
Jul 13 20:18:45.006539 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:45.003534    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-97.ec2.internal" event={"ID":"4b74d540315bcd62d8ef3b8967ccadd0","Type":"ContainerStarted","Data":"8cf5eff4c57c9609340bd60efad11a47465331df380216e763812759755dd65b"}
Jul 13 20:18:45.006539 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:45.006071    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal" event={"ID":"a9c3f301318acedb08c2b2e07e74f71f","Type":"ContainerStarted","Data":"b05e72200bbe4a95c7e1871ef5488150b5ffca720645a0b025c2abdb114e761e"}
Jul 13 20:18:45.099361 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:45.008825    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mr5jv"
Jul 13 20:18:45.099361 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:45.013948    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wfdvr"
Jul 13 20:18:45.099361 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:45.024216    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sr8qj"
Jul 13 20:18:45.099361 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:45.030750    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:18:45.099361 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:45.045628    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8whzd"
Jul 13 20:18:45.099361 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:45.049894    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc85bf135_1b33_4b7b_8984_588d51190322.slice/crio-7be329d9a382c4db701287bc0fa52bd1ad61c9146f00f28fbaa9f66657f51099 WatchSource:0}: Error finding container 7be329d9a382c4db701287bc0fa52bd1ad61c9146f00f28fbaa9f66657f51099: Status 404 returned error can't find the container with id 7be329d9a382c4db701287bc0fa52bd1ad61c9146f00f28fbaa9f66657f51099
Jul 13 20:18:45.099361 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:45.051171    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-52zwb"
Jul 13 20:18:45.099361 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:45.054712    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c811846_0dc1_4c86_82b3_8aa8225eecdb.slice/crio-ae557ced77e1124f2f9eb34951682db11bb6cfe7265f26a5df72a35337eba6ce WatchSource:0}: Error finding container ae557ced77e1124f2f9eb34951682db11bb6cfe7265f26a5df72a35337eba6ce: Status 404 returned error can't find the container with id ae557ced77e1124f2f9eb34951682db11bb6cfe7265f26a5df72a35337eba6ce
Jul 13 20:18:45.099361 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:45.058822    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-prx69"
Jul 13 20:18:45.099361 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:45.063421    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod358913e2_9ddb_4fef_9767_e811c7bbf7bb.slice/crio-2998d0e5db45f9442c769eb84f92690206a87c0c549dc72beeb1a11227af6e66 WatchSource:0}: Error finding container 2998d0e5db45f9442c769eb84f92690206a87c0c549dc72beeb1a11227af6e66: Status 404 returned error can't find the container with id 2998d0e5db45f9442c769eb84f92690206a87c0c549dc72beeb1a11227af6e66
Jul 13 20:18:45.099361 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:45.064623    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda41a03c6_83f4_4f6d_9624_cc390f7cf1af.slice/crio-3dc80a83c4154ec6b1fb38691a9aa62023b24f4cffccd81b25efba6264911061 WatchSource:0}: Error finding container 3dc80a83c4154ec6b1fb38691a9aa62023b24f4cffccd81b25efba6264911061: Status 404 returned error can't find the container with id 3dc80a83c4154ec6b1fb38691a9aa62023b24f4cffccd81b25efba6264911061
Jul 13 20:18:45.099361 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:45.070808    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21e62c48_f530_485c_9eac_f69d4272aa21.slice/crio-c3bf6c7d3c18f9076489637467c89fc0bc29ed74bc7067f2e198a073d3174100 WatchSource:0}: Error finding container c3bf6c7d3c18f9076489637467c89fc0bc29ed74bc7067f2e198a073d3174100: Status 404 returned error can't find the container with id c3bf6c7d3c18f9076489637467c89fc0bc29ed74bc7067f2e198a073d3174100
Jul 13 20:18:45.099361 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:45.071690    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b6c1a3c_3aad_41b9_b398_9b46b6019651.slice/crio-44862aa76d0355312393ec6e1df5613dfa51ab9bcf33b4b08a832a978655ecb2 WatchSource:0}: Error finding container 44862aa76d0355312393ec6e1df5613dfa51ab9bcf33b4b08a832a978655ecb2: Status 404 returned error can't find the container with id 44862aa76d0355312393ec6e1df5613dfa51ab9bcf33b4b08a832a978655ecb2
Jul 13 20:18:45.099361 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:18:45.075712    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod676788ea_de46_4eed_a864_097546d0d81e.slice/crio-59ddd78fbf779d2e41be8f71275fa1bc2db9d5acd4e0dbb1aa9e7ea39c71374f WatchSource:0}: Error finding container 59ddd78fbf779d2e41be8f71275fa1bc2db9d5acd4e0dbb1aa9e7ea39c71374f: Status 404 returned error can't find the container with id 59ddd78fbf779d2e41be8f71275fa1bc2db9d5acd4e0dbb1aa9e7ea39c71374f
Jul 13 20:18:45.397191 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:45.306720    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs\") pod \"network-metrics-daemon-ccnrf\" (UID: \"3c22ea6b-3598-4451-8520-e5f11a335825\") " pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:18:45.397191 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:45.306902    2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:18:45.397191 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:45.306987    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs podName:3c22ea6b-3598-4451-8520-e5f11a335825 nodeName:}" failed. No retries permitted until 2026-07-13 20:18:46.30696537 +0000 UTC m=+4.041616540 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs") pod "network-metrics-daemon-ccnrf" (UID: "3c22ea6b-3598-4451-8520-e5f11a335825") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:18:45.524385 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:45.408117    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret\") pod \"global-pull-secret-syncer-nr99r\" (UID: \"5c7c41b8-6279-424c-90c8-ef75fcee26d6\") " pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:18:45.524385 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:45.408212    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlts2\" (UniqueName: \"kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2\") pod \"network-check-target-tzvwk\" (UID: \"cd43f8e0-f611-4cf2-9a46-95f57f1ae944\") " pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:18:45.524385 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:45.408285    2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 20:18:45.524385 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:45.408334    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 20:18:45.524385 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:45.408353    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 20:18:45.524385 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:45.408359    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret podName:5c7c41b8-6279-424c-90c8-ef75fcee26d6 nodeName:}" failed. No retries permitted until 2026-07-13 20:18:46.408338565 +0000 UTC m=+4.142989742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret") pod "global-pull-secret-syncer-nr99r" (UID: "5c7c41b8-6279-424c-90c8-ef75fcee26d6") : object "kube-system"/"original-pull-secret" not registered
Jul 13 20:18:45.524385 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:45.408366    2588 projected.go:196] Error preparing data for projected volume kube-api-access-dlts2 for pod openshift-network-diagnostics/network-check-target-tzvwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:18:45.524385 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:45.408428    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2 podName:cd43f8e0-f611-4cf2-9a46-95f57f1ae944 nodeName:}" failed. No retries permitted until 2026-07-13 20:18:46.408416756 +0000 UTC m=+4.143067940 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlts2" (UniqueName: "kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2") pod "network-check-target-tzvwk" (UID: "cd43f8e0-f611-4cf2-9a46-95f57f1ae944") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:18:45.739026 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:45.738911    2588 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 20:13:44 +0000 UTC" deadline="2028-01-25 15:53:46.515571782 +0000 UTC"
Jul 13 20:18:45.739026 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:45.738975    2588 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13459h35m0.776600888s"
Jul 13 20:18:45.964828 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:45.964763    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:18:45.965007 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:45.964922    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccnrf" podUID="3c22ea6b-3598-4451-8520-e5f11a335825"
Jul 13 20:18:45.965411 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:45.965391    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:18:45.965518 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:45.965504    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr99r" podUID="5c7c41b8-6279-424c-90c8-ef75fcee26d6"
Jul 13 20:18:46.009277 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:46.009202    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8whzd" event={"ID":"21e62c48-f530-485c-9eac-f69d4272aa21","Type":"ContainerStarted","Data":"c3bf6c7d3c18f9076489637467c89fc0bc29ed74bc7067f2e198a073d3174100"}
Jul 13 20:18:46.011078 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:46.010988    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz" event={"ID":"a41a03c6-83f4-4f6d-9624-cc390f7cf1af","Type":"ContainerStarted","Data":"3dc80a83c4154ec6b1fb38691a9aa62023b24f4cffccd81b25efba6264911061"}
Jul 13 20:18:46.013268 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:46.013182    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sr8qj" event={"ID":"4c811846-0dc1-4c86-82b3-8aa8225eecdb","Type":"ContainerStarted","Data":"ae557ced77e1124f2f9eb34951682db11bb6cfe7265f26a5df72a35337eba6ce"}
Jul 13 20:18:46.016380 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:46.016247    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mr5jv" event={"ID":"c85bf135-1b33-4b7b-8984-588d51190322","Type":"ContainerStarted","Data":"7be329d9a382c4db701287bc0fa52bd1ad61c9146f00f28fbaa9f66657f51099"}
Jul 13 20:18:46.018397 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:46.018310    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q5tv4" event={"ID":"577929d2-ea07-42d9-bed7-da50c01da81e","Type":"ContainerStarted","Data":"5973ce49a2d446e2bf47b723c899d11b979825f4190836de8199db91bf32e3aa"}
Jul 13 20:18:46.021191 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:46.021102    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wfdvr" event={"ID":"358913e2-9ddb-4fef-9767-e811c7bbf7bb","Type":"ContainerStarted","Data":"2998d0e5db45f9442c769eb84f92690206a87c0c549dc72beeb1a11227af6e66"}
Jul 13 20:18:46.022885 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:46.022826    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp" event={"ID":"7332f350-4608-4ad0-a3dd-9327c757e50a","Type":"ContainerStarted","Data":"f54e50f5664c3cee2b8dbb122702f324dfce614d4a124c378d3c17e743c4dc01"}
Jul 13 20:18:46.024430 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:46.024375    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-prx69" event={"ID":"676788ea-de46-4eed-a864-097546d0d81e","Type":"ContainerStarted","Data":"59ddd78fbf779d2e41be8f71275fa1bc2db9d5acd4e0dbb1aa9e7ea39c71374f"}
Jul 13 20:18:46.026831 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:46.026776    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-52zwb" event={"ID":"4b6c1a3c-3aad-41b9-b398-9b46b6019651","Type":"ContainerStarted","Data":"44862aa76d0355312393ec6e1df5613dfa51ab9bcf33b4b08a832a978655ecb2"}
Jul 13 20:18:46.315857 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:46.315779    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs\") pod \"network-metrics-daemon-ccnrf\" (UID: \"3c22ea6b-3598-4451-8520-e5f11a335825\") " pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:18:46.316012 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:46.315916    2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:18:46.316012 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:46.315992    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs podName:3c22ea6b-3598-4451-8520-e5f11a335825 nodeName:}" failed. No retries permitted until 2026-07-13 20:18:48.315961581 +0000 UTC m=+6.050612747 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs") pod "network-metrics-daemon-ccnrf" (UID: "3c22ea6b-3598-4451-8520-e5f11a335825") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:18:46.416977 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:46.416930    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlts2\" (UniqueName: \"kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2\") pod \"network-check-target-tzvwk\" (UID: \"cd43f8e0-f611-4cf2-9a46-95f57f1ae944\") " pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:18:46.417131 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:46.417013    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret\") pod \"global-pull-secret-syncer-nr99r\" (UID: \"5c7c41b8-6279-424c-90c8-ef75fcee26d6\") " pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:18:46.417191 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:46.417144    2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 20:18:46.417237 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:46.417204    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret podName:5c7c41b8-6279-424c-90c8-ef75fcee26d6 nodeName:}" failed. No retries permitted until 2026-07-13 20:18:48.417186868 +0000 UTC m=+6.151838048 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret") pod "global-pull-secret-syncer-nr99r" (UID: "5c7c41b8-6279-424c-90c8-ef75fcee26d6") : object "kube-system"/"original-pull-secret" not registered
Jul 13 20:18:46.417653 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:46.417635    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 20:18:46.417700 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:46.417664    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 20:18:46.417700 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:46.417678    2588 projected.go:196] Error preparing data for projected volume kube-api-access-dlts2 for pod openshift-network-diagnostics/network-check-target-tzvwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:18:46.417766 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:46.417727    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2 podName:cd43f8e0-f611-4cf2-9a46-95f57f1ae944 nodeName:}" failed. No retries permitted until 2026-07-13 20:18:48.417711361 +0000 UTC m=+6.152362540 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlts2" (UniqueName: "kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2") pod "network-check-target-tzvwk" (UID: "cd43f8e0-f611-4cf2-9a46-95f57f1ae944") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:18:46.739332 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:46.739236    2588 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 20:13:44 +0000 UTC" deadline="2028-03-19 07:57:53.880696053 +0000 UTC"
Jul 13 20:18:46.739332 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:46.739276    2588 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14747h39m7.141424516s"
Jul 13 20:18:46.966270 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:46.966107    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:18:46.966270 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:46.966230    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tzvwk" podUID="cd43f8e0-f611-4cf2-9a46-95f57f1ae944"
Jul 13 20:18:47.964011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:47.963978    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:18:47.964436 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:47.964120    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccnrf" podUID="3c22ea6b-3598-4451-8520-e5f11a335825"
Jul 13 20:18:47.964436 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:47.964187    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:18:47.964436 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:47.964263    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr99r" podUID="5c7c41b8-6279-424c-90c8-ef75fcee26d6"
Jul 13 20:18:48.334074 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:48.333992    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs\") pod \"network-metrics-daemon-ccnrf\" (UID: \"3c22ea6b-3598-4451-8520-e5f11a335825\") " pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:18:48.334232 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:48.334196    2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:18:48.334291 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:48.334258    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs podName:3c22ea6b-3598-4451-8520-e5f11a335825 nodeName:}" failed. No retries permitted until 2026-07-13 20:18:52.334239857 +0000 UTC m=+10.068891026 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs") pod "network-metrics-daemon-ccnrf" (UID: "3c22ea6b-3598-4451-8520-e5f11a335825") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:18:48.435350 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:48.434641    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret\") pod \"global-pull-secret-syncer-nr99r\" (UID: \"5c7c41b8-6279-424c-90c8-ef75fcee26d6\") " pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:18:48.435350 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:48.434701    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlts2\" (UniqueName: \"kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2\") pod \"network-check-target-tzvwk\" (UID: \"cd43f8e0-f611-4cf2-9a46-95f57f1ae944\") " pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:18:48.435350 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:48.434826    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 20:18:48.435350 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:48.434840    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 20:18:48.435350 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:48.434850    2588 projected.go:196] Error preparing data for projected volume kube-api-access-dlts2 for pod openshift-network-diagnostics/network-check-target-tzvwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:18:48.435350 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:48.434892    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2 podName:cd43f8e0-f611-4cf2-9a46-95f57f1ae944 nodeName:}" failed. No retries permitted until 2026-07-13 20:18:52.434879136 +0000 UTC m=+10.169530315 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlts2" (UniqueName: "kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2") pod "network-check-target-tzvwk" (UID: "cd43f8e0-f611-4cf2-9a46-95f57f1ae944") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:18:48.435350 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:48.435272    2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 20:18:48.435350 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:48.435324    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret podName:5c7c41b8-6279-424c-90c8-ef75fcee26d6 nodeName:}" failed. No retries permitted until 2026-07-13 20:18:52.435307068 +0000 UTC m=+10.169958239 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret") pod "global-pull-secret-syncer-nr99r" (UID: "5c7c41b8-6279-424c-90c8-ef75fcee26d6") : object "kube-system"/"original-pull-secret" not registered
Jul 13 20:18:48.964922 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:48.964891    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:18:48.965356 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:48.965018    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tzvwk" podUID="cd43f8e0-f611-4cf2-9a46-95f57f1ae944"
Jul 13 20:18:49.964432 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:49.964174    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:18:49.964432 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:49.964316    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccnrf" podUID="3c22ea6b-3598-4451-8520-e5f11a335825"
Jul 13 20:18:49.964762 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:49.964740    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:18:49.964862 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:49.964842    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr99r" podUID="5c7c41b8-6279-424c-90c8-ef75fcee26d6"
Jul 13 20:18:50.964430 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:50.964396    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:18:50.964808 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:50.964529    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tzvwk" podUID="cd43f8e0-f611-4cf2-9a46-95f57f1ae944"
Jul 13 20:18:51.964487 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:51.964453    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:18:51.964895 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:51.964603    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccnrf" podUID="3c22ea6b-3598-4451-8520-e5f11a335825"
Jul 13 20:18:51.964895 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:51.964648    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:18:51.964895 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:51.964722    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr99r" podUID="5c7c41b8-6279-424c-90c8-ef75fcee26d6"
Jul 13 20:18:52.368008 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:52.367917    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs\") pod \"network-metrics-daemon-ccnrf\" (UID: \"3c22ea6b-3598-4451-8520-e5f11a335825\") " pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:18:52.368234 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:52.368199    2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:18:52.368335 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:52.368273    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs podName:3c22ea6b-3598-4451-8520-e5f11a335825 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:00.368254248 +0000 UTC m=+18.102905417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs") pod "network-metrics-daemon-ccnrf" (UID: "3c22ea6b-3598-4451-8520-e5f11a335825") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:18:52.469377 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:52.468836    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlts2\" (UniqueName: \"kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2\") pod \"network-check-target-tzvwk\" (UID: \"cd43f8e0-f611-4cf2-9a46-95f57f1ae944\") " pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:18:52.469377 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:52.468889    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret\") pod \"global-pull-secret-syncer-nr99r\" (UID: \"5c7c41b8-6279-424c-90c8-ef75fcee26d6\") " pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:18:52.469377 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:52.469001    2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 20:18:52.469377 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:52.469061    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret podName:5c7c41b8-6279-424c-90c8-ef75fcee26d6 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:00.469042272 +0000 UTC m=+18.203693439 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret") pod "global-pull-secret-syncer-nr99r" (UID: "5c7c41b8-6279-424c-90c8-ef75fcee26d6") : object "kube-system"/"original-pull-secret" not registered
Jul 13 20:18:52.469377 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:52.469090    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 20:18:52.469377 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:52.469118    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 20:18:52.469377 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:52.469131    2588 projected.go:196] Error preparing data for projected volume kube-api-access-dlts2 for pod openshift-network-diagnostics/network-check-target-tzvwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:18:52.469377 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:52.469179    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2 podName:cd43f8e0-f611-4cf2-9a46-95f57f1ae944 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:00.469163493 +0000 UTC m=+18.203814674 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlts2" (UniqueName: "kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2") pod "network-check-target-tzvwk" (UID: "cd43f8e0-f611-4cf2-9a46-95f57f1ae944") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:18:52.965297 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:52.965261    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:18:52.965765 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:52.965400    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tzvwk" podUID="cd43f8e0-f611-4cf2-9a46-95f57f1ae944"
Jul 13 20:18:53.964760 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:53.964729    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:18:53.964949 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:53.964843    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccnrf" podUID="3c22ea6b-3598-4451-8520-e5f11a335825"
Jul 13 20:18:53.964949 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:53.964892    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:18:53.965046 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:53.964967    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr99r" podUID="5c7c41b8-6279-424c-90c8-ef75fcee26d6"
Jul 13 20:18:54.964612 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:54.964575    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:18:54.965077 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:54.964722    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tzvwk" podUID="cd43f8e0-f611-4cf2-9a46-95f57f1ae944"
Jul 13 20:18:55.964628 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:55.964166    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:18:55.964628 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:55.964314    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccnrf" podUID="3c22ea6b-3598-4451-8520-e5f11a335825"
Jul 13 20:18:55.964628 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:55.964444    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:18:55.964628 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:55.964534    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr99r" podUID="5c7c41b8-6279-424c-90c8-ef75fcee26d6"
Jul 13 20:18:56.964689 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:56.964654    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:18:56.965144 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:56.964789    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tzvwk" podUID="cd43f8e0-f611-4cf2-9a46-95f57f1ae944"
Jul 13 20:18:57.964351 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:57.964310    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:18:57.964541 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:57.964310    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:18:57.964541 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:57.964485    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccnrf" podUID="3c22ea6b-3598-4451-8520-e5f11a335825"
Jul 13 20:18:57.964541 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:57.964525    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr99r" podUID="5c7c41b8-6279-424c-90c8-ef75fcee26d6"
Jul 13 20:18:58.964218 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:58.964188    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:18:58.964642 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:58.964295    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tzvwk" podUID="cd43f8e0-f611-4cf2-9a46-95f57f1ae944"
Jul 13 20:18:59.964870 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:59.964684    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:18:59.965290 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:18:59.964727    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:18:59.965290 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:59.964962    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccnrf" podUID="3c22ea6b-3598-4451-8520-e5f11a335825"
Jul 13 20:18:59.965290 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:18:59.965025    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr99r" podUID="5c7c41b8-6279-424c-90c8-ef75fcee26d6"
Jul 13 20:19:00.429348 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:00.429302    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs\") pod \"network-metrics-daemon-ccnrf\" (UID: \"3c22ea6b-3598-4451-8520-e5f11a335825\") " pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:19:00.429562 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:00.429477    2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:19:00.429626 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:00.429562    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs podName:3c22ea6b-3598-4451-8520-e5f11a335825 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:16.429529229 +0000 UTC m=+34.164180395 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs") pod "network-metrics-daemon-ccnrf" (UID: "3c22ea6b-3598-4451-8520-e5f11a335825") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:19:00.530422 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:00.530382    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlts2\" (UniqueName: \"kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2\") pod \"network-check-target-tzvwk\" (UID: \"cd43f8e0-f611-4cf2-9a46-95f57f1ae944\") " pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:19:00.530610 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:00.530460    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret\") pod \"global-pull-secret-syncer-nr99r\" (UID: \"5c7c41b8-6279-424c-90c8-ef75fcee26d6\") " pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:19:00.530610 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:00.530576    2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 20:19:00.530610 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:00.530588    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 20:19:00.530730 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:00.530618    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 20:19:00.530730 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:00.530635    2588 projected.go:196] Error preparing data for projected volume kube-api-access-dlts2 for pod openshift-network-diagnostics/network-check-target-tzvwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:19:00.530730 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:00.530647    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret podName:5c7c41b8-6279-424c-90c8-ef75fcee26d6 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:16.530626812 +0000 UTC m=+34.265278002 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret") pod "global-pull-secret-syncer-nr99r" (UID: "5c7c41b8-6279-424c-90c8-ef75fcee26d6") : object "kube-system"/"original-pull-secret" not registered
Jul 13 20:19:00.530730 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:00.530687    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2 podName:cd43f8e0-f611-4cf2-9a46-95f57f1ae944 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:16.530671479 +0000 UTC m=+34.265322661 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlts2" (UniqueName: "kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2") pod "network-check-target-tzvwk" (UID: "cd43f8e0-f611-4cf2-9a46-95f57f1ae944") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:19:00.966667 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:00.966641    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:19:00.967095 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:00.966735    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tzvwk" podUID="cd43f8e0-f611-4cf2-9a46-95f57f1ae944"
Jul 13 20:19:01.964452 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:01.964422    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:19:01.964624 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:01.964455    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:19:01.964624 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:01.964537    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccnrf" podUID="3c22ea6b-3598-4451-8520-e5f11a335825"
Jul 13 20:19:01.964739 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:01.964682    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr99r" podUID="5c7c41b8-6279-424c-90c8-ef75fcee26d6"
Jul 13 20:19:02.965346 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:02.965315    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:19:02.965813 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:02.965420    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tzvwk" podUID="cd43f8e0-f611-4cf2-9a46-95f57f1ae944"
Jul 13 20:19:03.964834 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:03.964808    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:19:03.964834 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:03.964840    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:19:03.965014 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:03.964912    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccnrf" podUID="3c22ea6b-3598-4451-8520-e5f11a335825"
Jul 13 20:19:03.965090 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:03.965068    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr99r" podUID="5c7c41b8-6279-424c-90c8-ef75fcee26d6"
Jul 13 20:19:04.964853 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:04.964821    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:19:04.965179 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:04.964945    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tzvwk" podUID="cd43f8e0-f611-4cf2-9a46-95f57f1ae944"
Jul 13 20:19:05.069096 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:05.068880    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-52zwb" event={"ID":"4b6c1a3c-3aad-41b9-b398-9b46b6019651","Type":"ContainerStarted","Data":"f2c85a28f0cb91a06a01ebb54da2b68001b7852307601af2f222742e20d01569"}
Jul 13 20:19:05.073249 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:05.073226    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 20:19:05.073738 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:05.073714    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz" event={"ID":"a41a03c6-83f4-4f6d-9624-cc390f7cf1af","Type":"ContainerStarted","Data":"53396d19932fd7f9cda023e1d47539a906e34b1761246654946cd28d0db2430b"}
Jul 13 20:19:05.073856 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:05.073790    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz" event={"ID":"a41a03c6-83f4-4f6d-9624-cc390f7cf1af","Type":"ContainerStarted","Data":"b1e39d0d1ed8c6c94e14bbe614c75eb27ef97912335963a226a06a1e3cd74d58"}
Jul 13 20:19:05.075265 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:05.075242    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q5tv4" event={"ID":"577929d2-ea07-42d9-bed7-da50c01da81e","Type":"ContainerStarted","Data":"a60dcfeacc6150064ebb9a7be40e9ddcfc6e0740e54414a0fcf178b59b3900cc"}
Jul 13 20:19:05.076774 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:05.076756    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-97.ec2.internal" event={"ID":"4b74d540315bcd62d8ef3b8967ccadd0","Type":"ContainerStarted","Data":"dc267717d5e2782281e247bff0ac058a0eb2467521d897d465b0d593396e4636"}
Jul 13 20:19:05.110951 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:05.110892    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-52zwb" podStartSLOduration=3.136968307 podStartE2EDuration="22.110870667s" totalImagesPullingTime="18.97390236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:05.092350266 +0000 UTC m=+22.827001455" watchObservedRunningTime="2026-07-13 20:19:05.110870667 +0000 UTC m=+22.845521856"
Jul 13 20:19:05.111249 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:05.111208    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q5tv4" podStartSLOduration=2.803901932 podStartE2EDuration="22.11119517s" totalImagesPullingTime="19.307293238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:05.110301372 +0000 UTC m=+22.844952563" watchObservedRunningTime="2026-07-13 20:19:05.11119517 +0000 UTC m=+22.845846358"
Jul 13 20:19:05.126476 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:05.126438    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-97.ec2.internal" podStartSLOduration=22.126422539 podStartE2EDuration="22.126422539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:18:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:05.126393905 +0000 UTC m=+22.861045093" watchObservedRunningTime="2026-07-13 20:19:05.126422539 +0000 UTC m=+22.861073723"
Jul 13 20:19:05.964859 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:05.964674    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:19:05.965569 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:05.964688    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:19:05.965569 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:05.964947    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr99r" podUID="5c7c41b8-6279-424c-90c8-ef75fcee26d6"
Jul 13 20:19:05.965569 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:05.965021    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccnrf" podUID="3c22ea6b-3598-4451-8520-e5f11a335825"
Jul 13 20:19:06.080675 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.080643    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wfdvr" event={"ID":"358913e2-9ddb-4fef-9767-e811c7bbf7bb","Type":"ContainerStarted","Data":"af036c0541672a58c6be4b114445e5d3eade410daf22a99987989657fbd1f77f"}
Jul 13 20:19:06.082320 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.082291    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp" event={"ID":"7332f350-4608-4ad0-a3dd-9327c757e50a","Type":"ContainerStarted","Data":"aa1ba48e060e3f29ac2d6cf36361a430619d00d0c93a7e232d60f25db3861736"}
Jul 13 20:19:06.083852 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.083827    2588 generic.go:356] "Generic (PLEG): container finished" podID="a9c3f301318acedb08c2b2e07e74f71f" containerID="c2baefa4dc3590bf431e9edb15047fdd9559351f6cbaab93f9dfdc703bd58cbe" exitCode=0
Jul 13 20:19:06.083970 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.083909    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal" event={"ID":"a9c3f301318acedb08c2b2e07e74f71f","Type":"ContainerDied","Data":"c2baefa4dc3590bf431e9edb15047fdd9559351f6cbaab93f9dfdc703bd58cbe"}
Jul 13 20:19:06.085641 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.085605    2588 generic.go:356] "Generic (PLEG): container finished" podID="676788ea-de46-4eed-a864-097546d0d81e" containerID="1f0053ac4e3a8354ea2efd3eaf38059983cd8202e0d77ad44e6b6378d10072dd" exitCode=0
Jul 13 20:19:06.085726 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.085641    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-prx69" event={"ID":"676788ea-de46-4eed-a864-097546d0d81e","Type":"ContainerDied","Data":"1f0053ac4e3a8354ea2efd3eaf38059983cd8202e0d77ad44e6b6378d10072dd"}
Jul 13 20:19:06.087500 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.087452    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8whzd" event={"ID":"21e62c48-f530-485c-9eac-f69d4272aa21","Type":"ContainerStarted","Data":"dd489d15668d8b6352709e1255009a02f529294f979a9e59353ac69cf65f5edc"}
Jul 13 20:19:06.090655 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.090639    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 20:19:06.090978 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.090956    2588 generic.go:356] "Generic (PLEG): container finished" podID="a41a03c6-83f4-4f6d-9624-cc390f7cf1af" containerID="53396d19932fd7f9cda023e1d47539a906e34b1761246654946cd28d0db2430b" exitCode=1
Jul 13 20:19:06.091068 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.091032    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz" event={"ID":"a41a03c6-83f4-4f6d-9624-cc390f7cf1af","Type":"ContainerDied","Data":"53396d19932fd7f9cda023e1d47539a906e34b1761246654946cd28d0db2430b"}
Jul 13 20:19:06.091125 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.091112    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz" event={"ID":"a41a03c6-83f4-4f6d-9624-cc390f7cf1af","Type":"ContainerStarted","Data":"3bf54202b62f3abf3d61cea33734567bbafa4d62fe5b128787e7a4df114976c4"}
Jul 13 20:19:06.091181 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.091168    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz" event={"ID":"a41a03c6-83f4-4f6d-9624-cc390f7cf1af","Type":"ContainerStarted","Data":"c1c2c064c673963af903cd1645d1c625b814a7c81ed1c97737d42d4b6f11fcac"}
Jul 13 20:19:06.091235 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.091219    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz" event={"ID":"a41a03c6-83f4-4f6d-9624-cc390f7cf1af","Type":"ContainerStarted","Data":"2698841aea06ec201388a9143204bf950fc3e429b809200810c5845733d7290c"}
Jul 13 20:19:06.091292 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.091270    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz" event={"ID":"a41a03c6-83f4-4f6d-9624-cc390f7cf1af","Type":"ContainerStarted","Data":"ef06a520b42575c914864df17e9be33652a4a4b684cba1e43f485169da20a911"}
Jul 13 20:19:06.092615 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.092592    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sr8qj" event={"ID":"4c811846-0dc1-4c86-82b3-8aa8225eecdb","Type":"ContainerStarted","Data":"7c4bba1db8f2d3ea494823a6e0a8eaf1fb3aa152bef6ae79151fd7ef8f363032"}
Jul 13 20:19:06.094037 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.094011    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mr5jv" event={"ID":"c85bf135-1b33-4b7b-8984-588d51190322","Type":"ContainerStarted","Data":"7fa6af5d7482d9b8d26925fd5f83efb454fec2faa26fc921435438af01a761fa"}
Jul 13 20:19:06.098039 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.097999    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wfdvr" podStartSLOduration=4.116392016 podStartE2EDuration="23.09798774s" totalImagesPullingTime="18.981595724s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:06.097683078 +0000 UTC m=+23.832334266" watchObservedRunningTime="2026-07-13 20:19:06.09798774 +0000 UTC m=+23.832638928"
Jul 13 20:19:06.114210 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.114164    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mr5jv" podStartSLOduration=8.37837862 podStartE2EDuration="23.114149915s" totalImagesPullingTime="14.735771295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:06.113477123 +0000 UTC m=+23.848128312" watchObservedRunningTime="2026-07-13 20:19:06.114149915 +0000 UTC m=+23.848801102"
Jul 13 20:19:06.128590 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.128551    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8whzd" podStartSLOduration=8.729879415 podStartE2EDuration="23.128538901s" totalImagesPullingTime="14.398659486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:06.127834337 +0000 UTC m=+23.862485524" watchObservedRunningTime="2026-07-13 20:19:06.128538901 +0000 UTC m=+23.863190088"
Jul 13 20:19:06.192867 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.192820    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sr8qj" podStartSLOduration=4.2532248169999995 podStartE2EDuration="23.192804163s" totalImagesPullingTime="18.939579346s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:06.192606291 +0000 UTC m=+23.927257479" watchObservedRunningTime="2026-07-13 20:19:06.192804163 +0000 UTC m=+23.927455350"
Jul 13 20:19:06.471162 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.471101    2588 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 13 20:19:06.770458 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.770283    2588 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T20:19:06.471117742Z","UUID":"df1af0e6-0e8b-4c69-b7e5-d2b9081af1dd","Handler":null,"Name":"","Endpoint":""}
Jul 13 20:19:06.771998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.771975    2588 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 13 20:19:06.772108 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.772013    2588 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 13 20:19:06.963933 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:06.963901    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:19:06.964094 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:06.964006    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tzvwk" podUID="cd43f8e0-f611-4cf2-9a46-95f57f1ae944"
Jul 13 20:19:07.098201 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:07.098122    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal" event={"ID":"a9c3f301318acedb08c2b2e07e74f71f","Type":"ContainerStarted","Data":"70d65081b20f73dfe96c427619697c87ccfdf7de77722ceaad0569155ed0421c"}
Jul 13 20:19:07.100155 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:07.100119    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp" event={"ID":"7332f350-4608-4ad0-a3dd-9327c757e50a","Type":"ContainerStarted","Data":"93ed104877d4d58d1666a1ecef0c4fc3df04a88797c16fa83b312e90b8efe5a5"}
Jul 13 20:19:07.115287 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:07.115244    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-97.ec2.internal" podStartSLOduration=24.115227017 podStartE2EDuration="24.115227017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:18:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:07.114741997 +0000 UTC m=+24.849393204" watchObservedRunningTime="2026-07-13 20:19:07.115227017 +0000 UTC m=+24.849878212"
Jul 13 20:19:07.964213 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:07.963991    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:19:07.964400 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:07.963996    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:19:07.964400 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:07.964331    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccnrf" podUID="3c22ea6b-3598-4451-8520-e5f11a335825"
Jul 13 20:19:07.964504 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:07.964458    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr99r" podUID="5c7c41b8-6279-424c-90c8-ef75fcee26d6"
Jul 13 20:19:08.104913 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:08.104818    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp" event={"ID":"7332f350-4608-4ad0-a3dd-9327c757e50a","Type":"ContainerStarted","Data":"72a9f832c91ac88bd2b173cde5646248acda4d3ce4d79a558dcfaaaf2c167027"}
Jul 13 20:19:08.108335 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:08.108315    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 20:19:08.108815 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:08.108793    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz" event={"ID":"a41a03c6-83f4-4f6d-9624-cc390f7cf1af","Type":"ContainerStarted","Data":"d1cec9db9f5c0061c67b1576da10724ab62d3362868a0cad790e02dcaaf8b293"}
Jul 13 20:19:08.124609 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:08.124567    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gs6wp" podStartSLOduration=3.6723682760000003 podStartE2EDuration="25.12455553s" totalImagesPullingTime="21.452187254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:18:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:08.124300602 +0000 UTC m=+25.858951790" watchObservedRunningTime="2026-07-13 20:19:08.12455553 +0000 UTC m=+25.859206717"
Jul 13 20:19:08.963941 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:08.963905    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:19:08.964126 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:08.964029    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tzvwk" podUID="cd43f8e0-f611-4cf2-9a46-95f57f1ae944"
Jul 13 20:19:09.964418 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:09.964376    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:19:09.964418 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:09.964400    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:19:09.965060 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:09.964523    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr99r" podUID="5c7c41b8-6279-424c-90c8-ef75fcee26d6"
Jul 13 20:19:09.965060 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:09.964688    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccnrf" podUID="3c22ea6b-3598-4451-8520-e5f11a335825"
Jul 13 20:19:10.627016 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:10.626986    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8whzd"
Jul 13 20:19:10.627602 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:10.627585    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8whzd"
Jul 13 20:19:10.964748 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:10.964679    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:19:10.965103 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:10.964786    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tzvwk" podUID="cd43f8e0-f611-4cf2-9a46-95f57f1ae944"
Jul 13 20:19:11.964297 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:11.964222    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:19:11.964459 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:11.964222    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:19:11.964459 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:11.964316    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr99r" podUID="5c7c41b8-6279-424c-90c8-ef75fcee26d6"
Jul 13 20:19:11.964459 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:11.964413    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccnrf" podUID="3c22ea6b-3598-4451-8520-e5f11a335825"
Jul 13 20:19:12.101772 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:12.101731    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8whzd"
Jul 13 20:19:12.102397 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:12.102357    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8whzd"
Jul 13 20:19:12.119946 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:12.119918    2588 generic.go:356] "Generic (PLEG): container finished" podID="676788ea-de46-4eed-a864-097546d0d81e" containerID="e893f8bb5332a3fea98ad41dc0702029de25701a9d9eb0e714bf13ef7a710c1f" exitCode=0
Jul 13 20:19:12.120115 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:12.120006    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-prx69" event={"ID":"676788ea-de46-4eed-a864-097546d0d81e","Type":"ContainerDied","Data":"e893f8bb5332a3fea98ad41dc0702029de25701a9d9eb0e714bf13ef7a710c1f"}
Jul 13 20:19:12.123550 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:12.123529    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 20:19:12.123962 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:12.123941    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz" event={"ID":"a41a03c6-83f4-4f6d-9624-cc390f7cf1af","Type":"ContainerStarted","Data":"490df05403ab46884b07fa6bee66f62a1d3393543dbaa150623c8db5076de4db"}
Jul 13 20:19:12.124221 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:12.124198    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:19:12.124298 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:12.124282    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:19:12.124351 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:12.124331    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:19:12.124424 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:12.124353    2588 scope.go:117] "RemoveContainer" containerID="53396d19932fd7f9cda023e1d47539a906e34b1761246654946cd28d0db2430b"
Jul 13 20:19:12.140429 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:12.140407    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:19:12.140657 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:12.140602    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:19:12.965008 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:12.964978    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:19:12.965147 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:12.965062    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tzvwk" podUID="cd43f8e0-f611-4cf2-9a46-95f57f1ae944"
Jul 13 20:19:13.128250 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:13.128170    2588 generic.go:356] "Generic (PLEG): container finished" podID="676788ea-de46-4eed-a864-097546d0d81e" containerID="523cd8a8de62fa7d29d378e4fc62fb138edf1c68450f209a064e67e9e89b402e" exitCode=0
Jul 13 20:19:13.128686 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:13.128245    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-prx69" event={"ID":"676788ea-de46-4eed-a864-097546d0d81e","Type":"ContainerDied","Data":"523cd8a8de62fa7d29d378e4fc62fb138edf1c68450f209a064e67e9e89b402e"}
Jul 13 20:19:13.131970 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:13.131955    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 20:19:13.132356 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:13.132333    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz" event={"ID":"a41a03c6-83f4-4f6d-9624-cc390f7cf1af","Type":"ContainerStarted","Data":"a98773e07c6319369d4d689f29c785600b5519ace8d2f351bc4b2a41038b05c3"}
Jul 13 20:19:13.187244 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:13.187197    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz" podStartSLOduration=10.420696079 podStartE2EDuration="30.187177868s" totalImagesPullingTime="19.766481789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:13.186848355 +0000 UTC m=+30.921499544" watchObservedRunningTime="2026-07-13 20:19:13.187177868 +0000 UTC m=+30.921829055"
Jul 13 20:19:13.404186 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:13.404108    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ccnrf"]
Jul 13 20:19:13.404327 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:13.404263    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:19:13.404384 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:13.404350    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccnrf" podUID="3c22ea6b-3598-4451-8520-e5f11a335825"
Jul 13 20:19:13.407322 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:13.407284    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nr99r"]
Jul 13 20:19:13.407449 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:13.407414    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:19:13.407563 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:13.407541    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr99r" podUID="5c7c41b8-6279-424c-90c8-ef75fcee26d6"
Jul 13 20:19:13.408070 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:13.408049    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tzvwk"]
Jul 13 20:19:13.408180 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:13.408133    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:19:13.408234 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:13.408208    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tzvwk" podUID="cd43f8e0-f611-4cf2-9a46-95f57f1ae944"
Jul 13 20:19:14.964397 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:14.964201    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:19:14.964913 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:14.964200    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:19:14.964913 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:14.964492    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccnrf" podUID="3c22ea6b-3598-4451-8520-e5f11a335825"
Jul 13 20:19:14.964913 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:14.964253    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:19:14.964913 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:14.964537    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr99r" podUID="5c7c41b8-6279-424c-90c8-ef75fcee26d6"
Jul 13 20:19:14.964913 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:14.964603    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tzvwk" podUID="cd43f8e0-f611-4cf2-9a46-95f57f1ae944"
Jul 13 20:19:15.139504 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:15.139472    2588 generic.go:356] "Generic (PLEG): container finished" podID="676788ea-de46-4eed-a864-097546d0d81e" containerID="d94f5d205ccf7176bc0f32ec4608f21636725223e9b395ab5a395f0ed0bc97d1" exitCode=0
Jul 13 20:19:15.139588 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:15.139536    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-prx69" event={"ID":"676788ea-de46-4eed-a864-097546d0d81e","Type":"ContainerDied","Data":"d94f5d205ccf7176bc0f32ec4608f21636725223e9b395ab5a395f0ed0bc97d1"}
Jul 13 20:19:16.445609 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:16.445516    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs\") pod \"network-metrics-daemon-ccnrf\" (UID: \"3c22ea6b-3598-4451-8520-e5f11a335825\") " pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:19:16.446135 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:16.445633    2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:19:16.446135 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:16.445696    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs podName:3c22ea6b-3598-4451-8520-e5f11a335825 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:48.445680076 +0000 UTC m=+66.180331242 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs") pod "network-metrics-daemon-ccnrf" (UID: "3c22ea6b-3598-4451-8520-e5f11a335825") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 13 20:19:16.546709 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:16.546666    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret\") pod \"global-pull-secret-syncer-nr99r\" (UID: \"5c7c41b8-6279-424c-90c8-ef75fcee26d6\") " pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:19:16.546900 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:16.546858    2588 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 13 20:19:16.546974 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:16.546935    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret podName:5c7c41b8-6279-424c-90c8-ef75fcee26d6 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:48.54690897 +0000 UTC m=+66.281560141 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret") pod "global-pull-secret-syncer-nr99r" (UID: "5c7c41b8-6279-424c-90c8-ef75fcee26d6") : object "kube-system"/"original-pull-secret" not registered
Jul 13 20:19:16.547105 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:16.547065    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlts2\" (UniqueName: \"kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2\") pod \"network-check-target-tzvwk\" (UID: \"cd43f8e0-f611-4cf2-9a46-95f57f1ae944\") " pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:19:16.547233 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:16.547212    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 13 20:19:16.547233 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:16.547233    2588 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 13 20:19:16.547331 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:16.547246    2588 projected.go:196] Error preparing data for projected volume kube-api-access-dlts2 for pod openshift-network-diagnostics/network-check-target-tzvwk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:19:16.547331 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:16.547305    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2 podName:cd43f8e0-f611-4cf2-9a46-95f57f1ae944 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:48.547289394 +0000 UTC m=+66.281940572 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlts2" (UniqueName: "kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2") pod "network-check-target-tzvwk" (UID: "cd43f8e0-f611-4cf2-9a46-95f57f1ae944") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 13 20:19:16.964599 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:16.964563    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:19:16.964766 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:16.964563    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:19:16.964766 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:16.964685    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tzvwk" podUID="cd43f8e0-f611-4cf2-9a46-95f57f1ae944"
Jul 13 20:19:16.964766 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:16.964704    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:19:16.964928 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:16.964810    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nr99r" podUID="5c7c41b8-6279-424c-90c8-ef75fcee26d6"
Jul 13 20:19:16.964928 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:16.964905    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ccnrf" podUID="3c22ea6b-3598-4451-8520-e5f11a335825"
Jul 13 20:19:18.043013 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.042974    2588 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-97.ec2.internal" event="NodeReady"
Jul 13 20:19:18.043607 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.043123    2588 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 13 20:19:18.088301 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.088271    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-548688fdbd-hgkxc"]
Jul 13 20:19:18.109460 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.109237    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cr5c9"]
Jul 13 20:19:18.109460 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.109393    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.112471 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.112446    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 13 20:19:18.112603 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.112447    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-82c5x\""
Jul 13 20:19:18.112936 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.112840    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 13 20:19:18.113045 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.112841    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 13 20:19:18.119347 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.119327    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 13 20:19:18.120954 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.120931    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-c758s"]
Jul 13 20:19:18.121074 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.121058    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:19:18.123850 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.123643    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 13 20:19:18.123850 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.123650    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 13 20:19:18.123850 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.123728    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t5qs6\""
Jul 13 20:19:18.132967 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.132946    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-548688fdbd-hgkxc"]
Jul 13 20:19:18.133081 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.132985    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cr5c9"]
Jul 13 20:19:18.133081 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.133015    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c758s"]
Jul 13 20:19:18.133185 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.133084    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c758s"
Jul 13 20:19:18.137170 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.137149    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 13 20:19:18.137414 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.137396    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wmtv8\""
Jul 13 20:19:18.138230 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.138203    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 13 20:19:18.138725 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.138644    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 13 20:19:18.260269 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.260190    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/57ac1c11-5790-4d43-9a05-5c2cfb9136db-trusted-ca\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.260269 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.260227    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/57ac1c11-5790-4d43-9a05-5c2cfb9136db-installation-pull-secrets\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.260542 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.260272    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/57ac1c11-5790-4d43-9a05-5c2cfb9136db-ca-trust-extracted\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.260542 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.260292    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1396fdd0-2cad-4bde-89d1-825a0d1b7727-config-volume\") pod \"dns-default-cr5c9\" (UID: \"1396fdd0-2cad-4bde-89d1-825a0d1b7727\") " pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:19:18.260542 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.260326    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znw8g\" (UniqueName: \"kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-kube-api-access-znw8g\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.260542 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.260408    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1396fdd0-2cad-4bde-89d1-825a0d1b7727-tmp-dir\") pod \"dns-default-cr5c9\" (UID: \"1396fdd0-2cad-4bde-89d1-825a0d1b7727\") " pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:19:18.260542 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.260535    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/57ac1c11-5790-4d43-9a05-5c2cfb9136db-image-registry-private-configuration\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.260767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.260561    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-certificates\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.260767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.260579    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5443da0e-8d29-4b04-bce2-066fa62418df-cert\") pod \"ingress-canary-c758s\" (UID: \"5443da0e-8d29-4b04-bce2-066fa62418df\") " pod="openshift-ingress-canary/ingress-canary-c758s"
Jul 13 20:19:18.260767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.260619    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-bound-sa-token\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.260767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.260639    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjprd\" (UniqueName: \"kubernetes.io/projected/1396fdd0-2cad-4bde-89d1-825a0d1b7727-kube-api-access-jjprd\") pod \"dns-default-cr5c9\" (UID: \"1396fdd0-2cad-4bde-89d1-825a0d1b7727\") " pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:19:18.260767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.260664    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6l4l\" (UniqueName: \"kubernetes.io/projected/5443da0e-8d29-4b04-bce2-066fa62418df-kube-api-access-w6l4l\") pod \"ingress-canary-c758s\" (UID: \"5443da0e-8d29-4b04-bce2-066fa62418df\") " pod="openshift-ingress-canary/ingress-canary-c758s"
Jul 13 20:19:18.260767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.260691    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls\") pod \"dns-default-cr5c9\" (UID: \"1396fdd0-2cad-4bde-89d1-825a0d1b7727\") " pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:19:18.260767 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.260726    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.361607 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.361566    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/57ac1c11-5790-4d43-9a05-5c2cfb9136db-trusted-ca\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.361782 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.361614    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/57ac1c11-5790-4d43-9a05-5c2cfb9136db-installation-pull-secrets\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.361782 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.361662    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/57ac1c11-5790-4d43-9a05-5c2cfb9136db-ca-trust-extracted\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.361782 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.361686    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1396fdd0-2cad-4bde-89d1-825a0d1b7727-config-volume\") pod \"dns-default-cr5c9\" (UID: \"1396fdd0-2cad-4bde-89d1-825a0d1b7727\") " pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:19:18.361782 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.361731    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znw8g\" (UniqueName: \"kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-kube-api-access-znw8g\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.361782 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.361757    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1396fdd0-2cad-4bde-89d1-825a0d1b7727-tmp-dir\") pod \"dns-default-cr5c9\" (UID: \"1396fdd0-2cad-4bde-89d1-825a0d1b7727\") " pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:19:18.361946 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.361821    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/57ac1c11-5790-4d43-9a05-5c2cfb9136db-image-registry-private-configuration\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.361946 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.361848    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-certificates\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.361946 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.361870    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5443da0e-8d29-4b04-bce2-066fa62418df-cert\") pod \"ingress-canary-c758s\" (UID: \"5443da0e-8d29-4b04-bce2-066fa62418df\") " pod="openshift-ingress-canary/ingress-canary-c758s"
Jul 13 20:19:18.361946 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.361900    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-bound-sa-token\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.361946 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.361928    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjprd\" (UniqueName: \"kubernetes.io/projected/1396fdd0-2cad-4bde-89d1-825a0d1b7727-kube-api-access-jjprd\") pod \"dns-default-cr5c9\" (UID: \"1396fdd0-2cad-4bde-89d1-825a0d1b7727\") " pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:19:18.362164 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.361958    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6l4l\" (UniqueName: \"kubernetes.io/projected/5443da0e-8d29-4b04-bce2-066fa62418df-kube-api-access-w6l4l\") pod \"ingress-canary-c758s\" (UID: \"5443da0e-8d29-4b04-bce2-066fa62418df\") " pod="openshift-ingress-canary/ingress-canary-c758s"
Jul 13 20:19:18.362164 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.361985    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls\") pod \"dns-default-cr5c9\" (UID: \"1396fdd0-2cad-4bde-89d1-825a0d1b7727\") " pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:19:18.362164 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.362019    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.362321 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:18.362177    2588 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 20:19:18.362321 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:18.362194    2588 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-548688fdbd-hgkxc: secret "image-registry-tls" not found
Jul 13 20:19:18.362321 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:18.362250    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls podName:57ac1c11-5790-4d43-9a05-5c2cfb9136db nodeName:}" failed. No retries permitted until 2026-07-13 20:19:18.862232066 +0000 UTC m=+36.596883253 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls") pod "image-registry-548688fdbd-hgkxc" (UID: "57ac1c11-5790-4d43-9a05-5c2cfb9136db") : secret "image-registry-tls" not found
Jul 13 20:19:18.362321 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:18.362320    2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 20:19:18.362611 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:18.362358    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls podName:1396fdd0-2cad-4bde-89d1-825a0d1b7727 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:18.862346548 +0000 UTC m=+36.596997738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls") pod "dns-default-cr5c9" (UID: "1396fdd0-2cad-4bde-89d1-825a0d1b7727") : secret "dns-default-metrics-tls" not found
Jul 13 20:19:18.362611 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.362392    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1396fdd0-2cad-4bde-89d1-825a0d1b7727-config-volume\") pod \"dns-default-cr5c9\" (UID: \"1396fdd0-2cad-4bde-89d1-825a0d1b7727\") " pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:19:18.362731 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.362684    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/57ac1c11-5790-4d43-9a05-5c2cfb9136db-ca-trust-extracted\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.362800 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.362774    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/57ac1c11-5790-4d43-9a05-5c2cfb9136db-trusted-ca\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.362899 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.362860    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1396fdd0-2cad-4bde-89d1-825a0d1b7727-tmp-dir\") pod \"dns-default-cr5c9\" (UID: \"1396fdd0-2cad-4bde-89d1-825a0d1b7727\") " pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:19:18.362982 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.362935    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-certificates\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.366515 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.366491    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/57ac1c11-5790-4d43-9a05-5c2cfb9136db-image-registry-private-configuration\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.366515 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.366508    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/57ac1c11-5790-4d43-9a05-5c2cfb9136db-installation-pull-secrets\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.366690 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.366515    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5443da0e-8d29-4b04-bce2-066fa62418df-cert\") pod \"ingress-canary-c758s\" (UID: \"5443da0e-8d29-4b04-bce2-066fa62418df\") " pod="openshift-ingress-canary/ingress-canary-c758s"
Jul 13 20:19:18.383231 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.383205    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-znw8g\" (UniqueName: \"kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-kube-api-access-znw8g\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.389899 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.389871    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjprd\" (UniqueName: \"kubernetes.io/projected/1396fdd0-2cad-4bde-89d1-825a0d1b7727-kube-api-access-jjprd\") pod \"dns-default-cr5c9\" (UID: \"1396fdd0-2cad-4bde-89d1-825a0d1b7727\") " pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:19:18.390273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.390249    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-bound-sa-token\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.390390 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.390252    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6l4l\" (UniqueName: \"kubernetes.io/projected/5443da0e-8d29-4b04-bce2-066fa62418df-kube-api-access-w6l4l\") pod \"ingress-canary-c758s\" (UID: \"5443da0e-8d29-4b04-bce2-066fa62418df\") " pod="openshift-ingress-canary/ingress-canary-c758s"
Jul 13 20:19:18.444843 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.444812    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-c758s"
Jul 13 20:19:18.866557 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.866516    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls\") pod \"dns-default-cr5c9\" (UID: \"1396fdd0-2cad-4bde-89d1-825a0d1b7727\") " pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:19:18.866748 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.866573    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:18.866748 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:18.866695    2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 20:19:18.866748 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:18.866741    2588 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 20:19:18.866906 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:18.866756    2588 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-548688fdbd-hgkxc: secret "image-registry-tls" not found
Jul 13 20:19:18.866906 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:18.866784    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls podName:1396fdd0-2cad-4bde-89d1-825a0d1b7727 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:19.866762657 +0000 UTC m=+37.601413835 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls") pod "dns-default-cr5c9" (UID: "1396fdd0-2cad-4bde-89d1-825a0d1b7727") : secret "dns-default-metrics-tls" not found
Jul 13 20:19:18.866906 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:18.866809    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls podName:57ac1c11-5790-4d43-9a05-5c2cfb9136db nodeName:}" failed. No retries permitted until 2026-07-13 20:19:19.866792791 +0000 UTC m=+37.601443961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls") pod "image-registry-548688fdbd-hgkxc" (UID: "57ac1c11-5790-4d43-9a05-5c2cfb9136db") : secret "image-registry-tls" not found
Jul 13 20:19:18.964982 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.964948    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:19:18.965163 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.964948    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:19:18.965163 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.964953    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:19:18.968176 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.967941    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 20:19:18.968176 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.967963    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 20:19:18.968176 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.967975    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j6z4f\""
Jul 13 20:19:18.968176 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.967987    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 20:19:18.968176 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.968037    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-899ms\""
Jul 13 20:19:18.968176 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:18.967963    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 20:19:19.242430 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:19.242249    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-c758s"]
Jul 13 20:19:19.273244 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:19:19.273210    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5443da0e_8d29_4b04_bce2_066fa62418df.slice/crio-2fc5ca4519dfd6581560373e65bcb8941b053b769feed1eb391d8ba2b91e0381 WatchSource:0}: Error finding container 2fc5ca4519dfd6581560373e65bcb8941b053b769feed1eb391d8ba2b91e0381: Status 404 returned error can't find the container with id 2fc5ca4519dfd6581560373e65bcb8941b053b769feed1eb391d8ba2b91e0381
Jul 13 20:19:19.873713 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:19.873676    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls\") pod \"dns-default-cr5c9\" (UID: \"1396fdd0-2cad-4bde-89d1-825a0d1b7727\") " pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:19:19.873878 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:19.873718    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:19.873878 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:19.873827    2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 20:19:19.873878 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:19.873848    2588 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 20:19:19.873878 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:19.873859    2588 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-548688fdbd-hgkxc: secret "image-registry-tls" not found
Jul 13 20:19:19.874023 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:19.873890    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls podName:1396fdd0-2cad-4bde-89d1-825a0d1b7727 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:21.873874164 +0000 UTC m=+39.608525330 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls") pod "dns-default-cr5c9" (UID: "1396fdd0-2cad-4bde-89d1-825a0d1b7727") : secret "dns-default-metrics-tls" not found
Jul 13 20:19:19.874023 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:19.873906    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls podName:57ac1c11-5790-4d43-9a05-5c2cfb9136db nodeName:}" failed. No retries permitted until 2026-07-13 20:19:21.873900096 +0000 UTC m=+39.608551262 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls") pod "image-registry-548688fdbd-hgkxc" (UID: "57ac1c11-5790-4d43-9a05-5c2cfb9136db") : secret "image-registry-tls" not found
Jul 13 20:19:20.156250 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:20.156165    2588 generic.go:356] "Generic (PLEG): container finished" podID="676788ea-de46-4eed-a864-097546d0d81e" containerID="3402bb43eaf6357061bedbb300b8451207653f5272c47b424f4200757e0db715" exitCode=0
Jul 13 20:19:20.156250 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:20.156207    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-prx69" event={"ID":"676788ea-de46-4eed-a864-097546d0d81e","Type":"ContainerDied","Data":"3402bb43eaf6357061bedbb300b8451207653f5272c47b424f4200757e0db715"}
Jul 13 20:19:20.157746 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:20.157592    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c758s" event={"ID":"5443da0e-8d29-4b04-bce2-066fa62418df","Type":"ContainerStarted","Data":"2fc5ca4519dfd6581560373e65bcb8941b053b769feed1eb391d8ba2b91e0381"}
Jul 13 20:19:21.162669 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:21.162631    2588 generic.go:356] "Generic (PLEG): container finished" podID="676788ea-de46-4eed-a864-097546d0d81e" containerID="0c227cc07a34bc49b7604564c5971e764decd7010e7264db38f0c158a26662e6" exitCode=0
Jul 13 20:19:21.162669 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:21.162671    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-prx69" event={"ID":"676788ea-de46-4eed-a864-097546d0d81e","Type":"ContainerDied","Data":"0c227cc07a34bc49b7604564c5971e764decd7010e7264db38f0c158a26662e6"}
Jul 13 20:19:21.892047 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:21.892012    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls\") pod \"dns-default-cr5c9\" (UID: \"1396fdd0-2cad-4bde-89d1-825a0d1b7727\") " pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:19:21.892217 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:21.892059    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:21.892217 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:21.892112    2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 20:19:21.892217 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:21.892167    2588 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 20:19:21.892217 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:21.892175    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls podName:1396fdd0-2cad-4bde-89d1-825a0d1b7727 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:25.89215994 +0000 UTC m=+43.626811107 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls") pod "dns-default-cr5c9" (UID: "1396fdd0-2cad-4bde-89d1-825a0d1b7727") : secret "dns-default-metrics-tls" not found
Jul 13 20:19:21.892217 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:21.892179    2588 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-548688fdbd-hgkxc: secret "image-registry-tls" not found
Jul 13 20:19:21.892217 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:21.892218    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls podName:57ac1c11-5790-4d43-9a05-5c2cfb9136db nodeName:}" failed. No retries permitted until 2026-07-13 20:19:25.8922065 +0000 UTC m=+43.626857702 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls") pod "image-registry-548688fdbd-hgkxc" (UID: "57ac1c11-5790-4d43-9a05-5c2cfb9136db") : secret "image-registry-tls" not found
Jul 13 20:19:22.169100 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:22.168824    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-prx69" event={"ID":"676788ea-de46-4eed-a864-097546d0d81e","Type":"ContainerStarted","Data":"6e7d00af530c61963e0febd55cc7c79fcc89ff6202b7a3e885e7823903464ff2"}
Jul 13 20:19:22.196608 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:22.196564    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-prx69" podStartSLOduration=8.180460213 podStartE2EDuration="39.196548054s" totalImagesPullingTime="31.016087841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:18:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:22.194806135 +0000 UTC m=+39.929457322" watchObservedRunningTime="2026-07-13 20:19:22.196548054 +0000 UTC m=+39.931199242"
Jul 13 20:19:22.434382 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:22.434340    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:22.521711 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:22.521666    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:23.172927 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:23.172855    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-c758s" event={"ID":"5443da0e-8d29-4b04-bce2-066fa62418df","Type":"ContainerStarted","Data":"d87f63f76812d881dd25e14f80b489a62313ba6901e38d91e09761b40ab92e6c"}
Jul 13 20:19:23.183770 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:23.183743    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:23.199248 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:23.199203    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-c758s" podStartSLOduration=2.3112441009999998 podStartE2EDuration="5.199187154s" totalImagesPullingTime="2.887943053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:23.199127892 +0000 UTC m=+40.933779075" watchObservedRunningTime="2026-07-13 20:19:23.199187154 +0000 UTC m=+40.933838355"
Jul 13 20:19:24.282284 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:24.282251    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:25.924551 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:25.924517    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:25.925001 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:25.924590    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls\") pod \"dns-default-cr5c9\" (UID: \"1396fdd0-2cad-4bde-89d1-825a0d1b7727\") " pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:19:25.925001 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:25.924667    2588 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 20:19:25.925001 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:25.924691    2588 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-548688fdbd-hgkxc: secret "image-registry-tls" not found
Jul 13 20:19:25.925001 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:25.924671    2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 20:19:25.925001 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:25.924744    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls podName:57ac1c11-5790-4d43-9a05-5c2cfb9136db nodeName:}" failed. No retries permitted until 2026-07-13 20:19:33.924729853 +0000 UTC m=+51.659381018 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls") pod "image-registry-548688fdbd-hgkxc" (UID: "57ac1c11-5790-4d43-9a05-5c2cfb9136db") : secret "image-registry-tls" not found
Jul 13 20:19:25.925001 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:25.924759    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls podName:1396fdd0-2cad-4bde-89d1-825a0d1b7727 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:33.924753586 +0000 UTC m=+51.659404752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls") pod "dns-default-cr5c9" (UID: "1396fdd0-2cad-4bde-89d1-825a0d1b7727") : secret "dns-default-metrics-tls" not found
Jul 13 20:19:28.192961 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:28.192923    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:28.294745 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:28.294708    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:32.868451 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:32.868413    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:33.990834 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:33.990796    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls\") pod \"dns-default-cr5c9\" (UID: \"1396fdd0-2cad-4bde-89d1-825a0d1b7727\") " pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:19:33.990834 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:33.990836    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:33.991278 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:33.990932    2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 20:19:33.991278 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:33.990999    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls podName:1396fdd0-2cad-4bde-89d1-825a0d1b7727 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:49.990984597 +0000 UTC m=+67.725635763 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls") pod "dns-default-cr5c9" (UID: "1396fdd0-2cad-4bde-89d1-825a0d1b7727") : secret "dns-default-metrics-tls" not found
Jul 13 20:19:33.991278 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:33.990935    2588 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 20:19:33.991278 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:33.991032    2588 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-548688fdbd-hgkxc: secret "image-registry-tls" not found
Jul 13 20:19:33.991278 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:33.991086    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls podName:57ac1c11-5790-4d43-9a05-5c2cfb9136db nodeName:}" failed. No retries permitted until 2026-07-13 20:19:49.991075186 +0000 UTC m=+67.725726352 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls") pod "image-registry-548688fdbd-hgkxc" (UID: "57ac1c11-5790-4d43-9a05-5c2cfb9136db") : secret "image-registry-tls" not found
Jul 13 20:19:37.503941 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:37.503905    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:37.591626 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:37.591588    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:37.719306 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:37.719275    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:37.822230 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:37.822116    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:38.481142 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:38.481106    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:38.559379 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:38.559330    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:38.657532 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:38.657493    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:38.760341 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:38.760255    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:39.067781 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:39.067700    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:39.175610 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:39.175577    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:39.884612 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:39.884577    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:40.294877 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:40.294844    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:40.417744 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:40.417712    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:42.853132 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:42.853091    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:44.046227 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:44.046188    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:44.145490 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:44.145466    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-c9wsz"
Jul 13 20:19:44.315434 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:44.315346    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:44.414967 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:44.414930    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:48.491949 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:48.491897    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs\") pod \"network-metrics-daemon-ccnrf\" (UID: \"3c22ea6b-3598-4451-8520-e5f11a335825\") " pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:19:48.494736 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:48.494716    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 13 20:19:48.503022 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:48.503002    2588 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 13 20:19:48.503084 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:48.503062    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs podName:3c22ea6b-3598-4451-8520-e5f11a335825 nodeName:}" failed. No retries permitted until 2026-07-13 20:20:52.50304175 +0000 UTC m=+130.237692916 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs") pod "network-metrics-daemon-ccnrf" (UID: "3c22ea6b-3598-4451-8520-e5f11a335825") : secret "metrics-daemon-secret" not found
Jul 13 20:19:48.592940 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:48.592898    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret\") pod \"global-pull-secret-syncer-nr99r\" (UID: \"5c7c41b8-6279-424c-90c8-ef75fcee26d6\") " pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:19:48.593081 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:48.592960    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlts2\" (UniqueName: \"kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2\") pod \"network-check-target-tzvwk\" (UID: \"cd43f8e0-f611-4cf2-9a46-95f57f1ae944\") " pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:19:48.596355 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:48.596328    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 13 20:19:48.596499 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:48.596382    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 13 20:19:48.607253 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:48.607229    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c7c41b8-6279-424c-90c8-ef75fcee26d6-original-pull-secret\") pod \"global-pull-secret-syncer-nr99r\" (UID: \"5c7c41b8-6279-424c-90c8-ef75fcee26d6\") " pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:19:48.611299 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:48.611274    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 13 20:19:48.616278 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:48.616257    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlts2\" (UniqueName: \"kubernetes.io/projected/cd43f8e0-f611-4cf2-9a46-95f57f1ae944-kube-api-access-dlts2\") pod \"network-check-target-tzvwk\" (UID: \"cd43f8e0-f611-4cf2-9a46-95f57f1ae944\") " pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:19:48.690591 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:48.690565    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nr99r"
Jul 13 20:19:48.701113 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:48.701090    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-899ms\""
Jul 13 20:19:48.708027 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:48.708008    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:19:48.835061 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:48.835027    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nr99r"]
Jul 13 20:19:48.838176 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:19:48.838152    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c7c41b8_6279_424c_90c8_ef75fcee26d6.slice/crio-de6c5980443b6af9ee08a72481cadc131f4db1593a7ac382dc3b535ad9a05cbb WatchSource:0}: Error finding container de6c5980443b6af9ee08a72481cadc131f4db1593a7ac382dc3b535ad9a05cbb: Status 404 returned error can't find the container with id de6c5980443b6af9ee08a72481cadc131f4db1593a7ac382dc3b535ad9a05cbb
Jul 13 20:19:48.852940 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:48.852920    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tzvwk"]
Jul 13 20:19:48.855789 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:19:48.855767    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd43f8e0_f611_4cf2_9a46_95f57f1ae944.slice/crio-7f7f7b552d30b83af158e4538c63d9ed3d61846f251c1fa2c2ee5ec6b062cdbd WatchSource:0}: Error finding container 7f7f7b552d30b83af158e4538c63d9ed3d61846f251c1fa2c2ee5ec6b062cdbd: Status 404 returned error can't find the container with id 7f7f7b552d30b83af158e4538c63d9ed3d61846f251c1fa2c2ee5ec6b062cdbd
Jul 13 20:19:49.231299 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:49.231264    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tzvwk" event={"ID":"cd43f8e0-f611-4cf2-9a46-95f57f1ae944","Type":"ContainerStarted","Data":"7f7f7b552d30b83af158e4538c63d9ed3d61846f251c1fa2c2ee5ec6b062cdbd"}
Jul 13 20:19:49.232301 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:49.232278    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nr99r" event={"ID":"5c7c41b8-6279-424c-90c8-ef75fcee26d6","Type":"ContainerStarted","Data":"de6c5980443b6af9ee08a72481cadc131f4db1593a7ac382dc3b535ad9a05cbb"}
Jul 13 20:19:50.002204 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.002163    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls\") pod \"dns-default-cr5c9\" (UID: \"1396fdd0-2cad-4bde-89d1-825a0d1b7727\") " pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:19:50.002783 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.002219    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:19:50.002783 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:50.002322    2588 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 13 20:19:50.002783 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:50.002325    2588 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 13 20:19:50.002783 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:50.002343    2588 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-548688fdbd-hgkxc: secret "image-registry-tls" not found
Jul 13 20:19:50.002783 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:50.002409    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls podName:1396fdd0-2cad-4bde-89d1-825a0d1b7727 nodeName:}" failed. No retries permitted until 2026-07-13 20:20:22.002389559 +0000 UTC m=+99.737040734 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls") pod "dns-default-cr5c9" (UID: "1396fdd0-2cad-4bde-89d1-825a0d1b7727") : secret "dns-default-metrics-tls" not found
Jul 13 20:19:50.002783 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:50.002428    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls podName:57ac1c11-5790-4d43-9a05-5c2cfb9136db nodeName:}" failed. No retries permitted until 2026-07-13 20:20:22.002420095 +0000 UTC m=+99.737071261 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls") pod "image-registry-548688fdbd-hgkxc" (UID: "57ac1c11-5790-4d43-9a05-5c2cfb9136db") : secret "image-registry-tls" not found
Jul 13 20:19:50.312195 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.312114    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n"]
Jul 13 20:19:50.331880 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.331852    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n"]
Jul 13 20:19:50.332038 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.331974    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n"
Jul 13 20:19:50.334857 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.334832    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 13 20:19:50.335462 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.335437    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 13 20:19:50.335590 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.335437    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 13 20:19:50.336041 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.335980    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-b74p7\""
Jul 13 20:19:50.337505 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.337484    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 13 20:19:50.405042 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.405009    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssx4j\" (UniqueName: \"kubernetes.io/projected/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-kube-api-access-ssx4j\") pod \"cluster-monitoring-operator-5f7f494dd4-9wb5n\" (UID: \"5df96b08-2166-4b7c-b5e8-c72f6704a5b9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n"
Jul 13 20:19:50.405199 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.405070    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-9wb5n\" (UID: \"5df96b08-2166-4b7c-b5e8-c72f6704a5b9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n"
Jul 13 20:19:50.405199 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.405112    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9wb5n\" (UID: \"5df96b08-2166-4b7c-b5e8-c72f6704a5b9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n"
Jul 13 20:19:50.422525 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.422495    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r5p5"]
Jul 13 20:19:50.441447 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.441418    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-t45cw"]
Jul 13 20:19:50.441592 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.441553    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r5p5"
Jul 13 20:19:50.445163 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.445141    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9xphj\""
Jul 13 20:19:50.445280 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.445171    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 13 20:19:50.445344 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.445286    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 13 20:19:50.445782 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.445584    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 13 20:19:50.455535 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.455508    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-llps6"]
Jul 13 20:19:50.456525 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.456479    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-t45cw"
Jul 13 20:19:50.459814 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.459735    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 13 20:19:50.460947 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.460545    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 13 20:19:50.460947 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.460621    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 13 20:19:50.460947 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.460801    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-x97dl\""
Jul 13 20:19:50.461164 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.461057    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 13 20:19:50.470958 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.470929    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 13 20:19:50.477391 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.477354    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6b498b7f44-rnqlq"]
Jul 13 20:19:50.477473 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.477449    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-llps6"
Jul 13 20:19:50.480967 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.480948    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-cfbrt\""
Jul 13 20:19:50.481105 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.480971    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 13 20:19:50.481301 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.481271    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 13 20:19:50.495862 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.495580    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-rmc2s"]
Jul 13 20:19:50.496046 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.496027    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:19:50.499648 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.499575    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 13 20:19:50.499648 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.499642    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 13 20:19:50.499803 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.499644    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 13 20:19:50.499803 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.499662    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-p7sdf\""
Jul 13 20:19:50.500087 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.500071    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 13 20:19:50.500156 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.500086    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 13 20:19:50.500846 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.500830    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 13 20:19:50.505651 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.505626    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-9wb5n\" (UID: \"5df96b08-2166-4b7c-b5e8-c72f6704a5b9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n"
Jul 13 20:19:50.505747 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.505663    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9wb5n\" (UID: \"5df96b08-2166-4b7c-b5e8-c72f6704a5b9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n"
Jul 13 20:19:50.505747 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.505695    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2k9w\" (UniqueName: \"kubernetes.io/projected/fc86f53e-ffd8-4afe-abb0-af88b668cdde-kube-api-access-c2k9w\") pod \"cluster-samples-operator-65db858894-5r5p5\" (UID: \"fc86f53e-ffd8-4afe-abb0-af88b668cdde\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r5p5"
Jul 13 20:19:50.505747 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.505718    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6a0ae10a-1565-4d86-92c0-f15d523042b9-snapshots\") pod \"insights-operator-68d9dd94cf-t45cw\" (UID: \"6a0ae10a-1565-4d86-92c0-f15d523042b9\") " pod="openshift-insights/insights-operator-68d9dd94cf-t45cw"
Jul 13 20:19:50.505906 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:50.505825    2588 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 20:19:50.505906 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:50.505876    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-cluster-monitoring-operator-tls podName:5df96b08-2166-4b7c-b5e8-c72f6704a5b9 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:51.005858853 +0000 UTC m=+68.740510036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9wb5n" (UID: "5df96b08-2166-4b7c-b5e8-c72f6704a5b9") : secret "cluster-monitoring-operator-tls" not found
Jul 13 20:19:50.505996 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.505937    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc86f53e-ffd8-4afe-abb0-af88b668cdde-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5r5p5\" (UID: \"fc86f53e-ffd8-4afe-abb0-af88b668cdde\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r5p5"
Jul 13 20:19:50.505996 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.505963    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a0ae10a-1565-4d86-92c0-f15d523042b9-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-t45cw\" (UID: \"6a0ae10a-1565-4d86-92c0-f15d523042b9\") " pod="openshift-insights/insights-operator-68d9dd94cf-t45cw"
Jul 13 20:19:50.505996 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.505985    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a0ae10a-1565-4d86-92c0-f15d523042b9-serving-cert\") pod \"insights-operator-68d9dd94cf-t45cw\" (UID: \"6a0ae10a-1565-4d86-92c0-f15d523042b9\") " pod="openshift-insights/insights-operator-68d9dd94cf-t45cw"
Jul 13 20:19:50.506089 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.506019    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42l2c\" (UniqueName: \"kubernetes.io/projected/77da0f34-0522-4826-b4df-12b3dc59ea10-kube-api-access-42l2c\") pod \"volume-data-source-validator-78495597f6-llps6\" (UID: \"77da0f34-0522-4826-b4df-12b3dc59ea10\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-llps6"
Jul 13 20:19:50.506163 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.506143    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssx4j\" (UniqueName: \"kubernetes.io/projected/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-kube-api-access-ssx4j\") pod \"cluster-monitoring-operator-5f7f494dd4-9wb5n\" (UID: \"5df96b08-2166-4b7c-b5e8-c72f6704a5b9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n"
Jul 13 20:19:50.506202 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.506185    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a0ae10a-1565-4d86-92c0-f15d523042b9-tmp\") pod \"insights-operator-68d9dd94cf-t45cw\" (UID: \"6a0ae10a-1565-4d86-92c0-f15d523042b9\") " pod="openshift-insights/insights-operator-68d9dd94cf-t45cw"
Jul 13 20:19:50.506246 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.506211    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a0ae10a-1565-4d86-92c0-f15d523042b9-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-t45cw\" (UID: \"6a0ae10a-1565-4d86-92c0-f15d523042b9\") " pod="openshift-insights/insights-operator-68d9dd94cf-t45cw"
Jul 13 20:19:50.506299 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.506244    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5225\" (UniqueName: \"kubernetes.io/projected/6a0ae10a-1565-4d86-92c0-f15d523042b9-kube-api-access-q5225\") pod \"insights-operator-68d9dd94cf-t45cw\" (UID: \"6a0ae10a-1565-4d86-92c0-f15d523042b9\") " pod="openshift-insights/insights-operator-68d9dd94cf-t45cw"
Jul 13 20:19:50.506871 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.506847    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-9wb5n\" (UID: \"5df96b08-2166-4b7c-b5e8-c72f6704a5b9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n"
Jul 13 20:19:50.521831 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.521737    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r5p5"]
Jul 13 20:19:50.521947 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.521837    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-rmc2s"
Jul 13 20:19:50.522541 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.522100    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-llps6"]
Jul 13 20:19:50.522541 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.522134    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-t45cw"]
Jul 13 20:19:50.522541 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.522154    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-rmc2s"]
Jul 13 20:19:50.522541 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.522173    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b498b7f44-rnqlq"]
Jul 13 20:19:50.522541 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.522203    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-65kk8"]
Jul 13 20:19:50.524647 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.524505    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6ctjt\""
Jul 13 20:19:50.526531 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.526487    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssx4j\" (UniqueName: \"kubernetes.io/projected/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-kube-api-access-ssx4j\") pod \"cluster-monitoring-operator-5f7f494dd4-9wb5n\" (UID: \"5df96b08-2166-4b7c-b5e8-c72f6704a5b9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n"
Jul 13 20:19:50.527812 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.527769    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 13 20:19:50.528105 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.528087    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 13 20:19:50.528265 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.528245    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 13 20:19:50.528535 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.528516    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 13 20:19:50.537049 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.536540    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 13 20:19:50.541812 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.541791    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rd8jg"]
Jul 13 20:19:50.541952 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.541933    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-65kk8"
Jul 13 20:19:50.545389 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.545121    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 13 20:19:50.545389 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.545138    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-58bsj\""
Jul 13 20:19:50.545587 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.545391    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 13 20:19:50.545652 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.545589    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 13 20:19:50.545710 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.545671    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 13 20:19:50.564072 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.564016    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-65kk8"]
Jul 13 20:19:50.564072 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.564056    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rd8jg"]
Jul 13 20:19:50.564225 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.564147    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rd8jg"
Jul 13 20:19:50.567151 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.567131    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 13 20:19:50.567827 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.567807    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 13 20:19:50.568151 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.568129    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gcxsj\""
Jul 13 20:19:50.568279 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.568262    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 13 20:19:50.568424 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.568410    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 13 20:19:50.606735 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.606706    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70f2cd6d-09a8-42ed-957f-ee50c42b98d1-config\") pod \"console-operator-7866497494-rmc2s\" (UID: \"70f2cd6d-09a8-42ed-957f-ee50c42b98d1\") " pod="openshift-console-operator/console-operator-7866497494-rmc2s"
Jul 13 20:19:50.606866 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.606744    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/061095eb-9b43-4331-9155-8dfab3aa3741-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-rd8jg\" (UID: \"061095eb-9b43-4331-9155-8dfab3aa3741\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rd8jg"
Jul 13 20:19:50.606866 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.606771    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-default-certificate\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:19:50.606866 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.606794    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fwmt\" (UniqueName: \"kubernetes.io/projected/f866ccdf-4a23-45a3-88b4-16bb48322947-kube-api-access-6fwmt\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:19:50.606866 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.606838    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2k9w\" (UniqueName: \"kubernetes.io/projected/fc86f53e-ffd8-4afe-abb0-af88b668cdde-kube-api-access-c2k9w\") pod \"cluster-samples-operator-65db858894-5r5p5\" (UID: \"fc86f53e-ffd8-4afe-abb0-af88b668cdde\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r5p5"
Jul 13 20:19:50.606866 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.606860    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6a0ae10a-1565-4d86-92c0-f15d523042b9-snapshots\") pod \"insights-operator-68d9dd94cf-t45cw\" (UID: \"6a0ae10a-1565-4d86-92c0-f15d523042b9\") " pod="openshift-insights/insights-operator-68d9dd94cf-t45cw"
Jul 13 20:19:50.607130 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.606885    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a0ae10a-1565-4d86-92c0-f15d523042b9-tmp\") pod \"insights-operator-68d9dd94cf-t45cw\" (UID: \"6a0ae10a-1565-4d86-92c0-f15d523042b9\") " pod="openshift-insights/insights-operator-68d9dd94cf-t45cw"
Jul 13 20:19:50.607130 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.606910    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a0ae10a-1565-4d86-92c0-f15d523042b9-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-t45cw\" (UID: \"6a0ae10a-1565-4d86-92c0-f15d523042b9\") " pod="openshift-insights/insights-operator-68d9dd94cf-t45cw"
Jul 13 20:19:50.607130 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.606941    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a400225c-4a8a-41ca-800a-d101a9e6efff-config\") pod \"service-ca-operator-7695fc6c8c-65kk8\" (UID: \"a400225c-4a8a-41ca-800a-d101a9e6efff\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-65kk8"
Jul 13 20:19:50.607130 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.606965    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f866ccdf-4a23-45a3-88b4-16bb48322947-service-ca-bundle\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:19:50.607130 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.607006    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvkhx\" (UniqueName: \"kubernetes.io/projected/70f2cd6d-09a8-42ed-957f-ee50c42b98d1-kube-api-access-tvkhx\") pod \"console-operator-7866497494-rmc2s\" (UID: \"70f2cd6d-09a8-42ed-957f-ee50c42b98d1\") " pod="openshift-console-operator/console-operator-7866497494-rmc2s"
Jul 13 20:19:50.607130 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.607031    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a400225c-4a8a-41ca-800a-d101a9e6efff-serving-cert\") pod \"service-ca-operator-7695fc6c8c-65kk8\" (UID: \"a400225c-4a8a-41ca-800a-d101a9e6efff\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-65kk8"
Jul 13 20:19:50.607130 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.607056    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbp85\" (UniqueName: \"kubernetes.io/projected/061095eb-9b43-4331-9155-8dfab3aa3741-kube-api-access-zbp85\") pod \"kube-storage-version-migrator-operator-799cb7f958-rd8jg\" (UID: \"061095eb-9b43-4331-9155-8dfab3aa3741\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rd8jg"
Jul 13 20:19:50.607130 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.607087    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc86f53e-ffd8-4afe-abb0-af88b668cdde-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5r5p5\" (UID: \"fc86f53e-ffd8-4afe-abb0-af88b668cdde\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r5p5"
Jul 13 20:19:50.607130 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.607112    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a0ae10a-1565-4d86-92c0-f15d523042b9-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-t45cw\" (UID: \"6a0ae10a-1565-4d86-92c0-f15d523042b9\") " pod="openshift-insights/insights-operator-68d9dd94cf-t45cw"
Jul 13 20:19:50.607667 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.607146    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42l2c\" (UniqueName: \"kubernetes.io/projected/77da0f34-0522-4826-b4df-12b3dc59ea10-kube-api-access-42l2c\") pod \"volume-data-source-validator-78495597f6-llps6\" (UID: \"77da0f34-0522-4826-b4df-12b3dc59ea10\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-llps6"
Jul 13 20:19:50.607667 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.607171    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-metrics-certs\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:19:50.607667 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.607194    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/061095eb-9b43-4331-9155-8dfab3aa3741-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-rd8jg\" (UID: \"061095eb-9b43-4331-9155-8dfab3aa3741\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rd8jg"
Jul 13 20:19:50.607667 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.607222    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a0ae10a-1565-4d86-92c0-f15d523042b9-serving-cert\") pod \"insights-operator-68d9dd94cf-t45cw\" (UID: \"6a0ae10a-1565-4d86-92c0-f15d523042b9\") " pod="openshift-insights/insights-operator-68d9dd94cf-t45cw"
Jul 13 20:19:50.607667 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.607256    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-stats-auth\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:19:50.607667 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.607299    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6nxs\" (UniqueName: \"kubernetes.io/projected/a400225c-4a8a-41ca-800a-d101a9e6efff-kube-api-access-k6nxs\") pod \"service-ca-operator-7695fc6c8c-65kk8\" (UID: \"a400225c-4a8a-41ca-800a-d101a9e6efff\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-65kk8"
Jul 13 20:19:50.607667 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.607328    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5225\" (UniqueName: \"kubernetes.io/projected/6a0ae10a-1565-4d86-92c0-f15d523042b9-kube-api-access-q5225\") pod \"insights-operator-68d9dd94cf-t45cw\" (UID: \"6a0ae10a-1565-4d86-92c0-f15d523042b9\") " pod="openshift-insights/insights-operator-68d9dd94cf-t45cw"
Jul 13 20:19:50.607667 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.607382    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70f2cd6d-09a8-42ed-957f-ee50c42b98d1-serving-cert\") pod \"console-operator-7866497494-rmc2s\" (UID: \"70f2cd6d-09a8-42ed-957f-ee50c42b98d1\") " pod="openshift-console-operator/console-operator-7866497494-rmc2s"
Jul 13 20:19:50.607667 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.607407    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/70f2cd6d-09a8-42ed-957f-ee50c42b98d1-trusted-ca\") pod \"console-operator-7866497494-rmc2s\" (UID: \"70f2cd6d-09a8-42ed-957f-ee50c42b98d1\") " pod="openshift-console-operator/console-operator-7866497494-rmc2s"
Jul 13 20:19:50.609037 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.608358    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a0ae10a-1565-4d86-92c0-f15d523042b9-tmp\") pod \"insights-operator-68d9dd94cf-t45cw\" (UID: \"6a0ae10a-1565-4d86-92c0-f15d523042b9\") " pod="openshift-insights/insights-operator-68d9dd94cf-t45cw"
Jul 13 20:19:50.609037 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.608396    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6a0ae10a-1565-4d86-92c0-f15d523042b9-snapshots\") pod \"insights-operator-68d9dd94cf-t45cw\" (UID: \"6a0ae10a-1565-4d86-92c0-f15d523042b9\") " pod="openshift-insights/insights-operator-68d9dd94cf-t45cw"
Jul 13 20:19:50.609037 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.608589    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a0ae10a-1565-4d86-92c0-f15d523042b9-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-t45cw\" (UID: \"6a0ae10a-1565-4d86-92c0-f15d523042b9\") " pod="openshift-insights/insights-operator-68d9dd94cf-t45cw"
Jul 13 20:19:50.609037 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:50.608744    2588 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 20:19:50.609037 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:50.608828    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc86f53e-ffd8-4afe-abb0-af88b668cdde-samples-operator-tls podName:fc86f53e-ffd8-4afe-abb0-af88b668cdde nodeName:}" failed. No retries permitted until 2026-07-13 20:19:51.108807924 +0000 UTC m=+68.843459107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fc86f53e-ffd8-4afe-abb0-af88b668cdde-samples-operator-tls") pod "cluster-samples-operator-65db858894-5r5p5" (UID: "fc86f53e-ffd8-4afe-abb0-af88b668cdde") : secret "samples-operator-tls" not found
Jul 13 20:19:50.609655 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.609632    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6a0ae10a-1565-4d86-92c0-f15d523042b9-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-t45cw\" (UID: \"6a0ae10a-1565-4d86-92c0-f15d523042b9\") " pod="openshift-insights/insights-operator-68d9dd94cf-t45cw"
Jul 13 20:19:50.613079 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.613051    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6a0ae10a-1565-4d86-92c0-f15d523042b9-serving-cert\") pod \"insights-operator-68d9dd94cf-t45cw\" (UID: \"6a0ae10a-1565-4d86-92c0-f15d523042b9\") " pod="openshift-insights/insights-operator-68d9dd94cf-t45cw"
Jul 13 20:19:50.618163 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.618068    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2k9w\" (UniqueName: \"kubernetes.io/projected/fc86f53e-ffd8-4afe-abb0-af88b668cdde-kube-api-access-c2k9w\") pod \"cluster-samples-operator-65db858894-5r5p5\" (UID: \"fc86f53e-ffd8-4afe-abb0-af88b668cdde\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r5p5"
Jul 13 20:19:50.625273 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.625031    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5225\" (UniqueName: \"kubernetes.io/projected/6a0ae10a-1565-4d86-92c0-f15d523042b9-kube-api-access-q5225\") pod \"insights-operator-68d9dd94cf-t45cw\" (UID: \"6a0ae10a-1565-4d86-92c0-f15d523042b9\") " pod="openshift-insights/insights-operator-68d9dd94cf-t45cw"
Jul 13 20:19:50.625662 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.625636    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42l2c\" (UniqueName: \"kubernetes.io/projected/77da0f34-0522-4826-b4df-12b3dc59ea10-kube-api-access-42l2c\") pod \"volume-data-source-validator-78495597f6-llps6\" (UID: \"77da0f34-0522-4826-b4df-12b3dc59ea10\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-llps6"
Jul 13 20:19:50.655239 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.655211    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:50.708121 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.708089    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70f2cd6d-09a8-42ed-957f-ee50c42b98d1-serving-cert\") pod \"console-operator-7866497494-rmc2s\" (UID: \"70f2cd6d-09a8-42ed-957f-ee50c42b98d1\") " pod="openshift-console-operator/console-operator-7866497494-rmc2s"
Jul 13 20:19:50.708265 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.708224    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/70f2cd6d-09a8-42ed-957f-ee50c42b98d1-trusted-ca\") pod \"console-operator-7866497494-rmc2s\" (UID: \"70f2cd6d-09a8-42ed-957f-ee50c42b98d1\") " pod="openshift-console-operator/console-operator-7866497494-rmc2s"
Jul 13 20:19:50.708334 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.708320    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70f2cd6d-09a8-42ed-957f-ee50c42b98d1-config\") pod \"console-operator-7866497494-rmc2s\" (UID: \"70f2cd6d-09a8-42ed-957f-ee50c42b98d1\") " pod="openshift-console-operator/console-operator-7866497494-rmc2s"
Jul 13 20:19:50.708413 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.708346    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/061095eb-9b43-4331-9155-8dfab3aa3741-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-rd8jg\" (UID: \"061095eb-9b43-4331-9155-8dfab3aa3741\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rd8jg"
Jul 13 20:19:50.708413 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.708390    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-default-certificate\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:19:50.708765 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.708739    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fwmt\" (UniqueName: \"kubernetes.io/projected/f866ccdf-4a23-45a3-88b4-16bb48322947-kube-api-access-6fwmt\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:19:50.708869 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.708841    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a400225c-4a8a-41ca-800a-d101a9e6efff-config\") pod \"service-ca-operator-7695fc6c8c-65kk8\" (UID: \"a400225c-4a8a-41ca-800a-d101a9e6efff\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-65kk8"
Jul 13 20:19:50.709089 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.709065    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/061095eb-9b43-4331-9155-8dfab3aa3741-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-rd8jg\" (UID: \"061095eb-9b43-4331-9155-8dfab3aa3741\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rd8jg"
Jul 13 20:19:50.709162 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.709127    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f866ccdf-4a23-45a3-88b4-16bb48322947-service-ca-bundle\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:19:50.709217 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.709181    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/70f2cd6d-09a8-42ed-957f-ee50c42b98d1-config\") pod \"console-operator-7866497494-rmc2s\" (UID: \"70f2cd6d-09a8-42ed-957f-ee50c42b98d1\") " pod="openshift-console-operator/console-operator-7866497494-rmc2s"
Jul 13 20:19:50.709217 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.709185    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvkhx\" (UniqueName: \"kubernetes.io/projected/70f2cd6d-09a8-42ed-957f-ee50c42b98d1-kube-api-access-tvkhx\") pod \"console-operator-7866497494-rmc2s\" (UID: \"70f2cd6d-09a8-42ed-957f-ee50c42b98d1\") " pod="openshift-console-operator/console-operator-7866497494-rmc2s"
Jul 13 20:19:50.709324 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.709246    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a400225c-4a8a-41ca-800a-d101a9e6efff-serving-cert\") pod \"service-ca-operator-7695fc6c8c-65kk8\" (UID: \"a400225c-4a8a-41ca-800a-d101a9e6efff\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-65kk8"
Jul 13 20:19:50.709324 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.709276    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbp85\" (UniqueName: \"kubernetes.io/projected/061095eb-9b43-4331-9155-8dfab3aa3741-kube-api-access-zbp85\") pod \"kube-storage-version-migrator-operator-799cb7f958-rd8jg\" (UID: \"061095eb-9b43-4331-9155-8dfab3aa3741\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rd8jg"
Jul 13 20:19:50.709324 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:50.709314    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f866ccdf-4a23-45a3-88b4-16bb48322947-service-ca-bundle podName:f866ccdf-4a23-45a3-88b4-16bb48322947 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:51.209294921 +0000 UTC m=+68.943946089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f866ccdf-4a23-45a3-88b4-16bb48322947-service-ca-bundle") pod "router-default-6b498b7f44-rnqlq" (UID: "f866ccdf-4a23-45a3-88b4-16bb48322947") : configmap references non-existent config key: service-ca.crt
Jul 13 20:19:50.709508 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.709384    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-metrics-certs\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:19:50.709508 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.709417    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/061095eb-9b43-4331-9155-8dfab3aa3741-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-rd8jg\" (UID: \"061095eb-9b43-4331-9155-8dfab3aa3741\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rd8jg"
Jul 13 20:19:50.709508 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.709420    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a400225c-4a8a-41ca-800a-d101a9e6efff-config\") pod \"service-ca-operator-7695fc6c8c-65kk8\" (UID: \"a400225c-4a8a-41ca-800a-d101a9e6efff\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-65kk8"
Jul 13 20:19:50.709508 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:50.709489    2588 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 20:19:50.709712 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:50.709552    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-metrics-certs podName:f866ccdf-4a23-45a3-88b4-16bb48322947 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:51.209536766 +0000 UTC m=+68.944187948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-metrics-certs") pod "router-default-6b498b7f44-rnqlq" (UID: "f866ccdf-4a23-45a3-88b4-16bb48322947") : secret "router-metrics-certs-default" not found
Jul 13 20:19:50.709712 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.709593    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-stats-auth\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:19:50.709712 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.709637    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6nxs\" (UniqueName: \"kubernetes.io/projected/a400225c-4a8a-41ca-800a-d101a9e6efff-kube-api-access-k6nxs\") pod \"service-ca-operator-7695fc6c8c-65kk8\" (UID: \"a400225c-4a8a-41ca-800a-d101a9e6efff\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-65kk8"
Jul 13 20:19:50.709867 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.709724    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/70f2cd6d-09a8-42ed-957f-ee50c42b98d1-trusted-ca\") pod \"console-operator-7866497494-rmc2s\" (UID: \"70f2cd6d-09a8-42ed-957f-ee50c42b98d1\") " pod="openshift-console-operator/console-operator-7866497494-rmc2s"
Jul 13 20:19:50.711862 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.711838    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/70f2cd6d-09a8-42ed-957f-ee50c42b98d1-serving-cert\") pod \"console-operator-7866497494-rmc2s\" (UID: \"70f2cd6d-09a8-42ed-957f-ee50c42b98d1\") " pod="openshift-console-operator/console-operator-7866497494-rmc2s"
Jul 13 20:19:50.711960 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.711891    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a400225c-4a8a-41ca-800a-d101a9e6efff-serving-cert\") pod \"service-ca-operator-7695fc6c8c-65kk8\" (UID: \"a400225c-4a8a-41ca-800a-d101a9e6efff\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-65kk8"
Jul 13 20:19:50.712290 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.712267    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-stats-auth\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:19:50.712749 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.712728    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-default-certificate\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:19:50.713526 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.713479    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/061095eb-9b43-4331-9155-8dfab3aa3741-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-rd8jg\" (UID: \"061095eb-9b43-4331-9155-8dfab3aa3741\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rd8jg"
Jul 13 20:19:50.721140 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.721118    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fwmt\" (UniqueName: \"kubernetes.io/projected/f866ccdf-4a23-45a3-88b4-16bb48322947-kube-api-access-6fwmt\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:19:50.721267 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.721196    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbp85\" (UniqueName: \"kubernetes.io/projected/061095eb-9b43-4331-9155-8dfab3aa3741-kube-api-access-zbp85\") pod \"kube-storage-version-migrator-operator-799cb7f958-rd8jg\" (UID: \"061095eb-9b43-4331-9155-8dfab3aa3741\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rd8jg"
Jul 13 20:19:50.724318 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.724294    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvkhx\" (UniqueName: \"kubernetes.io/projected/70f2cd6d-09a8-42ed-957f-ee50c42b98d1-kube-api-access-tvkhx\") pod \"console-operator-7866497494-rmc2s\" (UID: \"70f2cd6d-09a8-42ed-957f-ee50c42b98d1\") " pod="openshift-console-operator/console-operator-7866497494-rmc2s"
Jul 13 20:19:50.724872 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.724849    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6nxs\" (UniqueName: \"kubernetes.io/projected/a400225c-4a8a-41ca-800a-d101a9e6efff-kube-api-access-k6nxs\") pod \"service-ca-operator-7695fc6c8c-65kk8\" (UID: \"a400225c-4a8a-41ca-800a-d101a9e6efff\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-65kk8"
Jul 13 20:19:50.728036 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.728004    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:50.771445 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.771416    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-t45cw"
Jul 13 20:19:50.787821 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.787795    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-llps6"
Jul 13 20:19:50.839970 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.839940    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-rmc2s"
Jul 13 20:19:50.852197 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.852049    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-65kk8"
Jul 13 20:19:50.876599 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.876534    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rd8jg"
Jul 13 20:19:50.988994 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:50.988926    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-t45cw"]
Jul 13 20:19:50.994146 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:19:50.994055    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a0ae10a_1565_4d86_92c0_f15d523042b9.slice/crio-763683ffbbd107c93fbaa5682fabfc2df93a214e1f388957642265277c91609b WatchSource:0}: Error finding container 763683ffbbd107c93fbaa5682fabfc2df93a214e1f388957642265277c91609b: Status 404 returned error can't find the container with id 763683ffbbd107c93fbaa5682fabfc2df93a214e1f388957642265277c91609b
Jul 13 20:19:51.012310 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.012283    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9wb5n\" (UID: \"5df96b08-2166-4b7c-b5e8-c72f6704a5b9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n"
Jul 13 20:19:51.012723 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:51.012493    2588 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 20:19:51.012723 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:51.012571    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-cluster-monitoring-operator-tls podName:5df96b08-2166-4b7c-b5e8-c72f6704a5b9 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:52.012548874 +0000 UTC m=+69.747200048 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9wb5n" (UID: "5df96b08-2166-4b7c-b5e8-c72f6704a5b9") : secret "cluster-monitoring-operator-tls" not found
Jul 13 20:19:51.019401 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.017906    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-llps6"]
Jul 13 20:19:51.073943 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.073822    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-rmc2s"]
Jul 13 20:19:51.077407 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:19:51.077356    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70f2cd6d_09a8_42ed_957f_ee50c42b98d1.slice/crio-0f56fde84a6890e55ca4eeec875dc02c3b4d923ee77ca000dec8a5114b059bbd WatchSource:0}: Error finding container 0f56fde84a6890e55ca4eeec875dc02c3b4d923ee77ca000dec8a5114b059bbd: Status 404 returned error can't find the container with id 0f56fde84a6890e55ca4eeec875dc02c3b4d923ee77ca000dec8a5114b059bbd
Jul 13 20:19:51.095435 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.095409    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rd8jg"]
Jul 13 20:19:51.098127 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.098107    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-65kk8"]
Jul 13 20:19:51.098393 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:19:51.098354    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod061095eb_9b43_4331_9155_8dfab3aa3741.slice/crio-a8489afd60c4f79939f94ac007b1291169b4ef480eb302eddbcca570ee8b5e91 WatchSource:0}: Error finding container a8489afd60c4f79939f94ac007b1291169b4ef480eb302eddbcca570ee8b5e91: Status 404 returned error can't find the container with id a8489afd60c4f79939f94ac007b1291169b4ef480eb302eddbcca570ee8b5e91
Jul 13 20:19:51.101167 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:19:51.101147    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda400225c_4a8a_41ca_800a_d101a9e6efff.slice/crio-ccd4515478ebe73081021821e6e04628cab18284e67cd627fc5c26d51fd625fe WatchSource:0}: Error finding container ccd4515478ebe73081021821e6e04628cab18284e67cd627fc5c26d51fd625fe: Status 404 returned error can't find the container with id ccd4515478ebe73081021821e6e04628cab18284e67cd627fc5c26d51fd625fe
Jul 13 20:19:51.112006 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.111979    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-tbpsz"]
Jul 13 20:19:51.113302 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.113281    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc86f53e-ffd8-4afe-abb0-af88b668cdde-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5r5p5\" (UID: \"fc86f53e-ffd8-4afe-abb0-af88b668cdde\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r5p5"
Jul 13 20:19:51.113426 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:51.113413    2588 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 20:19:51.113477 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:51.113465    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc86f53e-ffd8-4afe-abb0-af88b668cdde-samples-operator-tls podName:fc86f53e-ffd8-4afe-abb0-af88b668cdde nodeName:}" failed. No retries permitted until 2026-07-13 20:19:52.113449559 +0000 UTC m=+69.848100725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fc86f53e-ffd8-4afe-abb0-af88b668cdde-samples-operator-tls") pod "cluster-samples-operator-65db858894-5r5p5" (UID: "fc86f53e-ffd8-4afe-abb0-af88b668cdde") : secret "samples-operator-tls" not found
Jul 13 20:19:51.133272 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.133226    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-tbpsz"]
Jul 13 20:19:51.133419 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.133335    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tbpsz"
Jul 13 20:19:51.142737 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.142713    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xrjbj\""
Jul 13 20:19:51.214006 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.213976    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f866ccdf-4a23-45a3-88b4-16bb48322947-service-ca-bundle\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:19:51.214145 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.214034    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-metrics-certs\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:19:51.214145 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.214090    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwzsc\" (UniqueName: \"kubernetes.io/projected/826c7f54-267c-4b4d-86f2-4e02c8f04543-kube-api-access-jwzsc\") pod \"network-check-source-869dcfcdcd-tbpsz\" (UID: \"826c7f54-267c-4b4d-86f2-4e02c8f04543\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tbpsz"
Jul 13 20:19:51.214229 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:51.214200    2588 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 20:19:51.214269 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:51.214200    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f866ccdf-4a23-45a3-88b4-16bb48322947-service-ca-bundle podName:f866ccdf-4a23-45a3-88b4-16bb48322947 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:52.214175534 +0000 UTC m=+69.948826723 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f866ccdf-4a23-45a3-88b4-16bb48322947-service-ca-bundle") pod "router-default-6b498b7f44-rnqlq" (UID: "f866ccdf-4a23-45a3-88b4-16bb48322947") : configmap references non-existent config key: service-ca.crt
Jul 13 20:19:51.214269 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:51.214255    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-metrics-certs podName:f866ccdf-4a23-45a3-88b4-16bb48322947 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:52.214243551 +0000 UTC m=+69.948894721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-metrics-certs") pod "router-default-6b498b7f44-rnqlq" (UID: "f866ccdf-4a23-45a3-88b4-16bb48322947") : secret "router-metrics-certs-default" not found
Jul 13 20:19:51.239063 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.239025    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rd8jg" event={"ID":"061095eb-9b43-4331-9155-8dfab3aa3741","Type":"ContainerStarted","Data":"a8489afd60c4f79939f94ac007b1291169b4ef480eb302eddbcca570ee8b5e91"}
Jul 13 20:19:51.240565 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.240524    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-65kk8" event={"ID":"a400225c-4a8a-41ca-800a-d101a9e6efff","Type":"ContainerStarted","Data":"ccd4515478ebe73081021821e6e04628cab18284e67cd627fc5c26d51fd625fe"}
Jul 13 20:19:51.241923 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.241894    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-llps6" event={"ID":"77da0f34-0522-4826-b4df-12b3dc59ea10","Type":"ContainerStarted","Data":"52d391cd2af41a4ada6794f476b19ea1af3ae126197283436cc97967016d28ca"}
Jul 13 20:19:51.243405 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.243343    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-rmc2s" event={"ID":"70f2cd6d-09a8-42ed-957f-ee50c42b98d1","Type":"ContainerStarted","Data":"0f56fde84a6890e55ca4eeec875dc02c3b4d923ee77ca000dec8a5114b059bbd"}
Jul 13 20:19:51.244789 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.244749    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-t45cw" event={"ID":"6a0ae10a-1565-4d86-92c0-f15d523042b9","Type":"ContainerStarted","Data":"763683ffbbd107c93fbaa5682fabfc2df93a214e1f388957642265277c91609b"}
Jul 13 20:19:51.315531 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.315500    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwzsc\" (UniqueName: \"kubernetes.io/projected/826c7f54-267c-4b4d-86f2-4e02c8f04543-kube-api-access-jwzsc\") pod \"network-check-source-869dcfcdcd-tbpsz\" (UID: \"826c7f54-267c-4b4d-86f2-4e02c8f04543\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tbpsz"
Jul 13 20:19:51.325340 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.325250    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwzsc\" (UniqueName: \"kubernetes.io/projected/826c7f54-267c-4b4d-86f2-4e02c8f04543-kube-api-access-jwzsc\") pod \"network-check-source-869dcfcdcd-tbpsz\" (UID: \"826c7f54-267c-4b4d-86f2-4e02c8f04543\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tbpsz"
Jul 13 20:19:51.350274 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.350231    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:51.415540 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.415504    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:51.445736 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.445705    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tbpsz"
Jul 13 20:19:51.727859 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.727826    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:51.842649 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:51.842597    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:52.022738 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:52.022654    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9wb5n\" (UID: \"5df96b08-2166-4b7c-b5e8-c72f6704a5b9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n"
Jul 13 20:19:52.023148 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:52.022823    2588 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 20:19:52.023148 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:52.022902    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-cluster-monitoring-operator-tls podName:5df96b08-2166-4b7c-b5e8-c72f6704a5b9 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:54.022881212 +0000 UTC m=+71.757532378 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9wb5n" (UID: "5df96b08-2166-4b7c-b5e8-c72f6704a5b9") : secret "cluster-monitoring-operator-tls" not found
Jul 13 20:19:52.123327 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:52.123286    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc86f53e-ffd8-4afe-abb0-af88b668cdde-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5r5p5\" (UID: \"fc86f53e-ffd8-4afe-abb0-af88b668cdde\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r5p5"
Jul 13 20:19:52.123499 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:52.123482    2588 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 20:19:52.123569 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:52.123561    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc86f53e-ffd8-4afe-abb0-af88b668cdde-samples-operator-tls podName:fc86f53e-ffd8-4afe-abb0-af88b668cdde nodeName:}" failed. No retries permitted until 2026-07-13 20:19:54.123539393 +0000 UTC m=+71.858190583 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fc86f53e-ffd8-4afe-abb0-af88b668cdde-samples-operator-tls") pod "cluster-samples-operator-65db858894-5r5p5" (UID: "fc86f53e-ffd8-4afe-abb0-af88b668cdde") : secret "samples-operator-tls" not found
Jul 13 20:19:52.224888 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:52.224848    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f866ccdf-4a23-45a3-88b4-16bb48322947-service-ca-bundle\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:19:52.225096 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:52.224945    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-metrics-certs\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:19:52.225096 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:52.225048    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f866ccdf-4a23-45a3-88b4-16bb48322947-service-ca-bundle podName:f866ccdf-4a23-45a3-88b4-16bb48322947 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:54.225021393 +0000 UTC m=+71.959672563 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f866ccdf-4a23-45a3-88b4-16bb48322947-service-ca-bundle") pod "router-default-6b498b7f44-rnqlq" (UID: "f866ccdf-4a23-45a3-88b4-16bb48322947") : configmap references non-existent config key: service-ca.crt
Jul 13 20:19:52.225207 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:52.225099    2588 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 20:19:52.225207 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:52.225161    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-metrics-certs podName:f866ccdf-4a23-45a3-88b4-16bb48322947 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:54.225144136 +0000 UTC m=+71.959795313 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-metrics-certs") pod "router-default-6b498b7f44-rnqlq" (UID: "f866ccdf-4a23-45a3-88b4-16bb48322947") : secret "router-metrics-certs-default" not found
Jul 13 20:19:52.765287 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:52.765252    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:52.867952 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:52.867922    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:54.043229 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:54.043192    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9wb5n\" (UID: \"5df96b08-2166-4b7c-b5e8-c72f6704a5b9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n"
Jul 13 20:19:54.043633 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:54.043337    2588 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 20:19:54.043633 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:54.043415    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-cluster-monitoring-operator-tls podName:5df96b08-2166-4b7c-b5e8-c72f6704a5b9 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:58.043400283 +0000 UTC m=+75.778051452 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9wb5n" (UID: "5df96b08-2166-4b7c-b5e8-c72f6704a5b9") : secret "cluster-monitoring-operator-tls" not found
Jul 13 20:19:54.144232 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:54.144199    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc86f53e-ffd8-4afe-abb0-af88b668cdde-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5r5p5\" (UID: \"fc86f53e-ffd8-4afe-abb0-af88b668cdde\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r5p5"
Jul 13 20:19:54.144435 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:54.144406    2588 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 20:19:54.144507 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:54.144493    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc86f53e-ffd8-4afe-abb0-af88b668cdde-samples-operator-tls podName:fc86f53e-ffd8-4afe-abb0-af88b668cdde nodeName:}" failed. No retries permitted until 2026-07-13 20:19:58.144469353 +0000 UTC m=+75.879120522 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fc86f53e-ffd8-4afe-abb0-af88b668cdde-samples-operator-tls") pod "cluster-samples-operator-65db858894-5r5p5" (UID: "fc86f53e-ffd8-4afe-abb0-af88b668cdde") : secret "samples-operator-tls" not found
Jul 13 20:19:54.245383 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:54.245334    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f866ccdf-4a23-45a3-88b4-16bb48322947-service-ca-bundle\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:19:54.245548 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:54.245426    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-metrics-certs\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:19:54.245548 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:54.245536    2588 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 20:19:54.245651 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:54.245539    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f866ccdf-4a23-45a3-88b4-16bb48322947-service-ca-bundle podName:f866ccdf-4a23-45a3-88b4-16bb48322947 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:58.245507064 +0000 UTC m=+75.980158249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f866ccdf-4a23-45a3-88b4-16bb48322947-service-ca-bundle") pod "router-default-6b498b7f44-rnqlq" (UID: "f866ccdf-4a23-45a3-88b4-16bb48322947") : configmap references non-existent config key: service-ca.crt
Jul 13 20:19:54.245651 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:54.245595    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-metrics-certs podName:f866ccdf-4a23-45a3-88b4-16bb48322947 nodeName:}" failed. No retries permitted until 2026-07-13 20:19:58.245581833 +0000 UTC m=+75.980233000 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-metrics-certs") pod "router-default-6b498b7f44-rnqlq" (UID: "f866ccdf-4a23-45a3-88b4-16bb48322947") : secret "router-metrics-certs-default" not found
Jul 13 20:19:54.594419 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:54.594377    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:54.690683 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:54.690606    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:55.453325 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:55.453282    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:55.555433 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:55.555388    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:56.152107 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:56.152074    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-tbpsz"]
Jul 13 20:19:56.398006 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:56.397921    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:56.462462 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:56.462428    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:56.533246 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:19:56.533215    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod826c7f54_267c_4b4d_86f2_4e02c8f04543.slice/crio-ab05c0d3f18b02d496deed28d59ea8b3a9fb8111fa705dc4781ab964426bd0b7 WatchSource:0}: Error finding container ab05c0d3f18b02d496deed28d59ea8b3a9fb8111fa705dc4781ab964426bd0b7: Status 404 returned error can't find the container with id ab05c0d3f18b02d496deed28d59ea8b3a9fb8111fa705dc4781ab964426bd0b7
Jul 13 20:19:57.275416 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.275039    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nr99r" event={"ID":"5c7c41b8-6279-424c-90c8-ef75fcee26d6","Type":"ContainerStarted","Data":"2f018e5daebdaf824f01186195e34ff59c1a8d8fa45417cb7c38ce04340a049a"}
Jul 13 20:19:57.277968 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.277939    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rd8jg" event={"ID":"061095eb-9b43-4331-9155-8dfab3aa3741","Type":"ContainerStarted","Data":"c133f9f2684efae122c459b890ea8ea54abed276d927bf6399470f1058f57d09"}
Jul 13 20:19:57.279776 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.279730    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-65kk8" event={"ID":"a400225c-4a8a-41ca-800a-d101a9e6efff","Type":"ContainerStarted","Data":"2e720f7f788644e540872bba0fdc2ab2e9c271561e5ac831d340687d04ee92d5"}
Jul 13 20:19:57.281674 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.281652    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-llps6" event={"ID":"77da0f34-0522-4826-b4df-12b3dc59ea10","Type":"ContainerStarted","Data":"bb67255fe394e7a7f1fdbe049b9267dda1fc4b0c2079632e71e306d16b0ca368"}
Jul 13 20:19:57.283233 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.283209    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tbpsz" event={"ID":"826c7f54-267c-4b4d-86f2-4e02c8f04543","Type":"ContainerStarted","Data":"72fa23d4d64953e7edf3c7896ae8fe3361d3849382e6d8eb0bcf16b16dc86023"}
Jul 13 20:19:57.283342 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.283250    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tbpsz" event={"ID":"826c7f54-267c-4b4d-86f2-4e02c8f04543","Type":"ContainerStarted","Data":"ab05c0d3f18b02d496deed28d59ea8b3a9fb8111fa705dc4781ab964426bd0b7"}
Jul 13 20:19:57.285379 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.285350    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/0.log"
Jul 13 20:19:57.285473 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.285405    2588 generic.go:356] "Generic (PLEG): container finished" podID="70f2cd6d-09a8-42ed-957f-ee50c42b98d1" containerID="66a62b63e461de0185d7730b7f4c982cfaa08545e77ce0dd53ebb9da40d2487e" exitCode=255
Jul 13 20:19:57.285473 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.285446    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-rmc2s" event={"ID":"70f2cd6d-09a8-42ed-957f-ee50c42b98d1","Type":"ContainerDied","Data":"66a62b63e461de0185d7730b7f4c982cfaa08545e77ce0dd53ebb9da40d2487e"}
Jul 13 20:19:57.285940 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.285921    2588 scope.go:117] "RemoveContainer" containerID="66a62b63e461de0185d7730b7f4c982cfaa08545e77ce0dd53ebb9da40d2487e"
Jul 13 20:19:57.287254 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.287224    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-t45cw" event={"ID":"6a0ae10a-1565-4d86-92c0-f15d523042b9","Type":"ContainerStarted","Data":"e904c420a3a4a22ed9ceab2552248b64a5a56a483931583e07b01688686a104b"}
Jul 13 20:19:57.289459 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.289437    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tzvwk" event={"ID":"cd43f8e0-f611-4cf2-9a46-95f57f1ae944","Type":"ContainerStarted","Data":"a1b99e1fc45b8139236cc592c6538fc45d8baa39ed02c9cd07a9000d3961594b"}
Jul 13 20:19:57.289702 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.289687    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:19:57.378013 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.377450    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nr99r" podStartSLOduration=67.202937037 podStartE2EDuration="1m14.377431549s" totalImagesPullingTime="7.174494512s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:57.319973016 +0000 UTC m=+75.054624205" watchObservedRunningTime="2026-07-13 20:19:57.377431549 +0000 UTC m=+75.112082737"
Jul 13 20:19:57.378013 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.377618    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tzvwk" podStartSLOduration=67.728758684 podStartE2EDuration="1m14.377608667s" totalImagesPullingTime="6.648849983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:57.376498989 +0000 UTC m=+75.111150192" watchObservedRunningTime="2026-07-13 20:19:57.377608667 +0000 UTC m=+75.112259858"
Jul 13 20:19:57.439425 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.439352    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rd8jg" podStartSLOduration=1.983752452 podStartE2EDuration="7.439332648s" totalImagesPullingTime="5.455580196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:57.438394947 +0000 UTC m=+75.173046135" watchObservedRunningTime="2026-07-13 20:19:57.439332648 +0000 UTC m=+75.173983834"
Jul 13 20:19:57.439639 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.439612    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-65kk8" podStartSLOduration=1.974251567 podStartE2EDuration="7.439604522s" totalImagesPullingTime="5.465352955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:57.407608729 +0000 UTC m=+75.142259915" watchObservedRunningTime="2026-07-13 20:19:57.439604522 +0000 UTC m=+75.174255687"
Jul 13 20:19:57.457458 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.457408    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-tbpsz" podStartSLOduration=6.4573895629999996 podStartE2EDuration="6.457389563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:57.456498833 +0000 UTC m=+75.191150026" watchObservedRunningTime="2026-07-13 20:19:57.457389563 +0000 UTC m=+75.192040751"
Jul 13 20:19:57.484467 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.484420    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-t45cw" podStartSLOduration=1.920888213 podStartE2EDuration="7.484401971s" totalImagesPullingTime="5.563513758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:57.482329906 +0000 UTC m=+75.216981094" watchObservedRunningTime="2026-07-13 20:19:57.484401971 +0000 UTC m=+75.219053159"
Jul 13 20:19:57.506559 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.506507    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-llps6" podStartSLOduration=2.022717795 podStartE2EDuration="7.506489013s" totalImagesPullingTime="5.483771218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:19:57.505925861 +0000 UTC m=+75.240577050" watchObservedRunningTime="2026-07-13 20:19:57.506489013 +0000 UTC m=+75.241140181"
Jul 13 20:19:57.610230 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.610190    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:57.673231 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.673193    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:57.994617 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:57.994585    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:58.082403 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.082348    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9wb5n\" (UID: \"5df96b08-2166-4b7c-b5e8-c72f6704a5b9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n"
Jul 13 20:19:58.082568 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:58.082502    2588 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 20:19:58.082623 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:58.082583    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-cluster-monitoring-operator-tls podName:5df96b08-2166-4b7c-b5e8-c72f6704a5b9 nodeName:}" failed. No retries permitted until 2026-07-13 20:20:06.082563399 +0000 UTC m=+83.817214570 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9wb5n" (UID: "5df96b08-2166-4b7c-b5e8-c72f6704a5b9") : secret "cluster-monitoring-operator-tls" not found
Jul 13 20:19:58.115305 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.115267    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:58.183444 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.183408    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc86f53e-ffd8-4afe-abb0-af88b668cdde-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5r5p5\" (UID: \"fc86f53e-ffd8-4afe-abb0-af88b668cdde\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r5p5"
Jul 13 20:19:58.183601 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:58.183580    2588 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 13 20:19:58.183673 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:58.183660    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fc86f53e-ffd8-4afe-abb0-af88b668cdde-samples-operator-tls podName:fc86f53e-ffd8-4afe-abb0-af88b668cdde nodeName:}" failed. No retries permitted until 2026-07-13 20:20:06.183639057 +0000 UTC m=+83.918290229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/fc86f53e-ffd8-4afe-abb0-af88b668cdde-samples-operator-tls") pod "cluster-samples-operator-65db858894-5r5p5" (UID: "fc86f53e-ffd8-4afe-abb0-af88b668cdde") : secret "samples-operator-tls" not found
Jul 13 20:19:58.223394 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.223343    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:58.284687 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.284606    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f866ccdf-4a23-45a3-88b4-16bb48322947-service-ca-bundle\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:19:58.284850 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.284688    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-metrics-certs\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:19:58.284850 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:58.284793    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f866ccdf-4a23-45a3-88b4-16bb48322947-service-ca-bundle podName:f866ccdf-4a23-45a3-88b4-16bb48322947 nodeName:}" failed. No retries permitted until 2026-07-13 20:20:06.284769645 +0000 UTC m=+84.019420812 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f866ccdf-4a23-45a3-88b4-16bb48322947-service-ca-bundle") pod "router-default-6b498b7f44-rnqlq" (UID: "f866ccdf-4a23-45a3-88b4-16bb48322947") : configmap references non-existent config key: service-ca.crt
Jul 13 20:19:58.284850 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:58.284828    2588 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 20:19:58.285017 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:58.284880    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-metrics-certs podName:f866ccdf-4a23-45a3-88b4-16bb48322947 nodeName:}" failed. No retries permitted until 2026-07-13 20:20:06.284865883 +0000 UTC m=+84.019517052 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-metrics-certs") pod "router-default-6b498b7f44-rnqlq" (UID: "f866ccdf-4a23-45a3-88b4-16bb48322947") : secret "router-metrics-certs-default" not found
Jul 13 20:19:58.295051 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.295027    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 20:19:58.295456 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.295440    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/0.log"
Jul 13 20:19:58.295565 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.295478    2588 generic.go:356] "Generic (PLEG): container finished" podID="70f2cd6d-09a8-42ed-957f-ee50c42b98d1" containerID="42ec348d57985668148ecf92d445e57a4fbd9aecabfbbe41acf56a8f65481a38" exitCode=255
Jul 13 20:19:58.295565 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.295555    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-rmc2s" event={"ID":"70f2cd6d-09a8-42ed-957f-ee50c42b98d1","Type":"ContainerDied","Data":"42ec348d57985668148ecf92d445e57a4fbd9aecabfbbe41acf56a8f65481a38"}
Jul 13 20:19:58.295668 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.295621    2588 scope.go:117] "RemoveContainer" containerID="66a62b63e461de0185d7730b7f4c982cfaa08545e77ce0dd53ebb9da40d2487e"
Jul 13 20:19:58.295813 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.295796    2588 scope.go:117] "RemoveContainer" containerID="42ec348d57985668148ecf92d445e57a4fbd9aecabfbbe41acf56a8f65481a38"
Jul 13 20:19:58.295995 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:58.295974    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-rmc2s_openshift-console-operator(70f2cd6d-09a8-42ed-957f-ee50c42b98d1)\"" pod="openshift-console-operator/console-operator-7866497494-rmc2s" podUID="70f2cd6d-09a8-42ed-957f-ee50c42b98d1"
Jul 13 20:19:58.341867 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.341832    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:58.713699 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.713667    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:58.861911 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.861881    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ngz5s"]
Jul 13 20:19:58.866323 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.866302    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:19:58.870291 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.870270    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 13 20:19:58.870410 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.870352    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nlmqs\""
Jul 13 20:19:58.870410 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.870269    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:58.870524 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.870484    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 13 20:19:58.892340 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.892268    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ngz5s"]
Jul 13 20:19:58.939090 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.939053    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:19:58.991509 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.991430    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a61811b-9717-4c54-a14a-640d70479a4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:19:58.991509 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.991467    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a61811b-9717-4c54-a14a-640d70479a4e-data-volume\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:19:58.991692 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.991564    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a61811b-9717-4c54-a14a-640d70479a4e-crio-socket\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:19:58.991692 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.991612    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tplw7\" (UniqueName: \"kubernetes.io/projected/4a61811b-9717-4c54-a14a-640d70479a4e-kube-api-access-tplw7\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:19:58.991692 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:58.991631    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a61811b-9717-4c54-a14a-640d70479a4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:19:59.093035 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:59.092995    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a61811b-9717-4c54-a14a-640d70479a4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:19:59.093207 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:59.093044    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a61811b-9717-4c54-a14a-640d70479a4e-data-volume\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:19:59.093207 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:59.093099    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a61811b-9717-4c54-a14a-640d70479a4e-crio-socket\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:19:59.093207 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:59.093153    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tplw7\" (UniqueName: \"kubernetes.io/projected/4a61811b-9717-4c54-a14a-640d70479a4e-kube-api-access-tplw7\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:19:59.093207 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:59.093174    2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 20:19:59.093207 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:59.093180    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a61811b-9717-4c54-a14a-640d70479a4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:19:59.093438 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:59.093241    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a61811b-9717-4c54-a14a-640d70479a4e-insights-runtime-extractor-tls podName:4a61811b-9717-4c54-a14a-640d70479a4e nodeName:}" failed. No retries permitted until 2026-07-13 20:19:59.593221923 +0000 UTC m=+77.327873109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4a61811b-9717-4c54-a14a-640d70479a4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ngz5s" (UID: "4a61811b-9717-4c54-a14a-640d70479a4e") : secret "insights-runtime-extractor-tls" not found
Jul 13 20:19:59.093438 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:59.093238    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a61811b-9717-4c54-a14a-640d70479a4e-crio-socket\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:19:59.093438 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:59.093292    2588 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 20:19:59.093438 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:59.093336    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4a61811b-9717-4c54-a14a-640d70479a4e-kube-rbac-proxy-cm podName:4a61811b-9717-4c54-a14a-640d70479a4e nodeName:}" failed. No retries permitted until 2026-07-13 20:19:59.593324288 +0000 UTC m=+77.327975458 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4a61811b-9717-4c54-a14a-640d70479a4e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ngz5s" (UID: "4a61811b-9717-4c54-a14a-640d70479a4e") : configmap "kube-rbac-proxy" not found
Jul 13 20:19:59.093573 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:59.093447    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a61811b-9717-4c54-a14a-640d70479a4e-data-volume\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:19:59.104167 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:59.104145    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tplw7\" (UniqueName: \"kubernetes.io/projected/4a61811b-9717-4c54-a14a-640d70479a4e-kube-api-access-tplw7\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:19:59.300144 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:59.300062    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 20:19:59.300443 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:59.300424    2588 scope.go:117] "RemoveContainer" containerID="42ec348d57985668148ecf92d445e57a4fbd9aecabfbbe41acf56a8f65481a38"
Jul 13 20:19:59.300641 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:59.300617    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-rmc2s_openshift-console-operator(70f2cd6d-09a8-42ed-957f-ee50c42b98d1)\"" pod="openshift-console-operator/console-operator-7866497494-rmc2s" podUID="70f2cd6d-09a8-42ed-957f-ee50c42b98d1"
Jul 13 20:19:59.597723 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:59.597641    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a61811b-9717-4c54-a14a-640d70479a4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:19:59.597857 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:59.597766    2588 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 20:19:59.597857 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:19:59.597813    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a61811b-9717-4c54-a14a-640d70479a4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:19:59.597857 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:59.597840    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4a61811b-9717-4c54-a14a-640d70479a4e-kube-rbac-proxy-cm podName:4a61811b-9717-4c54-a14a-640d70479a4e nodeName:}" failed. No retries permitted until 2026-07-13 20:20:00.597821227 +0000 UTC m=+78.332472393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4a61811b-9717-4c54-a14a-640d70479a4e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ngz5s" (UID: "4a61811b-9717-4c54-a14a-640d70479a4e") : configmap "kube-rbac-proxy" not found
Jul 13 20:19:59.597961 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:59.597897    2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 20:19:59.597961 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:19:59.597936    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a61811b-9717-4c54-a14a-640d70479a4e-insights-runtime-extractor-tls podName:4a61811b-9717-4c54-a14a-640d70479a4e nodeName:}" failed. No retries permitted until 2026-07-13 20:20:00.597926721 +0000 UTC m=+78.332577892 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4a61811b-9717-4c54-a14a-640d70479a4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ngz5s" (UID: "4a61811b-9717-4c54-a14a-640d70479a4e") : secret "insights-runtime-extractor-tls" not found
Jul 13 20:20:00.362480 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:00.362449    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:00.437737 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:00.437697    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:00.571207 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:00.571176    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:00.605163 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:00.605134    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a61811b-9717-4c54-a14a-640d70479a4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:20:00.605269 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:00.605245    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a61811b-9717-4c54-a14a-640d70479a4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:20:00.605415 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:00.605279    2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 20:20:00.605415 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:00.605352    2588 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 20:20:00.605415 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:00.605344    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a61811b-9717-4c54-a14a-640d70479a4e-insights-runtime-extractor-tls podName:4a61811b-9717-4c54-a14a-640d70479a4e nodeName:}" failed. No retries permitted until 2026-07-13 20:20:02.6053287 +0000 UTC m=+80.339979887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4a61811b-9717-4c54-a14a-640d70479a4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ngz5s" (UID: "4a61811b-9717-4c54-a14a-640d70479a4e") : secret "insights-runtime-extractor-tls" not found
Jul 13 20:20:00.605540 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:00.605424    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4a61811b-9717-4c54-a14a-640d70479a4e-kube-rbac-proxy-cm podName:4a61811b-9717-4c54-a14a-640d70479a4e nodeName:}" failed. No retries permitted until 2026-07-13 20:20:02.605409311 +0000 UTC m=+80.340060476 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4a61811b-9717-4c54-a14a-640d70479a4e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ngz5s" (UID: "4a61811b-9717-4c54-a14a-640d70479a4e") : configmap "kube-rbac-proxy" not found
Jul 13 20:20:00.668167 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:00.668096    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:00.840148 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:00.840115    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-rmc2s"
Jul 13 20:20:00.840438 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:00.840422    2588 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-rmc2s"
Jul 13 20:20:00.840565 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:00.840552    2588 scope.go:117] "RemoveContainer" containerID="42ec348d57985668148ecf92d445e57a4fbd9aecabfbbe41acf56a8f65481a38"
Jul 13 20:20:00.840714 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:00.840696    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-rmc2s_openshift-console-operator(70f2cd6d-09a8-42ed-957f-ee50c42b98d1)\"" pod="openshift-console-operator/console-operator-7866497494-rmc2s" podUID="70f2cd6d-09a8-42ed-957f-ee50c42b98d1"
Jul 13 20:20:01.306974 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:01.306950    2588 scope.go:117] "RemoveContainer" containerID="42ec348d57985668148ecf92d445e57a4fbd9aecabfbbe41acf56a8f65481a38"
Jul 13 20:20:01.307126 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:01.307107    2588 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-rmc2s_openshift-console-operator(70f2cd6d-09a8-42ed-957f-ee50c42b98d1)\"" pod="openshift-console-operator/console-operator-7866497494-rmc2s" podUID="70f2cd6d-09a8-42ed-957f-ee50c42b98d1"
Jul 13 20:20:01.813635 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:01.813603    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mr5jv_c85bf135-1b33-4b7b-8984-588d51190322/dns-node-resolver/0.log"
Jul 13 20:20:01.933244 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:01.933211    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:02.621894 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:02.621859    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a61811b-9717-4c54-a14a-640d70479a4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:20:02.622062 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:02.621943    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a61811b-9717-4c54-a14a-640d70479a4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:20:02.622062 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:02.621973    2588 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 20:20:02.622062 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:02.622037    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4a61811b-9717-4c54-a14a-640d70479a4e-kube-rbac-proxy-cm podName:4a61811b-9717-4c54-a14a-640d70479a4e nodeName:}" failed. No retries permitted until 2026-07-13 20:20:06.622020649 +0000 UTC m=+84.356671814 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4a61811b-9717-4c54-a14a-640d70479a4e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ngz5s" (UID: "4a61811b-9717-4c54-a14a-640d70479a4e") : configmap "kube-rbac-proxy" not found
Jul 13 20:20:02.622062 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:02.622059    2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 20:20:02.622197 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:02.622098    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a61811b-9717-4c54-a14a-640d70479a4e-insights-runtime-extractor-tls podName:4a61811b-9717-4c54-a14a-640d70479a4e nodeName:}" failed. No retries permitted until 2026-07-13 20:20:06.622087288 +0000 UTC m=+84.356738454 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4a61811b-9717-4c54-a14a-640d70479a4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ngz5s" (UID: "4a61811b-9717-4c54-a14a-640d70479a4e") : secret "insights-runtime-extractor-tls" not found
Jul 13 20:20:02.811817 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:02.811792    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wfdvr_358913e2-9ddb-4fef-9767-e811c7bbf7bb/node-ca/0.log"
Jul 13 20:20:03.414217 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:03.414181    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c758s_5443da0e-8d29-4b04-bce2-066fa62418df/serve-healthcheck-canary/0.log"
Jul 13 20:20:04.215582 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:04.215551    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-rd8jg_061095eb-9b43-4331-9155-8dfab3aa3741/kube-storage-version-migrator-operator/0.log"
Jul 13 20:20:04.899091 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:04.899062    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:05.294655 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:05.294620    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:05.395672 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:05.395637    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:05.500493 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:05.500457    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:05.596379 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:05.596275    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:05.699412 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:05.699380    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:06.153318 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:06.153281    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9wb5n\" (UID: \"5df96b08-2166-4b7c-b5e8-c72f6704a5b9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n"
Jul 13 20:20:06.153716 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:06.153445    2588 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 13 20:20:06.153716 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:06.153511    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-cluster-monitoring-operator-tls podName:5df96b08-2166-4b7c-b5e8-c72f6704a5b9 nodeName:}" failed. No retries permitted until 2026-07-13 20:20:22.153496004 +0000 UTC m=+99.888147169 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-9wb5n" (UID: "5df96b08-2166-4b7c-b5e8-c72f6704a5b9") : secret "cluster-monitoring-operator-tls" not found
Jul 13 20:20:06.254668 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:06.254639    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc86f53e-ffd8-4afe-abb0-af88b668cdde-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5r5p5\" (UID: \"fc86f53e-ffd8-4afe-abb0-af88b668cdde\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r5p5"
Jul 13 20:20:06.256978 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:06.256945    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/fc86f53e-ffd8-4afe-abb0-af88b668cdde-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-5r5p5\" (UID: \"fc86f53e-ffd8-4afe-abb0-af88b668cdde\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r5p5"
Jul 13 20:20:06.353445 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:06.353415    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r5p5"
Jul 13 20:20:06.355761 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:06.355740    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f866ccdf-4a23-45a3-88b4-16bb48322947-service-ca-bundle\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:20:06.355853 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:06.355787    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-metrics-certs\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:20:06.355901 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:06.355884    2588 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 13 20:20:06.355948 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:06.355909    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f866ccdf-4a23-45a3-88b4-16bb48322947-service-ca-bundle podName:f866ccdf-4a23-45a3-88b4-16bb48322947 nodeName:}" failed. No retries permitted until 2026-07-13 20:20:22.355888014 +0000 UTC m=+100.090539180 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f866ccdf-4a23-45a3-88b4-16bb48322947-service-ca-bundle") pod "router-default-6b498b7f44-rnqlq" (UID: "f866ccdf-4a23-45a3-88b4-16bb48322947") : configmap references non-existent config key: service-ca.crt
Jul 13 20:20:06.356069 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:06.356050    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-metrics-certs podName:f866ccdf-4a23-45a3-88b4-16bb48322947 nodeName:}" failed. No retries permitted until 2026-07-13 20:20:22.356026586 +0000 UTC m=+100.090677755 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-metrics-certs") pod "router-default-6b498b7f44-rnqlq" (UID: "f866ccdf-4a23-45a3-88b4-16bb48322947") : secret "router-metrics-certs-default" not found
Jul 13 20:20:06.474719 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:06.474682    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:06.484883 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:06.484857    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r5p5"]
Jul 13 20:20:06.658012 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:06.657978    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a61811b-9717-4c54-a14a-640d70479a4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:20:06.658188 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:06.658064    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a61811b-9717-4c54-a14a-640d70479a4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:20:06.658188 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:06.658108    2588 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 13 20:20:06.658188 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:06.658167    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4a61811b-9717-4c54-a14a-640d70479a4e-kube-rbac-proxy-cm podName:4a61811b-9717-4c54-a14a-640d70479a4e nodeName:}" failed. No retries permitted until 2026-07-13 20:20:14.658152584 +0000 UTC m=+92.392803749 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4a61811b-9717-4c54-a14a-640d70479a4e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ngz5s" (UID: "4a61811b-9717-4c54-a14a-640d70479a4e") : configmap "kube-rbac-proxy" not found
Jul 13 20:20:06.658291 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:06.658210    2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 20:20:06.658291 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:06.658264    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a61811b-9717-4c54-a14a-640d70479a4e-insights-runtime-extractor-tls podName:4a61811b-9717-4c54-a14a-640d70479a4e nodeName:}" failed. No retries permitted until 2026-07-13 20:20:14.658250072 +0000 UTC m=+92.392901237 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4a61811b-9717-4c54-a14a-640d70479a4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ngz5s" (UID: "4a61811b-9717-4c54-a14a-640d70479a4e") : secret "insights-runtime-extractor-tls" not found
Jul 13 20:20:07.069415 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:07.069358    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:07.263484 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:07.263453    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:07.328031 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:07.327956    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r5p5" event={"ID":"fc86f53e-ffd8-4afe-abb0-af88b668cdde","Type":"ContainerStarted","Data":"ecd23ffd3f8cd4b48147ac7a42dbd303fdecf157b56d44403118387a241eed80"}
Jul 13 20:20:07.725575 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:07.725526    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:07.864738 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:07.864696    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:08.267153 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:08.267114    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:08.587457 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:08.587429    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:08.860915 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:08.860822    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:09.336531 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:09.336493    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r5p5" event={"ID":"fc86f53e-ffd8-4afe-abb0-af88b668cdde","Type":"ContainerStarted","Data":"0cf159171e1257e1f644aa7604517881db0fd38f50dcb03b1567b4a04914662d"}
Jul 13 20:20:09.336891 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:09.336560    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r5p5" event={"ID":"fc86f53e-ffd8-4afe-abb0-af88b668cdde","Type":"ContainerStarted","Data":"4cfd81bbb6aabd9de9eefeb33f97f2b2f72d6bee11cc3a111b399f2d0644fe47"}
Jul 13 20:20:09.357570 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:09.357520    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-5r5p5" podStartSLOduration=17.456744264 podStartE2EDuration="19.357505878s" totalImagesPullingTime="1.900761614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:09.357409982 +0000 UTC m=+87.092061171" watchObservedRunningTime="2026-07-13 20:20:09.357505878 +0000 UTC m=+87.092157066"
Jul 13 20:20:09.453114 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:09.453075    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:09.657697 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:09.657606    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:09.718780 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:09.718743    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:10.086725 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:10.086689    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:10.285656 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:10.285620    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:10.660063 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:10.660023    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:11.191029 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:11.190985    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:11.291190 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:11.291161    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:11.393927 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:11.393891    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:11.907679 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:11.907647    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:12.076159 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:12.076130    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:12.526218 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:12.526187    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:12.693023 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:12.692982    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:13.228263 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:13.228227    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:13.338872 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:13.338840    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:13.836916 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:13.836887    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:13.908059 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:13.908024    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:14.067592 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:14.067554    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:14.466458 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:14.466422    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:14.727949 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:14.727862    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a61811b-9717-4c54-a14a-640d70479a4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:20:14.728095 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:14.727964    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a61811b-9717-4c54-a14a-640d70479a4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:20:14.728095 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:14.728005    2588 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 13 20:20:14.728095 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:14.728073    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a61811b-9717-4c54-a14a-640d70479a4e-insights-runtime-extractor-tls podName:4a61811b-9717-4c54-a14a-640d70479a4e nodeName:}" failed. No retries permitted until 2026-07-13 20:20:30.728059077 +0000 UTC m=+108.462710243 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4a61811b-9717-4c54-a14a-640d70479a4e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ngz5s" (UID: "4a61811b-9717-4c54-a14a-640d70479a4e") : secret "insights-runtime-extractor-tls" not found
Jul 13 20:20:14.728537 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:14.728522    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a61811b-9717-4c54-a14a-640d70479a4e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:20:14.964594 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:14.964561    2588 scope.go:117] "RemoveContainer" containerID="42ec348d57985668148ecf92d445e57a4fbd9aecabfbbe41acf56a8f65481a38"
Jul 13 20:20:15.029624 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:15.029592    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:15.262564 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:15.262470    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:15.358312 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:15.358281    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 20:20:15.358483 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:15.358354    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-rmc2s" event={"ID":"70f2cd6d-09a8-42ed-957f-ee50c42b98d1","Type":"ContainerStarted","Data":"6c4bd9912ca89dd38cf9bbe0d698dc7b95f59f73b4caebe202eb508541383582"}
Jul 13 20:20:15.358645 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:15.358628    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-rmc2s"
Jul 13 20:20:15.380625 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:15.380572    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-rmc2s" podStartSLOduration=19.905006376 podStartE2EDuration="25.380556421s" totalImagesPullingTime="5.475550045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:15.379241739 +0000 UTC m=+93.113892927" watchObservedRunningTime="2026-07-13 20:20:15.380556421 +0000 UTC m=+93.115207609"
Jul 13 20:20:15.462977 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:15.462939    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:15.669577 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:15.669471    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:15.852924 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:15.852894    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-rmc2s"
Jul 13 20:20:16.046229 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:16.046194    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:16.146288 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:16.146249    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:16.246820 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:16.246775    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:16.346661 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:16.346575    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:16.422088 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:16.422050    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:16.537289 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:16.537255    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:16.630124 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:16.630028    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:16.933210 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:16.933180    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:17.034279 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:17.034243    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:17.742947 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:17.742909    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:17.961681 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:17.961651    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:18.026631 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:18.026542    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:18.210837 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:18.210797    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:22.089670 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:22.089637    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls\") pod \"dns-default-cr5c9\" (UID: \"1396fdd0-2cad-4bde-89d1-825a0d1b7727\") " pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:20:22.090245 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:22.089680    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:20:22.092046 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:22.092020    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1396fdd0-2cad-4bde-89d1-825a0d1b7727-metrics-tls\") pod \"dns-default-cr5c9\" (UID: \"1396fdd0-2cad-4bde-89d1-825a0d1b7727\") " pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:20:22.092202 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:22.092180    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls\") pod \"image-registry-548688fdbd-hgkxc\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") " pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:20:22.190115 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:22.190071    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9wb5n\" (UID: \"5df96b08-2166-4b7c-b5e8-c72f6704a5b9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n"
Jul 13 20:20:22.192463 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:22.192432    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5df96b08-2166-4b7c-b5e8-c72f6704a5b9-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-9wb5n\" (UID: \"5df96b08-2166-4b7c-b5e8-c72f6704a5b9\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n"
Jul 13 20:20:22.324080 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:22.324048    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-82c5x\""
Jul 13 20:20:22.331454 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:22.331432    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:20:22.335317 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:22.335302    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t5qs6\""
Jul 13 20:20:22.341649 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:22.341623    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:20:22.392630 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:22.392601    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f866ccdf-4a23-45a3-88b4-16bb48322947-service-ca-bundle\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:20:22.392720 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:22.392670    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-metrics-certs\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:20:22.394091 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:22.393594    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f866ccdf-4a23-45a3-88b4-16bb48322947-service-ca-bundle\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:20:22.397777 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:22.397723    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f866ccdf-4a23-45a3-88b4-16bb48322947-metrics-certs\") pod \"router-default-6b498b7f44-rnqlq\" (UID: \"f866ccdf-4a23-45a3-88b4-16bb48322947\") " pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:20:22.445602 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:22.445510    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n"
Jul 13 20:20:22.522194 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:22.522156    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cr5c9"]
Jul 13 20:20:22.528838 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:20:22.528813    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1396fdd0_2cad_4bde_89d1_825a0d1b7727.slice/crio-e669f19a13780a8e5d64ef0cdb55c8ebd71582028158858ac148bde4d846c3dc WatchSource:0}: Error finding container e669f19a13780a8e5d64ef0cdb55c8ebd71582028158858ac148bde4d846c3dc: Status 404 returned error can't find the container with id e669f19a13780a8e5d64ef0cdb55c8ebd71582028158858ac148bde4d846c3dc
Jul 13 20:20:22.531137 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:20:22.531115    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57ac1c11_5790_4d43_9a05_5c2cfb9136db.slice/crio-85e90d31da4494180d27a13a51122e8399b6946d88ce39373266d1fc3b3fbee5 WatchSource:0}: Error finding container 85e90d31da4494180d27a13a51122e8399b6946d88ce39373266d1fc3b3fbee5: Status 404 returned error can't find the container with id 85e90d31da4494180d27a13a51122e8399b6946d88ce39373266d1fc3b3fbee5
Jul 13 20:20:22.541884 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:22.541817    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-548688fdbd-hgkxc"]
Jul 13 20:20:22.606876 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:22.606801    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:20:22.607147 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:22.607101    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n"]
Jul 13 20:20:22.610900 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:20:22.610877    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5df96b08_2166_4b7c_b5e8_c72f6704a5b9.slice/crio-bc7948cf0532fa3765d8a6dc9ba6527f2324e09b19b70d44c4b2d468f686ffc8 WatchSource:0}: Error finding container bc7948cf0532fa3765d8a6dc9ba6527f2324e09b19b70d44c4b2d468f686ffc8: Status 404 returned error can't find the container with id bc7948cf0532fa3765d8a6dc9ba6527f2324e09b19b70d44c4b2d468f686ffc8
Jul 13 20:20:22.763807 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:22.763508    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b498b7f44-rnqlq"]
Jul 13 20:20:22.768505 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:20:22.768464    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf866ccdf_4a23_45a3_88b4_16bb48322947.slice/crio-d3877217203a9b4c399830c4c7c0718954e0b37682264aadf32ea5af225676ec WatchSource:0}: Error finding container d3877217203a9b4c399830c4c7c0718954e0b37682264aadf32ea5af225676ec: Status 404 returned error can't find the container with id d3877217203a9b4c399830c4c7c0718954e0b37682264aadf32ea5af225676ec
Jul 13 20:20:22.868952 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:22.868873    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:22.981497 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:22.981461    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:23.126906 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:23.126825    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:23.223383 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:23.223335    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:23.387663 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:23.387564    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-548688fdbd-hgkxc" event={"ID":"57ac1c11-5790-4d43-9a05-5c2cfb9136db","Type":"ContainerStarted","Data":"d2ef39c8bf0765358c699767bc21c881901f022bb3625fbea92903a5ec3d8709"}
Jul 13 20:20:23.387663 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:23.387624    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-548688fdbd-hgkxc" event={"ID":"57ac1c11-5790-4d43-9a05-5c2cfb9136db","Type":"ContainerStarted","Data":"85e90d31da4494180d27a13a51122e8399b6946d88ce39373266d1fc3b3fbee5"}
Jul 13 20:20:23.387663 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:23.387650    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:20:23.389138 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:23.389107    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b498b7f44-rnqlq" event={"ID":"f866ccdf-4a23-45a3-88b4-16bb48322947","Type":"ContainerStarted","Data":"b041926b79f03cc2f1e6bc75df67011551062172f179363b72ee6858a986bb28"}
Jul 13 20:20:23.389278 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:23.389157    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b498b7f44-rnqlq" event={"ID":"f866ccdf-4a23-45a3-88b4-16bb48322947","Type":"ContainerStarted","Data":"d3877217203a9b4c399830c4c7c0718954e0b37682264aadf32ea5af225676ec"}
Jul 13 20:20:23.390340 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:23.390315    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n" event={"ID":"5df96b08-2166-4b7c-b5e8-c72f6704a5b9","Type":"ContainerStarted","Data":"bc7948cf0532fa3765d8a6dc9ba6527f2324e09b19b70d44c4b2d468f686ffc8"}
Jul 13 20:20:23.391474 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:23.391448    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cr5c9" event={"ID":"1396fdd0-2cad-4bde-89d1-825a0d1b7727","Type":"ContainerStarted","Data":"e669f19a13780a8e5d64ef0cdb55c8ebd71582028158858ac148bde4d846c3dc"}
Jul 13 20:20:23.438715 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:23.438654    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6b498b7f44-rnqlq" podStartSLOduration=33.438637746 podStartE2EDuration="33.438637746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:23.435825868 +0000 UTC m=+101.170477055" watchObservedRunningTime="2026-07-13 20:20:23.438637746 +0000 UTC m=+101.173288933"
Jul 13 20:20:23.439450 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:23.439407    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-548688fdbd-hgkxc" podStartSLOduration=100.43939429 podStartE2EDuration="1m40.43939429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:18:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:23.413067818 +0000 UTC m=+101.147719010" watchObservedRunningTime="2026-07-13 20:20:23.43939429 +0000 UTC m=+101.174045480"
Jul 13 20:20:23.607542 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:23.607506    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:20:23.610754 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:23.610727    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:20:23.794146 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:23.794105    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:23.887519 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:23.887479    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:24.394929 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:24.394899    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:20:24.396133 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:24.396106    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6b498b7f44-rnqlq"
Jul 13 20:20:25.407755 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:25.407673    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n" event={"ID":"5df96b08-2166-4b7c-b5e8-c72f6704a5b9","Type":"ContainerStarted","Data":"0bb313e68d333a159ae21603bf858d032d7059d9ee6704cd8122e5bd241ed1e5"}
Jul 13 20:20:25.409492 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:25.409351    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cr5c9" event={"ID":"1396fdd0-2cad-4bde-89d1-825a0d1b7727","Type":"ContainerStarted","Data":"27be9acdcfc09a1916df226e6b7263e33630663b1f592e3e00731127d9e023cc"}
Jul 13 20:20:25.683709 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:25.683674    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:25.877870 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:25.877780    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:26.150511 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:26.150423    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:26.370405 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:26.370355    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:26.414783 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:26.414706    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cr5c9" event={"ID":"1396fdd0-2cad-4bde-89d1-825a0d1b7727","Type":"ContainerStarted","Data":"cea6595f71c53c556bf9f48a76f2ff42f5e23def9e624168427bbf3d86dd29ff"}
Jul 13 20:20:26.443111 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:26.443062    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-9wb5n" podStartSLOduration=33.809707575 podStartE2EDuration="36.443046207s" totalImagesPullingTime="2.633338632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:26.440895321 +0000 UTC m=+104.175546509" watchObservedRunningTime="2026-07-13 20:20:26.443046207 +0000 UTC m=+104.177697373"
Jul 13 20:20:26.467883 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:26.467827    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cr5c9" podStartSLOduration=65.755873946 podStartE2EDuration="1m8.467808079s" totalImagesPullingTime="2.711934133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:19:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:26.466530274 +0000 UTC m=+104.201181464" watchObservedRunningTime="2026-07-13 20:20:26.467808079 +0000 UTC m=+104.202459269"
Jul 13 20:20:26.468990 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:26.468969    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:27.418455 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:27.418422    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:20:29.302749 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:29.302718    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tzvwk"
Jul 13 20:20:30.763205 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:30.763166    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a61811b-9717-4c54-a14a-640d70479a4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:20:30.765509 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:30.765483    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a61811b-9717-4c54-a14a-640d70479a4e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ngz5s\" (UID: \"4a61811b-9717-4c54-a14a-640d70479a4e\") " pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:20:30.771210 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:30.771182    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:30.896229 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:30.896189    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:30.976844 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:30.976818    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ngz5s"
Jul 13 20:20:31.139196 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:31.139164    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ngz5s"]
Jul 13 20:20:31.142512 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:20:31.142485    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a61811b_9717_4c54_a14a_640d70479a4e.slice/crio-1388179303fb4ac916f00915875793b48f038e8d1f9b9f65f2086e2e84adbdb8 WatchSource:0}: Error finding container 1388179303fb4ac916f00915875793b48f038e8d1f9b9f65f2086e2e84adbdb8: Status 404 returned error can't find the container with id 1388179303fb4ac916f00915875793b48f038e8d1f9b9f65f2086e2e84adbdb8
Jul 13 20:20:31.432859 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:31.432829    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ngz5s" event={"ID":"4a61811b-9717-4c54-a14a-640d70479a4e","Type":"ContainerStarted","Data":"1388179303fb4ac916f00915875793b48f038e8d1f9b9f65f2086e2e84adbdb8"}
Jul 13 20:20:33.937489 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:33.937458    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:34.002563 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.002535    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:34.165734 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.165685    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:34.565471 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.565434    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f7457f4f6-8n9jd"]
Jul 13 20:20:34.568710 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.568686    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:34.572431 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.572409    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-h8fpr\""
Jul 13 20:20:34.572578 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.572449    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 13 20:20:34.572626 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.572600    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 13 20:20:34.573660 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.573599    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 13 20:20:34.573660 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.573638    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 13 20:20:34.573832 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.573664    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 13 20:20:34.573832 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.573740    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 13 20:20:34.574258 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.574093    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 13 20:20:34.577696 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.577675    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 13 20:20:34.579353 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.579333    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f7457f4f6-8n9jd"]
Jul 13 20:20:34.591165 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.591096    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/666dc6a2-1474-4ee2-bd44-04a40f700b7a-console-oauth-config\") pod \"console-f7457f4f6-8n9jd\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") " pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:34.591165 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.591159    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-oauth-serving-cert\") pod \"console-f7457f4f6-8n9jd\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") " pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:34.591396 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.591191    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-service-ca\") pod \"console-f7457f4f6-8n9jd\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") " pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:34.591396 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.591232    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-console-config\") pod \"console-f7457f4f6-8n9jd\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") " pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:34.591396 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.591273    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/666dc6a2-1474-4ee2-bd44-04a40f700b7a-console-serving-cert\") pod \"console-f7457f4f6-8n9jd\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") " pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:34.591396 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.591312    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-trusted-ca-bundle\") pod \"console-f7457f4f6-8n9jd\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") " pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:34.591396 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.591384    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlzxf\" (UniqueName: \"kubernetes.io/projected/666dc6a2-1474-4ee2-bd44-04a40f700b7a-kube-api-access-wlzxf\") pod \"console-f7457f4f6-8n9jd\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") " pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:34.692166 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.692129    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/666dc6a2-1474-4ee2-bd44-04a40f700b7a-console-serving-cert\") pod \"console-f7457f4f6-8n9jd\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") " pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:34.692337 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.692183    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-trusted-ca-bundle\") pod \"console-f7457f4f6-8n9jd\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") " pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:34.692337 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.692288    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlzxf\" (UniqueName: \"kubernetes.io/projected/666dc6a2-1474-4ee2-bd44-04a40f700b7a-kube-api-access-wlzxf\") pod \"console-f7457f4f6-8n9jd\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") " pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:34.692461 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.692382    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/666dc6a2-1474-4ee2-bd44-04a40f700b7a-console-oauth-config\") pod \"console-f7457f4f6-8n9jd\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") " pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:34.692461 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.692420    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-oauth-serving-cert\") pod \"console-f7457f4f6-8n9jd\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") " pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:34.692461 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.692435    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-service-ca\") pod \"console-f7457f4f6-8n9jd\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") " pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:34.692571 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.692466    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-console-config\") pod \"console-f7457f4f6-8n9jd\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") " pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:34.693312 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.693255    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-console-config\") pod \"console-f7457f4f6-8n9jd\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") " pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:34.693461 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.693392    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-oauth-serving-cert\") pod \"console-f7457f4f6-8n9jd\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") " pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:34.693553 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.693533    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-service-ca\") pod \"console-f7457f4f6-8n9jd\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") " pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:34.693712 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.693687    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-trusted-ca-bundle\") pod \"console-f7457f4f6-8n9jd\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") " pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:34.695009 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.694988    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/666dc6a2-1474-4ee2-bd44-04a40f700b7a-console-serving-cert\") pod \"console-f7457f4f6-8n9jd\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") " pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:34.695419 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.695397    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/666dc6a2-1474-4ee2-bd44-04a40f700b7a-console-oauth-config\") pod \"console-f7457f4f6-8n9jd\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") " pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:34.701765 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.701721    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlzxf\" (UniqueName: \"kubernetes.io/projected/666dc6a2-1474-4ee2-bd44-04a40f700b7a-kube-api-access-wlzxf\") pod \"console-f7457f4f6-8n9jd\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") " pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:34.879524 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:34.879334    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:35.027982 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:35.027950    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f7457f4f6-8n9jd"]
Jul 13 20:20:35.031514 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:20:35.031488    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod666dc6a2_1474_4ee2_bd44_04a40f700b7a.slice/crio-260d91738dcf8c6ea8842eee54017735b5912142a02003ca5448d0a4fabd204a WatchSource:0}: Error finding container 260d91738dcf8c6ea8842eee54017735b5912142a02003ca5448d0a4fabd204a: Status 404 returned error can't find the container with id 260d91738dcf8c6ea8842eee54017735b5912142a02003ca5448d0a4fabd204a
Jul 13 20:20:35.450798 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:35.450765    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f7457f4f6-8n9jd" event={"ID":"666dc6a2-1474-4ee2-bd44-04a40f700b7a","Type":"ContainerStarted","Data":"260d91738dcf8c6ea8842eee54017735b5912142a02003ca5448d0a4fabd204a"}
Jul 13 20:20:35.452423 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:35.452397    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ngz5s" event={"ID":"4a61811b-9717-4c54-a14a-640d70479a4e","Type":"ContainerStarted","Data":"c036822c6d9fe1cbc0126c62f668e0809ff55ee703ee6acd2b83960cdd42210b"}
Jul 13 20:20:35.761187 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:35.761152    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:35.861705 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:35.861671    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:36.458521 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:36.458484    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ngz5s" event={"ID":"4a61811b-9717-4c54-a14a-640d70479a4e","Type":"ContainerStarted","Data":"8f1614bb35767c7a6dc38cbfc784b6084b330d2417cd1cd5962134593e068f38"}
Jul 13 20:20:37.423446 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:37.423408    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cr5c9"
Jul 13 20:20:39.158308 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:39.158217    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:39.235293 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:39.235259    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:39.473975 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:39.473935    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ngz5s" event={"ID":"4a61811b-9717-4c54-a14a-640d70479a4e","Type":"ContainerStarted","Data":"362bff6530050bc6e3695a3b4bd04589b4e858fe26bb0284a97387d61c5a4c90"}
Jul 13 20:20:39.475465 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:39.475441    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f7457f4f6-8n9jd" event={"ID":"666dc6a2-1474-4ee2-bd44-04a40f700b7a","Type":"ContainerStarted","Data":"b95c4e64d8ee0e72d706443b6dbc12850071837e14090c8c482a1653b843d095"}
Jul 13 20:20:39.496308 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:39.496258    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ngz5s" podStartSLOduration=33.951717649 podStartE2EDuration="41.49624436s" totalImagesPullingTime="7.544526711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 20:19:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:39.495104727 +0000 UTC m=+117.229755926" watchObservedRunningTime="2026-07-13 20:20:39.49624436 +0000 UTC m=+117.230895547"
Jul 13 20:20:39.513935 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:39.513888    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f7457f4f6-8n9jd" podStartSLOduration=1.7113852939999998 podStartE2EDuration="5.513876619s" totalImagesPullingTime="3.802491325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:20:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:39.513592133 +0000 UTC m=+117.248243321" watchObservedRunningTime="2026-07-13 20:20:39.513876619 +0000 UTC m=+117.248527810"
Jul 13 20:20:42.335967 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:42.335931    2588 patch_prober.go:28] interesting pod/image-registry-548688fdbd-hgkxc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 13 20:20:42.336337 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:42.335985    2588 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-548688fdbd-hgkxc" podUID="57ac1c11-5790-4d43-9a05-5c2cfb9136db" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:20:44.399338 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:44.399312    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:20:44.801166 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:44.801132    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:44.880129 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:44.880097    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:44.880320 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:44.880160    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:44.884666 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:44.884642    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:44.895107 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:44.895075    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:45.133644 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:45.133549    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:45.499752 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:45.499726    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:20:45.575558 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:45.575526    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:45.674977 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:45.674942    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:46.667283 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:46.667211    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:46.810130 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:46.810098    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:47.167578 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.167541    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:47.448850 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.448810    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:47.655805 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.655767    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:47.725926 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.725849    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-snb66"]
Jul 13 20:20:47.730758 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.730739    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.733993 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.733971    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 13 20:20:47.734108 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.734038    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pks4v\""
Jul 13 20:20:47.734161 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.734040    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 13 20:20:47.734956 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.734943    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 13 20:20:47.735004 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.734976    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 13 20:20:47.742409 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.742384    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:47.794618 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.794585    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-548688fdbd-hgkxc"]
Jul 13 20:20:47.802921 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.802896    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba767030-9cf0-428d-acb9-50d2aa40f8b3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.803090 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.802932    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba767030-9cf0-428d-acb9-50d2aa40f8b3-root\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.803090 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.802958    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba767030-9cf0-428d-acb9-50d2aa40f8b3-node-exporter-tls\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.803090 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.803062    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba767030-9cf0-428d-acb9-50d2aa40f8b3-node-exporter-textfile\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.803245 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.803099    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba767030-9cf0-428d-acb9-50d2aa40f8b3-sys\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.803245 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.803121    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba767030-9cf0-428d-acb9-50d2aa40f8b3-node-exporter-accelerators-collector-config\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.803245 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.803176    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba767030-9cf0-428d-acb9-50d2aa40f8b3-node-exporter-wtmp\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.803245 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.803193    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8wvd\" (UniqueName: \"kubernetes.io/projected/ba767030-9cf0-428d-acb9-50d2aa40f8b3-kube-api-access-h8wvd\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.803245 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.803239    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba767030-9cf0-428d-acb9-50d2aa40f8b3-metrics-client-ca\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.834399 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.834355    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:47.898839 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.898800    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:47.904203 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.904177    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba767030-9cf0-428d-acb9-50d2aa40f8b3-node-exporter-wtmp\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.904324 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.904211    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8wvd\" (UniqueName: \"kubernetes.io/projected/ba767030-9cf0-428d-acb9-50d2aa40f8b3-kube-api-access-h8wvd\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.904324 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.904240    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba767030-9cf0-428d-acb9-50d2aa40f8b3-metrics-client-ca\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.904324 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.904271    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba767030-9cf0-428d-acb9-50d2aa40f8b3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.904324 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.904301    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba767030-9cf0-428d-acb9-50d2aa40f8b3-root\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.904324 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.904315    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba767030-9cf0-428d-acb9-50d2aa40f8b3-node-exporter-wtmp\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.904586 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.904324    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba767030-9cf0-428d-acb9-50d2aa40f8b3-node-exporter-tls\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.904586 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.904395    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba767030-9cf0-428d-acb9-50d2aa40f8b3-root\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.904586 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.904436    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba767030-9cf0-428d-acb9-50d2aa40f8b3-node-exporter-textfile\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.904586 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.904465    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba767030-9cf0-428d-acb9-50d2aa40f8b3-sys\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.904586 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.904510    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba767030-9cf0-428d-acb9-50d2aa40f8b3-node-exporter-accelerators-collector-config\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.904586 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.904523    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba767030-9cf0-428d-acb9-50d2aa40f8b3-sys\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.904857 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.904758    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba767030-9cf0-428d-acb9-50d2aa40f8b3-node-exporter-textfile\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.904926 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.904909    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba767030-9cf0-428d-acb9-50d2aa40f8b3-metrics-client-ca\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.905084 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.905061    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba767030-9cf0-428d-acb9-50d2aa40f8b3-node-exporter-accelerators-collector-config\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.906625 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.906605    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba767030-9cf0-428d-acb9-50d2aa40f8b3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.906802 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.906787    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba767030-9cf0-428d-acb9-50d2aa40f8b3-node-exporter-tls\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:47.912965 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:47.912941    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8wvd\" (UniqueName: \"kubernetes.io/projected/ba767030-9cf0-428d-acb9-50d2aa40f8b3-kube-api-access-h8wvd\") pod \"node-exporter-snb66\" (UID: \"ba767030-9cf0-428d-acb9-50d2aa40f8b3\") " pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:48.040145 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:48.040069    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-snb66"
Jul 13 20:20:48.052029 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:20:48.052003    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba767030_9cf0_428d_acb9_50d2aa40f8b3.slice/crio-8673ec4f4ade9e0513b67d54c17e7966f6f535dfd33c0f6cec47b1031d611b6a WatchSource:0}: Error finding container 8673ec4f4ade9e0513b67d54c17e7966f6f535dfd33c0f6cec47b1031d611b6a: Status 404 returned error can't find the container with id 8673ec4f4ade9e0513b67d54c17e7966f6f535dfd33c0f6cec47b1031d611b6a
Jul 13 20:20:48.475290 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:48.475256    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:48.507665 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:48.507626    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-snb66" event={"ID":"ba767030-9cf0-428d-acb9-50d2aa40f8b3","Type":"ContainerStarted","Data":"8673ec4f4ade9e0513b67d54c17e7966f6f535dfd33c0f6cec47b1031d611b6a"}
Jul 13 20:20:48.616339 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:48.616300    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:48.717708 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:48.717675    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:48.814634 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:48.814547    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:49.512785 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:49.512752    2588 generic.go:356] "Generic (PLEG): container finished" podID="ba767030-9cf0-428d-acb9-50d2aa40f8b3" containerID="607c4567a554a098ce770b6395c783d1b19032ac0e78981b3035227fe58b5f82" exitCode=0
Jul 13 20:20:49.512961 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:49.512802    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-snb66" event={"ID":"ba767030-9cf0-428d-acb9-50d2aa40f8b3","Type":"ContainerDied","Data":"607c4567a554a098ce770b6395c783d1b19032ac0e78981b3035227fe58b5f82"}
Jul 13 20:20:50.376443 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:50.376407    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:50.518470 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:50.518441    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-snb66" event={"ID":"ba767030-9cf0-428d-acb9-50d2aa40f8b3","Type":"ContainerStarted","Data":"8e9cb3d729d15884c045cbad36ee6d1c02beec7e1a7c1c2b3241b84934c20bd7"}
Jul 13 20:20:50.518633 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:50.518492    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-snb66" event={"ID":"ba767030-9cf0-428d-acb9-50d2aa40f8b3","Type":"ContainerStarted","Data":"564eab2dcd7256c6d324c382572a8430c6287e31fb4beab3750b4492e3533190"}
Jul 13 20:20:50.539723 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:50.539676    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-snb66" podStartSLOduration=2.570060574 podStartE2EDuration="3.539660433s" totalImagesPullingTime="906.496819ms" totalInitContainerRuntime="63.10304ms" isStatefulPod=true podCreationTimestamp="2026-07-13 20:20:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:50.537814859 +0000 UTC m=+128.272466048" watchObservedRunningTime="2026-07-13 20:20:50.539660433 +0000 UTC m=+128.274311621"
Jul 13 20:20:50.541537 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:50.541511    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:50.666712 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:50.666622    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:51.824661 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:51.824629    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:51.943482 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:51.943449    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:52.052241 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.052210    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"]
Jul 13 20:20:52.055328 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.055310    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.059298 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.059265    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 13 20:20:52.060564 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.060543    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-kh6tj\""
Jul 13 20:20:52.060732 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.060711    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 13 20:20:52.060799 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.060754    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-4bk8ooud2rffr\""
Jul 13 20:20:52.060857 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.060757    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 13 20:20:52.060908 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.060787    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 13 20:20:52.069866 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.069845    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"]
Jul 13 20:20:52.144559 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.144472    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppl6q\" (UniqueName: \"kubernetes.io/projected/f1515661-7acb-4f3a-8912-283e4ffe9d4d-kube-api-access-ppl6q\") pod \"metrics-server-84ffd8d8c-5mkkq\" (UID: \"f1515661-7acb-4f3a-8912-283e4ffe9d4d\") " pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.144704 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.144570    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1515661-7acb-4f3a-8912-283e4ffe9d4d-client-ca-bundle\") pod \"metrics-server-84ffd8d8c-5mkkq\" (UID: \"f1515661-7acb-4f3a-8912-283e4ffe9d4d\") " pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.144704 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.144613    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f1515661-7acb-4f3a-8912-283e4ffe9d4d-secret-metrics-server-tls\") pod \"metrics-server-84ffd8d8c-5mkkq\" (UID: \"f1515661-7acb-4f3a-8912-283e4ffe9d4d\") " pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.144704 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.144638    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f1515661-7acb-4f3a-8912-283e4ffe9d4d-metrics-server-audit-profiles\") pod \"metrics-server-84ffd8d8c-5mkkq\" (UID: \"f1515661-7acb-4f3a-8912-283e4ffe9d4d\") " pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.144868 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.144707    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f1515661-7acb-4f3a-8912-283e4ffe9d4d-audit-log\") pod \"metrics-server-84ffd8d8c-5mkkq\" (UID: \"f1515661-7acb-4f3a-8912-283e4ffe9d4d\") " pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.144868 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.144727    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f1515661-7acb-4f3a-8912-283e4ffe9d4d-secret-metrics-server-client-certs\") pod \"metrics-server-84ffd8d8c-5mkkq\" (UID: \"f1515661-7acb-4f3a-8912-283e4ffe9d4d\") " pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.144868 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.144742    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1515661-7acb-4f3a-8912-283e4ffe9d4d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84ffd8d8c-5mkkq\" (UID: \"f1515661-7acb-4f3a-8912-283e4ffe9d4d\") " pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.160953 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.160924    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-xt8l5"]
Jul 13 20:20:52.164121 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.164105    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xt8l5"
Jul 13 20:20:52.171868 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.171850    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 13 20:20:52.172885 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.172869    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rsggb\""
Jul 13 20:20:52.190024 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.190004    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-xt8l5"]
Jul 13 20:20:52.245753 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.245716    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9qgl\" (UniqueName: \"kubernetes.io/projected/387e6058-795b-42cc-8b03-2dfc356ff40e-kube-api-access-c9qgl\") pod \"monitoring-plugin-5f68df7f58-xt8l5\" (UID: \"387e6058-795b-42cc-8b03-2dfc356ff40e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xt8l5"
Jul 13 20:20:52.245933 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.245776    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1515661-7acb-4f3a-8912-283e4ffe9d4d-client-ca-bundle\") pod \"metrics-server-84ffd8d8c-5mkkq\" (UID: \"f1515661-7acb-4f3a-8912-283e4ffe9d4d\") " pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.245933 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.245802    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f1515661-7acb-4f3a-8912-283e4ffe9d4d-secret-metrics-server-tls\") pod \"metrics-server-84ffd8d8c-5mkkq\" (UID: \"f1515661-7acb-4f3a-8912-283e4ffe9d4d\") " pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.245933 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.245823    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f1515661-7acb-4f3a-8912-283e4ffe9d4d-metrics-server-audit-profiles\") pod \"metrics-server-84ffd8d8c-5mkkq\" (UID: \"f1515661-7acb-4f3a-8912-283e4ffe9d4d\") " pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.245933 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.245881    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/387e6058-795b-42cc-8b03-2dfc356ff40e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-xt8l5\" (UID: \"387e6058-795b-42cc-8b03-2dfc356ff40e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xt8l5"
Jul 13 20:20:52.245933 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.245898    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f1515661-7acb-4f3a-8912-283e4ffe9d4d-audit-log\") pod \"metrics-server-84ffd8d8c-5mkkq\" (UID: \"f1515661-7acb-4f3a-8912-283e4ffe9d4d\") " pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.245933 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.245915    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f1515661-7acb-4f3a-8912-283e4ffe9d4d-secret-metrics-server-client-certs\") pod \"metrics-server-84ffd8d8c-5mkkq\" (UID: \"f1515661-7acb-4f3a-8912-283e4ffe9d4d\") " pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.245933 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.245931    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1515661-7acb-4f3a-8912-283e4ffe9d4d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84ffd8d8c-5mkkq\" (UID: \"f1515661-7acb-4f3a-8912-283e4ffe9d4d\") " pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.246285 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.246012    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppl6q\" (UniqueName: \"kubernetes.io/projected/f1515661-7acb-4f3a-8912-283e4ffe9d4d-kube-api-access-ppl6q\") pod \"metrics-server-84ffd8d8c-5mkkq\" (UID: \"f1515661-7acb-4f3a-8912-283e4ffe9d4d\") " pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.246402 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.246352    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f1515661-7acb-4f3a-8912-283e4ffe9d4d-audit-log\") pod \"metrics-server-84ffd8d8c-5mkkq\" (UID: \"f1515661-7acb-4f3a-8912-283e4ffe9d4d\") " pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.247020 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.246990    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1515661-7acb-4f3a-8912-283e4ffe9d4d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-84ffd8d8c-5mkkq\" (UID: \"f1515661-7acb-4f3a-8912-283e4ffe9d4d\") " pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.247170 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.247147    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f1515661-7acb-4f3a-8912-283e4ffe9d4d-metrics-server-audit-profiles\") pod \"metrics-server-84ffd8d8c-5mkkq\" (UID: \"f1515661-7acb-4f3a-8912-283e4ffe9d4d\") " pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.248542 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.248519    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f1515661-7acb-4f3a-8912-283e4ffe9d4d-secret-metrics-server-client-certs\") pod \"metrics-server-84ffd8d8c-5mkkq\" (UID: \"f1515661-7acb-4f3a-8912-283e4ffe9d4d\") " pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.248542 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.248534    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f1515661-7acb-4f3a-8912-283e4ffe9d4d-secret-metrics-server-tls\") pod \"metrics-server-84ffd8d8c-5mkkq\" (UID: \"f1515661-7acb-4f3a-8912-283e4ffe9d4d\") " pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.248654 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.248543    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f1515661-7acb-4f3a-8912-283e4ffe9d4d-client-ca-bundle\") pod \"metrics-server-84ffd8d8c-5mkkq\" (UID: \"f1515661-7acb-4f3a-8912-283e4ffe9d4d\") " pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.258160 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.258142    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppl6q\" (UniqueName: \"kubernetes.io/projected/f1515661-7acb-4f3a-8912-283e4ffe9d4d-kube-api-access-ppl6q\") pod \"metrics-server-84ffd8d8c-5mkkq\" (UID: \"f1515661-7acb-4f3a-8912-283e4ffe9d4d\") " pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.346709 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.346676    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/387e6058-795b-42cc-8b03-2dfc356ff40e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-xt8l5\" (UID: \"387e6058-795b-42cc-8b03-2dfc356ff40e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xt8l5"
Jul 13 20:20:52.346846 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.346722    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9qgl\" (UniqueName: \"kubernetes.io/projected/387e6058-795b-42cc-8b03-2dfc356ff40e-kube-api-access-c9qgl\") pod \"monitoring-plugin-5f68df7f58-xt8l5\" (UID: \"387e6058-795b-42cc-8b03-2dfc356ff40e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xt8l5"
Jul 13 20:20:52.346846 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:52.346815    2588 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 13 20:20:52.346920 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:20:52.346883    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/387e6058-795b-42cc-8b03-2dfc356ff40e-monitoring-plugin-cert podName:387e6058-795b-42cc-8b03-2dfc356ff40e nodeName:}" failed. No retries permitted until 2026-07-13 20:20:52.846868997 +0000 UTC m=+130.581520164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/387e6058-795b-42cc-8b03-2dfc356ff40e-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-xt8l5" (UID: "387e6058-795b-42cc-8b03-2dfc356ff40e") : secret "monitoring-plugin-cert" not found
Jul 13 20:20:52.365574 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.365549    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:20:52.372949 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.372925    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9qgl\" (UniqueName: \"kubernetes.io/projected/387e6058-795b-42cc-8b03-2dfc356ff40e-kube-api-access-c9qgl\") pod \"monitoring-plugin-5f68df7f58-xt8l5\" (UID: \"387e6058-795b-42cc-8b03-2dfc356ff40e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xt8l5"
Jul 13 20:20:52.494856 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.494815    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"]
Jul 13 20:20:52.497466 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:20:52.497435    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1515661_7acb_4f3a_8912_283e4ffe9d4d.slice/crio-2523268aa0a1538fb0b5a01a0c7a5e54e36e2818fd67a8cd43ef327b0bfdcc79 WatchSource:0}: Error finding container 2523268aa0a1538fb0b5a01a0c7a5e54e36e2818fd67a8cd43ef327b0bfdcc79: Status 404 returned error can't find the container with id 2523268aa0a1538fb0b5a01a0c7a5e54e36e2818fd67a8cd43ef327b0bfdcc79
Jul 13 20:20:52.527167 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.527140    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq" event={"ID":"f1515661-7acb-4f3a-8912-283e4ffe9d4d","Type":"ContainerStarted","Data":"2523268aa0a1538fb0b5a01a0c7a5e54e36e2818fd67a8cd43ef327b0bfdcc79"}
Jul 13 20:20:52.549147 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.549119    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs\") pod \"network-metrics-daemon-ccnrf\" (UID: \"3c22ea6b-3598-4451-8520-e5f11a335825\") " pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:20:52.551336 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.551315    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c22ea6b-3598-4451-8520-e5f11a335825-metrics-certs\") pod \"network-metrics-daemon-ccnrf\" (UID: \"3c22ea6b-3598-4451-8520-e5f11a335825\") " pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:20:52.580499 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.580481    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-j6z4f\""
Jul 13 20:20:52.588278 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.588264    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ccnrf"
Jul 13 20:20:52.716079 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.716050    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ccnrf"]
Jul 13 20:20:52.718842 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:20:52.718810    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c22ea6b_3598_4451_8520_e5f11a335825.slice/crio-0c032a827ef2f6699367847592a9624771da0b88189c95b0ec5f1473abb51034 WatchSource:0}: Error finding container 0c032a827ef2f6699367847592a9624771da0b88189c95b0ec5f1473abb51034: Status 404 returned error can't find the container with id 0c032a827ef2f6699367847592a9624771da0b88189c95b0ec5f1473abb51034
Jul 13 20:20:52.852194 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.852161    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/387e6058-795b-42cc-8b03-2dfc356ff40e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-xt8l5\" (UID: \"387e6058-795b-42cc-8b03-2dfc356ff40e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xt8l5"
Jul 13 20:20:52.854710 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.854684    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/387e6058-795b-42cc-8b03-2dfc356ff40e-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-xt8l5\" (UID: \"387e6058-795b-42cc-8b03-2dfc356ff40e\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xt8l5"
Jul 13 20:20:52.858826 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.858768    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:52.980697 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:52.980656    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:53.072516 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.072483    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xt8l5"
Jul 13 20:20:53.218313 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.218287    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-xt8l5"]
Jul 13 20:20:53.221038 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:20:53.221008    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod387e6058_795b_42cc_8b03_2dfc356ff40e.slice/crio-da3fe74c353ccbdda4e66ce634cc9c50fd14632e8cf17688e97827274c1ed7a1 WatchSource:0}: Error finding container da3fe74c353ccbdda4e66ce634cc9c50fd14632e8cf17688e97827274c1ed7a1: Status 404 returned error can't find the container with id da3fe74c353ccbdda4e66ce634cc9c50fd14632e8cf17688e97827274c1ed7a1
Jul 13 20:20:53.532441 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.532404    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ccnrf" event={"ID":"3c22ea6b-3598-4451-8520-e5f11a335825","Type":"ContainerStarted","Data":"0c032a827ef2f6699367847592a9624771da0b88189c95b0ec5f1473abb51034"}
Jul 13 20:20:53.533682 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.533655    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xt8l5" event={"ID":"387e6058-795b-42cc-8b03-2dfc356ff40e","Type":"ContainerStarted","Data":"da3fe74c353ccbdda4e66ce634cc9c50fd14632e8cf17688e97827274c1ed7a1"}
Jul 13 20:20:53.788118 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.788040    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 20:20:53.791882 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.791854    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.796656 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.796632    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 13 20:20:53.796801 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.796632    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 13 20:20:53.797265 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.797244    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 13 20:20:53.797410 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.797316    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 13 20:20:53.797692 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.797674    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 13 20:20:53.797911 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.797895    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hx62v\""
Jul 13 20:20:53.799216 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.799195    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 13 20:20:53.799733 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.799716    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 13 20:20:53.803436 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.803337    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 13 20:20:53.803953 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.803733    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 13 20:20:53.807076 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.804299    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 13 20:20:53.807076 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.804676    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 13 20:20:53.807076 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.805070    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bhe00vb3aem2u\""
Jul 13 20:20:53.807076 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.805391    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 13 20:20:53.807833 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.807668    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 13 20:20:53.814274 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.814254    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 13 20:20:53.830648 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.830595    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 20:20:53.831723 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.831687    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:53.862305 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.862261    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvvsg\" (UniqueName: \"kubernetes.io/projected/18f2f29f-fa1d-48dc-97ea-0dc379784bab-kube-api-access-rvvsg\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.862790 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.862311    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.862790 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.862344    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18f2f29f-fa1d-48dc-97ea-0dc379784bab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.862790 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.862381    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18f2f29f-fa1d-48dc-97ea-0dc379784bab-config-out\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.862790 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.862406    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/18f2f29f-fa1d-48dc-97ea-0dc379784bab-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.862790 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.862446    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18f2f29f-fa1d-48dc-97ea-0dc379784bab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.862790 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.862474    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.862790 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.862498    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18f2f29f-fa1d-48dc-97ea-0dc379784bab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.862790 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.862528    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.862790 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.862548    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/18f2f29f-fa1d-48dc-97ea-0dc379784bab-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.862790 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.862636    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18f2f29f-fa1d-48dc-97ea-0dc379784bab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.862790 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.862702    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-web-config\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.862790 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.862763    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18f2f29f-fa1d-48dc-97ea-0dc379784bab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.862790 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.862793    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.863349 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.862853    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.863349 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.862896    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/18f2f29f-fa1d-48dc-97ea-0dc379784bab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.863349 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.862916    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.863349 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.862939    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-config\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.863349 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.862989    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/18f2f29f-fa1d-48dc-97ea-0dc379784bab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.863349 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.863016    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.964031 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.963635    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-web-config\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.964031 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.963693    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18f2f29f-fa1d-48dc-97ea-0dc379784bab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.964031 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.963724    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.964031 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.963760    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.964031 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.963783    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/18f2f29f-fa1d-48dc-97ea-0dc379784bab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.964031 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.963806    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.964031 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.963831    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-config\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.964031 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.963863    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/18f2f29f-fa1d-48dc-97ea-0dc379784bab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.964031 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.963895    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.964031 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.963926    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvvsg\" (UniqueName: \"kubernetes.io/projected/18f2f29f-fa1d-48dc-97ea-0dc379784bab-kube-api-access-rvvsg\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.964031 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.963952    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.964031 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.963978    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18f2f29f-fa1d-48dc-97ea-0dc379784bab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.964031 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.963999    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18f2f29f-fa1d-48dc-97ea-0dc379784bab-config-out\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.964031 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.964022    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/18f2f29f-fa1d-48dc-97ea-0dc379784bab-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.964789 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.964061    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18f2f29f-fa1d-48dc-97ea-0dc379784bab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.964789 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.964090    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.964789 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.964113    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18f2f29f-fa1d-48dc-97ea-0dc379784bab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.964789 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.964146    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.964789 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.964188    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/18f2f29f-fa1d-48dc-97ea-0dc379784bab-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.964789 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.964224    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18f2f29f-fa1d-48dc-97ea-0dc379784bab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.964789 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.964515    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18f2f29f-fa1d-48dc-97ea-0dc379784bab-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.965129 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.964895    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18f2f29f-fa1d-48dc-97ea-0dc379784bab-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.965732 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.965709    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18f2f29f-fa1d-48dc-97ea-0dc379784bab-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.966868 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.966839    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/18f2f29f-fa1d-48dc-97ea-0dc379784bab-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.968409 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.968384    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/18f2f29f-fa1d-48dc-97ea-0dc379784bab-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.968760 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.968733    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18f2f29f-fa1d-48dc-97ea-0dc379784bab-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.968827 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.968786    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/18f2f29f-fa1d-48dc-97ea-0dc379784bab-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.969182 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.969160    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-config\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.969666 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.969260    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/18f2f29f-fa1d-48dc-97ea-0dc379784bab-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.969666 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.969569    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.970191 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.970169    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.970640 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.970617    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.972987 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.972963    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.973602 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.973561    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/18f2f29f-fa1d-48dc-97ea-0dc379784bab-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.973780 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.973756    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.973840 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.973766    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.974030 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.973896    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-web-config\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.974030 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.973943    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/18f2f29f-fa1d-48dc-97ea-0dc379784bab-config-out\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.974955 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.974925    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/18f2f29f-fa1d-48dc-97ea-0dc379784bab-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:53.979012 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:53.978990    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvvsg\" (UniqueName: \"kubernetes.io/projected/18f2f29f-fa1d-48dc-97ea-0dc379784bab-kube-api-access-rvvsg\") pod \"prometheus-k8s-0\" (UID: \"18f2f29f-fa1d-48dc-97ea-0dc379784bab\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:54.111682 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:54.111304    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:20:54.224732 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:54.224616    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:54.287498 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:54.287472    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 13 20:20:54.290504 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:20:54.290476    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18f2f29f_fa1d_48dc_97ea_0dc379784bab.slice/crio-bbaf9cc0c0fc8c61923780014ce42b15587d1f6f6fee824e10bc6d09e014b1cb WatchSource:0}: Error finding container bbaf9cc0c0fc8c61923780014ce42b15587d1f6f6fee824e10bc6d09e014b1cb: Status 404 returned error can't find the container with id bbaf9cc0c0fc8c61923780014ce42b15587d1f6f6fee824e10bc6d09e014b1cb
Jul 13 20:20:54.326599 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:54.326514    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:54.540358 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:54.540317    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq" event={"ID":"f1515661-7acb-4f3a-8912-283e4ffe9d4d","Type":"ContainerStarted","Data":"6cecb24e620643acd541df78ced1df49a968157f9731c661eb212ed9db74161a"}
Jul 13 20:20:54.542638 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:54.542608    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ccnrf" event={"ID":"3c22ea6b-3598-4451-8520-e5f11a335825","Type":"ContainerStarted","Data":"495bd6eb5144f0fb526f4f6fabd66b99f4e27a5270dbe247d658a45949d9a7ed"}
Jul 13 20:20:54.542756 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:54.542658    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ccnrf" event={"ID":"3c22ea6b-3598-4451-8520-e5f11a335825","Type":"ContainerStarted","Data":"c08fff2c17ee99a4536f5f21c3407e8b0bc23951c3319317a35f35ec43075715"}
Jul 13 20:20:54.544166 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:54.544136    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18f2f29f-fa1d-48dc-97ea-0dc379784bab","Type":"ContainerStarted","Data":"bbaf9cc0c0fc8c61923780014ce42b15587d1f6f6fee824e10bc6d09e014b1cb"}
Jul 13 20:20:54.561187 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:54.561131    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq" podStartSLOduration=1.120420179 podStartE2EDuration="2.561111908s" totalImagesPullingTime="1.440691729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:54.559560927 +0000 UTC m=+132.294212116" watchObservedRunningTime="2026-07-13 20:20:54.561111908 +0000 UTC m=+132.295763161"
Jul 13 20:20:54.577061 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:54.576917    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ccnrf" podStartSLOduration=130.354987917 podStartE2EDuration="2m11.57689761s" totalImagesPullingTime="1.221909693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:18:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:54.576028595 +0000 UTC m=+132.310679783" watchObservedRunningTime="2026-07-13 20:20:54.57689761 +0000 UTC m=+132.311548799"
Jul 13 20:20:54.743049 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:54.743014    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:54.843808 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:54.843766    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:55.552025 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:55.551997    2588 generic.go:356] "Generic (PLEG): container finished" podID="18f2f29f-fa1d-48dc-97ea-0dc379784bab" containerID="229ae7c998cda9b87b17f8274bc329d8d6dba0c0505400330690e18c06d9c6d5" exitCode=0
Jul 13 20:20:55.552424 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:55.552077    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18f2f29f-fa1d-48dc-97ea-0dc379784bab","Type":"ContainerDied","Data":"229ae7c998cda9b87b17f8274bc329d8d6dba0c0505400330690e18c06d9c6d5"}
Jul 13 20:20:55.553649 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:55.553617    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xt8l5" event={"ID":"387e6058-795b-42cc-8b03-2dfc356ff40e","Type":"ContainerStarted","Data":"0e1dcacdeabf81ad883bdc2cc13185699e1a9d36b468880be918df93f6a73e29"}
Jul 13 20:20:55.614827 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:55.614791    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:55.750298 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:55.750220    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:56.558475 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:56.558420    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xt8l5"
Jul 13 20:20:56.563872 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:56.563847    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xt8l5"
Jul 13 20:20:56.582482 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:56.582428    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-xt8l5" podStartSLOduration=3.027827346 podStartE2EDuration="4.582408798s" totalImagesPullingTime="1.554581452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:20:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:20:55.606052035 +0000 UTC m=+133.340703224" watchObservedRunningTime="2026-07-13 20:20:56.582408798 +0000 UTC m=+134.317059988"
Jul 13 20:20:58.197692 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:58.197653    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:58.292480 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:58.292446    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:20:58.570043 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:58.570010    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18f2f29f-fa1d-48dc-97ea-0dc379784bab","Type":"ContainerStarted","Data":"18708f4c50ef7a3e73aa1b98867a7b63e67b22ebd5401124c4cc1b4c56885ac8"}
Jul 13 20:20:58.570225 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:20:58.570078    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18f2f29f-fa1d-48dc-97ea-0dc379784bab","Type":"ContainerStarted","Data":"8801cf3214f842166a302001e200317a57630ecf758247f20a40edb9a48be28d"}
Jul 13 20:21:00.581063 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:00.580978    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18f2f29f-fa1d-48dc-97ea-0dc379784bab","Type":"ContainerStarted","Data":"ffc699b294755d000d371b5239fd42cf1c6a28130e48ff3cafb7068dc947d682"}
Jul 13 20:21:00.581063 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:00.581043    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18f2f29f-fa1d-48dc-97ea-0dc379784bab","Type":"ContainerStarted","Data":"e386065732e80819853e08923b14f8c193f44d25874ca3689699531a2627c9b3"}
Jul 13 20:21:00.581582 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:00.581070    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18f2f29f-fa1d-48dc-97ea-0dc379784bab","Type":"ContainerStarted","Data":"2154b68b0d6f89dc242d3eaac7ad143fe3b3e8e52d12de5315b1e385d947731f"}
Jul 13 20:21:00.581582 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:00.581096    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"18f2f29f-fa1d-48dc-97ea-0dc379784bab","Type":"ContainerStarted","Data":"10cc1bdde46e3cc8fae2ac18c6657df82b826c3f3b95d198cb931cb332cc9c7a"}
Jul 13 20:21:00.612569 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:00.612511    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.924872017 podStartE2EDuration="7.612487699s" totalImagesPullingTime="5.673566952s" totalInitContainerRuntime="14.04873ms" isStatefulPod=false podCreationTimestamp="2026-07-13 20:20:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:21:00.610865889 +0000 UTC m=+138.345517076" watchObservedRunningTime="2026-07-13 20:21:00.612487699 +0000 UTC m=+138.347138916"
Jul 13 20:21:01.693204 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:01.693162    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:21:01.826057 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:01.826010    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:21:02.589347 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:02.589314    2588 generic.go:356] "Generic (PLEG): container finished" podID="a400225c-4a8a-41ca-800a-d101a9e6efff" containerID="2e720f7f788644e540872bba0fdc2ab2e9c271561e5ac831d340687d04ee92d5" exitCode=0
Jul 13 20:21:02.589564 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:02.589384    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-65kk8" event={"ID":"a400225c-4a8a-41ca-800a-d101a9e6efff","Type":"ContainerDied","Data":"2e720f7f788644e540872bba0fdc2ab2e9c271561e5ac831d340687d04ee92d5"}
Jul 13 20:21:02.589738 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:02.589724    2588 scope.go:117] "RemoveContainer" containerID="2e720f7f788644e540872bba0fdc2ab2e9c271561e5ac831d340687d04ee92d5"
Jul 13 20:21:03.029232 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:03.029194    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f7457f4f6-8n9jd"]
Jul 13 20:21:03.169850 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:03.169815    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:21:03.268598 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:03.268555    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:21:03.336509 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:03.336418    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:21:03.595158 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:03.595075    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-65kk8" event={"ID":"a400225c-4a8a-41ca-800a-d101a9e6efff","Type":"ContainerStarted","Data":"a2fb26173e5d37c292f7770022f3c8736a97f2a0a038eb1c40ec084780deed60"}
Jul 13 20:21:04.112254 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:04.112217    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:21:06.418157 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:06.418124    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:21:06.519243 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:06.519215    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:21:06.596350 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:06.596320    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:21:07.618916 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:07.618827    2588 generic.go:356] "Generic (PLEG): container finished" podID="061095eb-9b43-4331-9155-8dfab3aa3741" containerID="c133f9f2684efae122c459b890ea8ea54abed276d927bf6399470f1058f57d09" exitCode=0
Jul 13 20:21:07.618916 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:07.618871    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rd8jg" event={"ID":"061095eb-9b43-4331-9155-8dfab3aa3741","Type":"ContainerDied","Data":"c133f9f2684efae122c459b890ea8ea54abed276d927bf6399470f1058f57d09"}
Jul 13 20:21:07.619353 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:07.619187    2588 scope.go:117] "RemoveContainer" containerID="c133f9f2684efae122c459b890ea8ea54abed276d927bf6399470f1058f57d09"
Jul 13 20:21:08.624584 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:08.624550    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-rd8jg" event={"ID":"061095eb-9b43-4331-9155-8dfab3aa3741","Type":"ContainerStarted","Data":"7c80b1b0d864c88b8fec2a99bdef7e3c5ca5b1cc13f813d89dfdab4e5e36e66d"}
Jul 13 20:21:09.065007 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:09.064976    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:21:12.366613 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:12.366570    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:21:12.367011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:12.366635    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:21:12.814600 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:12.814545    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-548688fdbd-hgkxc" podUID="57ac1c11-5790-4d43-9a05-5c2cfb9136db" containerName="registry" containerID="cri-o://d2ef39c8bf0765358c699767bc21c881901f022bb3625fbea92903a5ec3d8709" gracePeriod=30
Jul 13 20:21:13.054430 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.054407    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:21:13.135445 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.135339    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znw8g\" (UniqueName: \"kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-kube-api-access-znw8g\") pod \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") "
Jul 13 20:21:13.135445 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.135407    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/57ac1c11-5790-4d43-9a05-5c2cfb9136db-ca-trust-extracted\") pod \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") "
Jul 13 20:21:13.135445 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.135434    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/57ac1c11-5790-4d43-9a05-5c2cfb9136db-installation-pull-secrets\") pod \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") "
Jul 13 20:21:13.135700 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.135469    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-bound-sa-token\") pod \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") "
Jul 13 20:21:13.135700 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.135500    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/57ac1c11-5790-4d43-9a05-5c2cfb9136db-image-registry-private-configuration\") pod \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") "
Jul 13 20:21:13.135700 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.135548    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls\") pod \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") "
Jul 13 20:21:13.135700 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.135591    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/57ac1c11-5790-4d43-9a05-5c2cfb9136db-trusted-ca\") pod \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") "
Jul 13 20:21:13.135700 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.135615    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-certificates\") pod \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\" (UID: \"57ac1c11-5790-4d43-9a05-5c2cfb9136db\") "
Jul 13 20:21:13.136558 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.136496    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57ac1c11-5790-4d43-9a05-5c2cfb9136db-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "57ac1c11-5790-4d43-9a05-5c2cfb9136db" (UID: "57ac1c11-5790-4d43-9a05-5c2cfb9136db"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:21:13.136558 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.136555    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "57ac1c11-5790-4d43-9a05-5c2cfb9136db" (UID: "57ac1c11-5790-4d43-9a05-5c2cfb9136db"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:21:13.138478 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.138419    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-kube-api-access-znw8g" (OuterVolumeSpecName: "kube-api-access-znw8g") pod "57ac1c11-5790-4d43-9a05-5c2cfb9136db" (UID: "57ac1c11-5790-4d43-9a05-5c2cfb9136db"). InnerVolumeSpecName "kube-api-access-znw8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:21:13.138478 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.138434    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57ac1c11-5790-4d43-9a05-5c2cfb9136db-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "57ac1c11-5790-4d43-9a05-5c2cfb9136db" (UID: "57ac1c11-5790-4d43-9a05-5c2cfb9136db"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 20:21:13.138643 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.138473    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "57ac1c11-5790-4d43-9a05-5c2cfb9136db" (UID: "57ac1c11-5790-4d43-9a05-5c2cfb9136db"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:21:13.138643 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.138498    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "57ac1c11-5790-4d43-9a05-5c2cfb9136db" (UID: "57ac1c11-5790-4d43-9a05-5c2cfb9136db"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:21:13.138643 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.138498    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/57ac1c11-5790-4d43-9a05-5c2cfb9136db-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "57ac1c11-5790-4d43-9a05-5c2cfb9136db" (UID: "57ac1c11-5790-4d43-9a05-5c2cfb9136db"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 20:21:13.144610 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.144586    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57ac1c11-5790-4d43-9a05-5c2cfb9136db-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "57ac1c11-5790-4d43-9a05-5c2cfb9136db" (UID: "57ac1c11-5790-4d43-9a05-5c2cfb9136db"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 20:21:13.196016 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.195986    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:21:13.236707 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.236684    2588 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/57ac1c11-5790-4d43-9a05-5c2cfb9136db-ca-trust-extracted\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:21:13.236800 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.236707    2588 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/57ac1c11-5790-4d43-9a05-5c2cfb9136db-installation-pull-secrets\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:21:13.236800 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.236721    2588 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-bound-sa-token\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:21:13.236800 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.236731    2588 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/57ac1c11-5790-4d43-9a05-5c2cfb9136db-image-registry-private-configuration\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:21:13.236800 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.236739    2588 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-tls\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:21:13.236800 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.236747    2588 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/57ac1c11-5790-4d43-9a05-5c2cfb9136db-trusted-ca\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:21:13.236800 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.236754    2588 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/57ac1c11-5790-4d43-9a05-5c2cfb9136db-registry-certificates\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:21:13.236800 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.236762    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znw8g\" (UniqueName: \"kubernetes.io/projected/57ac1c11-5790-4d43-9a05-5c2cfb9136db-kube-api-access-znw8g\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:21:13.296871 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.296838    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:21:13.643945 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.643912    2588 generic.go:356] "Generic (PLEG): container finished" podID="57ac1c11-5790-4d43-9a05-5c2cfb9136db" containerID="d2ef39c8bf0765358c699767bc21c881901f022bb3625fbea92903a5ec3d8709" exitCode=0
Jul 13 20:21:13.644306 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.643955    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-548688fdbd-hgkxc"
Jul 13 20:21:13.644306 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.643991    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-548688fdbd-hgkxc" event={"ID":"57ac1c11-5790-4d43-9a05-5c2cfb9136db","Type":"ContainerDied","Data":"d2ef39c8bf0765358c699767bc21c881901f022bb3625fbea92903a5ec3d8709"}
Jul 13 20:21:13.644306 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.644038    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-548688fdbd-hgkxc" event={"ID":"57ac1c11-5790-4d43-9a05-5c2cfb9136db","Type":"ContainerDied","Data":"85e90d31da4494180d27a13a51122e8399b6946d88ce39373266d1fc3b3fbee5"}
Jul 13 20:21:13.644306 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.644059    2588 scope.go:117] "RemoveContainer" containerID="d2ef39c8bf0765358c699767bc21c881901f022bb3625fbea92903a5ec3d8709"
Jul 13 20:21:13.652918 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.652901    2588 scope.go:117] "RemoveContainer" containerID="d2ef39c8bf0765358c699767bc21c881901f022bb3625fbea92903a5ec3d8709"
Jul 13 20:21:13.653190 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:21:13.653170    2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2ef39c8bf0765358c699767bc21c881901f022bb3625fbea92903a5ec3d8709\": container with ID starting with d2ef39c8bf0765358c699767bc21c881901f022bb3625fbea92903a5ec3d8709 not found: ID does not exist" containerID="d2ef39c8bf0765358c699767bc21c881901f022bb3625fbea92903a5ec3d8709"
Jul 13 20:21:13.653256 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.653198    2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2ef39c8bf0765358c699767bc21c881901f022bb3625fbea92903a5ec3d8709"} err="failed to get container status \"d2ef39c8bf0765358c699767bc21c881901f022bb3625fbea92903a5ec3d8709\": rpc error: code = NotFound desc = could not find container \"d2ef39c8bf0765358c699767bc21c881901f022bb3625fbea92903a5ec3d8709\": container with ID starting with d2ef39c8bf0765358c699767bc21c881901f022bb3625fbea92903a5ec3d8709 not found: ID does not exist"
Jul 13 20:21:13.668261 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.668233    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-548688fdbd-hgkxc"]
Jul 13 20:21:13.672608 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:13.672580    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-548688fdbd-hgkxc"]
Jul 13 20:21:14.969876 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:14.969841    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57ac1c11-5790-4d43-9a05-5c2cfb9136db" path="/var/lib/kubelet/pods/57ac1c11-5790-4d43-9a05-5c2cfb9136db/volumes"
Jul 13 20:21:18.665569 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:18.665535    2588 generic.go:356] "Generic (PLEG): container finished" podID="6a0ae10a-1565-4d86-92c0-f15d523042b9" containerID="e904c420a3a4a22ed9ceab2552248b64a5a56a483931583e07b01688686a104b" exitCode=0
Jul 13 20:21:18.665954 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:18.665600    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-t45cw" event={"ID":"6a0ae10a-1565-4d86-92c0-f15d523042b9","Type":"ContainerDied","Data":"e904c420a3a4a22ed9ceab2552248b64a5a56a483931583e07b01688686a104b"}
Jul 13 20:21:18.665954 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:18.665910    2588 scope.go:117] "RemoveContainer" containerID="e904c420a3a4a22ed9ceab2552248b64a5a56a483931583e07b01688686a104b"
Jul 13 20:21:19.670998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:19.670965    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-t45cw" event={"ID":"6a0ae10a-1565-4d86-92c0-f15d523042b9","Type":"ContainerStarted","Data":"1ec45fedb7b9d12f38f8b670eb8927636e06e64332aedf0f8b20120ff2d62a28"}
Jul 13 20:21:28.051807 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.051764    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f7457f4f6-8n9jd" podUID="666dc6a2-1474-4ee2-bd44-04a40f700b7a" containerName="console" containerID="cri-o://b95c4e64d8ee0e72d706443b6dbc12850071837e14090c8c482a1653b843d095" gracePeriod=15
Jul 13 20:21:28.192109 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.192069    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:21:28.293006 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.292976    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:21:28.300386 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.300352    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:21:28.363423 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.363331    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-trusted-ca-bundle\") pod \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") "
Jul 13 20:21:28.363423 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.363394    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/666dc6a2-1474-4ee2-bd44-04a40f700b7a-console-oauth-config\") pod \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") "
Jul 13 20:21:28.363684 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.363426    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-service-ca\") pod \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") "
Jul 13 20:21:28.363684 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.363464    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-console-config\") pod \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") "
Jul 13 20:21:28.363684 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.363508    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/666dc6a2-1474-4ee2-bd44-04a40f700b7a-console-serving-cert\") pod \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") "
Jul 13 20:21:28.363684 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.363553    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-oauth-serving-cert\") pod \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") "
Jul 13 20:21:28.363684 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.363581    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlzxf\" (UniqueName: \"kubernetes.io/projected/666dc6a2-1474-4ee2-bd44-04a40f700b7a-kube-api-access-wlzxf\") pod \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\" (UID: \"666dc6a2-1474-4ee2-bd44-04a40f700b7a\") "
Jul 13 20:21:28.363930 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.363897    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "666dc6a2-1474-4ee2-bd44-04a40f700b7a" (UID: "666dc6a2-1474-4ee2-bd44-04a40f700b7a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:21:28.363974 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.363956    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-service-ca" (OuterVolumeSpecName: "service-ca") pod "666dc6a2-1474-4ee2-bd44-04a40f700b7a" (UID: "666dc6a2-1474-4ee2-bd44-04a40f700b7a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:21:28.364009 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.363964    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-console-config" (OuterVolumeSpecName: "console-config") pod "666dc6a2-1474-4ee2-bd44-04a40f700b7a" (UID: "666dc6a2-1474-4ee2-bd44-04a40f700b7a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:21:28.364042 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.364012    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "666dc6a2-1474-4ee2-bd44-04a40f700b7a" (UID: "666dc6a2-1474-4ee2-bd44-04a40f700b7a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:21:28.365819 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.365788    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/666dc6a2-1474-4ee2-bd44-04a40f700b7a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "666dc6a2-1474-4ee2-bd44-04a40f700b7a" (UID: "666dc6a2-1474-4ee2-bd44-04a40f700b7a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 20:21:28.365945 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.365842    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/666dc6a2-1474-4ee2-bd44-04a40f700b7a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "666dc6a2-1474-4ee2-bd44-04a40f700b7a" (UID: "666dc6a2-1474-4ee2-bd44-04a40f700b7a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 20:21:28.365945 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.365846    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/666dc6a2-1474-4ee2-bd44-04a40f700b7a-kube-api-access-wlzxf" (OuterVolumeSpecName: "kube-api-access-wlzxf") pod "666dc6a2-1474-4ee2-bd44-04a40f700b7a" (UID: "666dc6a2-1474-4ee2-bd44-04a40f700b7a"). InnerVolumeSpecName "kube-api-access-wlzxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 20:21:28.465116 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.465079    2588 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-trusted-ca-bundle\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:21:28.465116 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.465108    2588 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/666dc6a2-1474-4ee2-bd44-04a40f700b7a-console-oauth-config\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:21:28.465116 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.465119    2588 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-service-ca\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:21:28.465116 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.465128    2588 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-console-config\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:21:28.465425 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.465137    2588 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/666dc6a2-1474-4ee2-bd44-04a40f700b7a-console-serving-cert\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:21:28.465425 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.465145    2588 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/666dc6a2-1474-4ee2-bd44-04a40f700b7a-oauth-serving-cert\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:21:28.465425 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.465153    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlzxf\" (UniqueName: \"kubernetes.io/projected/666dc6a2-1474-4ee2-bd44-04a40f700b7a-kube-api-access-wlzxf\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:21:28.704859 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.704820    2588 generic.go:356] "Generic (PLEG): container finished" podID="666dc6a2-1474-4ee2-bd44-04a40f700b7a" containerID="b95c4e64d8ee0e72d706443b6dbc12850071837e14090c8c482a1653b843d095" exitCode=0
Jul 13 20:21:28.705010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.704870    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f7457f4f6-8n9jd"
Jul 13 20:21:28.705010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.704880    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f7457f4f6-8n9jd" event={"ID":"666dc6a2-1474-4ee2-bd44-04a40f700b7a","Type":"ContainerDied","Data":"b95c4e64d8ee0e72d706443b6dbc12850071837e14090c8c482a1653b843d095"}
Jul 13 20:21:28.705010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.704929    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f7457f4f6-8n9jd" event={"ID":"666dc6a2-1474-4ee2-bd44-04a40f700b7a","Type":"ContainerDied","Data":"260d91738dcf8c6ea8842eee54017735b5912142a02003ca5448d0a4fabd204a"}
Jul 13 20:21:28.705010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.704955    2588 scope.go:117] "RemoveContainer" containerID="b95c4e64d8ee0e72d706443b6dbc12850071837e14090c8c482a1653b843d095"
Jul 13 20:21:28.715731 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.715701    2588 scope.go:117] "RemoveContainer" containerID="b95c4e64d8ee0e72d706443b6dbc12850071837e14090c8c482a1653b843d095"
Jul 13 20:21:28.716023 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:21:28.715994    2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b95c4e64d8ee0e72d706443b6dbc12850071837e14090c8c482a1653b843d095\": container with ID starting with b95c4e64d8ee0e72d706443b6dbc12850071837e14090c8c482a1653b843d095 not found: ID does not exist" containerID="b95c4e64d8ee0e72d706443b6dbc12850071837e14090c8c482a1653b843d095"
Jul 13 20:21:28.716092 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.716032    2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b95c4e64d8ee0e72d706443b6dbc12850071837e14090c8c482a1653b843d095"} err="failed to get container status \"b95c4e64d8ee0e72d706443b6dbc12850071837e14090c8c482a1653b843d095\": rpc error: code = NotFound desc = could not find container \"b95c4e64d8ee0e72d706443b6dbc12850071837e14090c8c482a1653b843d095\": container with ID starting with b95c4e64d8ee0e72d706443b6dbc12850071837e14090c8c482a1653b843d095 not found: ID does not exist"
Jul 13 20:21:28.730669 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.730639    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f7457f4f6-8n9jd"]
Jul 13 20:21:28.734580 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.734559    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f7457f4f6-8n9jd"]
Jul 13 20:21:28.969336 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:28.969242    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="666dc6a2-1474-4ee2-bd44-04a40f700b7a" path="/var/lib/kubelet/pods/666dc6a2-1474-4ee2-bd44-04a40f700b7a/volumes"
Jul 13 20:21:32.372068 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:32.372034    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:21:32.379433 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:32.379405    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-84ffd8d8c-5mkkq"
Jul 13 20:21:45.988279 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:45.988238    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:21:46.048776 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:46.048742    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:21:54.112491 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:54.112459    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:21:54.128110 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:54.128084    2588 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:21:54.823917 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:21:54.823883    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 13 20:22:06.699499 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:22:06.699464    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:22:06.994411 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:22:06.994300    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:22:16.067105 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:22:16.067062    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:22:16.166814 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:22:16.166775    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:22:17.016820 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:22:17.016780    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:22:17.122739 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:22:17.122699    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:22:21.976496 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:22:21.976465    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:22:22.055534 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:22:22.055498    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:22:26.542627 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:22:26.542589    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:22:27.021163 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:22:27.021122    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:22:27.121232 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:22:27.121199    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:22:33.855847 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:22:33.855813    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:22:33.937181 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:22:33.937148    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:22:37.530065 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:22:37.530028    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:22:37.631520 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:22:37.631481    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:22:37.732498 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:22:37.732462    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:22:43.255496 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:22:43.255458    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:22:43.352451 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:22:43.352410    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:22:43.456667 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:22:43.456628    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:22:49.585748 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:22:49.585704    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:22:49.651460 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:22:49.651418    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:23:00.151238 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:23:00.151194    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:23:42.690958 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:23:42.690930    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 20:23:42.697402 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:23:42.697350    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 20:23:42.698111 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:23:42.698091    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 20:23:42.701914 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:23:42.701896    2588 kubelet.go:1648] "Image garbage collection succeeded"
Jul 13 20:23:42.710920 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:23:42.710900    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 20:23:57.917339 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:23:57.917299    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:23:58.017277 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:23:58.017241    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:23:58.261703 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:23:58.261666    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:23:58.360896 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:23:58.360846    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:23:58.463428 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:23:58.463389    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:24:20.930692 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:20.930657    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:24:22.295570 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:22.295535    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:24:27.403928 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:27.403889    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:24:27.684811 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:27.684777    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:24:27.813636 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:27.813596    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:24:27.906637 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:27.906606    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:24:28.260910 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.260870    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:24:28.484485 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.484445    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:24:28.484997 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.484977    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-9hdm4"]
Jul 13 20:24:28.485274 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.485261    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="666dc6a2-1474-4ee2-bd44-04a40f700b7a" containerName="console"
Jul 13 20:24:28.485318 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.485274    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="666dc6a2-1474-4ee2-bd44-04a40f700b7a" containerName="console"
Jul 13 20:24:28.485318 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.485288    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57ac1c11-5790-4d43-9a05-5c2cfb9136db" containerName="registry"
Jul 13 20:24:28.485318 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.485293    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="57ac1c11-5790-4d43-9a05-5c2cfb9136db" containerName="registry"
Jul 13 20:24:28.485448 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.485343    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="57ac1c11-5790-4d43-9a05-5c2cfb9136db" containerName="registry"
Jul 13 20:24:28.485448 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.485356    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="666dc6a2-1474-4ee2-bd44-04a40f700b7a" containerName="console"
Jul 13 20:24:28.488280 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.488262    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-9hdm4"
Jul 13 20:24:28.493963 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.493938    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 13 20:24:28.495329 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.495310    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-qzpk6\""
Jul 13 20:24:28.495445 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.495325    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 13 20:24:28.495445 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.495310    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Jul 13 20:24:28.495445 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.495396    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 13 20:24:28.502260 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.502238    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-9hdm4"]
Jul 13 20:24:28.578854 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.578759    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:24:28.607178 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.607152    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d2aab920-7240-4703-8030-46a303a6b37d-certificates\") pod \"keda-admission-56f9798bb4-9hdm4\" (UID: \"d2aab920-7240-4703-8030-46a303a6b37d\") " pod="openshift-keda/keda-admission-56f9798bb4-9hdm4"
Jul 13 20:24:28.607331 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.607203    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb6lk\" (UniqueName: \"kubernetes.io/projected/d2aab920-7240-4703-8030-46a303a6b37d-kube-api-access-fb6lk\") pod \"keda-admission-56f9798bb4-9hdm4\" (UID: \"d2aab920-7240-4703-8030-46a303a6b37d\") " pod="openshift-keda/keda-admission-56f9798bb4-9hdm4"
Jul 13 20:24:28.684988 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.684959    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:24:28.708042 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.708009    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d2aab920-7240-4703-8030-46a303a6b37d-certificates\") pod \"keda-admission-56f9798bb4-9hdm4\" (UID: \"d2aab920-7240-4703-8030-46a303a6b37d\") " pod="openshift-keda/keda-admission-56f9798bb4-9hdm4"
Jul 13 20:24:28.708178 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.708072    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb6lk\" (UniqueName: \"kubernetes.io/projected/d2aab920-7240-4703-8030-46a303a6b37d-kube-api-access-fb6lk\") pod \"keda-admission-56f9798bb4-9hdm4\" (UID: \"d2aab920-7240-4703-8030-46a303a6b37d\") " pod="openshift-keda/keda-admission-56f9798bb4-9hdm4"
Jul 13 20:24:28.710397 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.710377    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d2aab920-7240-4703-8030-46a303a6b37d-certificates\") pod \"keda-admission-56f9798bb4-9hdm4\" (UID: \"d2aab920-7240-4703-8030-46a303a6b37d\") " pod="openshift-keda/keda-admission-56f9798bb4-9hdm4"
Jul 13 20:24:28.719025 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.719003    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb6lk\" (UniqueName: \"kubernetes.io/projected/d2aab920-7240-4703-8030-46a303a6b37d-kube-api-access-fb6lk\") pod \"keda-admission-56f9798bb4-9hdm4\" (UID: \"d2aab920-7240-4703-8030-46a303a6b37d\") " pod="openshift-keda/keda-admission-56f9798bb4-9hdm4"
Jul 13 20:24:28.798500 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.798462    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-9hdm4"
Jul 13 20:24:28.883735 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.883673    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:24:28.926822 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.926798    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-9hdm4"]
Jul 13 20:24:28.929239 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:24:28.929215    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2aab920_7240_4703_8030_46a303a6b37d.slice/crio-49c184f2a8e800cf4a3d7b08f8122df37f56c66498e9f6e5d1dbc15682e9bfcf WatchSource:0}: Error finding container 49c184f2a8e800cf4a3d7b08f8122df37f56c66498e9f6e5d1dbc15682e9bfcf: Status 404 returned error can't find the container with id 49c184f2a8e800cf4a3d7b08f8122df37f56c66498e9f6e5d1dbc15682e9bfcf
Jul 13 20:24:28.930782 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:28.930762    2588 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 20:24:29.037155 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:29.037125    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:24:29.252219 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:29.252183    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:24:29.349275 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:29.349233    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:24:29.381426 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:29.381394    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-9hdm4" event={"ID":"d2aab920-7240-4703-8030-46a303a6b37d","Type":"ContainerStarted","Data":"49c184f2a8e800cf4a3d7b08f8122df37f56c66498e9f6e5d1dbc15682e9bfcf"}
Jul 13 20:24:32.394547 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:32.394507    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-9hdm4" event={"ID":"d2aab920-7240-4703-8030-46a303a6b37d","Type":"ContainerStarted","Data":"e03290315617292b9020a7ce43625071c028b60083e0fa608c5016939968ab6f"}
Jul 13 20:24:32.394932 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:32.394620    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-9hdm4"
Jul 13 20:24:32.422028 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:32.421980    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-9hdm4" podStartSLOduration=1.998888854 podStartE2EDuration="4.421966564s" totalImagesPullingTime="2.42307771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:24:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:24:32.420936524 +0000 UTC m=+350.155587771" watchObservedRunningTime="2026-07-13 20:24:32.421966564 +0000 UTC m=+350.156617752"
Jul 13 20:24:53.401016 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:24:53.400940    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-9hdm4"
Jul 13 20:25:09.847980 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:25:09.847946    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:25:29.142175 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:25:29.142142    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:25:29.254667 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:25:29.254623    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:25:37.715688 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:25:37.715651    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:25:37.802083 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:25:37.802050    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:25:37.960397 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:25:37.960349    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:25:38.105889 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:25:38.105794    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:25:38.515814 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:25:38.515780    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:25:38.612696 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:25:38.612658    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:25:38.714322 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:25:38.714291    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:25:51.303104 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:25:51.303072    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:25:51.484560 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:25:51.484529    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:26:47.904205 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:47.904167    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:26:47.951239 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:47.951207    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-q9x89"]
Jul 13 20:26:47.954463 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:47.954447    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-q9x89"
Jul 13 20:26:47.957877 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:47.957857    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
Jul 13 20:26:47.958003 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:47.957951    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-f8r7c\""
Jul 13 20:26:47.958956 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:47.958937    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 13 20:26:47.959018 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:47.958972    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 13 20:26:47.968146 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:47.968123    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-q9x89"]
Jul 13 20:26:47.993718 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:47.993691    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:26:48.061960 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:48.061926    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ada3115-a8d4-4792-81de-2a5bdb6faa75-tls-certs\") pod \"model-serving-api-fd65d7d6-q9x89\" (UID: \"8ada3115-a8d4-4792-81de-2a5bdb6faa75\") " pod="kserve/model-serving-api-fd65d7d6-q9x89"
Jul 13 20:26:48.062094 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:48.061963    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wcbk\" (UniqueName: \"kubernetes.io/projected/8ada3115-a8d4-4792-81de-2a5bdb6faa75-kube-api-access-4wcbk\") pod \"model-serving-api-fd65d7d6-q9x89\" (UID: \"8ada3115-a8d4-4792-81de-2a5bdb6faa75\") " pod="kserve/model-serving-api-fd65d7d6-q9x89"
Jul 13 20:26:48.082165 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:48.082139    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:26:48.162755 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:48.162689    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wcbk\" (UniqueName: \"kubernetes.io/projected/8ada3115-a8d4-4792-81de-2a5bdb6faa75-kube-api-access-4wcbk\") pod \"model-serving-api-fd65d7d6-q9x89\" (UID: \"8ada3115-a8d4-4792-81de-2a5bdb6faa75\") " pod="kserve/model-serving-api-fd65d7d6-q9x89"
Jul 13 20:26:48.162892 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:48.162868    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ada3115-a8d4-4792-81de-2a5bdb6faa75-tls-certs\") pod \"model-serving-api-fd65d7d6-q9x89\" (UID: \"8ada3115-a8d4-4792-81de-2a5bdb6faa75\") " pod="kserve/model-serving-api-fd65d7d6-q9x89"
Jul 13 20:26:48.165192 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:48.165172    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8ada3115-a8d4-4792-81de-2a5bdb6faa75-tls-certs\") pod \"model-serving-api-fd65d7d6-q9x89\" (UID: \"8ada3115-a8d4-4792-81de-2a5bdb6faa75\") " pod="kserve/model-serving-api-fd65d7d6-q9x89"
Jul 13 20:26:48.173189 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:48.173166    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wcbk\" (UniqueName: \"kubernetes.io/projected/8ada3115-a8d4-4792-81de-2a5bdb6faa75-kube-api-access-4wcbk\") pod \"model-serving-api-fd65d7d6-q9x89\" (UID: \"8ada3115-a8d4-4792-81de-2a5bdb6faa75\") " pod="kserve/model-serving-api-fd65d7d6-q9x89"
Jul 13 20:26:48.185660 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:48.185625    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:26:48.263815 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:48.263789    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-q9x89"
Jul 13 20:26:48.391570 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:48.391548    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-q9x89"]
Jul 13 20:26:48.394117 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:26:48.394091    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ada3115_a8d4_4792_81de_2a5bdb6faa75.slice/crio-d8df3028338535c0ecb09b6a1090401d977a0990c385a804ceccd6d0fc3b8bc1 WatchSource:0}: Error finding container d8df3028338535c0ecb09b6a1090401d977a0990c385a804ceccd6d0fc3b8bc1: Status 404 returned error can't find the container with id d8df3028338535c0ecb09b6a1090401d977a0990c385a804ceccd6d0fc3b8bc1
Jul 13 20:26:48.913179 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:48.913142    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-q9x89" event={"ID":"8ada3115-a8d4-4792-81de-2a5bdb6faa75","Type":"ContainerStarted","Data":"d8df3028338535c0ecb09b6a1090401d977a0990c385a804ceccd6d0fc3b8bc1"}
Jul 13 20:26:48.996421 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:48.996356    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:26:49.098591 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:49.098542    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:26:50.923795 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:50.923709    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-q9x89" event={"ID":"8ada3115-a8d4-4792-81de-2a5bdb6faa75","Type":"ContainerStarted","Data":"7cfb1f90580c7d42e279bb0d480954f82cf8cb7c2f5efcc8d48055faca8043ae"}
Jul 13 20:26:50.923795 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:26:50.923776    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-q9x89"
Jul 13 20:27:01.931022 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:27:01.930993    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-q9x89"
Jul 13 20:27:01.950694 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:27:01.950636    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-q9x89" podStartSLOduration=12.755298232 podStartE2EDuration="14.950619857s" totalImagesPullingTime="2.195321625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:26:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:26:50.955944302 +0000 UTC m=+488.690595490" watchObservedRunningTime="2026-07-13 20:27:01.950619857 +0000 UTC m=+499.685271048"
Jul 13 20:27:16.895106 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:27:16.895058    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:27:16.995725 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:27:16.995688    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:27:27.748668 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:27:27.748624    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:27:27.849200 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:27:27.849158    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:27:27.914965 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:27:27.914918    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:28:18.749119 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:28:18.749032    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:28:22.205766 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:28:22.205726    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:28:22.301818 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:28:22.301784    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:28:34.097839 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:28:34.097808    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:28:34.162703 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:28:34.162663    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:28:34.244468 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:28:34.244427    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:28:34.318542 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:28:34.318508    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:28:34.446222 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:28:34.446186    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:28:34.533059 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:28:34.533022    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:28:34.724417 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:28:34.724305    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:28:34.834136 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:28:34.834098    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:28:42.723757 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:28:42.723725    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 20:28:42.729978 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:28:42.729954    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 20:28:42.730122 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:28:42.729996    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 20:28:42.735975 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:28:42.735953    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 20:29:21.564399 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:21.564343    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:29:53.904113 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:53.904080    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh"]
Jul 13 20:29:53.907204 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:53.907185    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh"
Jul 13 20:29:53.910419 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:53.910393    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:29:53.912262 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:53.912244    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-cbd18-kube-rbac-proxy-sar-config\""
Jul 13 20:29:53.912355 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:53.912260    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 13 20:29:53.912355 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:53.912250    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-cbd18-serving-cert\""
Jul 13 20:29:53.912600 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:53.912584    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-kvq55\""
Jul 13 20:29:53.920383 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:53.920351    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh"]
Jul 13 20:29:54.012439 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:54.012405    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/65a76ec0-4a2a-455f-9c09-638cb6e3986f-proxy-tls\") pod \"switch-graph-cbd18-7b6659b66b-s74jh\" (UID: \"65a76ec0-4a2a-455f-9c09-638cb6e3986f\") " pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh"
Jul 13 20:29:54.012593 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:54.012446    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65a76ec0-4a2a-455f-9c09-638cb6e3986f-openshift-service-ca-bundle\") pod \"switch-graph-cbd18-7b6659b66b-s74jh\" (UID: \"65a76ec0-4a2a-455f-9c09-638cb6e3986f\") " pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh"
Jul 13 20:29:54.113244 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:54.113208    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/65a76ec0-4a2a-455f-9c09-638cb6e3986f-proxy-tls\") pod \"switch-graph-cbd18-7b6659b66b-s74jh\" (UID: \"65a76ec0-4a2a-455f-9c09-638cb6e3986f\") " pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh"
Jul 13 20:29:54.113244 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:54.113244    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65a76ec0-4a2a-455f-9c09-638cb6e3986f-openshift-service-ca-bundle\") pod \"switch-graph-cbd18-7b6659b66b-s74jh\" (UID: \"65a76ec0-4a2a-455f-9c09-638cb6e3986f\") " pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh"
Jul 13 20:29:54.113481 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:29:54.113381    2588 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-cbd18-serving-cert: secret "switch-graph-cbd18-serving-cert" not found
Jul 13 20:29:54.113481 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:29:54.113462    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65a76ec0-4a2a-455f-9c09-638cb6e3986f-proxy-tls podName:65a76ec0-4a2a-455f-9c09-638cb6e3986f nodeName:}" failed. No retries permitted until 2026-07-13 20:29:54.613444305 +0000 UTC m=+672.348095471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/65a76ec0-4a2a-455f-9c09-638cb6e3986f-proxy-tls") pod "switch-graph-cbd18-7b6659b66b-s74jh" (UID: "65a76ec0-4a2a-455f-9c09-638cb6e3986f") : secret "switch-graph-cbd18-serving-cert" not found
Jul 13 20:29:54.113931 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:54.113913    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65a76ec0-4a2a-455f-9c09-638cb6e3986f-openshift-service-ca-bundle\") pod \"switch-graph-cbd18-7b6659b66b-s74jh\" (UID: \"65a76ec0-4a2a-455f-9c09-638cb6e3986f\") " pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh"
Jul 13 20:29:54.617475 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:54.617421    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/65a76ec0-4a2a-455f-9c09-638cb6e3986f-proxy-tls\") pod \"switch-graph-cbd18-7b6659b66b-s74jh\" (UID: \"65a76ec0-4a2a-455f-9c09-638cb6e3986f\") " pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh"
Jul 13 20:29:54.619940 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:54.619918    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/65a76ec0-4a2a-455f-9c09-638cb6e3986f-proxy-tls\") pod \"switch-graph-cbd18-7b6659b66b-s74jh\" (UID: \"65a76ec0-4a2a-455f-9c09-638cb6e3986f\") " pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh"
Jul 13 20:29:54.817481 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:54.817451    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh"
Jul 13 20:29:54.945856 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:54.945832    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh"]
Jul 13 20:29:54.947761 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:29:54.947728    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65a76ec0_4a2a_455f_9c09_638cb6e3986f.slice/crio-55eeafab504578fb4f180647deb95cee8b7bd05c20ef0251690ec301096a19c3 WatchSource:0}: Error finding container 55eeafab504578fb4f180647deb95cee8b7bd05c20ef0251690ec301096a19c3: Status 404 returned error can't find the container with id 55eeafab504578fb4f180647deb95cee8b7bd05c20ef0251690ec301096a19c3
Jul 13 20:29:54.949538 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:54.949520    2588 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 20:29:55.512013 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:55.511979    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:29:55.625739 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:55.625704    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh" event={"ID":"65a76ec0-4a2a-455f-9c09-638cb6e3986f","Type":"ContainerStarted","Data":"55eeafab504578fb4f180647deb95cee8b7bd05c20ef0251690ec301096a19c3"}
Jul 13 20:29:57.635241 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:57.635206    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh" event={"ID":"65a76ec0-4a2a-455f-9c09-638cb6e3986f","Type":"ContainerStarted","Data":"791c21b1ca164d7a64f0ea45e499032a403d3c836afe02f499d5fa47ebfa63bb"}
Jul 13 20:29:57.635616 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:57.635394    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh"
Jul 13 20:29:57.659130 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:29:57.659075    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh" podStartSLOduration=2.059224435 podStartE2EDuration="4.65905925s" totalImagesPullingTime="2.599834815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:29:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:29:57.658897142 +0000 UTC m=+675.393548333" watchObservedRunningTime="2026-07-13 20:29:57.65905925 +0000 UTC m=+675.393710438"
Jul 13 20:30:03.645351 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:03.645322    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh"
Jul 13 20:30:04.056106 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:04.056066    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh"]
Jul 13 20:30:04.056349 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:04.056298    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh" podUID="65a76ec0-4a2a-455f-9c09-638cb6e3986f" containerName="switch-graph-cbd18" containerID="cri-o://791c21b1ca164d7a64f0ea45e499032a403d3c836afe02f499d5fa47ebfa63bb" gracePeriod=30
Jul 13 20:30:04.078257 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:04.078224    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:30:04.641537 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:04.641494    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:30:04.859117 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:04.859086    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:30:05.062324 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:05.062287    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:30:08.643800 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:08.643765    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh" podUID="65a76ec0-4a2a-455f-9c09-638cb6e3986f" containerName="switch-graph-cbd18" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:30:13.643147 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:13.643106    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh" podUID="65a76ec0-4a2a-455f-9c09-638cb6e3986f" containerName="switch-graph-cbd18" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:30:18.643146 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:18.643108    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh" podUID="65a76ec0-4a2a-455f-9c09-638cb6e3986f" containerName="switch-graph-cbd18" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:30:18.643540 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:18.643220    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh"
Jul 13 20:30:23.643227 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:23.643183    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh" podUID="65a76ec0-4a2a-455f-9c09-638cb6e3986f" containerName="switch-graph-cbd18" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:30:28.643865 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:28.643819    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh" podUID="65a76ec0-4a2a-455f-9c09-638cb6e3986f" containerName="switch-graph-cbd18" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:30:33.644006 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:33.643966    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh" podUID="65a76ec0-4a2a-455f-9c09-638cb6e3986f" containerName="switch-graph-cbd18" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:30:34.707687 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:34.707661    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh"
Jul 13 20:30:34.778322 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:34.778285    2588 generic.go:356] "Generic (PLEG): container finished" podID="65a76ec0-4a2a-455f-9c09-638cb6e3986f" containerID="791c21b1ca164d7a64f0ea45e499032a403d3c836afe02f499d5fa47ebfa63bb" exitCode=0
Jul 13 20:30:34.778495 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:34.778331    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh"
Jul 13 20:30:34.778495 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:34.778386    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh" event={"ID":"65a76ec0-4a2a-455f-9c09-638cb6e3986f","Type":"ContainerDied","Data":"791c21b1ca164d7a64f0ea45e499032a403d3c836afe02f499d5fa47ebfa63bb"}
Jul 13 20:30:34.778495 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:34.778450    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh" event={"ID":"65a76ec0-4a2a-455f-9c09-638cb6e3986f","Type":"ContainerDied","Data":"55eeafab504578fb4f180647deb95cee8b7bd05c20ef0251690ec301096a19c3"}
Jul 13 20:30:34.778495 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:34.778481    2588 scope.go:117] "RemoveContainer" containerID="791c21b1ca164d7a64f0ea45e499032a403d3c836afe02f499d5fa47ebfa63bb"
Jul 13 20:30:34.786524 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:34.786505    2588 scope.go:117] "RemoveContainer" containerID="791c21b1ca164d7a64f0ea45e499032a403d3c836afe02f499d5fa47ebfa63bb"
Jul 13 20:30:34.786776 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:30:34.786757    2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"791c21b1ca164d7a64f0ea45e499032a403d3c836afe02f499d5fa47ebfa63bb\": container with ID starting with 791c21b1ca164d7a64f0ea45e499032a403d3c836afe02f499d5fa47ebfa63bb not found: ID does not exist" containerID="791c21b1ca164d7a64f0ea45e499032a403d3c836afe02f499d5fa47ebfa63bb"
Jul 13 20:30:34.786836 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:34.786789    2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"791c21b1ca164d7a64f0ea45e499032a403d3c836afe02f499d5fa47ebfa63bb"} err="failed to get container status \"791c21b1ca164d7a64f0ea45e499032a403d3c836afe02f499d5fa47ebfa63bb\": rpc error: code = NotFound desc = could not find container \"791c21b1ca164d7a64f0ea45e499032a403d3c836afe02f499d5fa47ebfa63bb\": container with ID starting with 791c21b1ca164d7a64f0ea45e499032a403d3c836afe02f499d5fa47ebfa63bb not found: ID does not exist"
Jul 13 20:30:34.847093 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:34.847007    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/65a76ec0-4a2a-455f-9c09-638cb6e3986f-proxy-tls\") pod \"65a76ec0-4a2a-455f-9c09-638cb6e3986f\" (UID: \"65a76ec0-4a2a-455f-9c09-638cb6e3986f\") "
Jul 13 20:30:34.847234 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:34.847122    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65a76ec0-4a2a-455f-9c09-638cb6e3986f-openshift-service-ca-bundle\") pod \"65a76ec0-4a2a-455f-9c09-638cb6e3986f\" (UID: \"65a76ec0-4a2a-455f-9c09-638cb6e3986f\") "
Jul 13 20:30:34.847536 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:34.847511    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65a76ec0-4a2a-455f-9c09-638cb6e3986f-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "65a76ec0-4a2a-455f-9c09-638cb6e3986f" (UID: "65a76ec0-4a2a-455f-9c09-638cb6e3986f"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:30:34.849232 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:34.849212    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65a76ec0-4a2a-455f-9c09-638cb6e3986f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "65a76ec0-4a2a-455f-9c09-638cb6e3986f" (UID: "65a76ec0-4a2a-455f-9c09-638cb6e3986f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 20:30:34.948495 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:34.948457    2588 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/65a76ec0-4a2a-455f-9c09-638cb6e3986f-proxy-tls\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:30:34.948495 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:34.948490    2588 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/65a76ec0-4a2a-455f-9c09-638cb6e3986f-openshift-service-ca-bundle\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:30:35.098090 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:35.098006    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh"]
Jul 13 20:30:35.103173 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:35.103143    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-cbd18-7b6659b66b-s74jh"]
Jul 13 20:30:36.969763 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:36.969726    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65a76ec0-4a2a-455f-9c09-638cb6e3986f" path="/var/lib/kubelet/pods/65a76ec0-4a2a-455f-9c09-638cb6e3986f/volumes"
Jul 13 20:30:53.829589 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:53.829544    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw"]
Jul 13 20:30:53.830012 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:53.829901    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65a76ec0-4a2a-455f-9c09-638cb6e3986f" containerName="switch-graph-cbd18"
Jul 13 20:30:53.830012 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:53.829917    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="65a76ec0-4a2a-455f-9c09-638cb6e3986f" containerName="switch-graph-cbd18"
Jul 13 20:30:53.830012 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:53.829993    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="65a76ec0-4a2a-455f-9c09-638cb6e3986f" containerName="switch-graph-cbd18"
Jul 13 20:30:53.830458 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:53.830414    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:30:53.834070 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:53.834053    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw"
Jul 13 20:30:53.837789 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:53.837764    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-kvq55\""
Jul 13 20:30:53.837951 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:53.837934    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-serving-cert\""
Jul 13 20:30:53.838737 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:53.838723    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-kube-rbac-proxy-sar-config\""
Jul 13 20:30:53.838806 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:53.838724    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 13 20:30:53.847531 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:53.847512    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw"]
Jul 13 20:30:54.017678 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:54.017641    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f93e1ab4-a893-4796-a2aa-e1b42bfaebde-openshift-service-ca-bundle\") pod \"model-chainer-659b76d949-vdqbw\" (UID: \"f93e1ab4-a893-4796-a2aa-e1b42bfaebde\") " pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw"
Jul 13 20:30:54.017850 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:54.017757    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f93e1ab4-a893-4796-a2aa-e1b42bfaebde-proxy-tls\") pod \"model-chainer-659b76d949-vdqbw\" (UID: \"f93e1ab4-a893-4796-a2aa-e1b42bfaebde\") " pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw"
Jul 13 20:30:54.119242 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:54.119140    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f93e1ab4-a893-4796-a2aa-e1b42bfaebde-openshift-service-ca-bundle\") pod \"model-chainer-659b76d949-vdqbw\" (UID: \"f93e1ab4-a893-4796-a2aa-e1b42bfaebde\") " pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw"
Jul 13 20:30:54.119412 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:54.119268    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f93e1ab4-a893-4796-a2aa-e1b42bfaebde-proxy-tls\") pod \"model-chainer-659b76d949-vdqbw\" (UID: \"f93e1ab4-a893-4796-a2aa-e1b42bfaebde\") " pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw"
Jul 13 20:30:54.119866 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:54.119840    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f93e1ab4-a893-4796-a2aa-e1b42bfaebde-openshift-service-ca-bundle\") pod \"model-chainer-659b76d949-vdqbw\" (UID: \"f93e1ab4-a893-4796-a2aa-e1b42bfaebde\") " pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw"
Jul 13 20:30:54.121654 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:54.121626    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f93e1ab4-a893-4796-a2aa-e1b42bfaebde-proxy-tls\") pod \"model-chainer-659b76d949-vdqbw\" (UID: \"f93e1ab4-a893-4796-a2aa-e1b42bfaebde\") " pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw"
Jul 13 20:30:54.143964 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:54.143942    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw"
Jul 13 20:30:54.272258 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:54.272232    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw"]
Jul 13 20:30:54.274933 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:30:54.274909    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf93e1ab4_a893_4796_a2aa_e1b42bfaebde.slice/crio-201b898b0d882607e180f019f11f3c07f76e4a407bbd227de4fee55d58b605ca WatchSource:0}: Error finding container 201b898b0d882607e180f019f11f3c07f76e4a407bbd227de4fee55d58b605ca: Status 404 returned error can't find the container with id 201b898b0d882607e180f019f11f3c07f76e4a407bbd227de4fee55d58b605ca
Jul 13 20:30:54.867380 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:54.867324    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw" event={"ID":"f93e1ab4-a893-4796-a2aa-e1b42bfaebde","Type":"ContainerStarted","Data":"6ccdb0efca7d1503b99a1505db8dd4f991bfaedd51e594fab8e25ec01eae028e"}
Jul 13 20:30:54.867785 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:54.867389    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw" event={"ID":"f93e1ab4-a893-4796-a2aa-e1b42bfaebde","Type":"ContainerStarted","Data":"201b898b0d882607e180f019f11f3c07f76e4a407bbd227de4fee55d58b605ca"}
Jul 13 20:30:54.867785 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:54.867489    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw"
Jul 13 20:30:54.884906 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:54.884860    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw" podStartSLOduration=1.884845831 podStartE2EDuration="1.884845831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:30:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:30:54.884354694 +0000 UTC m=+732.619005883" watchObservedRunningTime="2026-07-13 20:30:54.884845831 +0000 UTC m=+732.619497083"
Jul 13 20:30:55.026736 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:30:55.026706    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:31:00.876645 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:00.876616    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw"
Jul 13 20:31:03.926796 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:03.926765    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw"]
Jul 13 20:31:03.927185 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:03.926930    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw" podUID="f93e1ab4-a893-4796-a2aa-e1b42bfaebde" containerName="model-chainer" containerID="cri-o://6ccdb0efca7d1503b99a1505db8dd4f991bfaedd51e594fab8e25ec01eae028e" gracePeriod=30
Jul 13 20:31:04.187666 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:04.187636    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:31:04.325691 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:04.325655    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:31:04.347326 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:04.347289    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj"]
Jul 13 20:31:04.350747 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:04.350725    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj"
Jul 13 20:31:04.354791 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:04.354775    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-91263-serving-cert\""
Jul 13 20:31:04.354885 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:04.354779    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-91263-kube-rbac-proxy-sar-config\""
Jul 13 20:31:04.362413 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:04.362392    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj"]
Jul 13 20:31:04.398140 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:04.398112    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cbfa2e52-3b47-4cb0-9471-3c6170494b8d-proxy-tls\") pod \"switch-graph-91263-5f5cb88ccb-cqznj\" (UID: \"cbfa2e52-3b47-4cb0-9471-3c6170494b8d\") " pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj"
Jul 13 20:31:04.398283 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:04.398150    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbfa2e52-3b47-4cb0-9471-3c6170494b8d-openshift-service-ca-bundle\") pod \"switch-graph-91263-5f5cb88ccb-cqznj\" (UID: \"cbfa2e52-3b47-4cb0-9471-3c6170494b8d\") " pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj"
Jul 13 20:31:04.399722 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:04.399696    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:31:04.499396 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:04.499313    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cbfa2e52-3b47-4cb0-9471-3c6170494b8d-proxy-tls\") pod \"switch-graph-91263-5f5cb88ccb-cqznj\" (UID: \"cbfa2e52-3b47-4cb0-9471-3c6170494b8d\") " pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj"
Jul 13 20:31:04.499396 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:04.499351    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbfa2e52-3b47-4cb0-9471-3c6170494b8d-openshift-service-ca-bundle\") pod \"switch-graph-91263-5f5cb88ccb-cqznj\" (UID: \"cbfa2e52-3b47-4cb0-9471-3c6170494b8d\") " pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj"
Jul 13 20:31:04.500024 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:04.500006    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbfa2e52-3b47-4cb0-9471-3c6170494b8d-openshift-service-ca-bundle\") pod \"switch-graph-91263-5f5cb88ccb-cqznj\" (UID: \"cbfa2e52-3b47-4cb0-9471-3c6170494b8d\") " pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj"
Jul 13 20:31:04.501703 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:04.501684    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cbfa2e52-3b47-4cb0-9471-3c6170494b8d-proxy-tls\") pod \"switch-graph-91263-5f5cb88ccb-cqznj\" (UID: \"cbfa2e52-3b47-4cb0-9471-3c6170494b8d\") " pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj"
Jul 13 20:31:04.661443 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:04.661416    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj"
Jul 13 20:31:04.694327 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:04.694290    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:31:04.795499 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:04.795309    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:31:04.795639 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:04.795620    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj"]
Jul 13 20:31:04.798062 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:31:04.798033    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbfa2e52_3b47_4cb0_9471_3c6170494b8d.slice/crio-3754a075ac5c474dddfd0334ccddd6eb1623991fc57e3689839fef8f65826f70 WatchSource:0}: Error finding container 3754a075ac5c474dddfd0334ccddd6eb1623991fc57e3689839fef8f65826f70: Status 404 returned error can't find the container with id 3754a075ac5c474dddfd0334ccddd6eb1623991fc57e3689839fef8f65826f70
Jul 13 20:31:04.910737 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:04.910697    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj" event={"ID":"cbfa2e52-3b47-4cb0-9471-3c6170494b8d","Type":"ContainerStarted","Data":"aef78543c454ad3e9dea07d398e3511e3eec956e064f6de4a5859710b5be4db3"}
Jul 13 20:31:04.910890 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:04.910755    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj" event={"ID":"cbfa2e52-3b47-4cb0-9471-3c6170494b8d","Type":"ContainerStarted","Data":"3754a075ac5c474dddfd0334ccddd6eb1623991fc57e3689839fef8f65826f70"}
Jul 13 20:31:04.910890 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:04.910814    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj"
Jul 13 20:31:04.933513 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:04.933468    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj" podStartSLOduration=0.933453333 podStartE2EDuration="933.453333ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:31:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:31:04.931855411 +0000 UTC m=+742.666506600" watchObservedRunningTime="2026-07-13 20:31:04.933453333 +0000 UTC m=+742.668104498"
Jul 13 20:31:05.875731 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:05.875693    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw" podUID="f93e1ab4-a893-4796-a2aa-e1b42bfaebde" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:31:10.874947 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:10.874903    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw" podUID="f93e1ab4-a893-4796-a2aa-e1b42bfaebde" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:31:10.921078 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:10.921043    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj"
Jul 13 20:31:15.875798 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:15.875752    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw" podUID="f93e1ab4-a893-4796-a2aa-e1b42bfaebde" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:31:15.876166 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:15.875860    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw"
Jul 13 20:31:20.875023 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:20.874987    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw" podUID="f93e1ab4-a893-4796-a2aa-e1b42bfaebde" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:31:25.875853 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:25.875812    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw" podUID="f93e1ab4-a893-4796-a2aa-e1b42bfaebde" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:31:30.875188 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:30.875148    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw" podUID="f93e1ab4-a893-4796-a2aa-e1b42bfaebde" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:31:34.023748 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:34.023714    2588 generic.go:356] "Generic (PLEG): container finished" podID="f93e1ab4-a893-4796-a2aa-e1b42bfaebde" containerID="6ccdb0efca7d1503b99a1505db8dd4f991bfaedd51e594fab8e25ec01eae028e" exitCode=0
Jul 13 20:31:34.024153 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:34.023786    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw" event={"ID":"f93e1ab4-a893-4796-a2aa-e1b42bfaebde","Type":"ContainerDied","Data":"6ccdb0efca7d1503b99a1505db8dd4f991bfaedd51e594fab8e25ec01eae028e"}
Jul 13 20:31:34.574821 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:34.574798    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw"
Jul 13 20:31:34.660775 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:34.660748    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f93e1ab4-a893-4796-a2aa-e1b42bfaebde-openshift-service-ca-bundle\") pod \"f93e1ab4-a893-4796-a2aa-e1b42bfaebde\" (UID: \"f93e1ab4-a893-4796-a2aa-e1b42bfaebde\") "
Jul 13 20:31:34.660943 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:34.660804    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f93e1ab4-a893-4796-a2aa-e1b42bfaebde-proxy-tls\") pod \"f93e1ab4-a893-4796-a2aa-e1b42bfaebde\" (UID: \"f93e1ab4-a893-4796-a2aa-e1b42bfaebde\") "
Jul 13 20:31:34.661168 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:34.661140    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f93e1ab4-a893-4796-a2aa-e1b42bfaebde-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "f93e1ab4-a893-4796-a2aa-e1b42bfaebde" (UID: "f93e1ab4-a893-4796-a2aa-e1b42bfaebde"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:31:34.662775 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:34.662753    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f93e1ab4-a893-4796-a2aa-e1b42bfaebde-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f93e1ab4-a893-4796-a2aa-e1b42bfaebde" (UID: "f93e1ab4-a893-4796-a2aa-e1b42bfaebde"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 20:31:34.762216 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:34.762136    2588 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f93e1ab4-a893-4796-a2aa-e1b42bfaebde-openshift-service-ca-bundle\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:31:34.762216 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:34.762172    2588 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f93e1ab4-a893-4796-a2aa-e1b42bfaebde-proxy-tls\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:31:35.028691 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:35.028608    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw"
Jul 13 20:31:35.028691 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:35.028637    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw" event={"ID":"f93e1ab4-a893-4796-a2aa-e1b42bfaebde","Type":"ContainerDied","Data":"201b898b0d882607e180f019f11f3c07f76e4a407bbd227de4fee55d58b605ca"}
Jul 13 20:31:35.028691 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:35.028693    2588 scope.go:117] "RemoveContainer" containerID="6ccdb0efca7d1503b99a1505db8dd4f991bfaedd51e594fab8e25ec01eae028e"
Jul 13 20:31:35.052203 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:35.052179    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw"]
Jul 13 20:31:35.057035 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:35.057011    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-659b76d949-vdqbw"]
Jul 13 20:31:36.969102 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:31:36.969062    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f93e1ab4-a893-4796-a2aa-e1b42bfaebde" path="/var/lib/kubelet/pods/f93e1ab4-a893-4796-a2aa-e1b42bfaebde/volumes"
Jul 13 20:32:04.200125 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:04.200090    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4"]
Jul 13 20:32:04.200549 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:04.200410    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f93e1ab4-a893-4796-a2aa-e1b42bfaebde" containerName="model-chainer"
Jul 13 20:32:04.200549 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:04.200423    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="f93e1ab4-a893-4796-a2aa-e1b42bfaebde" containerName="model-chainer"
Jul 13 20:32:04.200549 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:04.200480    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="f93e1ab4-a893-4796-a2aa-e1b42bfaebde" containerName="model-chainer"
Jul 13 20:32:04.202961 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:04.202934    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:32:04.208965 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:04.205227    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4"
Jul 13 20:32:04.208965 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:04.208869    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-43619-kube-rbac-proxy-sar-config\""
Jul 13 20:32:04.209299 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:04.209268    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-43619-serving-cert\""
Jul 13 20:32:04.222636 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:04.222613    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4"]
Jul 13 20:32:04.281612 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:04.281558    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4f3e95fb-3229-43dd-b1ae-1ac6888ba33e-proxy-tls\") pod \"sequence-graph-43619-cb57bcfb7-mjrs4\" (UID: \"4f3e95fb-3229-43dd-b1ae-1ac6888ba33e\") " pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4"
Jul 13 20:32:04.281758 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:04.281649    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3e95fb-3229-43dd-b1ae-1ac6888ba33e-openshift-service-ca-bundle\") pod \"sequence-graph-43619-cb57bcfb7-mjrs4\" (UID: \"4f3e95fb-3229-43dd-b1ae-1ac6888ba33e\") " pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4"
Jul 13 20:32:04.320801 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:04.320769    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:32:04.382858 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:04.382828    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4f3e95fb-3229-43dd-b1ae-1ac6888ba33e-proxy-tls\") pod \"sequence-graph-43619-cb57bcfb7-mjrs4\" (UID: \"4f3e95fb-3229-43dd-b1ae-1ac6888ba33e\") " pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4"
Jul 13 20:32:04.383017 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:04.382895    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3e95fb-3229-43dd-b1ae-1ac6888ba33e-openshift-service-ca-bundle\") pod \"sequence-graph-43619-cb57bcfb7-mjrs4\" (UID: \"4f3e95fb-3229-43dd-b1ae-1ac6888ba33e\") " pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4"
Jul 13 20:32:04.383528 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:04.383500    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3e95fb-3229-43dd-b1ae-1ac6888ba33e-openshift-service-ca-bundle\") pod \"sequence-graph-43619-cb57bcfb7-mjrs4\" (UID: \"4f3e95fb-3229-43dd-b1ae-1ac6888ba33e\") " pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4"
Jul 13 20:32:04.385185 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:04.385163    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4f3e95fb-3229-43dd-b1ae-1ac6888ba33e-proxy-tls\") pod \"sequence-graph-43619-cb57bcfb7-mjrs4\" (UID: \"4f3e95fb-3229-43dd-b1ae-1ac6888ba33e\") " pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4"
Jul 13 20:32:04.517281 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:04.517197    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4"
Jul 13 20:32:04.645090 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:04.645068    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4"]
Jul 13 20:32:04.647498 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:32:04.647470    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f3e95fb_3229_43dd_b1ae_1ac6888ba33e.slice/crio-9e58d8d40f6d19c944034e69030d109dcef957b1e9635afa7a2bb4ea7863c635 WatchSource:0}: Error finding container 9e58d8d40f6d19c944034e69030d109dcef957b1e9635afa7a2bb4ea7863c635: Status 404 returned error can't find the container with id 9e58d8d40f6d19c944034e69030d109dcef957b1e9635afa7a2bb4ea7863c635
Jul 13 20:32:05.154600 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:05.154530    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4" event={"ID":"4f3e95fb-3229-43dd-b1ae-1ac6888ba33e","Type":"ContainerStarted","Data":"71fbf01f962f4930e0be54a0d71b2f111ce53d8db05a2114888342708312fbd8"}
Jul 13 20:32:05.154600 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:05.154580    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4" event={"ID":"4f3e95fb-3229-43dd-b1ae-1ac6888ba33e","Type":"ContainerStarted","Data":"9e58d8d40f6d19c944034e69030d109dcef957b1e9635afa7a2bb4ea7863c635"}
Jul 13 20:32:05.154774 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:05.154666    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4"
Jul 13 20:32:05.172043 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:05.172004    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4" podStartSLOduration=1.171991869 podStartE2EDuration="1.171991869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:32:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:32:05.171563334 +0000 UTC m=+802.906214521" watchObservedRunningTime="2026-07-13 20:32:05.171991869 +0000 UTC m=+802.906643056"
Jul 13 20:32:11.164207 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:11.164178    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4"
Jul 13 20:32:45.735333 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:32:45.735302    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:33:21.999093 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:33:21.999055    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:33:42.749637 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:33:42.749565    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 20:33:42.754236 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:33:42.754212    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 20:33:42.756018 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:33:42.755994    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 20:33:42.760065 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:33:42.760048    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 20:35:28.270974 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:35:28.270942    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:36:23.466381 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:36:23.466311    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:37:07.506696 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:37:07.506614    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:38:42.776266 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:38:42.776241    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 20:38:42.781265 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:38:42.781243    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 20:38:42.785229 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:38:42.785203    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 20:38:42.787562 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:38:42.787545    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 20:39:19.028975 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:19.028944    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj"]
Jul 13 20:39:19.029489 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:19.029151    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj" podUID="cbfa2e52-3b47-4cb0-9471-3c6170494b8d" containerName="switch-graph-91263" containerID="cri-o://aef78543c454ad3e9dea07d398e3511e3eec956e064f6de4a5859710b5be4db3" gracePeriod=30
Jul 13 20:39:19.098726 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:19.098697    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:39:19.235905 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:19.235870    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:39:19.339728 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:19.339660    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:39:19.439030 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:19.438996    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:39:19.518065 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:19.518029    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:39:20.045820 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:20.045790    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:39:20.919672 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:20.919636    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj" podUID="cbfa2e52-3b47-4cb0-9471-3c6170494b8d" containerName="switch-graph-91263" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:39:25.919245 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:25.919207    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj" podUID="cbfa2e52-3b47-4cb0-9471-3c6170494b8d" containerName="switch-graph-91263" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:39:30.919435 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:30.919394    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj" podUID="cbfa2e52-3b47-4cb0-9471-3c6170494b8d" containerName="switch-graph-91263" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:39:30.919809 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:30.919511    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj"
Jul 13 20:39:35.919140 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:35.919060    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj" podUID="cbfa2e52-3b47-4cb0-9471-3c6170494b8d" containerName="switch-graph-91263" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:39:40.918982 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:40.918943    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj" podUID="cbfa2e52-3b47-4cb0-9471-3c6170494b8d" containerName="switch-graph-91263" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:39:45.919317 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:45.919281    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj" podUID="cbfa2e52-3b47-4cb0-9471-3c6170494b8d" containerName="switch-graph-91263" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:39:49.215110 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:49.215085    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj"
Jul 13 20:39:49.321869 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:49.321785    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbfa2e52-3b47-4cb0-9471-3c6170494b8d-openshift-service-ca-bundle\") pod \"cbfa2e52-3b47-4cb0-9471-3c6170494b8d\" (UID: \"cbfa2e52-3b47-4cb0-9471-3c6170494b8d\") "
Jul 13 20:39:49.321869 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:49.321861    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cbfa2e52-3b47-4cb0-9471-3c6170494b8d-proxy-tls\") pod \"cbfa2e52-3b47-4cb0-9471-3c6170494b8d\" (UID: \"cbfa2e52-3b47-4cb0-9471-3c6170494b8d\") "
Jul 13 20:39:49.322153 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:49.322128    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbfa2e52-3b47-4cb0-9471-3c6170494b8d-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "cbfa2e52-3b47-4cb0-9471-3c6170494b8d" (UID: "cbfa2e52-3b47-4cb0-9471-3c6170494b8d"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:39:49.323901 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:49.323879    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbfa2e52-3b47-4cb0-9471-3c6170494b8d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "cbfa2e52-3b47-4cb0-9471-3c6170494b8d" (UID: "cbfa2e52-3b47-4cb0-9471-3c6170494b8d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 20:39:49.423037 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:49.423010    2588 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/cbfa2e52-3b47-4cb0-9471-3c6170494b8d-proxy-tls\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:39:49.423037 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:49.423032    2588 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cbfa2e52-3b47-4cb0-9471-3c6170494b8d-openshift-service-ca-bundle\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:39:49.946695 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:49.946661    2588 generic.go:356] "Generic (PLEG): container finished" podID="cbfa2e52-3b47-4cb0-9471-3c6170494b8d" containerID="aef78543c454ad3e9dea07d398e3511e3eec956e064f6de4a5859710b5be4db3" exitCode=0
Jul 13 20:39:49.946854 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:49.946702    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj"
Jul 13 20:39:49.946854 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:49.946710    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj" event={"ID":"cbfa2e52-3b47-4cb0-9471-3c6170494b8d","Type":"ContainerDied","Data":"aef78543c454ad3e9dea07d398e3511e3eec956e064f6de4a5859710b5be4db3"}
Jul 13 20:39:49.946854 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:49.946763    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj" event={"ID":"cbfa2e52-3b47-4cb0-9471-3c6170494b8d","Type":"ContainerDied","Data":"3754a075ac5c474dddfd0334ccddd6eb1623991fc57e3689839fef8f65826f70"}
Jul 13 20:39:49.946854 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:49.946786    2588 scope.go:117] "RemoveContainer" containerID="aef78543c454ad3e9dea07d398e3511e3eec956e064f6de4a5859710b5be4db3"
Jul 13 20:39:49.954998 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:49.954983    2588 scope.go:117] "RemoveContainer" containerID="aef78543c454ad3e9dea07d398e3511e3eec956e064f6de4a5859710b5be4db3"
Jul 13 20:39:49.955234 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:39:49.955217    2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aef78543c454ad3e9dea07d398e3511e3eec956e064f6de4a5859710b5be4db3\": container with ID starting with aef78543c454ad3e9dea07d398e3511e3eec956e064f6de4a5859710b5be4db3 not found: ID does not exist" containerID="aef78543c454ad3e9dea07d398e3511e3eec956e064f6de4a5859710b5be4db3"
Jul 13 20:39:49.955284 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:49.955243    2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aef78543c454ad3e9dea07d398e3511e3eec956e064f6de4a5859710b5be4db3"} err="failed to get container status \"aef78543c454ad3e9dea07d398e3511e3eec956e064f6de4a5859710b5be4db3\": rpc error: code = NotFound desc = could not find container \"aef78543c454ad3e9dea07d398e3511e3eec956e064f6de4a5859710b5be4db3\": container with ID starting with aef78543c454ad3e9dea07d398e3511e3eec956e064f6de4a5859710b5be4db3 not found: ID does not exist"
Jul 13 20:39:49.974416 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:49.974384    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj"]
Jul 13 20:39:49.978183 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:49.978159    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-91263-5f5cb88ccb-cqznj"]
Jul 13 20:39:50.968571 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:39:50.968532    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbfa2e52-3b47-4cb0-9471-3c6170494b8d" path="/var/lib/kubelet/pods/cbfa2e52-3b47-4cb0-9471-3c6170494b8d/volumes"
Jul 13 20:40:18.806864 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:18.806828    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4"]
Jul 13 20:40:18.807357 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:18.807065    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4" podUID="4f3e95fb-3229-43dd-b1ae-1ac6888ba33e" containerName="sequence-graph-43619" containerID="cri-o://71fbf01f962f4930e0be54a0d71b2f111ce53d8db05a2114888342708312fbd8" gracePeriod=30
Jul 13 20:40:18.836011 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:18.835979    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:40:18.992260 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:18.992229    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:40:19.099084 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:19.098997    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:40:19.190544 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:19.190516    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:40:19.285319 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:19.285285    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:40:19.348955 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:19.348918    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq"]
Jul 13 20:40:19.349258 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:19.349219    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbfa2e52-3b47-4cb0-9471-3c6170494b8d" containerName="switch-graph-91263"
Jul 13 20:40:19.349258 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:19.349232    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbfa2e52-3b47-4cb0-9471-3c6170494b8d" containerName="switch-graph-91263"
Jul 13 20:40:19.349338 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:19.349299    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbfa2e52-3b47-4cb0-9471-3c6170494b8d" containerName="switch-graph-91263"
Jul 13 20:40:19.352469 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:19.352449    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq"
Jul 13 20:40:19.355013 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:19.354992    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-02ff4-serving-cert\""
Jul 13 20:40:19.355252 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:19.355234    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-02ff4-kube-rbac-proxy-sar-config\""
Jul 13 20:40:19.365258 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:19.365234    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq"]
Jul 13 20:40:19.386356 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:19.386331    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:40:19.464539 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:19.464506    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e542f4f7-5fee-4226-b2f9-deccc433481d-proxy-tls\") pod \"ensemble-graph-02ff4-854c9cfd46-slghq\" (UID: \"e542f4f7-5fee-4226-b2f9-deccc433481d\") " pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq"
Jul 13 20:40:19.464691 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:19.464600    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e542f4f7-5fee-4226-b2f9-deccc433481d-openshift-service-ca-bundle\") pod \"ensemble-graph-02ff4-854c9cfd46-slghq\" (UID: \"e542f4f7-5fee-4226-b2f9-deccc433481d\") " pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq"
Jul 13 20:40:19.565665 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:19.565612    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e542f4f7-5fee-4226-b2f9-deccc433481d-proxy-tls\") pod \"ensemble-graph-02ff4-854c9cfd46-slghq\" (UID: \"e542f4f7-5fee-4226-b2f9-deccc433481d\") " pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq"
Jul 13 20:40:19.565870 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:19.565722    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e542f4f7-5fee-4226-b2f9-deccc433481d-openshift-service-ca-bundle\") pod \"ensemble-graph-02ff4-854c9cfd46-slghq\" (UID: \"e542f4f7-5fee-4226-b2f9-deccc433481d\") " pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq"
Jul 13 20:40:19.565870 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:40:19.565774    2588 secret.go:189] Couldn't get secret kserve-ci-e2e-test/ensemble-graph-02ff4-serving-cert: secret "ensemble-graph-02ff4-serving-cert" not found
Jul 13 20:40:19.565870 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:40:19.565848    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e542f4f7-5fee-4226-b2f9-deccc433481d-proxy-tls podName:e542f4f7-5fee-4226-b2f9-deccc433481d nodeName:}" failed. No retries permitted until 2026-07-13 20:40:20.065831018 +0000 UTC m=+1297.800482192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/e542f4f7-5fee-4226-b2f9-deccc433481d-proxy-tls") pod "ensemble-graph-02ff4-854c9cfd46-slghq" (UID: "e542f4f7-5fee-4226-b2f9-deccc433481d") : secret "ensemble-graph-02ff4-serving-cert" not found
Jul 13 20:40:19.566445 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:19.566423    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e542f4f7-5fee-4226-b2f9-deccc433481d-openshift-service-ca-bundle\") pod \"ensemble-graph-02ff4-854c9cfd46-slghq\" (UID: \"e542f4f7-5fee-4226-b2f9-deccc433481d\") " pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq"
Jul 13 20:40:19.705355 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:19.705323    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:40:20.069928 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:20.069842    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e542f4f7-5fee-4226-b2f9-deccc433481d-proxy-tls\") pod \"ensemble-graph-02ff4-854c9cfd46-slghq\" (UID: \"e542f4f7-5fee-4226-b2f9-deccc433481d\") " pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq"
Jul 13 20:40:20.072197 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:20.072177    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e542f4f7-5fee-4226-b2f9-deccc433481d-proxy-tls\") pod \"ensemble-graph-02ff4-854c9cfd46-slghq\" (UID: \"e542f4f7-5fee-4226-b2f9-deccc433481d\") " pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq"
Jul 13 20:40:20.261961 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:20.261923    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq"
Jul 13 20:40:20.397188 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:20.397119    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq"]
Jul 13 20:40:20.401408 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:40:20.401377    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode542f4f7_5fee_4226_b2f9_deccc433481d.slice/crio-ad04e347871b8476c42ab51a8f16ec9fccb83b53fef7e6f7096be1458d2925b2 WatchSource:0}: Error finding container ad04e347871b8476c42ab51a8f16ec9fccb83b53fef7e6f7096be1458d2925b2: Status 404 returned error can't find the container with id ad04e347871b8476c42ab51a8f16ec9fccb83b53fef7e6f7096be1458d2925b2
Jul 13 20:40:21.067023 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:21.066985    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq" event={"ID":"e542f4f7-5fee-4226-b2f9-deccc433481d","Type":"ContainerStarted","Data":"ba24705e4d251b79375683bec17879a211ea1eb58629c29318f4aaa7505991b3"}
Jul 13 20:40:21.067210 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:21.067035    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq" event={"ID":"e542f4f7-5fee-4226-b2f9-deccc433481d","Type":"ContainerStarted","Data":"ad04e347871b8476c42ab51a8f16ec9fccb83b53fef7e6f7096be1458d2925b2"}
Jul 13 20:40:21.067210 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:21.067104    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq"
Jul 13 20:40:21.089948 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:21.089898    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq" podStartSLOduration=2.089882556 podStartE2EDuration="2.089882556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:40:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:40:21.08805391 +0000 UTC m=+1298.822705098" watchObservedRunningTime="2026-07-13 20:40:21.089882556 +0000 UTC m=+1298.824533744"
Jul 13 20:40:21.163711 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:21.163672    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4" podUID="4f3e95fb-3229-43dd-b1ae-1ac6888ba33e" containerName="sequence-graph-43619" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:40:26.162740 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:26.162701    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4" podUID="4f3e95fb-3229-43dd-b1ae-1ac6888ba33e" containerName="sequence-graph-43619" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:40:27.077262 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:27.077231    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq"
Jul 13 20:40:29.414461 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:29.414384    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq"]
Jul 13 20:40:29.414866 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:29.414565    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq" podUID="e542f4f7-5fee-4226-b2f9-deccc433481d" containerName="ensemble-graph-02ff4" containerID="cri-o://ba24705e4d251b79375683bec17879a211ea1eb58629c29318f4aaa7505991b3" gracePeriod=30
Jul 13 20:40:29.449832 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:29.449794    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:40:29.600598 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:29.600574    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:40:31.044215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:31.044186    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:40:31.162904 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:31.162866    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4" podUID="4f3e95fb-3229-43dd-b1ae-1ac6888ba33e" containerName="sequence-graph-43619" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:40:31.163058 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:31.162965    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4"
Jul 13 20:40:32.074591 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:32.074549    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq" podUID="e542f4f7-5fee-4226-b2f9-deccc433481d" containerName="ensemble-graph-02ff4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:40:36.163450 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:36.163411    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4" podUID="4f3e95fb-3229-43dd-b1ae-1ac6888ba33e" containerName="sequence-graph-43619" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:40:37.075294 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:37.075256    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq" podUID="e542f4f7-5fee-4226-b2f9-deccc433481d" containerName="ensemble-graph-02ff4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:40:41.163523 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:41.163480    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4" podUID="4f3e95fb-3229-43dd-b1ae-1ac6888ba33e" containerName="sequence-graph-43619" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:40:42.075222 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:42.075179    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq" podUID="e542f4f7-5fee-4226-b2f9-deccc433481d" containerName="ensemble-graph-02ff4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:40:42.075417 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:42.075308    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq"
Jul 13 20:40:46.163306 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:46.163270    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4" podUID="4f3e95fb-3229-43dd-b1ae-1ac6888ba33e" containerName="sequence-graph-43619" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:40:47.074963 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:47.074919    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq" podUID="e542f4f7-5fee-4226-b2f9-deccc433481d" containerName="ensemble-graph-02ff4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:40:48.957435 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:48.957409    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4"
Jul 13 20:40:49.006511 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:49.006478    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3e95fb-3229-43dd-b1ae-1ac6888ba33e-openshift-service-ca-bundle\") pod \"4f3e95fb-3229-43dd-b1ae-1ac6888ba33e\" (UID: \"4f3e95fb-3229-43dd-b1ae-1ac6888ba33e\") "
Jul 13 20:40:49.006797 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:49.006777    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f3e95fb-3229-43dd-b1ae-1ac6888ba33e-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "4f3e95fb-3229-43dd-b1ae-1ac6888ba33e" (UID: "4f3e95fb-3229-43dd-b1ae-1ac6888ba33e"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:40:49.107421 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:49.107326    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4f3e95fb-3229-43dd-b1ae-1ac6888ba33e-proxy-tls\") pod \"4f3e95fb-3229-43dd-b1ae-1ac6888ba33e\" (UID: \"4f3e95fb-3229-43dd-b1ae-1ac6888ba33e\") "
Jul 13 20:40:49.107580 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:49.107497    2588 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3e95fb-3229-43dd-b1ae-1ac6888ba33e-openshift-service-ca-bundle\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:40:49.109310 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:49.109280    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4f3e95fb-3229-43dd-b1ae-1ac6888ba33e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4f3e95fb-3229-43dd-b1ae-1ac6888ba33e" (UID: "4f3e95fb-3229-43dd-b1ae-1ac6888ba33e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 20:40:49.173282 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:49.173252    2588 generic.go:356] "Generic (PLEG): container finished" podID="4f3e95fb-3229-43dd-b1ae-1ac6888ba33e" containerID="71fbf01f962f4930e0be54a0d71b2f111ce53d8db05a2114888342708312fbd8" exitCode=0
Jul 13 20:40:49.173430 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:49.173301    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4"
Jul 13 20:40:49.173430 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:49.173344    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4" event={"ID":"4f3e95fb-3229-43dd-b1ae-1ac6888ba33e","Type":"ContainerDied","Data":"71fbf01f962f4930e0be54a0d71b2f111ce53d8db05a2114888342708312fbd8"}
Jul 13 20:40:49.173430 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:49.173410    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4" event={"ID":"4f3e95fb-3229-43dd-b1ae-1ac6888ba33e","Type":"ContainerDied","Data":"9e58d8d40f6d19c944034e69030d109dcef957b1e9635afa7a2bb4ea7863c635"}
Jul 13 20:40:49.173554 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:49.173434    2588 scope.go:117] "RemoveContainer" containerID="71fbf01f962f4930e0be54a0d71b2f111ce53d8db05a2114888342708312fbd8"
Jul 13 20:40:49.181298 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:49.181282    2588 scope.go:117] "RemoveContainer" containerID="71fbf01f962f4930e0be54a0d71b2f111ce53d8db05a2114888342708312fbd8"
Jul 13 20:40:49.181619 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:40:49.181590    2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71fbf01f962f4930e0be54a0d71b2f111ce53d8db05a2114888342708312fbd8\": container with ID starting with 71fbf01f962f4930e0be54a0d71b2f111ce53d8db05a2114888342708312fbd8 not found: ID does not exist" containerID="71fbf01f962f4930e0be54a0d71b2f111ce53d8db05a2114888342708312fbd8"
Jul 13 20:40:49.181706 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:49.181620    2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71fbf01f962f4930e0be54a0d71b2f111ce53d8db05a2114888342708312fbd8"} err="failed to get container status \"71fbf01f962f4930e0be54a0d71b2f111ce53d8db05a2114888342708312fbd8\": rpc error: code = NotFound desc = could not find container \"71fbf01f962f4930e0be54a0d71b2f111ce53d8db05a2114888342708312fbd8\": container with ID starting with 71fbf01f962f4930e0be54a0d71b2f111ce53d8db05a2114888342708312fbd8 not found: ID does not exist"
Jul 13 20:40:49.199147 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:49.199126    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4"]
Jul 13 20:40:49.208400 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:49.208374    2588 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4f3e95fb-3229-43dd-b1ae-1ac6888ba33e-proxy-tls\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:40:49.212922 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:49.212902    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-43619-cb57bcfb7-mjrs4"]
Jul 13 20:40:50.969268 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:50.969236    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f3e95fb-3229-43dd-b1ae-1ac6888ba33e" path="/var/lib/kubelet/pods/4f3e95fb-3229-43dd-b1ae-1ac6888ba33e/volumes"
Jul 13 20:40:52.074525 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:52.074492    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq" podUID="e542f4f7-5fee-4226-b2f9-deccc433481d" containerName="ensemble-graph-02ff4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:40:57.075034 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:40:57.074994    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq" podUID="e542f4f7-5fee-4226-b2f9-deccc433481d" containerName="ensemble-graph-02ff4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:41:00.063279 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:00.063253    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq"
Jul 13 20:41:00.082745 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:00.082439    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e542f4f7-5fee-4226-b2f9-deccc433481d-proxy-tls\") pod \"e542f4f7-5fee-4226-b2f9-deccc433481d\" (UID: \"e542f4f7-5fee-4226-b2f9-deccc433481d\") "
Jul 13 20:41:00.082745 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:00.082505    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e542f4f7-5fee-4226-b2f9-deccc433481d-openshift-service-ca-bundle\") pod \"e542f4f7-5fee-4226-b2f9-deccc433481d\" (UID: \"e542f4f7-5fee-4226-b2f9-deccc433481d\") "
Jul 13 20:41:00.082980 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:00.082953    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e542f4f7-5fee-4226-b2f9-deccc433481d-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "e542f4f7-5fee-4226-b2f9-deccc433481d" (UID: "e542f4f7-5fee-4226-b2f9-deccc433481d"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:41:00.084960 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:00.084935    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e542f4f7-5fee-4226-b2f9-deccc433481d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "e542f4f7-5fee-4226-b2f9-deccc433481d" (UID: "e542f4f7-5fee-4226-b2f9-deccc433481d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 20:41:00.183820 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:00.183727    2588 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e542f4f7-5fee-4226-b2f9-deccc433481d-proxy-tls\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:41:00.183820 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:00.183763    2588 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e542f4f7-5fee-4226-b2f9-deccc433481d-openshift-service-ca-bundle\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:41:00.222859 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:00.222819    2588 generic.go:356] "Generic (PLEG): container finished" podID="e542f4f7-5fee-4226-b2f9-deccc433481d" containerID="ba24705e4d251b79375683bec17879a211ea1eb58629c29318f4aaa7505991b3" exitCode=0
Jul 13 20:41:00.223013 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:00.222875    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq"
Jul 13 20:41:00.223013 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:00.222879    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq" event={"ID":"e542f4f7-5fee-4226-b2f9-deccc433481d","Type":"ContainerDied","Data":"ba24705e4d251b79375683bec17879a211ea1eb58629c29318f4aaa7505991b3"}
Jul 13 20:41:00.223013 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:00.222958    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq" event={"ID":"e542f4f7-5fee-4226-b2f9-deccc433481d","Type":"ContainerDied","Data":"ad04e347871b8476c42ab51a8f16ec9fccb83b53fef7e6f7096be1458d2925b2"}
Jul 13 20:41:00.223013 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:00.222987    2588 scope.go:117] "RemoveContainer" containerID="ba24705e4d251b79375683bec17879a211ea1eb58629c29318f4aaa7505991b3"
Jul 13 20:41:00.231845 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:00.231826    2588 scope.go:117] "RemoveContainer" containerID="ba24705e4d251b79375683bec17879a211ea1eb58629c29318f4aaa7505991b3"
Jul 13 20:41:00.232092 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:41:00.232074    2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba24705e4d251b79375683bec17879a211ea1eb58629c29318f4aaa7505991b3\": container with ID starting with ba24705e4d251b79375683bec17879a211ea1eb58629c29318f4aaa7505991b3 not found: ID does not exist" containerID="ba24705e4d251b79375683bec17879a211ea1eb58629c29318f4aaa7505991b3"
Jul 13 20:41:00.232152 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:00.232098    2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba24705e4d251b79375683bec17879a211ea1eb58629c29318f4aaa7505991b3"} err="failed to get container status \"ba24705e4d251b79375683bec17879a211ea1eb58629c29318f4aaa7505991b3\": rpc error: code = NotFound desc = could not find container \"ba24705e4d251b79375683bec17879a211ea1eb58629c29318f4aaa7505991b3\": container with ID starting with ba24705e4d251b79375683bec17879a211ea1eb58629c29318f4aaa7505991b3 not found: ID does not exist"
Jul 13 20:41:00.246756 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:00.246732    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq"]
Jul 13 20:41:00.251029 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:00.250988    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-02ff4-854c9cfd46-slghq"]
Jul 13 20:41:00.969541 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:00.969503    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e542f4f7-5fee-4226-b2f9-deccc433481d" path="/var/lib/kubelet/pods/e542f4f7-5fee-4226-b2f9-deccc433481d/volumes"
Jul 13 20:41:19.065706 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.065629    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6"]
Jul 13 20:41:19.066065 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.065939    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f3e95fb-3229-43dd-b1ae-1ac6888ba33e" containerName="sequence-graph-43619"
Jul 13 20:41:19.066065 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.065960    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f3e95fb-3229-43dd-b1ae-1ac6888ba33e" containerName="sequence-graph-43619"
Jul 13 20:41:19.066065 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.065972    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e542f4f7-5fee-4226-b2f9-deccc433481d" containerName="ensemble-graph-02ff4"
Jul 13 20:41:19.066065 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.065978    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="e542f4f7-5fee-4226-b2f9-deccc433481d" containerName="ensemble-graph-02ff4"
Jul 13 20:41:19.066065 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.066032    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="e542f4f7-5fee-4226-b2f9-deccc433481d" containerName="ensemble-graph-02ff4"
Jul 13 20:41:19.066065 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.066040    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f3e95fb-3229-43dd-b1ae-1ac6888ba33e" containerName="sequence-graph-43619"
Jul 13 20:41:19.068839 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.068822    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6"
Jul 13 20:41:19.072647 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.072623    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 13 20:41:19.073272 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.073256    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-kvq55\""
Jul 13 20:41:19.074700 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.074683    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-e8943-kube-rbac-proxy-sar-config\""
Jul 13 20:41:19.074790 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.074698    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-e8943-serving-cert\""
Jul 13 20:41:19.094186 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.094163    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6"]
Jul 13 20:41:19.099112 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.099083    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:41:19.128259 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.128237    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/76b7ee37-b200-4de2-8dbd-daeb4750066d-proxy-tls\") pod \"sequence-graph-e8943-86d8b689d5-jprd6\" (UID: \"76b7ee37-b200-4de2-8dbd-daeb4750066d\") " pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6"
Jul 13 20:41:19.128405 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.128269    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76b7ee37-b200-4de2-8dbd-daeb4750066d-openshift-service-ca-bundle\") pod \"sequence-graph-e8943-86d8b689d5-jprd6\" (UID: \"76b7ee37-b200-4de2-8dbd-daeb4750066d\") " pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6"
Jul 13 20:41:19.228743 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.228713    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/76b7ee37-b200-4de2-8dbd-daeb4750066d-proxy-tls\") pod \"sequence-graph-e8943-86d8b689d5-jprd6\" (UID: \"76b7ee37-b200-4de2-8dbd-daeb4750066d\") " pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6"
Jul 13 20:41:19.228907 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.228751    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76b7ee37-b200-4de2-8dbd-daeb4750066d-openshift-service-ca-bundle\") pod \"sequence-graph-e8943-86d8b689d5-jprd6\" (UID: \"76b7ee37-b200-4de2-8dbd-daeb4750066d\") " pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6"
Jul 13 20:41:19.229389 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.229338    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76b7ee37-b200-4de2-8dbd-daeb4750066d-openshift-service-ca-bundle\") pod \"sequence-graph-e8943-86d8b689d5-jprd6\" (UID: \"76b7ee37-b200-4de2-8dbd-daeb4750066d\") " pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6"
Jul 13 20:41:19.231107 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.231087    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/76b7ee37-b200-4de2-8dbd-daeb4750066d-proxy-tls\") pod \"sequence-graph-e8943-86d8b689d5-jprd6\" (UID: \"76b7ee37-b200-4de2-8dbd-daeb4750066d\") " pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6"
Jul 13 20:41:19.231975 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.231951    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:41:19.379434 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.379349    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6"
Jul 13 20:41:19.525505 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:19.525474    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6"]
Jul 13 20:41:19.528631 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:41:19.528601    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76b7ee37_b200_4de2_8dbd_daeb4750066d.slice/crio-0d642cfbe38a42d8ec93f4f405031fdc24bcc55784c03d430298a069af1e24fe WatchSource:0}: Error finding container 0d642cfbe38a42d8ec93f4f405031fdc24bcc55784c03d430298a069af1e24fe: Status 404 returned error can't find the container with id 0d642cfbe38a42d8ec93f4f405031fdc24bcc55784c03d430298a069af1e24fe
Jul 13 20:41:20.301772 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:20.301743    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6" event={"ID":"76b7ee37-b200-4de2-8dbd-daeb4750066d","Type":"ContainerStarted","Data":"b838a914ce154774c0d348d481ad22ee0eb81d634e65d4d0c645b1cd2c9e6a64"}
Jul 13 20:41:20.302158 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:20.301791    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6" event={"ID":"76b7ee37-b200-4de2-8dbd-daeb4750066d","Type":"ContainerStarted","Data":"0d642cfbe38a42d8ec93f4f405031fdc24bcc55784c03d430298a069af1e24fe"}
Jul 13 20:41:20.302158 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:20.301821    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6"
Jul 13 20:41:26.315949 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:26.315916    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6"
Jul 13 20:41:26.337465 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:26.337419    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6" podStartSLOduration=7.337404456 podStartE2EDuration="7.337404456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:41:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:41:20.332113451 +0000 UTC m=+1358.066764638" watchObservedRunningTime="2026-07-13 20:41:26.337404456 +0000 UTC m=+1364.072055644"
Jul 13 20:41:29.118520 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:29.118484    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6"]
Jul 13 20:41:29.118949 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:29.118708    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6" podUID="76b7ee37-b200-4de2-8dbd-daeb4750066d" containerName="sequence-graph-e8943" containerID="cri-o://b838a914ce154774c0d348d481ad22ee0eb81d634e65d4d0c645b1cd2c9e6a64" gracePeriod=30
Jul 13 20:41:29.137223 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:29.137192    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:41:29.283950 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:29.283879    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:41:29.369400 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:29.369348    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:41:29.438222 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:29.438186    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:41:29.589068 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:29.588993    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:41:29.685077 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:29.685045    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:41:29.715010 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:29.714980    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq"]
Jul 13 20:41:29.718470 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:29.718454    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq"
Jul 13 20:41:29.721275 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:29.721251    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-db27e-serving-cert\""
Jul 13 20:41:29.722336 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:29.722318    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-db27e-kube-rbac-proxy-sar-config\""
Jul 13 20:41:29.734376 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:29.734341    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq"]
Jul 13 20:41:29.772776 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:29.772747    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:41:29.817038 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:29.817012    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6868ae1f-8f62-428d-949f-8d37a7f9148d-openshift-service-ca-bundle\") pod \"ensemble-graph-db27e-7896bb48fc-nhrvq\" (UID: \"6868ae1f-8f62-428d-949f-8d37a7f9148d\") " pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq"
Jul 13 20:41:29.817173 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:29.817051    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6868ae1f-8f62-428d-949f-8d37a7f9148d-proxy-tls\") pod \"ensemble-graph-db27e-7896bb48fc-nhrvq\" (UID: \"6868ae1f-8f62-428d-949f-8d37a7f9148d\") " pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq"
Jul 13 20:41:29.917725 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:29.917638    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6868ae1f-8f62-428d-949f-8d37a7f9148d-proxy-tls\") pod \"ensemble-graph-db27e-7896bb48fc-nhrvq\" (UID: \"6868ae1f-8f62-428d-949f-8d37a7f9148d\") " pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq"
Jul 13 20:41:29.917886 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:29.917745    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6868ae1f-8f62-428d-949f-8d37a7f9148d-openshift-service-ca-bundle\") pod \"ensemble-graph-db27e-7896bb48fc-nhrvq\" (UID: \"6868ae1f-8f62-428d-949f-8d37a7f9148d\") " pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq"
Jul 13 20:41:29.917886 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:41:29.917802    2588 secret.go:189] Couldn't get secret kserve-ci-e2e-test/ensemble-graph-db27e-serving-cert: secret "ensemble-graph-db27e-serving-cert" not found
Jul 13 20:41:29.917886 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:41:29.917868    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6868ae1f-8f62-428d-949f-8d37a7f9148d-proxy-tls podName:6868ae1f-8f62-428d-949f-8d37a7f9148d nodeName:}" failed. No retries permitted until 2026-07-13 20:41:30.417850629 +0000 UTC m=+1368.152501802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/6868ae1f-8f62-428d-949f-8d37a7f9148d-proxy-tls") pod "ensemble-graph-db27e-7896bb48fc-nhrvq" (UID: "6868ae1f-8f62-428d-949f-8d37a7f9148d") : secret "ensemble-graph-db27e-serving-cert" not found
Jul 13 20:41:29.918478 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:29.918455    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6868ae1f-8f62-428d-949f-8d37a7f9148d-openshift-service-ca-bundle\") pod \"ensemble-graph-db27e-7896bb48fc-nhrvq\" (UID: \"6868ae1f-8f62-428d-949f-8d37a7f9148d\") " pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq"
Jul 13 20:41:30.265935 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:30.265901    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:41:30.422440 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:30.422409    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6868ae1f-8f62-428d-949f-8d37a7f9148d-proxy-tls\") pod \"ensemble-graph-db27e-7896bb48fc-nhrvq\" (UID: \"6868ae1f-8f62-428d-949f-8d37a7f9148d\") " pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq"
Jul 13 20:41:30.424866 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:30.424841    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6868ae1f-8f62-428d-949f-8d37a7f9148d-proxy-tls\") pod \"ensemble-graph-db27e-7896bb48fc-nhrvq\" (UID: \"6868ae1f-8f62-428d-949f-8d37a7f9148d\") " pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq"
Jul 13 20:41:30.628852 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:30.628773    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq"
Jul 13 20:41:30.755423 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:30.755393    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq"]
Jul 13 20:41:30.758277 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:41:30.758248    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6868ae1f_8f62_428d_949f_8d37a7f9148d.slice/crio-4d758d77684747662e6371ade79aa544006a114f4ee99571649739b258bf4bf0 WatchSource:0}: Error finding container 4d758d77684747662e6371ade79aa544006a114f4ee99571649739b258bf4bf0: Status 404 returned error can't find the container with id 4d758d77684747662e6371ade79aa544006a114f4ee99571649739b258bf4bf0
Jul 13 20:41:31.314345 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:31.314296    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6" podUID="76b7ee37-b200-4de2-8dbd-daeb4750066d" containerName="sequence-graph-e8943" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:41:31.350215 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:31.350186    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq" event={"ID":"6868ae1f-8f62-428d-949f-8d37a7f9148d","Type":"ContainerStarted","Data":"0f6b2b9f2a76b87354323722a3071195461ff090ffadb86c430dbe47ed44617c"}
Jul 13 20:41:31.350396 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:31.350238    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq" event={"ID":"6868ae1f-8f62-428d-949f-8d37a7f9148d","Type":"ContainerStarted","Data":"4d758d77684747662e6371ade79aa544006a114f4ee99571649739b258bf4bf0"}
Jul 13 20:41:31.350396 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:31.350292    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq"
Jul 13 20:41:31.373842 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:31.373791    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq" podStartSLOduration=2.3737741740000002 podStartE2EDuration="2.373774174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:41:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:41:31.371635093 +0000 UTC m=+1369.106286283" watchObservedRunningTime="2026-07-13 20:41:31.373774174 +0000 UTC m=+1369.108425362"
Jul 13 20:41:36.314672 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:36.314634    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6" podUID="76b7ee37-b200-4de2-8dbd-daeb4750066d" containerName="sequence-graph-e8943" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:41:37.360974 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:37.360947    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq"
Jul 13 20:41:41.314265 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:41.314227    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6" podUID="76b7ee37-b200-4de2-8dbd-daeb4750066d" containerName="sequence-graph-e8943" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:41:41.314700 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:41.314354    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6"
Jul 13 20:41:46.313792 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:46.313747    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6" podUID="76b7ee37-b200-4de2-8dbd-daeb4750066d" containerName="sequence-graph-e8943" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:41:51.314805 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:51.314769    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6" podUID="76b7ee37-b200-4de2-8dbd-daeb4750066d" containerName="sequence-graph-e8943" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:41:56.314746 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:56.314698    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6" podUID="76b7ee37-b200-4de2-8dbd-daeb4750066d" containerName="sequence-graph-e8943" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:41:59.264207 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:59.264184    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6"
Jul 13 20:41:59.362427 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:59.362397    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76b7ee37-b200-4de2-8dbd-daeb4750066d-openshift-service-ca-bundle\") pod \"76b7ee37-b200-4de2-8dbd-daeb4750066d\" (UID: \"76b7ee37-b200-4de2-8dbd-daeb4750066d\") "
Jul 13 20:41:59.362584 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:59.362440    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/76b7ee37-b200-4de2-8dbd-daeb4750066d-proxy-tls\") pod \"76b7ee37-b200-4de2-8dbd-daeb4750066d\" (UID: \"76b7ee37-b200-4de2-8dbd-daeb4750066d\") "
Jul 13 20:41:59.362735 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:59.362712    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76b7ee37-b200-4de2-8dbd-daeb4750066d-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "76b7ee37-b200-4de2-8dbd-daeb4750066d" (UID: "76b7ee37-b200-4de2-8dbd-daeb4750066d"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:41:59.364495 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:59.364463    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76b7ee37-b200-4de2-8dbd-daeb4750066d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "76b7ee37-b200-4de2-8dbd-daeb4750066d" (UID: "76b7ee37-b200-4de2-8dbd-daeb4750066d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 20:41:59.461859 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:59.461831    2588 generic.go:356] "Generic (PLEG): container finished" podID="76b7ee37-b200-4de2-8dbd-daeb4750066d" containerID="b838a914ce154774c0d348d481ad22ee0eb81d634e65d4d0c645b1cd2c9e6a64" exitCode=137
Jul 13 20:41:59.461980 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:59.461879    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6"
Jul 13 20:41:59.461980 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:59.461890    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6" event={"ID":"76b7ee37-b200-4de2-8dbd-daeb4750066d","Type":"ContainerDied","Data":"b838a914ce154774c0d348d481ad22ee0eb81d634e65d4d0c645b1cd2c9e6a64"}
Jul 13 20:41:59.461980 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:59.461938    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6" event={"ID":"76b7ee37-b200-4de2-8dbd-daeb4750066d","Type":"ContainerDied","Data":"0d642cfbe38a42d8ec93f4f405031fdc24bcc55784c03d430298a069af1e24fe"}
Jul 13 20:41:59.461980 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:59.461963    2588 scope.go:117] "RemoveContainer" containerID="b838a914ce154774c0d348d481ad22ee0eb81d634e65d4d0c645b1cd2c9e6a64"
Jul 13 20:41:59.463054 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:59.463031    2588 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76b7ee37-b200-4de2-8dbd-daeb4750066d-openshift-service-ca-bundle\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:41:59.463106 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:59.463065    2588 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/76b7ee37-b200-4de2-8dbd-daeb4750066d-proxy-tls\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:41:59.470056 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:59.470031    2588 scope.go:117] "RemoveContainer" containerID="b838a914ce154774c0d348d481ad22ee0eb81d634e65d4d0c645b1cd2c9e6a64"
Jul 13 20:41:59.470299 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:41:59.470281    2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b838a914ce154774c0d348d481ad22ee0eb81d634e65d4d0c645b1cd2c9e6a64\": container with ID starting with b838a914ce154774c0d348d481ad22ee0eb81d634e65d4d0c645b1cd2c9e6a64 not found: ID does not exist" containerID="b838a914ce154774c0d348d481ad22ee0eb81d634e65d4d0c645b1cd2c9e6a64"
Jul 13 20:41:59.470382 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:59.470307    2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b838a914ce154774c0d348d481ad22ee0eb81d634e65d4d0c645b1cd2c9e6a64"} err="failed to get container status \"b838a914ce154774c0d348d481ad22ee0eb81d634e65d4d0c645b1cd2c9e6a64\": rpc error: code = NotFound desc = could not find container \"b838a914ce154774c0d348d481ad22ee0eb81d634e65d4d0c645b1cd2c9e6a64\": container with ID starting with b838a914ce154774c0d348d481ad22ee0eb81d634e65d4d0c645b1cd2c9e6a64 not found: ID does not exist"
Jul 13 20:41:59.486698 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:59.486676    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6"]
Jul 13 20:41:59.488009 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:41:59.487990    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-e8943-86d8b689d5-jprd6"]
Jul 13 20:42:00.968899 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:00.968865    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76b7ee37-b200-4de2-8dbd-daeb4750066d" path="/var/lib/kubelet/pods/76b7ee37-b200-4de2-8dbd-daeb4750066d/volumes"
Jul 13 20:42:11.622576 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:11.622538    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:42:11.887239 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:11.887137    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:42:20.448749 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:20.448715    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:42:29.389789 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:29.389709    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4"]
Jul 13 20:42:29.390125 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:29.390099    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76b7ee37-b200-4de2-8dbd-daeb4750066d" containerName="sequence-graph-e8943"
Jul 13 20:42:29.390125 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:29.390112    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="76b7ee37-b200-4de2-8dbd-daeb4750066d" containerName="sequence-graph-e8943"
Jul 13 20:42:29.390194 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:29.390168    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="76b7ee37-b200-4de2-8dbd-daeb4750066d" containerName="sequence-graph-e8943"
Jul 13 20:42:29.392927 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:29.392909    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4"
Jul 13 20:42:29.395236 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:29.395220    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-5859e-kube-rbac-proxy-sar-config\""
Jul 13 20:42:29.395509 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:29.395495    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-5859e-serving-cert\""
Jul 13 20:42:29.401818 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:29.401794    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4"]
Jul 13 20:42:29.418045 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:29.418019    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:42:29.500243 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:29.500203    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:42:29.510333 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:29.510312    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85687986-8924-4a05-9a2e-e927954ed56c-openshift-service-ca-bundle\") pod \"sequence-graph-5859e-7c56564db7-krtf4\" (UID: \"85687986-8924-4a05-9a2e-e927954ed56c\") " pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4"
Jul 13 20:42:29.510433 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:29.510347    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/85687986-8924-4a05-9a2e-e927954ed56c-proxy-tls\") pod \"sequence-graph-5859e-7c56564db7-krtf4\" (UID: \"85687986-8924-4a05-9a2e-e927954ed56c\") " pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4"
Jul 13 20:42:29.611326 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:29.611298    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85687986-8924-4a05-9a2e-e927954ed56c-openshift-service-ca-bundle\") pod \"sequence-graph-5859e-7c56564db7-krtf4\" (UID: \"85687986-8924-4a05-9a2e-e927954ed56c\") " pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4"
Jul 13 20:42:29.611463 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:29.611332    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/85687986-8924-4a05-9a2e-e927954ed56c-proxy-tls\") pod \"sequence-graph-5859e-7c56564db7-krtf4\" (UID: \"85687986-8924-4a05-9a2e-e927954ed56c\") " pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4"
Jul 13 20:42:29.611905 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:29.611886    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85687986-8924-4a05-9a2e-e927954ed56c-openshift-service-ca-bundle\") pod \"sequence-graph-5859e-7c56564db7-krtf4\" (UID: \"85687986-8924-4a05-9a2e-e927954ed56c\") " pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4"
Jul 13 20:42:29.613632 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:29.613615    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/85687986-8924-4a05-9a2e-e927954ed56c-proxy-tls\") pod \"sequence-graph-5859e-7c56564db7-krtf4\" (UID: \"85687986-8924-4a05-9a2e-e927954ed56c\") " pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4"
Jul 13 20:42:29.703439 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:29.703417    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4"
Jul 13 20:42:29.830320 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:29.830296    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4"]
Jul 13 20:42:29.832445 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:42:29.832415    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85687986_8924_4a05_9a2e_e927954ed56c.slice/crio-6f773678a757de9f821d7d4173c1c002c2e5c3d1adb0801ee30b547a80a0f735 WatchSource:0}: Error finding container 6f773678a757de9f821d7d4173c1c002c2e5c3d1adb0801ee30b547a80a0f735: Status 404 returned error can't find the container with id 6f773678a757de9f821d7d4173c1c002c2e5c3d1adb0801ee30b547a80a0f735
Jul 13 20:42:30.589108 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:30.589072    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4" event={"ID":"85687986-8924-4a05-9a2e-e927954ed56c","Type":"ContainerStarted","Data":"b2d663e11e2e235576609e8911722d4675892f517141dba47fbed6d9048388ac"}
Jul 13 20:42:30.589587 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:30.589129    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4" event={"ID":"85687986-8924-4a05-9a2e-e927954ed56c","Type":"ContainerStarted","Data":"6f773678a757de9f821d7d4173c1c002c2e5c3d1adb0801ee30b547a80a0f735"}
Jul 13 20:42:30.589587 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:30.589225    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4"
Jul 13 20:42:30.605405 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:30.605307    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4" podStartSLOduration=1.605290722 podStartE2EDuration="1.605290722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:42:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:42:30.604694107 +0000 UTC m=+1428.339345300" watchObservedRunningTime="2026-07-13 20:42:30.605290722 +0000 UTC m=+1428.339941910"
Jul 13 20:42:36.598893 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:42:36.598816    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4"
Jul 13 20:43:42.805455 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:43:42.805426    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 20:43:42.805981 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:43:42.805426    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 20:43:42.816897 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:43:42.816871    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 20:43:42.817044 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:43:42.816876    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 20:43:49.949790 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:43:49.949756    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:48:42.835332 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:48:42.835305    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 20:48:42.836865 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:48:42.836843    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 20:48:42.841196 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:48:42.841176    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 20:48:42.842481 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:48:42.842458    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 20:49:44.354347 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:49:44.354312    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq"]
Jul 13 20:49:44.354950 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:49:44.354548    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq" podUID="6868ae1f-8f62-428d-949f-8d37a7f9148d" containerName="ensemble-graph-db27e" containerID="cri-o://0f6b2b9f2a76b87354323722a3071195461ff090ffadb86c430dbe47ed44617c" gracePeriod=30
Jul 13 20:49:45.395352 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:49:45.395318    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:49:46.628996 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:49:46.628963    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:49:47.359303 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:49:47.359268    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq" podUID="6868ae1f-8f62-428d-949f-8d37a7f9148d" containerName="ensemble-graph-db27e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:49:52.358910 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:49:52.358871    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq" podUID="6868ae1f-8f62-428d-949f-8d37a7f9148d" containerName="ensemble-graph-db27e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:49:57.359112 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:49:57.359074    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq" podUID="6868ae1f-8f62-428d-949f-8d37a7f9148d" containerName="ensemble-graph-db27e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:49:57.359589 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:49:57.359170    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq"
Jul 13 20:50:02.358847 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:02.358813    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq" podUID="6868ae1f-8f62-428d-949f-8d37a7f9148d" containerName="ensemble-graph-db27e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:50:07.358422 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:07.358305    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq" podUID="6868ae1f-8f62-428d-949f-8d37a7f9148d" containerName="ensemble-graph-db27e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:50:12.359085 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:12.359049    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq" podUID="6868ae1f-8f62-428d-949f-8d37a7f9148d" containerName="ensemble-graph-db27e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:50:14.389069 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:14.389027    2588 generic.go:356] "Generic (PLEG): container finished" podID="6868ae1f-8f62-428d-949f-8d37a7f9148d" containerID="0f6b2b9f2a76b87354323722a3071195461ff090ffadb86c430dbe47ed44617c" exitCode=0
Jul 13 20:50:14.389425 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:14.389099    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq" event={"ID":"6868ae1f-8f62-428d-949f-8d37a7f9148d","Type":"ContainerDied","Data":"0f6b2b9f2a76b87354323722a3071195461ff090ffadb86c430dbe47ed44617c"}
Jul 13 20:50:14.501062 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:14.501039    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq"
Jul 13 20:50:14.551135 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:14.551103    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6868ae1f-8f62-428d-949f-8d37a7f9148d-openshift-service-ca-bundle\") pod \"6868ae1f-8f62-428d-949f-8d37a7f9148d\" (UID: \"6868ae1f-8f62-428d-949f-8d37a7f9148d\") "
Jul 13 20:50:14.551307 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:14.551140    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6868ae1f-8f62-428d-949f-8d37a7f9148d-proxy-tls\") pod \"6868ae1f-8f62-428d-949f-8d37a7f9148d\" (UID: \"6868ae1f-8f62-428d-949f-8d37a7f9148d\") "
Jul 13 20:50:14.551549 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:14.551523    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6868ae1f-8f62-428d-949f-8d37a7f9148d-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "6868ae1f-8f62-428d-949f-8d37a7f9148d" (UID: "6868ae1f-8f62-428d-949f-8d37a7f9148d"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:50:14.553242 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:14.553220    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6868ae1f-8f62-428d-949f-8d37a7f9148d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "6868ae1f-8f62-428d-949f-8d37a7f9148d" (UID: "6868ae1f-8f62-428d-949f-8d37a7f9148d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 20:50:14.651713 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:14.651623    2588 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6868ae1f-8f62-428d-949f-8d37a7f9148d-openshift-service-ca-bundle\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:50:14.651713 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:14.651650    2588 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6868ae1f-8f62-428d-949f-8d37a7f9148d-proxy-tls\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:50:15.394624 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:15.394538    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq"
Jul 13 20:50:15.394624 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:15.394571    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq" event={"ID":"6868ae1f-8f62-428d-949f-8d37a7f9148d","Type":"ContainerDied","Data":"4d758d77684747662e6371ade79aa544006a114f4ee99571649739b258bf4bf0"}
Jul 13 20:50:15.394624 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:15.394626    2588 scope.go:117] "RemoveContainer" containerID="0f6b2b9f2a76b87354323722a3071195461ff090ffadb86c430dbe47ed44617c"
Jul 13 20:50:15.411115 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:15.411089    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq"]
Jul 13 20:50:15.414635 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:15.414615    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-db27e-7896bb48fc-nhrvq"]
Jul 13 20:50:16.969942 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:16.969910    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6868ae1f-8f62-428d-949f-8d37a7f9148d" path="/var/lib/kubelet/pods/6868ae1f-8f62-428d-949f-8d37a7f9148d/volumes"
Jul 13 20:50:30.234406 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:30.234354    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:50:43.987625 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:43.987590    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4"]
Jul 13 20:50:43.988003 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:43.987849    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4" podUID="85687986-8924-4a05-9a2e-e927954ed56c" containerName="sequence-graph-5859e" containerID="cri-o://b2d663e11e2e235576609e8911722d4675892f517141dba47fbed6d9048388ac" gracePeriod=30
Jul 13 20:50:44.013173 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.013136    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:50:44.116739 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.116705    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:50:44.179673 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.179643    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:50:44.278891 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.278811    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:50:44.422711 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.422678    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:50:44.524115 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.524085    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:50:44.588058 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.587988    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64"]
Jul 13 20:50:44.588323 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.588310    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6868ae1f-8f62-428d-949f-8d37a7f9148d" containerName="ensemble-graph-db27e"
Jul 13 20:50:44.588391 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.588325    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="6868ae1f-8f62-428d-949f-8d37a7f9148d" containerName="ensemble-graph-db27e"
Jul 13 20:50:44.588432 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.588411    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="6868ae1f-8f62-428d-949f-8d37a7f9148d" containerName="ensemble-graph-db27e"
Jul 13 20:50:44.592217 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.592200    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64"
Jul 13 20:50:44.594485 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.594466    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-35019-kube-rbac-proxy-sar-config\""
Jul 13 20:50:44.594603 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.594469    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-35019-serving-cert\""
Jul 13 20:50:44.599450 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.599428    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64"]
Jul 13 20:50:44.602308 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.602286    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:50:44.702396 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.702352    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:50:44.709463 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.709444    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6d137771-a26b-4357-b7a0-e4079ac333f8-proxy-tls\") pod \"splitter-graph-35019-8565bdbbb7-fcg64\" (UID: \"6d137771-a26b-4357-b7a0-e4079ac333f8\") " pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64"
Jul 13 20:50:44.709532 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.709504    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d137771-a26b-4357-b7a0-e4079ac333f8-openshift-service-ca-bundle\") pod \"splitter-graph-35019-8565bdbbb7-fcg64\" (UID: \"6d137771-a26b-4357-b7a0-e4079ac333f8\") " pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64"
Jul 13 20:50:44.810009 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.809969    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d137771-a26b-4357-b7a0-e4079ac333f8-openshift-service-ca-bundle\") pod \"splitter-graph-35019-8565bdbbb7-fcg64\" (UID: \"6d137771-a26b-4357-b7a0-e4079ac333f8\") " pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64"
Jul 13 20:50:44.810163 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.810084    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6d137771-a26b-4357-b7a0-e4079ac333f8-proxy-tls\") pod \"splitter-graph-35019-8565bdbbb7-fcg64\" (UID: \"6d137771-a26b-4357-b7a0-e4079ac333f8\") " pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64"
Jul 13 20:50:44.810710 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.810687    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d137771-a26b-4357-b7a0-e4079ac333f8-openshift-service-ca-bundle\") pod \"splitter-graph-35019-8565bdbbb7-fcg64\" (UID: \"6d137771-a26b-4357-b7a0-e4079ac333f8\") " pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64"
Jul 13 20:50:44.812516 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.812495    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6d137771-a26b-4357-b7a0-e4079ac333f8-proxy-tls\") pod \"splitter-graph-35019-8565bdbbb7-fcg64\" (UID: \"6d137771-a26b-4357-b7a0-e4079ac333f8\") " pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64"
Jul 13 20:50:44.902782 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:44.902704    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64"
Jul 13 20:50:45.036286 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:45.035896    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64"]
Jul 13 20:50:45.038683 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:50:45.038654    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d137771_a26b_4357_b7a0_e4079ac333f8.slice/crio-ec38ed33781a6aef636ec1179de60f154561b9306442bfd0926d642b9b5dac5a WatchSource:0}: Error finding container ec38ed33781a6aef636ec1179de60f154561b9306442bfd0926d642b9b5dac5a: Status 404 returned error can't find the container with id ec38ed33781a6aef636ec1179de60f154561b9306442bfd0926d642b9b5dac5a
Jul 13 20:50:45.521410 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:45.521375    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64" event={"ID":"6d137771-a26b-4357-b7a0-e4079ac333f8","Type":"ContainerStarted","Data":"70a8f6e54b2a9851c5546d2efbe7c8bd1384c8950fe8c9863f9e33e8ebbcddd9"}
Jul 13 20:50:45.521591 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:45.521428    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64" event={"ID":"6d137771-a26b-4357-b7a0-e4079ac333f8","Type":"ContainerStarted","Data":"ec38ed33781a6aef636ec1179de60f154561b9306442bfd0926d642b9b5dac5a"}
Jul 13 20:50:45.521591 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:45.521532    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64"
Jul 13 20:50:45.541177 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:45.541130    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64" podStartSLOduration=1.541114604 podStartE2EDuration="1.541114604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:50:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:50:45.540295659 +0000 UTC m=+1923.274946847" watchObservedRunningTime="2026-07-13 20:50:45.541114604 +0000 UTC m=+1923.275765793"
Jul 13 20:50:46.597410 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:46.597347    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4" podUID="85687986-8924-4a05-9a2e-e927954ed56c" containerName="sequence-graph-5859e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:50:51.530829 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:51.530801    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64"
Jul 13 20:50:51.598046 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:51.598004    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4" podUID="85687986-8924-4a05-9a2e-e927954ed56c" containerName="sequence-graph-5859e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:50:54.679956 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:54.679926    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64"]
Jul 13 20:50:54.680294 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:54.680135    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64" podUID="6d137771-a26b-4357-b7a0-e4079ac333f8" containerName="splitter-graph-35019" containerID="cri-o://70a8f6e54b2a9851c5546d2efbe7c8bd1384c8950fe8c9863f9e33e8ebbcddd9" gracePeriod=30
Jul 13 20:50:54.701655 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:54.701621    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:50:54.808594 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:54.808563    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:50:54.881611 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:54.881580    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:50:54.944657 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:54.944580    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:50:55.059358 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:55.059328    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:50:55.163227 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:55.163198    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:50:56.529538 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:56.529499    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64" podUID="6d137771-a26b-4357-b7a0-e4079ac333f8" containerName="splitter-graph-35019" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:50:56.598083 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:56.598035    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4" podUID="85687986-8924-4a05-9a2e-e927954ed56c" containerName="sequence-graph-5859e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:50:56.598237 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:50:56.598188    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4"
Jul 13 20:51:01.529505 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:01.529455    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64" podUID="6d137771-a26b-4357-b7a0-e4079ac333f8" containerName="splitter-graph-35019" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:51:01.597395 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:01.597339    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4" podUID="85687986-8924-4a05-9a2e-e927954ed56c" containerName="sequence-graph-5859e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:51:03.746098 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:03.746065    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:51:06.529748 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:06.529706    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64" podUID="6d137771-a26b-4357-b7a0-e4079ac333f8" containerName="splitter-graph-35019" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:51:06.530151 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:06.529810    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64"
Jul 13 20:51:06.597816 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:06.597778    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4" podUID="85687986-8924-4a05-9a2e-e927954ed56c" containerName="sequence-graph-5859e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:51:11.529195 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:11.529151    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64" podUID="6d137771-a26b-4357-b7a0-e4079ac333f8" containerName="splitter-graph-35019" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:51:11.597580 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:11.597544    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4" podUID="85687986-8924-4a05-9a2e-e927954ed56c" containerName="sequence-graph-5859e" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:51:14.132179 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:14.132156    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4"
Jul 13 20:51:14.148980 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:14.148574    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/85687986-8924-4a05-9a2e-e927954ed56c-proxy-tls\") pod \"85687986-8924-4a05-9a2e-e927954ed56c\" (UID: \"85687986-8924-4a05-9a2e-e927954ed56c\") "
Jul 13 20:51:14.149138 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:14.149051    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85687986-8924-4a05-9a2e-e927954ed56c-openshift-service-ca-bundle\") pod \"85687986-8924-4a05-9a2e-e927954ed56c\" (UID: \"85687986-8924-4a05-9a2e-e927954ed56c\") "
Jul 13 20:51:14.149455 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:14.149432    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85687986-8924-4a05-9a2e-e927954ed56c-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "85687986-8924-4a05-9a2e-e927954ed56c" (UID: "85687986-8924-4a05-9a2e-e927954ed56c"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:51:14.150761 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:14.150737    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/85687986-8924-4a05-9a2e-e927954ed56c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "85687986-8924-4a05-9a2e-e927954ed56c" (UID: "85687986-8924-4a05-9a2e-e927954ed56c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 20:51:14.250503 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:14.250423    2588 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/85687986-8924-4a05-9a2e-e927954ed56c-proxy-tls\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:51:14.250503 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:14.250452    2588 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85687986-8924-4a05-9a2e-e927954ed56c-openshift-service-ca-bundle\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:51:14.638306 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:14.638220    2588 generic.go:356] "Generic (PLEG): container finished" podID="85687986-8924-4a05-9a2e-e927954ed56c" containerID="b2d663e11e2e235576609e8911722d4675892f517141dba47fbed6d9048388ac" exitCode=0
Jul 13 20:51:14.638306 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:14.638277    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4"
Jul 13 20:51:14.638550 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:14.638305    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4" event={"ID":"85687986-8924-4a05-9a2e-e927954ed56c","Type":"ContainerDied","Data":"b2d663e11e2e235576609e8911722d4675892f517141dba47fbed6d9048388ac"}
Jul 13 20:51:14.638550 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:14.638376    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4" event={"ID":"85687986-8924-4a05-9a2e-e927954ed56c","Type":"ContainerDied","Data":"6f773678a757de9f821d7d4173c1c002c2e5c3d1adb0801ee30b547a80a0f735"}
Jul 13 20:51:14.638550 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:14.638407    2588 scope.go:117] "RemoveContainer" containerID="b2d663e11e2e235576609e8911722d4675892f517141dba47fbed6d9048388ac"
Jul 13 20:51:14.647123 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:14.647099    2588 scope.go:117] "RemoveContainer" containerID="b2d663e11e2e235576609e8911722d4675892f517141dba47fbed6d9048388ac"
Jul 13 20:51:14.647395 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:51:14.647357    2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2d663e11e2e235576609e8911722d4675892f517141dba47fbed6d9048388ac\": container with ID starting with b2d663e11e2e235576609e8911722d4675892f517141dba47fbed6d9048388ac not found: ID does not exist" containerID="b2d663e11e2e235576609e8911722d4675892f517141dba47fbed6d9048388ac"
Jul 13 20:51:14.647465 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:14.647408    2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2d663e11e2e235576609e8911722d4675892f517141dba47fbed6d9048388ac"} err="failed to get container status \"b2d663e11e2e235576609e8911722d4675892f517141dba47fbed6d9048388ac\": rpc error: code = NotFound desc = could not find container \"b2d663e11e2e235576609e8911722d4675892f517141dba47fbed6d9048388ac\": container with ID starting with b2d663e11e2e235576609e8911722d4675892f517141dba47fbed6d9048388ac not found: ID does not exist"
Jul 13 20:51:14.659757 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:14.659733    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4"]
Jul 13 20:51:14.663279 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:14.663258    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-5859e-7c56564db7-krtf4"]
Jul 13 20:51:14.968969 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:14.968941    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85687986-8924-4a05-9a2e-e927954ed56c" path="/var/lib/kubelet/pods/85687986-8924-4a05-9a2e-e927954ed56c/volumes"
Jul 13 20:51:16.528820 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:16.528784    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64" podUID="6d137771-a26b-4357-b7a0-e4079ac333f8" containerName="splitter-graph-35019" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:51:21.529279 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:21.529239    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64" podUID="6d137771-a26b-4357-b7a0-e4079ac333f8" containerName="splitter-graph-35019" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 20:51:24.821665 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:24.821634    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64"
Jul 13 20:51:24.938436 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:24.938331    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d137771-a26b-4357-b7a0-e4079ac333f8-openshift-service-ca-bundle\") pod \"6d137771-a26b-4357-b7a0-e4079ac333f8\" (UID: \"6d137771-a26b-4357-b7a0-e4079ac333f8\") "
Jul 13 20:51:24.938436 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:24.938421    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6d137771-a26b-4357-b7a0-e4079ac333f8-proxy-tls\") pod \"6d137771-a26b-4357-b7a0-e4079ac333f8\" (UID: \"6d137771-a26b-4357-b7a0-e4079ac333f8\") "
Jul 13 20:51:24.938711 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:24.938689    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d137771-a26b-4357-b7a0-e4079ac333f8-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "6d137771-a26b-4357-b7a0-e4079ac333f8" (UID: "6d137771-a26b-4357-b7a0-e4079ac333f8"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 20:51:24.940462 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:24.940431    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d137771-a26b-4357-b7a0-e4079ac333f8-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "6d137771-a26b-4357-b7a0-e4079ac333f8" (UID: "6d137771-a26b-4357-b7a0-e4079ac333f8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 20:51:25.039770 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:25.039727    2588 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d137771-a26b-4357-b7a0-e4079ac333f8-openshift-service-ca-bundle\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:51:25.039770 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:25.039766    2588 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6d137771-a26b-4357-b7a0-e4079ac333f8-proxy-tls\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 20:51:25.684336 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:25.684304    2588 generic.go:356] "Generic (PLEG): container finished" podID="6d137771-a26b-4357-b7a0-e4079ac333f8" containerID="70a8f6e54b2a9851c5546d2efbe7c8bd1384c8950fe8c9863f9e33e8ebbcddd9" exitCode=0
Jul 13 20:51:25.684520 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:25.684346    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64" event={"ID":"6d137771-a26b-4357-b7a0-e4079ac333f8","Type":"ContainerDied","Data":"70a8f6e54b2a9851c5546d2efbe7c8bd1384c8950fe8c9863f9e33e8ebbcddd9"}
Jul 13 20:51:25.684520 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:25.684379    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64"
Jul 13 20:51:25.684520 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:25.684431    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64" event={"ID":"6d137771-a26b-4357-b7a0-e4079ac333f8","Type":"ContainerDied","Data":"ec38ed33781a6aef636ec1179de60f154561b9306442bfd0926d642b9b5dac5a"}
Jul 13 20:51:25.684520 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:25.684455    2588 scope.go:117] "RemoveContainer" containerID="70a8f6e54b2a9851c5546d2efbe7c8bd1384c8950fe8c9863f9e33e8ebbcddd9"
Jul 13 20:51:25.692734 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:25.692716    2588 scope.go:117] "RemoveContainer" containerID="70a8f6e54b2a9851c5546d2efbe7c8bd1384c8950fe8c9863f9e33e8ebbcddd9"
Jul 13 20:51:25.692986 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:51:25.692967    2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70a8f6e54b2a9851c5546d2efbe7c8bd1384c8950fe8c9863f9e33e8ebbcddd9\": container with ID starting with 70a8f6e54b2a9851c5546d2efbe7c8bd1384c8950fe8c9863f9e33e8ebbcddd9 not found: ID does not exist" containerID="70a8f6e54b2a9851c5546d2efbe7c8bd1384c8950fe8c9863f9e33e8ebbcddd9"
Jul 13 20:51:25.693029 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:25.693000    2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70a8f6e54b2a9851c5546d2efbe7c8bd1384c8950fe8c9863f9e33e8ebbcddd9"} err="failed to get container status \"70a8f6e54b2a9851c5546d2efbe7c8bd1384c8950fe8c9863f9e33e8ebbcddd9\": rpc error: code = NotFound desc = could not find container \"70a8f6e54b2a9851c5546d2efbe7c8bd1384c8950fe8c9863f9e33e8ebbcddd9\": container with ID starting with 70a8f6e54b2a9851c5546d2efbe7c8bd1384c8950fe8c9863f9e33e8ebbcddd9 not found: ID does not exist"
Jul 13 20:51:25.700831 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:25.700801    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64"]
Jul 13 20:51:25.704627 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:25.704605    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-35019-8565bdbbb7-fcg64"]
Jul 13 20:51:26.969645 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:26.969616    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d137771-a26b-4357-b7a0-e4079ac333f8" path="/var/lib/kubelet/pods/6d137771-a26b-4357-b7a0-e4079ac333f8/volumes"
Jul 13 20:51:54.239378 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.239327    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn"]
Jul 13 20:51:54.239866 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.239629    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85687986-8924-4a05-9a2e-e927954ed56c" containerName="sequence-graph-5859e"
Jul 13 20:51:54.239866 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.239641    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="85687986-8924-4a05-9a2e-e927954ed56c" containerName="sequence-graph-5859e"
Jul 13 20:51:54.239866 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.239665    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d137771-a26b-4357-b7a0-e4079ac333f8" containerName="splitter-graph-35019"
Jul 13 20:51:54.239866 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.239672    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d137771-a26b-4357-b7a0-e4079ac333f8" containerName="splitter-graph-35019"
Jul 13 20:51:54.239866 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.239718    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d137771-a26b-4357-b7a0-e4079ac333f8" containerName="splitter-graph-35019"
Jul 13 20:51:54.239866 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.239726    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="85687986-8924-4a05-9a2e-e927954ed56c" containerName="sequence-graph-5859e"
Jul 13 20:51:54.242531 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.242514    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn"
Jul 13 20:51:54.245203 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.245176    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-575ad-serving-cert\""
Jul 13 20:51:54.245314 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.245214    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-575ad-kube-rbac-proxy-sar-config\""
Jul 13 20:51:54.245931 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.245910    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 13 20:51:54.246037 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.245950    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-kvq55\""
Jul 13 20:51:54.252465 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.252439    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn"]
Jul 13 20:51:54.253096 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.252577    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:51:54.389004 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.388968    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e36ee415-fdf7-4b2c-931a-7f3da8cc3e06-openshift-service-ca-bundle\") pod \"switch-graph-575ad-64d456d77c-rsdgn\" (UID: \"e36ee415-fdf7-4b2c-931a-7f3da8cc3e06\") " pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn"
Jul 13 20:51:54.389252 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.389035    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e36ee415-fdf7-4b2c-931a-7f3da8cc3e06-proxy-tls\") pod \"switch-graph-575ad-64d456d77c-rsdgn\" (UID: \"e36ee415-fdf7-4b2c-931a-7f3da8cc3e06\") " pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn"
Jul 13 20:51:54.490140 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.490038    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e36ee415-fdf7-4b2c-931a-7f3da8cc3e06-openshift-service-ca-bundle\") pod \"switch-graph-575ad-64d456d77c-rsdgn\" (UID: \"e36ee415-fdf7-4b2c-931a-7f3da8cc3e06\") " pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn"
Jul 13 20:51:54.490140 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.490128    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e36ee415-fdf7-4b2c-931a-7f3da8cc3e06-proxy-tls\") pod \"switch-graph-575ad-64d456d77c-rsdgn\" (UID: \"e36ee415-fdf7-4b2c-931a-7f3da8cc3e06\") " pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn"
Jul 13 20:51:54.490406 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:51:54.490243    2588 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-575ad-serving-cert: secret "switch-graph-575ad-serving-cert" not found
Jul 13 20:51:54.490406 ip-10-0-134-97 kubenswrapper[2588]: E0713 20:51:54.490312    2588 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e36ee415-fdf7-4b2c-931a-7f3da8cc3e06-proxy-tls podName:e36ee415-fdf7-4b2c-931a-7f3da8cc3e06 nodeName:}" failed. No retries permitted until 2026-07-13 20:51:54.990291671 +0000 UTC m=+1992.724942839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/e36ee415-fdf7-4b2c-931a-7f3da8cc3e06-proxy-tls") pod "switch-graph-575ad-64d456d77c-rsdgn" (UID: "e36ee415-fdf7-4b2c-931a-7f3da8cc3e06") : secret "switch-graph-575ad-serving-cert" not found
Jul 13 20:51:54.490730 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.490708    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e36ee415-fdf7-4b2c-931a-7f3da8cc3e06-openshift-service-ca-bundle\") pod \"switch-graph-575ad-64d456d77c-rsdgn\" (UID: \"e36ee415-fdf7-4b2c-931a-7f3da8cc3e06\") " pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn"
Jul 13 20:51:54.644570 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.644538    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:51:54.914132 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.914054    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv"]
Jul 13 20:51:54.917513 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.917484    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv"
Jul 13 20:51:54.917700 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.917671    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:51:54.919892 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.919871    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-492f6-serving-cert\""
Jul 13 20:51:54.919974 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.919875    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-492f6-kube-rbac-proxy-sar-config\""
Jul 13 20:51:54.926668 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.926642    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv"]
Jul 13 20:51:54.995822 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.995787    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e36ee415-fdf7-4b2c-931a-7f3da8cc3e06-proxy-tls\") pod \"switch-graph-575ad-64d456d77c-rsdgn\" (UID: \"e36ee415-fdf7-4b2c-931a-7f3da8cc3e06\") " pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn"
Jul 13 20:51:54.998155 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:54.998133    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e36ee415-fdf7-4b2c-931a-7f3da8cc3e06-proxy-tls\") pod \"switch-graph-575ad-64d456d77c-rsdgn\" (UID: \"e36ee415-fdf7-4b2c-931a-7f3da8cc3e06\") " pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn"
Jul 13 20:51:55.096974 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:55.096944    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5a02f041-848b-4179-aaf7-b9291aaad1a9-proxy-tls\") pod \"splitter-graph-492f6-67c988957c-hcprv\" (UID: \"5a02f041-848b-4179-aaf7-b9291aaad1a9\") " pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv"
Jul 13 20:51:55.097145 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:55.096998    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a02f041-848b-4179-aaf7-b9291aaad1a9-openshift-service-ca-bundle\") pod \"splitter-graph-492f6-67c988957c-hcprv\" (UID: \"5a02f041-848b-4179-aaf7-b9291aaad1a9\") " pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv"
Jul 13 20:51:55.126199 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:55.126166    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:51:55.158129 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:55.158106    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn"
Jul 13 20:51:55.197993 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:55.197960    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a02f041-848b-4179-aaf7-b9291aaad1a9-openshift-service-ca-bundle\") pod \"splitter-graph-492f6-67c988957c-hcprv\" (UID: \"5a02f041-848b-4179-aaf7-b9291aaad1a9\") " pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv"
Jul 13 20:51:55.198155 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:55.198047    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5a02f041-848b-4179-aaf7-b9291aaad1a9-proxy-tls\") pod \"splitter-graph-492f6-67c988957c-hcprv\" (UID: \"5a02f041-848b-4179-aaf7-b9291aaad1a9\") " pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv"
Jul 13 20:51:55.198599 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:55.198568    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a02f041-848b-4179-aaf7-b9291aaad1a9-openshift-service-ca-bundle\") pod \"splitter-graph-492f6-67c988957c-hcprv\" (UID: \"5a02f041-848b-4179-aaf7-b9291aaad1a9\") " pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv"
Jul 13 20:51:55.200590 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:55.200555    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5a02f041-848b-4179-aaf7-b9291aaad1a9-proxy-tls\") pod \"splitter-graph-492f6-67c988957c-hcprv\" (UID: \"5a02f041-848b-4179-aaf7-b9291aaad1a9\") " pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv"
Jul 13 20:51:55.227600 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:55.227517    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv"
Jul 13 20:51:55.290768 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:55.290739    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn"]
Jul 13 20:51:55.294103 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:51:55.294069    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode36ee415_fdf7_4b2c_931a_7f3da8cc3e06.slice/crio-7fcc687c658d2d55a8b4d84d4e42c54fead7a3877f57413bac11cd1f80fbb477 WatchSource:0}: Error finding container 7fcc687c658d2d55a8b4d84d4e42c54fead7a3877f57413bac11cd1f80fbb477: Status 404 returned error can't find the container with id 7fcc687c658d2d55a8b4d84d4e42c54fead7a3877f57413bac11cd1f80fbb477
Jul 13 20:51:55.364797 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:55.364770    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv"]
Jul 13 20:51:55.367243 ip-10-0-134-97 kubenswrapper[2588]: W0713 20:51:55.367220    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a02f041_848b_4179_aaf7_b9291aaad1a9.slice/crio-4120e9e2b8026d95c78450b22e1de7d11962c736f539a3ff5fd1c5518d40cdbf WatchSource:0}: Error finding container 4120e9e2b8026d95c78450b22e1de7d11962c736f539a3ff5fd1c5518d40cdbf: Status 404 returned error can't find the container with id 4120e9e2b8026d95c78450b22e1de7d11962c736f539a3ff5fd1c5518d40cdbf
Jul 13 20:51:55.806256 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:55.806218    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn" event={"ID":"e36ee415-fdf7-4b2c-931a-7f3da8cc3e06","Type":"ContainerStarted","Data":"80c4b10305b3edc8e3a492c1443bfcfbb8ef1d620d7be821cf617fe3a309bfea"}
Jul 13 20:51:55.806492 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:55.806396    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn"
Jul 13 20:51:55.806492 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:55.806452    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn" event={"ID":"e36ee415-fdf7-4b2c-931a-7f3da8cc3e06","Type":"ContainerStarted","Data":"7fcc687c658d2d55a8b4d84d4e42c54fead7a3877f57413bac11cd1f80fbb477"}
Jul 13 20:51:55.807623 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:55.807602    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv" event={"ID":"5a02f041-848b-4179-aaf7-b9291aaad1a9","Type":"ContainerStarted","Data":"74de7bda1d968839eae2124bcaa6295676ba62b0dcdec22ecd213b004f9d8015"}
Jul 13 20:51:55.807718 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:55.807640    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv" event={"ID":"5a02f041-848b-4179-aaf7-b9291aaad1a9","Type":"ContainerStarted","Data":"4120e9e2b8026d95c78450b22e1de7d11962c736f539a3ff5fd1c5518d40cdbf"}
Jul 13 20:51:55.807718 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:55.807663    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv"
Jul 13 20:51:55.824351 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:55.824308    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn" podStartSLOduration=1.824294589 podStartE2EDuration="1.824294589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:51:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:51:55.822590645 +0000 UTC m=+1993.557241833" watchObservedRunningTime="2026-07-13 20:51:55.824294589 +0000 UTC m=+1993.558945816"
Jul 13 20:51:55.837782 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:51:55.837746    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv" podStartSLOduration=1.837732828 podStartE2EDuration="1.837732828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 20:51:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 20:51:55.837187714 +0000 UTC m=+1993.571838905" watchObservedRunningTime="2026-07-13 20:51:55.837732828 +0000 UTC m=+1993.572384016"
Jul 13 20:52:01.815891 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:52:01.815858    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv"
Jul 13 20:52:01.816451 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:52:01.816431    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn"
Jul 13 20:53:42.859112 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:53:42.859072    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 20:53:42.861745 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:53:42.861707    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 20:53:42.865225 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:53:42.865205    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 20:53:42.867768 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:53:42.867752    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 20:56:14.927518 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:56:14.927435    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 20:58:42.889875 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:58:42.889767    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 20:58:42.893827 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:58:42.893170    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 20:58:42.896004 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:58:42.895984    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 20:58:42.899113 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:58:42.899096    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 20:59:14.402323 ip-10-0-134-97 kubenswrapper[2588]: I0713 20:59:14.402241    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 21:00:09.588829 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:09.588793    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv"]
Jul 13 21:00:09.589357 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:09.589025    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv" podUID="5a02f041-848b-4179-aaf7-b9291aaad1a9" containerName="splitter-graph-492f6" containerID="cri-o://74de7bda1d968839eae2124bcaa6295676ba62b0dcdec22ecd213b004f9d8015" gracePeriod=30
Jul 13 21:00:09.613495 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:09.613463    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 21:00:09.773388 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:09.773343    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 21:00:09.827305 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:09.827276    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 21:00:11.815217 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:11.815174    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv" podUID="5a02f041-848b-4179-aaf7-b9291aaad1a9" containerName="splitter-graph-492f6" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 21:00:16.815601 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:16.815565    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv" podUID="5a02f041-848b-4179-aaf7-b9291aaad1a9" containerName="splitter-graph-492f6" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 21:00:21.815290 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:21.815252    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv" podUID="5a02f041-848b-4179-aaf7-b9291aaad1a9" containerName="splitter-graph-492f6" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 21:00:21.815703 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:21.815354    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv"
Jul 13 21:00:26.815164 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:26.815130    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv" podUID="5a02f041-848b-4179-aaf7-b9291aaad1a9" containerName="splitter-graph-492f6" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 21:00:31.815625 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:31.815587    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv" podUID="5a02f041-848b-4179-aaf7-b9291aaad1a9" containerName="splitter-graph-492f6" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 21:00:36.814884 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:36.814792    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv" podUID="5a02f041-848b-4179-aaf7-b9291aaad1a9" containerName="splitter-graph-492f6" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 21:00:39.734509 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:39.734482    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv"
Jul 13 21:00:39.847031 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:39.846960    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5a02f041-848b-4179-aaf7-b9291aaad1a9-proxy-tls\") pod \"5a02f041-848b-4179-aaf7-b9291aaad1a9\" (UID: \"5a02f041-848b-4179-aaf7-b9291aaad1a9\") "
Jul 13 21:00:39.847031 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:39.846995    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a02f041-848b-4179-aaf7-b9291aaad1a9-openshift-service-ca-bundle\") pod \"5a02f041-848b-4179-aaf7-b9291aaad1a9\" (UID: \"5a02f041-848b-4179-aaf7-b9291aaad1a9\") "
Jul 13 21:00:39.847471 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:39.847442    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a02f041-848b-4179-aaf7-b9291aaad1a9-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "5a02f041-848b-4179-aaf7-b9291aaad1a9" (UID: "5a02f041-848b-4179-aaf7-b9291aaad1a9"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:00:39.848889 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:39.848866    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a02f041-848b-4179-aaf7-b9291aaad1a9-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "5a02f041-848b-4179-aaf7-b9291aaad1a9" (UID: "5a02f041-848b-4179-aaf7-b9291aaad1a9"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:00:39.851910 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:39.851881    2588 generic.go:356] "Generic (PLEG): container finished" podID="5a02f041-848b-4179-aaf7-b9291aaad1a9" containerID="74de7bda1d968839eae2124bcaa6295676ba62b0dcdec22ecd213b004f9d8015" exitCode=0
Jul 13 21:00:39.852009 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:39.851962    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv" event={"ID":"5a02f041-848b-4179-aaf7-b9291aaad1a9","Type":"ContainerDied","Data":"74de7bda1d968839eae2124bcaa6295676ba62b0dcdec22ecd213b004f9d8015"}
Jul 13 21:00:39.852009 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:39.851993    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv"
Jul 13 21:00:39.852125 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:39.852016    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv" event={"ID":"5a02f041-848b-4179-aaf7-b9291aaad1a9","Type":"ContainerDied","Data":"4120e9e2b8026d95c78450b22e1de7d11962c736f539a3ff5fd1c5518d40cdbf"}
Jul 13 21:00:39.852125 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:39.852046    2588 scope.go:117] "RemoveContainer" containerID="74de7bda1d968839eae2124bcaa6295676ba62b0dcdec22ecd213b004f9d8015"
Jul 13 21:00:39.859812 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:39.859736    2588 scope.go:117] "RemoveContainer" containerID="74de7bda1d968839eae2124bcaa6295676ba62b0dcdec22ecd213b004f9d8015"
Jul 13 21:00:39.860105 ip-10-0-134-97 kubenswrapper[2588]: E0713 21:00:39.860037    2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74de7bda1d968839eae2124bcaa6295676ba62b0dcdec22ecd213b004f9d8015\": container with ID starting with 74de7bda1d968839eae2124bcaa6295676ba62b0dcdec22ecd213b004f9d8015 not found: ID does not exist" containerID="74de7bda1d968839eae2124bcaa6295676ba62b0dcdec22ecd213b004f9d8015"
Jul 13 21:00:39.860105 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:39.860088    2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74de7bda1d968839eae2124bcaa6295676ba62b0dcdec22ecd213b004f9d8015"} err="failed to get container status \"74de7bda1d968839eae2124bcaa6295676ba62b0dcdec22ecd213b004f9d8015\": rpc error: code = NotFound desc = could not find container \"74de7bda1d968839eae2124bcaa6295676ba62b0dcdec22ecd213b004f9d8015\": container with ID starting with 74de7bda1d968839eae2124bcaa6295676ba62b0dcdec22ecd213b004f9d8015 not found: ID does not exist"
Jul 13 21:00:39.872604 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:39.872571    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv"]
Jul 13 21:00:39.876651 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:39.876632    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-492f6-67c988957c-hcprv"]
Jul 13 21:00:39.948310 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:39.948287    2588 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/5a02f041-848b-4179-aaf7-b9291aaad1a9-proxy-tls\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 21:00:39.948310 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:39.948309    2588 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a02f041-848b-4179-aaf7-b9291aaad1a9-openshift-service-ca-bundle\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 21:00:40.973955 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:00:40.970583    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a02f041-848b-4179-aaf7-b9291aaad1a9" path="/var/lib/kubelet/pods/5a02f041-848b-4179-aaf7-b9291aaad1a9/volumes"
Jul 13 21:03:42.914250 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:03:42.914140    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 21:03:42.918710 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:03:42.918639    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 21:03:42.920142 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:03:42.920126    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 21:03:42.924270 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:03:42.924253    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 21:03:44.419896 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:03:44.419856    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 21:07:20.394735 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:07:20.394699    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:13.626596 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:13.626500    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn"]
Jul 13 21:08:13.627140 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:13.626773    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn" podUID="e36ee415-fdf7-4b2c-931a-7f3da8cc3e06" containerName="switch-graph-575ad" containerID="cri-o://80c4b10305b3edc8e3a492c1443bfcfbb8ef1d620d7be821cf617fe3a309bfea" gracePeriod=30
Jul 13 21:08:13.670208 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:13.670172    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:13.792271 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:13.792238    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:13.854867 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:13.854805    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:15.217804 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:15.217774    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:15.224610 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:15.224579    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xm2jj/must-gather-5jqql"]
Jul 13 21:08:15.224936 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:15.224923    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a02f041-848b-4179-aaf7-b9291aaad1a9" containerName="splitter-graph-492f6"
Jul 13 21:08:15.224981 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:15.224938    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a02f041-848b-4179-aaf7-b9291aaad1a9" containerName="splitter-graph-492f6"
Jul 13 21:08:15.225020 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:15.225005    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a02f041-848b-4179-aaf7-b9291aaad1a9" containerName="splitter-graph-492f6"
Jul 13 21:08:15.228147 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:15.228131    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xm2jj/must-gather-5jqql"
Jul 13 21:08:15.230798 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:15.230780    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xm2jj\"/\"kube-root-ca.crt\""
Jul 13 21:08:15.231897 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:15.231878    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xm2jj\"/\"default-dockercfg-5vc2h\""
Jul 13 21:08:15.232002 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:15.231940    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xm2jj\"/\"openshift-service-ca.crt\""
Jul 13 21:08:15.235906 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:15.235883    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xm2jj/must-gather-5jqql"]
Jul 13 21:08:15.269908 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:15.269882    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:15.296925 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:15.296898    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn2c5\" (UniqueName: \"kubernetes.io/projected/682547bc-6486-4a5f-8d90-08039b9a5891-kube-api-access-sn2c5\") pod \"must-gather-5jqql\" (UID: \"682547bc-6486-4a5f-8d90-08039b9a5891\") " pod="openshift-must-gather-xm2jj/must-gather-5jqql"
Jul 13 21:08:15.297019 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:15.296959    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/682547bc-6486-4a5f-8d90-08039b9a5891-must-gather-output\") pod \"must-gather-5jqql\" (UID: \"682547bc-6486-4a5f-8d90-08039b9a5891\") " pod="openshift-must-gather-xm2jj/must-gather-5jqql"
Jul 13 21:08:15.397621 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:15.397595    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/682547bc-6486-4a5f-8d90-08039b9a5891-must-gather-output\") pod \"must-gather-5jqql\" (UID: \"682547bc-6486-4a5f-8d90-08039b9a5891\") " pod="openshift-must-gather-xm2jj/must-gather-5jqql"
Jul 13 21:08:15.397740 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:15.397659    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sn2c5\" (UniqueName: \"kubernetes.io/projected/682547bc-6486-4a5f-8d90-08039b9a5891-kube-api-access-sn2c5\") pod \"must-gather-5jqql\" (UID: \"682547bc-6486-4a5f-8d90-08039b9a5891\") " pod="openshift-must-gather-xm2jj/must-gather-5jqql"
Jul 13 21:08:15.397935 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:15.397915    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/682547bc-6486-4a5f-8d90-08039b9a5891-must-gather-output\") pod \"must-gather-5jqql\" (UID: \"682547bc-6486-4a5f-8d90-08039b9a5891\") " pod="openshift-must-gather-xm2jj/must-gather-5jqql"
Jul 13 21:08:15.405640 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:15.405619    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn2c5\" (UniqueName: \"kubernetes.io/projected/682547bc-6486-4a5f-8d90-08039b9a5891-kube-api-access-sn2c5\") pod \"must-gather-5jqql\" (UID: \"682547bc-6486-4a5f-8d90-08039b9a5891\") " pod="openshift-must-gather-xm2jj/must-gather-5jqql"
Jul 13 21:08:15.545583 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:15.545500    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xm2jj/must-gather-5jqql"
Jul 13 21:08:15.675601 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:15.675578    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xm2jj/must-gather-5jqql"]
Jul 13 21:08:15.678098 ip-10-0-134-97 kubenswrapper[2588]: W0713 21:08:15.678071    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod682547bc_6486_4a5f_8d90_08039b9a5891.slice/crio-9ce783a719e5c7a8efcb2750edf6822bea69c4556e5b3d4e1fbd6f8f3a6e3d69 WatchSource:0}: Error finding container 9ce783a719e5c7a8efcb2750edf6822bea69c4556e5b3d4e1fbd6f8f3a6e3d69: Status 404 returned error can't find the container with id 9ce783a719e5c7a8efcb2750edf6822bea69c4556e5b3d4e1fbd6f8f3a6e3d69
Jul 13 21:08:15.679956 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:15.679936    2588 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 13 21:08:16.612625 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:16.612560    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xm2jj/must-gather-5jqql" event={"ID":"682547bc-6486-4a5f-8d90-08039b9a5891","Type":"ContainerStarted","Data":"9ce783a719e5c7a8efcb2750edf6822bea69c4556e5b3d4e1fbd6f8f3a6e3d69"}
Jul 13 21:08:16.817201 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:16.817136    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn" podUID="e36ee415-fdf7-4b2c-931a-7f3da8cc3e06" containerName="switch-graph-575ad" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 21:08:21.815923 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:21.815885    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn" podUID="e36ee415-fdf7-4b2c-931a-7f3da8cc3e06" containerName="switch-graph-575ad" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 21:08:22.644172 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:22.644132    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xm2jj/must-gather-5jqql" event={"ID":"682547bc-6486-4a5f-8d90-08039b9a5891","Type":"ContainerStarted","Data":"723f98a89982b55f5d0f09d92d5b6084ceb4f6f6cd03b86584150611bb8c2892"}
Jul 13 21:08:22.644341 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:22.644188    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xm2jj/must-gather-5jqql" event={"ID":"682547bc-6486-4a5f-8d90-08039b9a5891","Type":"ContainerStarted","Data":"ebe3c11406173cfd362b907d6a20c7f30f54214c1b831c8dd359f62d6f94f86c"}
Jul 13 21:08:22.659447 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:22.659395    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xm2jj/must-gather-5jqql" podStartSLOduration=1.395722533 podStartE2EDuration="7.659357811s" totalImagesPullingTime="6.263635278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 21:08:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:08:22.658700032 +0000 UTC m=+2980.393351220" watchObservedRunningTime="2026-07-13 21:08:22.659357811 +0000 UTC m=+2980.394008999"
Jul 13 21:08:26.814981 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:26.814938    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn" podUID="e36ee415-fdf7-4b2c-931a-7f3da8cc3e06" containerName="switch-graph-575ad" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 21:08:26.815454 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:26.815058    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn"
Jul 13 21:08:30.901551 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:30.901516    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-575ad-64d456d77c-rsdgn_e36ee415-fdf7-4b2c-931a-7f3da8cc3e06/switch-graph-575ad/0.log"
Jul 13 21:08:31.734584 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:31.734555    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-575ad-64d456d77c-rsdgn_e36ee415-fdf7-4b2c-931a-7f3da8cc3e06/switch-graph-575ad/0.log"
Jul 13 21:08:31.815329 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:31.815295    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn" podUID="e36ee415-fdf7-4b2c-931a-7f3da8cc3e06" containerName="switch-graph-575ad" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 21:08:32.567193 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:32.567160    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-575ad-64d456d77c-rsdgn_e36ee415-fdf7-4b2c-931a-7f3da8cc3e06/switch-graph-575ad/0.log"
Jul 13 21:08:33.360649 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:33.360619    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-575ad-64d456d77c-rsdgn_e36ee415-fdf7-4b2c-931a-7f3da8cc3e06/switch-graph-575ad/0.log"
Jul 13 21:08:34.173042 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:34.173013    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-575ad-64d456d77c-rsdgn_e36ee415-fdf7-4b2c-931a-7f3da8cc3e06/switch-graph-575ad/0.log"
Jul 13 21:08:35.004177 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:35.004147    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-575ad-64d456d77c-rsdgn_e36ee415-fdf7-4b2c-931a-7f3da8cc3e06/switch-graph-575ad/0.log"
Jul 13 21:08:35.804294 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:35.804262    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-575ad-64d456d77c-rsdgn_e36ee415-fdf7-4b2c-931a-7f3da8cc3e06/switch-graph-575ad/0.log"
Jul 13 21:08:36.620790 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:36.620755    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-575ad-64d456d77c-rsdgn_e36ee415-fdf7-4b2c-931a-7f3da8cc3e06/switch-graph-575ad/0.log"
Jul 13 21:08:36.814598 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:36.814559    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn" podUID="e36ee415-fdf7-4b2c-931a-7f3da8cc3e06" containerName="switch-graph-575ad" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 21:08:37.426024 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:37.425984    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-575ad-64d456d77c-rsdgn_e36ee415-fdf7-4b2c-931a-7f3da8cc3e06/switch-graph-575ad/0.log"
Jul 13 21:08:38.217430 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:38.217377    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-575ad-64d456d77c-rsdgn_e36ee415-fdf7-4b2c-931a-7f3da8cc3e06/switch-graph-575ad/0.log"
Jul 13 21:08:39.037381 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:39.037333    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-575ad-64d456d77c-rsdgn_e36ee415-fdf7-4b2c-931a-7f3da8cc3e06/switch-graph-575ad/0.log"
Jul 13 21:08:39.837200 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:39.837174    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-575ad-64d456d77c-rsdgn_e36ee415-fdf7-4b2c-931a-7f3da8cc3e06/switch-graph-575ad/0.log"
Jul 13 21:08:40.646432 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:40.646397    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-575ad-64d456d77c-rsdgn_e36ee415-fdf7-4b2c-931a-7f3da8cc3e06/switch-graph-575ad/0.log"
Jul 13 21:08:41.480207 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:41.480161    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-575ad-64d456d77c-rsdgn_e36ee415-fdf7-4b2c-931a-7f3da8cc3e06/switch-graph-575ad/0.log"
Jul 13 21:08:41.815475 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:41.815396    2588 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn" podUID="e36ee415-fdf7-4b2c-931a-7f3da8cc3e06" containerName="switch-graph-575ad" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 13 21:08:42.940928 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:42.940904    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 21:08:43.363763 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:42.944437    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 21:08:43.363763 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:42.947296    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 21:08:43.363763 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:42.950502    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 21:08:43.739393 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:43.739345    2588 generic.go:356] "Generic (PLEG): container finished" podID="e36ee415-fdf7-4b2c-931a-7f3da8cc3e06" containerID="80c4b10305b3edc8e3a492c1443bfcfbb8ef1d620d7be821cf617fe3a309bfea" exitCode=0
Jul 13 21:08:43.739536 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:43.739416    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn" event={"ID":"e36ee415-fdf7-4b2c-931a-7f3da8cc3e06","Type":"ContainerDied","Data":"80c4b10305b3edc8e3a492c1443bfcfbb8ef1d620d7be821cf617fe3a309bfea"}
Jul 13 21:08:44.381593 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:44.381556    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn"
Jul 13 21:08:44.462959 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:44.462890    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e36ee415-fdf7-4b2c-931a-7f3da8cc3e06-openshift-service-ca-bundle\") pod \"e36ee415-fdf7-4b2c-931a-7f3da8cc3e06\" (UID: \"e36ee415-fdf7-4b2c-931a-7f3da8cc3e06\") "
Jul 13 21:08:44.462959 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:44.462948    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e36ee415-fdf7-4b2c-931a-7f3da8cc3e06-proxy-tls\") pod \"e36ee415-fdf7-4b2c-931a-7f3da8cc3e06\" (UID: \"e36ee415-fdf7-4b2c-931a-7f3da8cc3e06\") "
Jul 13 21:08:44.463212 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:44.463192    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e36ee415-fdf7-4b2c-931a-7f3da8cc3e06-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "e36ee415-fdf7-4b2c-931a-7f3da8cc3e06" (UID: "e36ee415-fdf7-4b2c-931a-7f3da8cc3e06"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 13 21:08:44.464908 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:44.464887    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e36ee415-fdf7-4b2c-931a-7f3da8cc3e06-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "e36ee415-fdf7-4b2c-931a-7f3da8cc3e06" (UID: "e36ee415-fdf7-4b2c-931a-7f3da8cc3e06"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 13 21:08:44.563685 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:44.563655    2588 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e36ee415-fdf7-4b2c-931a-7f3da8cc3e06-openshift-service-ca-bundle\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 21:08:44.563685 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:44.563680    2588 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e36ee415-fdf7-4b2c-931a-7f3da8cc3e06-proxy-tls\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 21:08:44.745243 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:44.745161    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn"
Jul 13 21:08:44.745243 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:44.745187    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn" event={"ID":"e36ee415-fdf7-4b2c-931a-7f3da8cc3e06","Type":"ContainerDied","Data":"7fcc687c658d2d55a8b4d84d4e42c54fead7a3877f57413bac11cd1f80fbb477"}
Jul 13 21:08:44.745485 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:44.745251    2588 scope.go:117] "RemoveContainer" containerID="80c4b10305b3edc8e3a492c1443bfcfbb8ef1d620d7be821cf617fe3a309bfea"
Jul 13 21:08:44.766446 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:44.766417    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn"]
Jul 13 21:08:44.771407 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:44.771385    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-575ad-64d456d77c-rsdgn"]
Jul 13 21:08:44.969492 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:44.969461    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e36ee415-fdf7-4b2c-931a-7f3da8cc3e06" path="/var/lib/kubelet/pods/e36ee415-fdf7-4b2c-931a-7f3da8cc3e06/volumes"
Jul 13 21:08:45.752242 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:45.752210    2588 generic.go:356] "Generic (PLEG): container finished" podID="682547bc-6486-4a5f-8d90-08039b9a5891" containerID="ebe3c11406173cfd362b907d6a20c7f30f54214c1b831c8dd359f62d6f94f86c" exitCode=0
Jul 13 21:08:45.752667 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:45.752283    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xm2jj/must-gather-5jqql" event={"ID":"682547bc-6486-4a5f-8d90-08039b9a5891","Type":"ContainerDied","Data":"ebe3c11406173cfd362b907d6a20c7f30f54214c1b831c8dd359f62d6f94f86c"}
Jul 13 21:08:45.752667 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:45.752598    2588 scope.go:117] "RemoveContainer" containerID="ebe3c11406173cfd362b907d6a20c7f30f54214c1b831c8dd359f62d6f94f86c"
Jul 13 21:08:45.858504 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:45.858473    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xm2jj_must-gather-5jqql_682547bc-6486-4a5f-8d90-08039b9a5891/gather/0.log"
Jul 13 21:08:46.331807 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:46.331716    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:47.760157 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:47.760113    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:49.068248 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:49.068215    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nr99r_5c7c41b8-6279-424c-90c8-ef75fcee26d6/global-pull-secret-syncer/0.log"
Jul 13 21:08:49.161314 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:49.161287    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log"
Jul 13 21:08:49.304908 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:49.304878    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-97.ec2.internal_4b74d540315bcd62d8ef3b8967ccadd0/haproxy/0.log"
Jul 13 21:08:51.312039 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:51.312002    2588 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-xm2jj/must-gather-5jqql"]
Jul 13 21:08:51.312472 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:51.312175    2588 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-xm2jj/must-gather-5jqql" podUID="682547bc-6486-4a5f-8d90-08039b9a5891" containerName="copy" containerID="cri-o://723f98a89982b55f5d0f09d92d5b6084ceb4f6f6cd03b86584150611bb8c2892" gracePeriod=2
Jul 13 21:08:51.314559 ip-10-0-134-97 kubenswrapper[2588]: E0713 21:08:51.314523    2588 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-5jqql\" is forbidden: User \"system:node:ip-10-0-134-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xm2jj\": no relationship found between node 'ip-10-0-134-97.ec2.internal' and this object" podUID="682547bc-6486-4a5f-8d90-08039b9a5891" pod="openshift-must-gather-xm2jj/must-gather-5jqql"
Jul 13 21:08:51.315470 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:51.315448    2588 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-xm2jj/must-gather-5jqql"]
Jul 13 21:08:51.555567 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:51.555543    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xm2jj_must-gather-5jqql_682547bc-6486-4a5f-8d90-08039b9a5891/copy/0.log"
Jul 13 21:08:51.558183 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:51.558155    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xm2jj/must-gather-5jqql"
Jul 13 21:08:51.560285 ip-10-0-134-97 kubenswrapper[2588]: E0713 21:08:51.560260    2588 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-5jqql\" is forbidden: User \"system:node:ip-10-0-134-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xm2jj\": no relationship found between node 'ip-10-0-134-97.ec2.internal' and this object" podUID="682547bc-6486-4a5f-8d90-08039b9a5891" pod="openshift-must-gather-xm2jj/must-gather-5jqql"
Jul 13 21:08:51.613755 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:51.613682    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sn2c5\" (UniqueName: \"kubernetes.io/projected/682547bc-6486-4a5f-8d90-08039b9a5891-kube-api-access-sn2c5\") pod \"682547bc-6486-4a5f-8d90-08039b9a5891\" (UID: \"682547bc-6486-4a5f-8d90-08039b9a5891\") "
Jul 13 21:08:51.613755 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:51.613733    2588 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/682547bc-6486-4a5f-8d90-08039b9a5891-must-gather-output\") pod \"682547bc-6486-4a5f-8d90-08039b9a5891\" (UID: \"682547bc-6486-4a5f-8d90-08039b9a5891\") "
Jul 13 21:08:51.615203 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:51.615180    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/682547bc-6486-4a5f-8d90-08039b9a5891-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "682547bc-6486-4a5f-8d90-08039b9a5891" (UID: "682547bc-6486-4a5f-8d90-08039b9a5891"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 13 21:08:51.615836 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:51.615814    2588 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/682547bc-6486-4a5f-8d90-08039b9a5891-kube-api-access-sn2c5" (OuterVolumeSpecName: "kube-api-access-sn2c5") pod "682547bc-6486-4a5f-8d90-08039b9a5891" (UID: "682547bc-6486-4a5f-8d90-08039b9a5891"). InnerVolumeSpecName "kube-api-access-sn2c5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 13 21:08:51.714248 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:51.714221    2588 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sn2c5\" (UniqueName: \"kubernetes.io/projected/682547bc-6486-4a5f-8d90-08039b9a5891-kube-api-access-sn2c5\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 21:08:51.714248 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:51.714244    2588 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/682547bc-6486-4a5f-8d90-08039b9a5891-must-gather-output\") on node \"ip-10-0-134-97.ec2.internal\" DevicePath \"\""
Jul 13 21:08:51.778555 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:51.778531    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-xm2jj_must-gather-5jqql_682547bc-6486-4a5f-8d90-08039b9a5891/copy/0.log"
Jul 13 21:08:51.778895 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:51.778873    2588 generic.go:356] "Generic (PLEG): container finished" podID="682547bc-6486-4a5f-8d90-08039b9a5891" containerID="723f98a89982b55f5d0f09d92d5b6084ceb4f6f6cd03b86584150611bb8c2892" exitCode=143
Jul 13 21:08:51.778982 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:51.778922    2588 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xm2jj/must-gather-5jqql"
Jul 13 21:08:51.779023 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:51.778980    2588 scope.go:117] "RemoveContainer" containerID="723f98a89982b55f5d0f09d92d5b6084ceb4f6f6cd03b86584150611bb8c2892"
Jul 13 21:08:51.781070 ip-10-0-134-97 kubenswrapper[2588]: E0713 21:08:51.781035    2588 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-5jqql\" is forbidden: User \"system:node:ip-10-0-134-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xm2jj\": no relationship found between node 'ip-10-0-134-97.ec2.internal' and this object" podUID="682547bc-6486-4a5f-8d90-08039b9a5891" pod="openshift-must-gather-xm2jj/must-gather-5jqql"
Jul 13 21:08:51.787486 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:51.787462    2588 scope.go:117] "RemoveContainer" containerID="ebe3c11406173cfd362b907d6a20c7f30f54214c1b831c8dd359f62d6f94f86c"
Jul 13 21:08:51.789762 ip-10-0-134-97 kubenswrapper[2588]: E0713 21:08:51.789738    2588 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-5jqql\" is forbidden: User \"system:node:ip-10-0-134-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xm2jj\": no relationship found between node 'ip-10-0-134-97.ec2.internal' and this object" podUID="682547bc-6486-4a5f-8d90-08039b9a5891" pod="openshift-must-gather-xm2jj/must-gather-5jqql"
Jul 13 21:08:51.798256 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:51.798236    2588 scope.go:117] "RemoveContainer" containerID="723f98a89982b55f5d0f09d92d5b6084ceb4f6f6cd03b86584150611bb8c2892"
Jul 13 21:08:51.798508 ip-10-0-134-97 kubenswrapper[2588]: E0713 21:08:51.798490    2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"723f98a89982b55f5d0f09d92d5b6084ceb4f6f6cd03b86584150611bb8c2892\": container with ID starting with 723f98a89982b55f5d0f09d92d5b6084ceb4f6f6cd03b86584150611bb8c2892 not found: ID does not exist" containerID="723f98a89982b55f5d0f09d92d5b6084ceb4f6f6cd03b86584150611bb8c2892"
Jul 13 21:08:51.798551 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:51.798516    2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"723f98a89982b55f5d0f09d92d5b6084ceb4f6f6cd03b86584150611bb8c2892"} err="failed to get container status \"723f98a89982b55f5d0f09d92d5b6084ceb4f6f6cd03b86584150611bb8c2892\": rpc error: code = NotFound desc = could not find container \"723f98a89982b55f5d0f09d92d5b6084ceb4f6f6cd03b86584150611bb8c2892\": container with ID starting with 723f98a89982b55f5d0f09d92d5b6084ceb4f6f6cd03b86584150611bb8c2892 not found: ID does not exist"
Jul 13 21:08:51.798551 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:51.798532    2588 scope.go:117] "RemoveContainer" containerID="ebe3c11406173cfd362b907d6a20c7f30f54214c1b831c8dd359f62d6f94f86c"
Jul 13 21:08:51.798718 ip-10-0-134-97 kubenswrapper[2588]: E0713 21:08:51.798702    2588 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebe3c11406173cfd362b907d6a20c7f30f54214c1b831c8dd359f62d6f94f86c\": container with ID starting with ebe3c11406173cfd362b907d6a20c7f30f54214c1b831c8dd359f62d6f94f86c not found: ID does not exist" containerID="ebe3c11406173cfd362b907d6a20c7f30f54214c1b831c8dd359f62d6f94f86c"
Jul 13 21:08:51.798758 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:51.798722    2588 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebe3c11406173cfd362b907d6a20c7f30f54214c1b831c8dd359f62d6f94f86c"} err="failed to get container status \"ebe3c11406173cfd362b907d6a20c7f30f54214c1b831c8dd359f62d6f94f86c\": rpc error: code = NotFound desc = could not find container \"ebe3c11406173cfd362b907d6a20c7f30f54214c1b831c8dd359f62d6f94f86c\": container with ID starting with ebe3c11406173cfd362b907d6a20c7f30f54214c1b831c8dd359f62d6f94f86c not found: ID does not exist"
Jul 13 21:08:51.874990 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:51.874911    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:51.929083 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:51.929045    2588 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8whzd_21e62c48-f530-485c-9eac-f69d4272aa21/konnectivity-agent/0.log" limit=1024
Jul 13 21:08:52.967903 ip-10-0-134-97 kubenswrapper[2588]: E0713 21:08:52.967860    2588 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-5jqql\" is forbidden: User \"system:node:ip-10-0-134-97.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-xm2jj\": no relationship found between node 'ip-10-0-134-97.ec2.internal' and this object" podUID="682547bc-6486-4a5f-8d90-08039b9a5891" pod="openshift-must-gather-xm2jj/must-gather-5jqql"
Jul 13 21:08:52.969440 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:52.969408    2588 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="682547bc-6486-4a5f-8d90-08039b9a5891" path="/var/lib/kubelet/pods/682547bc-6486-4a5f-8d90-08039b9a5891/volumes"
Jul 13 21:08:53.295616 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:53.295533    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-9wb5n_5df96b08-2166-4b7c-b5e8-c72f6704a5b9/cluster-monitoring-operator/0.log"
Jul 13 21:08:53.400404 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:53.400355    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-84ffd8d8c-5mkkq_f1515661-7acb-4f3a-8912-283e4ffe9d4d/metrics-server/0.log"
Jul 13 21:08:53.430641 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:53.430612    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-xt8l5_387e6058-795b-42cc-8b03-2dfc356ff40e/monitoring-plugin/0.log"
Jul 13 21:08:53.659028 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:53.658949    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-snb66_ba767030-9cf0-428d-acb9-50d2aa40f8b3/node-exporter/0.log"
Jul 13 21:08:53.678794 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:53.678770    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-snb66_ba767030-9cf0-428d-acb9-50d2aa40f8b3/kube-rbac-proxy/0.log"
Jul 13 21:08:53.699349 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:53.699326    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-snb66_ba767030-9cf0-428d-acb9-50d2aa40f8b3/init-textfile/0.log"
Jul 13 21:08:53.820747 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:53.820717    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_18f2f29f-fa1d-48dc-97ea-0dc379784bab/prometheus/0.log"
Jul 13 21:08:53.841450 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:53.841424    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_18f2f29f-fa1d-48dc-97ea-0dc379784bab/config-reloader/0.log"
Jul 13 21:08:53.861721 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:53.861694    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_18f2f29f-fa1d-48dc-97ea-0dc379784bab/thanos-sidecar/0.log"
Jul 13 21:08:53.887075 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:53.887053    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_18f2f29f-fa1d-48dc-97ea-0dc379784bab/kube-rbac-proxy-web/0.log"
Jul 13 21:08:53.909380 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:53.909303    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_18f2f29f-fa1d-48dc-97ea-0dc379784bab/kube-rbac-proxy/0.log"
Jul 13 21:08:53.929570 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:53.929541    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_18f2f29f-fa1d-48dc-97ea-0dc379784bab/kube-rbac-proxy-thanos/0.log"
Jul 13 21:08:53.962263 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:53.962238    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_18f2f29f-fa1d-48dc-97ea-0dc379784bab/init-config-reloader/0.log"
Jul 13 21:08:56.165476 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:56.165399    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/1.log"
Jul 13 21:08:56.174275 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:56.174245    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rmc2s_70f2cd6d-09a8-42ed-957f-ee50c42b98d1/console-operator/2.log"
Jul 13 21:08:57.114395 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.114351    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-llps6_77da0f34-0522-4826-b4df-12b3dc59ea10/volume-data-source-validator/0.log"
Jul 13 21:08:57.400948 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.400865    2588 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t"]
Jul 13 21:08:57.401286 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.401163    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="682547bc-6486-4a5f-8d90-08039b9a5891" containerName="copy"
Jul 13 21:08:57.401286 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.401173    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="682547bc-6486-4a5f-8d90-08039b9a5891" containerName="copy"
Jul 13 21:08:57.401286 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.401185    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e36ee415-fdf7-4b2c-931a-7f3da8cc3e06" containerName="switch-graph-575ad"
Jul 13 21:08:57.401286 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.401193    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="e36ee415-fdf7-4b2c-931a-7f3da8cc3e06" containerName="switch-graph-575ad"
Jul 13 21:08:57.401286 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.401199    2588 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="682547bc-6486-4a5f-8d90-08039b9a5891" containerName="gather"
Jul 13 21:08:57.401286 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.401206    2588 state_mem.go:107] "Deleted CPUSet assignment" podUID="682547bc-6486-4a5f-8d90-08039b9a5891" containerName="gather"
Jul 13 21:08:57.401286 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.401252    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="e36ee415-fdf7-4b2c-931a-7f3da8cc3e06" containerName="switch-graph-575ad"
Jul 13 21:08:57.401286 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.401260    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="682547bc-6486-4a5f-8d90-08039b9a5891" containerName="copy"
Jul 13 21:08:57.401286 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.401267    2588 memory_manager.go:368] "RemoveStaleState removing state" podUID="682547bc-6486-4a5f-8d90-08039b9a5891" containerName="gather"
Jul 13 21:08:57.404301 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.404278    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t"
Jul 13 21:08:57.406670 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.406648    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xlsxm\"/\"openshift-service-ca.crt\""
Jul 13 21:08:57.407759 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.407738    2588 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xlsxm\"/\"default-dockercfg-nr2xr\""
Jul 13 21:08:57.407863 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.407844    2588 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xlsxm\"/\"kube-root-ca.crt\""
Jul 13 21:08:57.413584 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.413551    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t"]
Jul 13 21:08:57.461823 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.461798    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ba584e1d-2896-45e1-94a2-99572bb61a00-podres\") pod \"perf-node-gather-daemonset-v525t\" (UID: \"ba584e1d-2896-45e1-94a2-99572bb61a00\") " pod="openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t"
Jul 13 21:08:57.461978 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.461835    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ba584e1d-2896-45e1-94a2-99572bb61a00-proc\") pod \"perf-node-gather-daemonset-v525t\" (UID: \"ba584e1d-2896-45e1-94a2-99572bb61a00\") " pod="openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t"
Jul 13 21:08:57.461978 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.461866    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba584e1d-2896-45e1-94a2-99572bb61a00-sys\") pod \"perf-node-gather-daemonset-v525t\" (UID: \"ba584e1d-2896-45e1-94a2-99572bb61a00\") " pod="openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t"
Jul 13 21:08:57.461978 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.461923    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba584e1d-2896-45e1-94a2-99572bb61a00-lib-modules\") pod \"perf-node-gather-daemonset-v525t\" (UID: \"ba584e1d-2896-45e1-94a2-99572bb61a00\") " pod="openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t"
Jul 13 21:08:57.462166 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.461992    2588 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fr9p\" (UniqueName: \"kubernetes.io/projected/ba584e1d-2896-45e1-94a2-99572bb61a00-kube-api-access-6fr9p\") pod \"perf-node-gather-daemonset-v525t\" (UID: \"ba584e1d-2896-45e1-94a2-99572bb61a00\") " pod="openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t"
Jul 13 21:08:57.562652 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.562617    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ba584e1d-2896-45e1-94a2-99572bb61a00-podres\") pod \"perf-node-gather-daemonset-v525t\" (UID: \"ba584e1d-2896-45e1-94a2-99572bb61a00\") " pod="openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t"
Jul 13 21:08:57.562813 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.562660    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ba584e1d-2896-45e1-94a2-99572bb61a00-proc\") pod \"perf-node-gather-daemonset-v525t\" (UID: \"ba584e1d-2896-45e1-94a2-99572bb61a00\") " pod="openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t"
Jul 13 21:08:57.562813 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.562708    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba584e1d-2896-45e1-94a2-99572bb61a00-sys\") pod \"perf-node-gather-daemonset-v525t\" (UID: \"ba584e1d-2896-45e1-94a2-99572bb61a00\") " pod="openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t"
Jul 13 21:08:57.562813 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.562729    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba584e1d-2896-45e1-94a2-99572bb61a00-lib-modules\") pod \"perf-node-gather-daemonset-v525t\" (UID: \"ba584e1d-2896-45e1-94a2-99572bb61a00\") " pod="openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t"
Jul 13 21:08:57.562813 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.562778    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ba584e1d-2896-45e1-94a2-99572bb61a00-podres\") pod \"perf-node-gather-daemonset-v525t\" (UID: \"ba584e1d-2896-45e1-94a2-99572bb61a00\") " pod="openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t"
Jul 13 21:08:57.562813 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.562781    2588 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fr9p\" (UniqueName: \"kubernetes.io/projected/ba584e1d-2896-45e1-94a2-99572bb61a00-kube-api-access-6fr9p\") pod \"perf-node-gather-daemonset-v525t\" (UID: \"ba584e1d-2896-45e1-94a2-99572bb61a00\") " pod="openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t"
Jul 13 21:08:57.563010 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.562819    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba584e1d-2896-45e1-94a2-99572bb61a00-sys\") pod \"perf-node-gather-daemonset-v525t\" (UID: \"ba584e1d-2896-45e1-94a2-99572bb61a00\") " pod="openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t"
Jul 13 21:08:57.563010 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.562823    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ba584e1d-2896-45e1-94a2-99572bb61a00-proc\") pod \"perf-node-gather-daemonset-v525t\" (UID: \"ba584e1d-2896-45e1-94a2-99572bb61a00\") " pod="openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t"
Jul 13 21:08:57.563010 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.562908    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ba584e1d-2896-45e1-94a2-99572bb61a00-lib-modules\") pod \"perf-node-gather-daemonset-v525t\" (UID: \"ba584e1d-2896-45e1-94a2-99572bb61a00\") " pod="openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t"
Jul 13 21:08:57.570682 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.570662    2588 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fr9p\" (UniqueName: \"kubernetes.io/projected/ba584e1d-2896-45e1-94a2-99572bb61a00-kube-api-access-6fr9p\") pod \"perf-node-gather-daemonset-v525t\" (UID: \"ba584e1d-2896-45e1-94a2-99572bb61a00\") " pod="openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t"
Jul 13 21:08:57.715085 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.715057    2588 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t"
Jul 13 21:08:57.841002 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:57.840969    2588 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t"]
Jul 13 21:08:57.844399 ip-10-0-134-97 kubenswrapper[2588]: W0713 21:08:57.844357    2588 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podba584e1d_2896_45e1_94a2_99572bb61a00.slice/crio-3e8067770c382fca53ce040040715680f213b8488b024d51c89be25ac196de78 WatchSource:0}: Error finding container 3e8067770c382fca53ce040040715680f213b8488b024d51c89be25ac196de78: Status 404 returned error can't find the container with id 3e8067770c382fca53ce040040715680f213b8488b024d51c89be25ac196de78
Jul 13 21:08:58.020966 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:58.020893    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cr5c9_1396fdd0-2cad-4bde-89d1-825a0d1b7727/dns/0.log"
Jul 13 21:08:58.042844 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:58.042824    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cr5c9_1396fdd0-2cad-4bde-89d1-825a0d1b7727/kube-rbac-proxy/0.log"
Jul 13 21:08:58.232676 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:58.232650    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mr5jv_c85bf135-1b33-4b7b-8984-588d51190322/dns-node-resolver/0.log"
Jul 13 21:08:58.813613 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:58.813571    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t" event={"ID":"ba584e1d-2896-45e1-94a2-99572bb61a00","Type":"ContainerStarted","Data":"a5fc6e2be0a752912245a6dcdd7bea96b1f1376e485aa04e1e292829edce5e4d"}
Jul 13 21:08:58.814008 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:58.813648    2588 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t" event={"ID":"ba584e1d-2896-45e1-94a2-99572bb61a00","Type":"ContainerStarted","Data":"3e8067770c382fca53ce040040715680f213b8488b024d51c89be25ac196de78"}
Jul 13 21:08:58.814008 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:58.813670    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t"
Jul 13 21:08:58.867477 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:58.867443    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wfdvr_358913e2-9ddb-4fef-9767-e811c7bbf7bb/node-ca/0.log"
Jul 13 21:08:59.610530 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:59.610493    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b498b7f44-rnqlq_f866ccdf-4a23-45a3-88b4-16bb48322947/router/0.log"
Jul 13 21:08:59.984939 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:08:59.984905    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-c758s_5443da0e-8d29-4b04-bce2-066fa62418df/serve-healthcheck-canary/0.log"
Jul 13 21:09:00.355501 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:00.355402    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-t45cw_6a0ae10a-1565-4d86-92c0-f15d523042b9/insights-operator/0.log"
Jul 13 21:09:00.356605 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:00.356585    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-t45cw_6a0ae10a-1565-4d86-92c0-f15d523042b9/insights-operator/1.log"
Jul 13 21:09:00.545555 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:00.545527    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ngz5s_4a61811b-9717-4c54-a14a-640d70479a4e/kube-rbac-proxy/0.log"
Jul 13 21:09:00.563045 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:00.563021    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ngz5s_4a61811b-9717-4c54-a14a-640d70479a4e/exporter/0.log"
Jul 13 21:09:00.584660 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:00.584637    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ngz5s_4a61811b-9717-4c54-a14a-640d70479a4e/extractor/0.log"
Jul 13 21:09:02.837776 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:02.837752    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-q9x89_8ada3115-a8d4-4792-81de-2a5bdb6faa75/server/0.log"
Jul 13 21:09:04.827850 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:04.827826    2588 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t"
Jul 13 21:09:04.845829 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:04.845787    2588 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xlsxm/perf-node-gather-daemonset-v525t" podStartSLOduration=7.845770799 podStartE2EDuration="7.845770799s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 21:08:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 21:08:58.829613206 +0000 UTC m=+3016.564264395" watchObservedRunningTime="2026-07-13 21:09:04.845770799 +0000 UTC m=+3022.580421986"
Jul 13 21:09:07.414238 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:07.414165    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-rd8jg_061095eb-9b43-4331-9155-8dfab3aa3741/kube-storage-version-migrator-operator/1.log"
Jul 13 21:09:07.415790 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:07.415761    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-rd8jg_061095eb-9b43-4331-9155-8dfab3aa3741/kube-storage-version-migrator-operator/0.log"
Jul 13 21:09:08.464830 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:08.464801    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-prx69_676788ea-de46-4eed-a864-097546d0d81e/kube-multus-additional-cni-plugins/0.log"
Jul 13 21:09:08.484337 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:08.484314    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-prx69_676788ea-de46-4eed-a864-097546d0d81e/egress-router-binary-copy/0.log"
Jul 13 21:09:08.509031 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:08.509007    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-prx69_676788ea-de46-4eed-a864-097546d0d81e/cni-plugins/0.log"
Jul 13 21:09:08.527281 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:08.527256    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-prx69_676788ea-de46-4eed-a864-097546d0d81e/bond-cni-plugin/0.log"
Jul 13 21:09:08.548282 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:08.548254    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-prx69_676788ea-de46-4eed-a864-097546d0d81e/routeoverride-cni/0.log"
Jul 13 21:09:08.567933 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:08.567910    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-prx69_676788ea-de46-4eed-a864-097546d0d81e/whereabouts-cni-bincopy/0.log"
Jul 13 21:09:08.586858 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:08.586832    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-prx69_676788ea-de46-4eed-a864-097546d0d81e/whereabouts-cni/0.log"
Jul 13 21:09:08.776302 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:08.776226    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q5tv4_577929d2-ea07-42d9-bed7-da50c01da81e/kube-multus/0.log"
Jul 13 21:09:08.856193 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:08.856164    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ccnrf_3c22ea6b-3598-4451-8520-e5f11a335825/network-metrics-daemon/0.log"
Jul 13 21:09:08.879380 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:08.879342    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ccnrf_3c22ea6b-3598-4451-8520-e5f11a335825/kube-rbac-proxy/0.log"
Jul 13 21:09:09.845839 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:09.845814    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-controller/0.log"
Jul 13 21:09:09.859865 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:09.859846    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/0.log"
Jul 13 21:09:09.860016 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:09.859848    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovn-acl-logging/1.log"
Jul 13 21:09:09.877892 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:09.877844    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/kube-rbac-proxy-node/0.log"
Jul 13 21:09:09.897165 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:09.897141    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/kube-rbac-proxy-ovn-metrics/0.log"
Jul 13 21:09:09.914096 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:09.914073    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/northd/0.log"
Jul 13 21:09:09.930848 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:09.930830    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/nbdb/0.log"
Jul 13 21:09:09.948268 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:09.948247    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/sbdb/0.log"
Jul 13 21:09:10.008379 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:10.008342    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-c9wsz_a41a03c6-83f4-4f6d-9624-cc390f7cf1af/ovnkube-controller/0.log"
Jul 13 21:09:11.229018 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:11.228945    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-869dcfcdcd-tbpsz_826c7f54-267c-4b4d-86f2-4e02c8f04543/check-endpoints/0.log"
Jul 13 21:09:11.299459 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:11.299434    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-tzvwk_cd43f8e0-f611-4cf2-9a46-95f57f1ae944/network-check-target-container/0.log"
Jul 13 21:09:12.203982 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:12.203952    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-sr8qj_4c811846-0dc1-4c86-82b3-8aa8225eecdb/iptables-alerter/0.log"
Jul 13 21:09:12.845897 ip-10-0-134-97 kubenswrapper[2588]: I0713 21:09:12.845861    2588 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-52zwb_4b6c1a3c-3aad-41b9-b398-9b46b6019651/tuned/0.log"