Jul 15 20:59:58.228305 ip-10-0-130-35 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 15 20:59:58.228318 ip-10-0-130-35 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 15 20:59:58.228327 ip-10-0-130-35 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 15 20:59:58.228622 ip-10-0-130-35 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 15 21:00:08.319742 ip-10-0-130-35 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 15 21:00:08.319781 ip-10-0-130-35 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 328d692fde8146ffa4611827c4a1b02f --
Jul 15 21:01:38.446121 ip-10-0-130-35 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 21:01:39.035959 ip-10-0-130-35 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 21:01:39.035959 ip-10-0-130-35 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 21:01:39.035959 ip-10-0-130-35 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 21:01:39.035959 ip-10-0-130-35 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 21:01:39.035959 ip-10-0-130-35 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 21:01:39.035959 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.892183    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 21:01:39.035959 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898019    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 21:01:39.035959 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898034    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 21:01:39.035959 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898039    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 21:01:39.035959 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898044    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 21:01:39.035959 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898048    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 21:01:39.035959 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898053    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 21:01:39.035959 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898058    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 21:01:39.035959 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898062    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 21:01:39.041110 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898066    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 21:01:39.041110 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898070    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 21:01:39.041110 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898075    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 21:01:39.041110 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898079    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 21:01:39.041110 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898083    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 21:01:39.041110 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898087    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 21:01:39.041110 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898091    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 21:01:39.041110 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898096    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 21:01:39.041110 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898100    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 21:01:39.041110 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898104    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 21:01:39.041110 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898108    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 21:01:39.041110 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898112    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 21:01:39.041110 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898116    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 21:01:39.041110 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898120    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 21:01:39.041110 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898125    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 21:01:39.041110 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898130    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 21:01:39.041110 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898134    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 21:01:39.041110 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898138    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 21:01:39.041110 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898142    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 21:01:38.972768 ip-10-0-130-35 systemd[1]: Started Kubernetes Kubelet.
Jul 15 21:01:39.068197 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898147    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 21:01:39.068197 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898151    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 21:01:39.068197 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898155    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 21:01:39.068197 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898159    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 21:01:39.068197 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898163    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 21:01:39.068197 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898167    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 21:01:39.068197 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898170    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 21:01:39.068197 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898175    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 21:01:39.068197 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898178    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 21:01:39.068197 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898182    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 21:01:39.068197 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898186    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 21:01:39.068197 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898190    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 21:01:39.068197 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898196    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 21:01:39.068197 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898201    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 21:01:39.068197 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898209    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 21:01:39.068197 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898213    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 21:01:39.068197 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898218    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 21:01:39.068197 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898222    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 21:01:39.068197 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898226    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 21:01:39.069006 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898231    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 21:01:39.069006 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898235    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 21:01:39.069006 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898238    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 21:01:39.069006 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898242    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 21:01:39.069006 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898246    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 21:01:39.069006 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898250    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 21:01:39.069006 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898253    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 21:01:39.069006 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898258    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 21:01:39.069006 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898262    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 21:01:39.069006 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898266    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 21:01:39.069006 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898270    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 21:01:39.069006 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898274    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 21:01:39.069006 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898278    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 21:01:39.069006 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898283    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 21:01:39.069006 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898286    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 21:01:39.069006 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898290    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 21:01:39.069006 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898294    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 21:01:39.069006 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898298    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 21:01:39.069006 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898302    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 21:01:39.176219 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898305    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 21:01:39.176219 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898309    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 21:01:39.176219 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898314    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 21:01:39.176219 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898318    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 21:01:39.176219 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898322    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 21:01:39.176219 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898325    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 21:01:39.176219 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898329    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 21:01:39.176219 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898333    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 21:01:39.176219 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898338    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 21:01:39.176219 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898341    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 21:01:39.176219 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898346    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 21:01:39.176219 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898349    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 21:01:39.176219 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898353    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 21:01:39.176219 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898357    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 21:01:39.176219 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898360    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 21:01:39.176219 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898364    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 21:01:39.176219 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898369    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 21:01:39.176219 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898372    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 21:01:39.176219 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898377    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 21:01:39.176219 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898383    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 21:01:39.177820 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898388    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 21:01:39.177820 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898392    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 21:01:39.177820 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898396    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 21:01:39.177820 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898400    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 21:01:39.177820 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898403    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 21:01:39.177820 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898407    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 21:01:39.177820 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898411    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 21:01:39.177820 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898415    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 21:01:39.177820 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898419    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 21:01:39.177820 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898423    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 21:01:39.177820 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898427    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 21:01:39.177820 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898430    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 21:01:39.177820 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898434    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 21:01:39.177820 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.898438    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 21:01:39.177820 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899435    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 21:01:39.177820 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899443    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 21:01:39.177820 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899447    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 21:01:39.177820 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899451    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 21:01:39.177820 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899455    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 21:01:39.177820 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899459    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 21:01:39.178665 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899462    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 21:01:39.178665 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899468    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 21:01:39.178665 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899472    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 21:01:39.178665 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899476    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 21:01:39.178665 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899479    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 21:01:39.178665 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899484    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 21:01:39.178665 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899488    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 21:01:39.178665 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899491    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 21:01:39.178665 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899497    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 21:01:39.178665 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899502    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 21:01:39.178665 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899507    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 21:01:39.178665 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899510    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 21:01:39.178665 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899514    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 21:01:39.178665 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899520    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 21:01:39.178665 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899531    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 21:01:39.178665 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899535    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 21:01:39.178665 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899539    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 21:01:39.178665 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899544    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 21:01:39.178665 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899547    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 21:01:39.179932 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899552    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 21:01:39.179932 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899558    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 21:01:39.179932 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899563    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 21:01:39.179932 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899567    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 21:01:39.179932 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899572    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 21:01:39.179932 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899576    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 21:01:39.179932 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899580    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 21:01:39.179932 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899583    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 21:01:39.179932 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899587    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 21:01:39.179932 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899591    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 21:01:39.179932 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899596    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 21:01:39.179932 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899599    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 21:01:39.179932 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899604    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 21:01:39.179932 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899609    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 21:01:39.179932 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899613    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 21:01:39.179932 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899623    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 21:01:39.179932 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899627    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 21:01:39.179932 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899631    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 21:01:39.179932 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899634    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 21:01:39.180718 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899639    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 21:01:39.180718 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899643    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 21:01:39.180718 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899647    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 21:01:39.180718 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899650    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 21:01:39.180718 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899654    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 21:01:39.180718 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899658    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 21:01:39.180718 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899662    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 21:01:39.180718 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899665    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 21:01:39.180718 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899669    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 21:01:39.180718 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899673    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 21:01:39.180718 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899677    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 21:01:39.180718 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899681    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 21:01:39.180718 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899684    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 21:01:39.180718 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899688    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 21:01:39.180718 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899692    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 21:01:39.180718 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899696    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 21:01:39.180718 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899699    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 21:01:39.180718 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899703    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 21:01:39.180718 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899707    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 21:01:39.180718 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899711    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 21:01:39.182351 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899715    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 21:01:39.182351 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899718    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 21:01:39.182351 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899721    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 21:01:39.182351 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899725    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 21:01:39.182351 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899729    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 21:01:39.182351 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899734    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 21:01:39.182351 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899738    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 21:01:39.182351 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899741    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 21:01:39.182351 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899746    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 21:01:39.182351 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899758    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 21:01:39.182351 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899763    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 21:01:39.182351 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899766    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 21:01:39.182351 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899770    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 21:01:39.182351 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899774    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 21:01:39.182351 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899778    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 21:01:39.182351 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899782    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 21:01:39.182351 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899786    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 21:01:39.182351 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899789    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 21:01:39.182351 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899793    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 21:01:39.182351 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899799    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 21:01:39.183187 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899803    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 21:01:39.183187 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899807    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 21:01:39.183187 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899810    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 21:01:39.183187 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899814    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 21:01:39.183187 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899818    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 21:01:39.183187 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899821    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 21:01:39.183187 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899825    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 21:01:39.183187 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899829    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 21:01:39.183187 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899833    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 21:01:39.183187 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899859    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 21:01:39.183187 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899864    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 21:01:39.183187 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899867    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 21:01:39.183187 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899871    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 21:01:39.183187 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899875    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 21:01:39.183187 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.899879    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 21:01:39.183187 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900426    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 21:01:39.183187 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900438    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 21:01:39.183187 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900441    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 21:01:39.183187 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900445    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 21:01:39.183187 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900448    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 21:01:39.184408 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900450    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 21:01:39.184408 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900454    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 21:01:39.184408 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900457    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 21:01:39.184408 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900459    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 21:01:39.184408 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900462    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 21:01:39.184408 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900464    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 21:01:39.184408 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900467    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 21:01:39.184408 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900469    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 21:01:39.184408 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900472    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 21:01:39.184408 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900475    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 21:01:39.184408 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900477    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 21:01:39.184408 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900480    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 21:01:39.184408 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900482    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 21:01:39.184408 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900485    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 21:01:39.184408 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900487    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 21:01:39.184408 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900490    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 21:01:39.184408 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900493    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 21:01:39.184408 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900496    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 21:01:39.184408 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900499    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 21:01:39.184408 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900501    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 21:01:39.186441 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900504    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 21:01:39.186441 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900506    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 21:01:39.186441 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900509    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 21:01:39.186441 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900512    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 21:01:39.186441 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900515    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 21:01:39.186441 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900518    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 21:01:39.186441 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900520    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 21:01:39.186441 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900523    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 21:01:39.186441 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900525    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 21:01:39.186441 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900528    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 21:01:39.186441 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900530    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 21:01:39.186441 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900533    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 21:01:39.186441 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900535    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 21:01:39.186441 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900540    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 21:01:39.186441 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900543    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 21:01:39.186441 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900546    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 21:01:39.186441 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900548    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 21:01:39.186441 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900551    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 21:01:39.186441 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900553    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 21:01:39.186441 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900556    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 21:01:39.187048 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900558    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 21:01:39.187048 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900560    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 21:01:39.187048 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900563    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 21:01:39.187048 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900565    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 21:01:39.187048 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900568    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 21:01:39.187048 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900571    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 21:01:39.187048 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900573    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 21:01:39.187048 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900576    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 21:01:39.187048 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900578    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 21:01:39.187048 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900580    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 21:01:39.187048 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900583    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 21:01:39.187048 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900586    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 21:01:39.187048 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900588    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 21:01:39.187048 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900591    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 21:01:39.187048 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900593    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 21:01:39.187048 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900598    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 21:01:39.187048 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900603    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 21:01:39.187048 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900606    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 21:01:39.187048 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900609    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 21:01:39.187507 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900612    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 21:01:39.187507 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900615    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 21:01:39.187507 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900618    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 21:01:39.187507 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900620    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 21:01:39.187507 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900623    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 21:01:39.187507 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900625    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 21:01:39.187507 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900628    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 21:01:39.187507 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900630    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 21:01:39.187507 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900632    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 21:01:39.187507 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900635    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 21:01:39.187507 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900637    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 21:01:39.187507 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900640    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 21:01:39.187507 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900642    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 21:01:39.187507 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900644    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 21:01:39.187507 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900647    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 21:01:39.187507 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900649    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 21:01:39.187507 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900652    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 21:01:39.187507 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900654    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 21:01:39.187507 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900659    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 21:01:39.187507 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900662    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 21:01:39.188008 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900665    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 21:01:39.188008 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900667    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 21:01:39.188008 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900669    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 21:01:39.188008 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900672    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 21:01:39.188008 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900675    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 21:01:39.188008 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900678    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 21:01:39.188008 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900680    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 21:01:39.188008 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900682    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 21:01:39.188008 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900685    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 21:01:39.188008 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900689    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 21:01:39.188008 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900693    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 21:01:39.188008 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900696    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 21:01:39.188008 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900699    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 21:01:39.188008 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900701    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 21:01:39.188008 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.900704    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 21:01:39.188008 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900779    2580 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 21:01:39.188008 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900786    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 21:01:39.188008 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900793    2580 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 21:01:39.188008 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900797    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 21:01:39.188008 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900802    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 21:01:39.188008 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900805    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900810    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900814    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900817    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900820    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900824    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900827    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900830    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900833    2580 flags.go:64] FLAG: --cgroup-root=""
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900836    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900854    2580 flags.go:64] FLAG: --client-ca-file=""
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900858    2580 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900861    2580 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900865    2580 flags.go:64] FLAG: --cluster-domain=""
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900868    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900871    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900874    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900878    2580 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900882    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900885    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900889    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900893    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900896    2580 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900899    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 21:01:39.188502 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900902    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900905    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900908    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900912    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900915    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900918    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900921    2580 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900924    2580 flags.go:64] FLAG: --enable-server="true"
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900926    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900931    2580 flags.go:64] FLAG: --event-burst="100"
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900934    2580 flags.go:64] FLAG: --event-qps="50"
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900937    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900940    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900944    2580 flags.go:64] FLAG: --eviction-hard=""
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900948    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900951    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900954    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900956    2580 flags.go:64] FLAG: --eviction-soft=""
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900960    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900963    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900966    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900969    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900972    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900975    2580 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900978    2580 flags.go:64] FLAG: --feature-gates=""
Jul 15 21:01:39.189095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900986    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900990    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900993    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.900998    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901001    2580 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901004    2580 flags.go:64] FLAG: --help="false"
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901007    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-130-35.ec2.internal"
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901010    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901013    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901016    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901019    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901022    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901025    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901028    2580 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901031    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901034    2580 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901037    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901040    2580 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901043    2580 flags.go:64] FLAG: --kube-reserved=""
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901046    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901049    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901051    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901054    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901057    2580 flags.go:64] FLAG: --lock-file=""
Jul 15 21:01:39.189740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901060    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901064    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901067    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901073    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901075    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901078    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901081    2580 flags.go:64] FLAG: --logging-format="text"
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901084    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901087    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901091    2580 flags.go:64] FLAG: --manifest-url=""
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901094    2580 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901100    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901103    2580 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901107    2580 flags.go:64] FLAG: --max-pods="110"
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901110    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901113    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901115    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901118    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901121    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901124    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901127    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901133    2580 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901136    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901138    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 21:01:39.190341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901141    2580 flags.go:64] FLAG: --pod-cidr=""
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901144    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901148    2580 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901151    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901154    2580 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901157    2580 flags.go:64] FLAG: --port="10250"
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901160    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901163    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09e8373910f333332"
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901166    2580 flags.go:64] FLAG: --qos-reserved=""
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901172    2580 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901175    2580 flags.go:64] FLAG: --register-node="true"
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901178    2580 flags.go:64] FLAG: --register-with-taints=""
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901181    2580 flags.go:64] FLAG: --registry-burst="10"
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901184    2580 flags.go:64] FLAG: --registry-qps="5"
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901187    2580 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901190    2580 flags.go:64] FLAG: --reserved-memory=""
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901193    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901196    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901199    2580 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901202    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901206    2580 flags.go:64] FLAG: --runonce="false"
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901210    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901213    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901215    2580 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901218    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 21:01:39.190913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901221    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901224    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901227    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901230    2580 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901233    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901236    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901239    2580 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901242    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901244    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901247    2580 flags.go:64] FLAG: --system-cgroups=""
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901250    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901256    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901259    2580 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901261    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901265    2580 flags.go:64] FLAG: --tls-min-version=""
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901268    2580 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901272    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901275    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901277    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901280    2580 flags.go:64] FLAG: --v="2"
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901284    2580 flags.go:64] FLAG: --version="false"
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901288    2580 flags.go:64] FLAG: --vmodule=""
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901291    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.901295    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901425    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 21:01:39.191523 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901430    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 21:01:39.192193 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901432    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 21:01:39.192193 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901438    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 21:01:39.192193 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901441    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 21:01:39.192193 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901444    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 21:01:39.192193 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901447    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 21:01:39.192193 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901450    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 21:01:39.192193 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901453    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 21:01:39.192193 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901455    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 21:01:39.192193 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901458    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 21:01:39.192193 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901460    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 21:01:39.192193 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901463    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 21:01:39.192193 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901465    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 21:01:39.192193 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901468    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 21:01:39.192193 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901470    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 21:01:39.192193 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901473    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 21:01:39.192193 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901477    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 21:01:39.192193 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901480    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 21:01:39.192193 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901483    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 21:01:39.192193 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901486    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 21:01:39.192193 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901489    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 21:01:39.192674 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901492    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 21:01:39.192674 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901494    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 21:01:39.192674 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901498    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 21:01:39.192674 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901500    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 21:01:39.192674 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901503    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 21:01:39.192674 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901506    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 21:01:39.192674 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901508    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 21:01:39.192674 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901511    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 21:01:39.192674 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901515    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 21:01:39.192674 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901518    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 21:01:39.192674 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901522    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 21:01:39.192674 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901524    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 21:01:39.192674 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901527    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 21:01:39.192674 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901531    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 21:01:39.192674 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901534    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 21:01:39.192674 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901537    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 21:01:39.192674 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901540    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 21:01:39.192674 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901542    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 21:01:39.192674 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901545    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 21:01:39.192674 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901547    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 21:01:39.193203 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901550    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 21:01:39.193203 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901553    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 21:01:39.193203 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901555    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 21:01:39.193203 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901558    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 21:01:39.193203 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901560    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 21:01:39.193203 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901563    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 21:01:39.193203 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901565    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 21:01:39.193203 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901568    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 21:01:39.193203 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901570    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 21:01:39.193203 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901573    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 21:01:39.193203 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901575    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 21:01:39.193203 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901578    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 21:01:39.193203 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901580    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 21:01:39.193203 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901583    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 21:01:39.193203 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901586    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 21:01:39.193203 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901589    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 21:01:39.193203 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901593    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 21:01:39.193203 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901596    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 21:01:39.193203 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901599    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 21:01:39.193663 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901602    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 21:01:39.193663 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901605    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 21:01:39.193663 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901608    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 21:01:39.193663 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901610    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 21:01:39.193663 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901613    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 21:01:39.193663 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901615    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 21:01:39.193663 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901619    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 21:01:39.193663 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901622    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 21:01:39.193663 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901625    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 21:01:39.193663 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901628    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 21:01:39.193663 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901630    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 21:01:39.193663 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901633    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 21:01:39.193663 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901635    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 21:01:39.193663 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901638    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 21:01:39.193663 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901640    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 21:01:39.193663 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901643    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 21:01:39.193663 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901646    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 21:01:39.193663 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901648    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 21:01:39.193663 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901651    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 21:01:39.193663 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901654    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 21:01:39.194158 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901656    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 21:01:39.194158 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901659    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 21:01:39.194158 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901661    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 21:01:39.194158 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901664    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 21:01:39.194158 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901666    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 21:01:39.194158 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901669    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 21:01:39.194158 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901672    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 21:01:39.194158 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901675    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 21:01:39.194158 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901678    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 21:01:39.194158 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901680    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 21:01:39.194158 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901683    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 21:01:39.194158 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901685    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 21:01:39.194158 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901688    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 21:01:39.194158 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901690    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 21:01:39.194158 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901693    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 21:01:39.194158 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901695    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 21:01:39.194158 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901698    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 21:01:39.194158 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.901700    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 21:01:39.194594 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.902465    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 21:01:39.194594 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.910929    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 21:01:39.194594 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.910947    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 21:01:39.194594 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.911853    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 21:01:39.194594 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.911861    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 21:01:39.194594 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911921    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 21:01:39.194594 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911926    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 21:01:39.194594 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911929    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 21:01:39.194594 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911932    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 21:01:39.194594 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911935    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 21:01:39.194594 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911938    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 21:01:39.194594 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911941    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 21:01:39.194594 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911943    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 21:01:39.194594 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911946    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 21:01:39.194594 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911949    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 21:01:39.194984 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911951    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 21:01:39.194984 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911954    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 21:01:39.194984 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911957    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 21:01:39.194984 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911959    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 21:01:39.194984 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911962    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 21:01:39.194984 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911965    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 21:01:39.194984 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911967    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 21:01:39.194984 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911971    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 21:01:39.194984 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911975    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 21:01:39.194984 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911978    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 21:01:39.194984 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911982    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 21:01:39.194984 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911985    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 21:01:39.194984 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911989    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 21:01:39.194984 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911994    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 21:01:39.194984 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.911998    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 21:01:39.194984 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912002    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 21:01:39.194984 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912004    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 21:01:39.194984 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912008    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 21:01:39.194984 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912011    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 21:01:39.195430 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912014    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 21:01:39.195430 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912017    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 21:01:39.195430 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912019    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 21:01:39.195430 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912022    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 21:01:39.195430 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912025    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 21:01:39.195430 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912027    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 21:01:39.195430 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912030    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 21:01:39.195430 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912032    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 21:01:39.195430 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912035    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 21:01:39.195430 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912037    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 21:01:39.195430 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912040    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 21:01:39.195430 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912043    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 21:01:39.195430 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912045    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 21:01:39.195430 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912048    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 21:01:39.195430 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912050    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 21:01:39.195430 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912053    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 21:01:39.195430 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912055    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 21:01:39.195430 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912058    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 21:01:39.195430 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912061    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 21:01:39.195430 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912064    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 21:01:39.195918 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912066    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 21:01:39.195918 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912069    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 21:01:39.195918 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912071    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 21:01:39.195918 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912074    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 21:01:39.195918 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912077    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 21:01:39.195918 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912079    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 21:01:39.195918 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912082    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 21:01:39.195918 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912084    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 21:01:39.195918 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912086    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 21:01:39.195918 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912089    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 21:01:39.195918 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912094    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 21:01:39.195918 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912097    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 21:01:39.195918 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912100    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 21:01:39.195918 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912102    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 21:01:39.195918 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912106    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 21:01:39.195918 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912108    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 21:01:39.195918 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912111    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 21:01:39.195918 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912113    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 21:01:39.195918 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912116    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 21:01:39.195918 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912119    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 21:01:39.196383 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912121    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 21:01:39.196383 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912124    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 21:01:39.196383 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912127    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 21:01:39.196383 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912129    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 21:01:39.196383 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912132    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 21:01:39.196383 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912135    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 21:01:39.196383 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912137    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 21:01:39.196383 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912140    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 21:01:39.196383 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912142    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 21:01:39.196383 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912145    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 21:01:39.196383 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912154    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 21:01:39.196383 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912157    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 21:01:39.196383 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912159    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 21:01:39.196383 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912162    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 21:01:39.196383 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912164    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 21:01:39.196383 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912167    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 21:01:39.196383 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912169    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 21:01:39.196383 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912172    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 21:01:39.196383 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912174    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 21:01:39.196855 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912177    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 21:01:39.196855 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912179    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 21:01:39.196855 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912182    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 21:01:39.196855 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912186    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 21:01:39.196855 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912190    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 21:01:39.196855 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912192    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 21:01:39.196855 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912195    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 21:01:39.196855 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912197    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 21:01:39.196855 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912200    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 21:01:39.196855 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912203    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 21:01:39.196855 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912205    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 21:01:39.196855 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.912210    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 21:01:39.196855 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912320    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 21:01:39.196855 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912325    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 21:01:39.196855 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912328    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 21:01:39.197232 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912331    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 21:01:39.197232 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912334    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 21:01:39.197232 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912337    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 21:01:39.197232 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912339    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 21:01:39.197232 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912342    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 21:01:39.197232 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912344    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 21:01:39.197232 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912347    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 21:01:39.197232 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912350    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 21:01:39.197232 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912352    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 21:01:39.197232 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912360    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 21:01:39.197232 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912363    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 21:01:39.197232 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912366    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 21:01:39.197232 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912369    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 21:01:39.197232 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912371    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 21:01:39.197232 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912373    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 21:01:39.197232 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912376    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 21:01:39.197232 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912379    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 21:01:39.197232 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912381    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 21:01:39.197232 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912384    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 21:01:39.197232 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912386    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 21:01:39.197707 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912389    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 21:01:39.197707 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912394    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 21:01:39.197707 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912396    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 21:01:39.197707 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912399    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 21:01:39.197707 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912401    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 21:01:39.197707 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912404    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 21:01:39.197707 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912406    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 21:01:39.197707 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912409    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 21:01:39.197707 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912412    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 21:01:39.197707 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912414    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 21:01:39.197707 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912417    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 21:01:39.197707 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912419    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 21:01:39.197707 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912422    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 21:01:39.197707 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912425    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 21:01:39.197707 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912427    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 21:01:39.197707 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912430    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 21:01:39.197707 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912432    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 21:01:39.197707 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912434    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 21:01:39.197707 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912437    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 21:01:39.198185 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912440    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 21:01:39.198185 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912442    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 21:01:39.198185 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912444    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 21:01:39.198185 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912454    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 21:01:39.198185 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912457    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 21:01:39.198185 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912460    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 21:01:39.198185 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912462    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 21:01:39.198185 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912465    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 21:01:39.198185 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912467    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 21:01:39.198185 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912470    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 21:01:39.198185 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912472    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 21:01:39.198185 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912474    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 21:01:39.198185 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912477    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 21:01:39.198185 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912479    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 21:01:39.198185 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912484    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 21:01:39.198185 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912487    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 21:01:39.198185 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912490    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 21:01:39.198185 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912493    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 21:01:39.198185 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912495    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 21:01:39.198634 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912498    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 21:01:39.198634 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912500    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 21:01:39.198634 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912503    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 21:01:39.198634 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912505    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 21:01:39.198634 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912509    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 21:01:39.198634 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912512    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 21:01:39.198634 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912515    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 21:01:39.198634 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912518    2580 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 21:01:39.198634 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912521    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 21:01:39.198634 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912524    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 21:01:39.198634 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912526    2580 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 21:01:39.198634 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912529    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 21:01:39.198634 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912532    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 21:01:39.198634 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912534    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 21:01:39.198634 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912537    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 21:01:39.198634 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912539    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 21:01:39.198634 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912542    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 21:01:39.198634 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912545    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 21:01:39.198634 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912548    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 21:01:39.198634 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912551    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 21:01:39.199166 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912553    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 21:01:39.199166 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912556    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 21:01:39.199166 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912558    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 21:01:39.199166 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912561    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 21:01:39.199166 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912563    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 21:01:39.199166 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912566    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 21:01:39.199166 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912568    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 21:01:39.199166 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912575    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 21:01:39.199166 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912577    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 21:01:39.199166 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912581    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 21:01:39.199166 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912585    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 21:01:39.199166 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912588    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 21:01:39.199166 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912592    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 21:01:39.199166 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912596    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 21:01:39.199166 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912599    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 21:01:39.199166 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912602    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 21:01:39.199166 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912605    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 21:01:39.199166 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:38.912607    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 21:01:39.199597 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.912612    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 21:01:39.199597 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.912722    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 21:01:39.199597 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.915938    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 21:01:39.199597 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.917693    2580 server.go:1019] "Starting client certificate rotation"
Jul 15 21:01:39.199597 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.917797    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 21:01:39.199597 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.917834    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 21:01:39.199597 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.920616    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 21:01:39.199597 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.924768    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 21:01:39.199597 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.936449    2580 log.go:25] "Validated CRI v1 runtime API"
Jul 15 21:01:39.199597 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.939818    2580 log.go:25] "Validated CRI v1 image API"
Jul 15 21:01:39.199597 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.940655    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 21:01:39.199597 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.943571    2580 fs.go:135] Filesystem UUIDs: map[23d563dc-1ce1-40c1-8930-383de945a75e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c9691311-49f6-48ff-8c7a-b73853a42adc:/dev/nvme0n1p4]
Jul 15 21:01:39.199936 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.943595    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 21:01:39.199967 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.950723    2580 manager.go:216] Machine: {Timestamp:2026-07-15 21:01:38.950237923 +0000 UTC m=+0.378197550 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3109415 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2efc063c79573b5bd95636c3f97082 SystemUUID:ec2efc06-3c79-573b-5bd9-5636c3f97082 BootID:328d692f-de81-46ff-a461-1827c4a1b02f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b8:d2:55:f2:43 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b8:d2:55:f2:43 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:14:d6:05:dd:4a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 21:01:39.199967 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.950832    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 21:01:39.199967 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.950929    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 21:01:39.199967 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.953489    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 21:01:39.199967 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.953513    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-35.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 21:01:39.199967 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.954324    2580 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 21:01:39.199967 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.954334    2580 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 21:01:39.199967 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.954342    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.954356    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.955379    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.956243    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.960891    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.961009    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.961038    2580 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.961049    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.961060    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.961069    2580 kubelet.go:398] "Adding apiserver pod source"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.961079    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.961477    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.961495    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.963920    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.966361    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.966388    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.966585    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.966598    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.966604    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.966609    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.966617    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.966622    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.967227    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.967234    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.967240    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.967246    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.967254    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.967263    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.968219    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.968228    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.970536    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-35.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:38.971421    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:38.971421    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.971922    2580 server.go:1268] "Started kubelet"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.972018    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.972099    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.972174    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.974621    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.975260    2580 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 21:01:39.200196 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:38.978005    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:38.977477    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-35.ec2.internal.18c29255a77b631f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-35.ec2.internal,UID:ip-10-0-130-35.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-35.ec2.internal,},FirstTimestamp:2026-07-15 21:01:38.971894559 +0000 UTC m=+0.399854187,LastTimestamp:2026-07-15 21:01:38.971894559 +0000 UTC m=+0.399854187,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-35.ec2.internal,}"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.981470    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.981961    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:38.982031    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-35.ec2.internal\" not found"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.982663    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.982692    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.982707    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.982766    2580 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.982779    2580 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.982816    2580 factory.go:55] Registering systemd factory
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.982874    2580 factory.go:223] Registration of the systemd container factory successfully
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.983154    2580 factory.go:153] Registering CRI-O factory
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.983168    2580 factory.go:223] Registration of the crio container factory successfully
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.983217    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.983239    2580 factory.go:103] Registering Raw factory
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.983257    2580 manager.go:1196] Started watching for new ooms in manager
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.983733    2580 manager.go:349] Starting recovery of all containers
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:38.993879    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:38.993948    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-35.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.995733    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.997197    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tw54s"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:38.998183    2580 manager.go:354] Recovery completed
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.002556    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.004234    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.004266    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.004280    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientPID"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.004792    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.004801    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.004815    2580 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.004835    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.005562    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.005584    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 21:01:39.201179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.005594    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientPID"
Jul 15 21:01:39.201990 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.006153    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tw54s"
Jul 15 21:01:39.201990 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.007002    2580 policy_none.go:49] "None policy: Start"
Jul 15 21:01:39.201990 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.007015    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 21:01:39.201990 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.007025    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 21:01:39.201990 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.009005    2580 policy_none.go:47] "Start"
Jul 15 21:01:39.201990 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.056299    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 21:01:39.201990 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.056432    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 21:01:39.201990 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.056453    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 21:01:39.201990 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:39.056482    2580 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Jul 15 21:01:39.201990 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.060054    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 21:01:39.201990 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.061620    2580 manager.go:337] "Starting Device Plugin manager"
Jul 15 21:01:39.201990 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:39.061746    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 21:01:39.201990 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.061759    2580 server.go:87] "Starting device plugin registration server"
Jul 15 21:01:39.201990 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.061995    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 21:01:39.201990 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.062010    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 21:01:39.201990 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.062122    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 21:01:39.201990 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.062223    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 21:01:39.201990 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.062234    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 21:01:39.201990 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:39.062710    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 21:01:39.201990 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:39.062760    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-35.ec2.internal\" not found"
Jul 15 21:01:39.227541 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.227518    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 21:01:39.227631 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.227508    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal"]
Jul 15 21:01:39.227683 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.227672    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 21:01:39.228886 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.228829    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 21:01:39.228943 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.228894    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 21:01:39.228943 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.228916    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientPID"
Jul 15 21:01:39.228943 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.228922    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 21:01:39.228943 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.228944    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 21:01:39.229107 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.228973    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientPID"
Jul 15 21:01:39.229107 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.228945    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-35.ec2.internal"
Jul 15 21:01:39.231362 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.231350    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 21:01:39.231451 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.231437    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal"
Jul 15 21:01:39.231499 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.231464    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 21:01:39.232327 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.232301    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 21:01:39.232327 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.232327    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 21:01:39.232454 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.232341    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientPID"
Jul 15 21:01:39.232454 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.232366    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 21:01:39.232454 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.232386    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 21:01:39.232454 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.232398    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientPID"
Jul 15 21:01:39.234489 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:39.234474    2580 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-130-35.ec2.internal\" not found" node="ip-10-0-130-35.ec2.internal"
Jul 15 21:01:39.234600 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.234585    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal"
Jul 15 21:01:39.234666 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.234617    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 21:01:39.235266 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.235249    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 21:01:39.235345 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.235276    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 21:01:39.235345 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.235291    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeHasSufficientPID"
Jul 15 21:01:39.236327 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.236312    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-35.ec2.internal"
Jul 15 21:01:39.236395 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:39.236331    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-35.ec2.internal\": node \"ip-10-0-130-35.ec2.internal\" not found"
Jul 15 21:01:39.255403 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:39.255381    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-35.ec2.internal\" not found" node="ip-10-0-130-35.ec2.internal"
Jul 15 21:01:39.258557 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:39.258540    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-35.ec2.internal\" not found" node="ip-10-0-130-35.ec2.internal"
Jul 15 21:01:39.271050 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:39.271032    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-35.ec2.internal\" not found"
Jul 15 21:01:39.328216 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.328161    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9e4dbfad2ee44e7e791b99af789a46fa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal\" (UID: \"9e4dbfad2ee44e7e791b99af789a46fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal"
Jul 15 21:01:39.328216 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.328188    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e4dbfad2ee44e7e791b99af789a46fa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal\" (UID: \"9e4dbfad2ee44e7e791b99af789a46fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal"
Jul 15 21:01:39.328216 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.328208    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9093750e6d24bbef1ba3b0def477f9fe-config\") pod \"kube-apiserver-proxy-ip-10-0-130-35.ec2.internal\" (UID: \"9093750e6d24bbef1ba3b0def477f9fe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal"
Jul 15 21:01:39.371233 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:39.371211    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-35.ec2.internal\" not found"
Jul 15 21:01:39.428891 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.428863    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9e4dbfad2ee44e7e791b99af789a46fa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal\" (UID: \"9e4dbfad2ee44e7e791b99af789a46fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal"
Jul 15 21:01:39.428891 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.428816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9e4dbfad2ee44e7e791b99af789a46fa-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal\" (UID: \"9e4dbfad2ee44e7e791b99af789a46fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal"
Jul 15 21:01:39.429024 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.428917    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e4dbfad2ee44e7e791b99af789a46fa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal\" (UID: \"9e4dbfad2ee44e7e791b99af789a46fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal"
Jul 15 21:01:39.429024 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.428934    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9093750e6d24bbef1ba3b0def477f9fe-config\") pod \"kube-apiserver-proxy-ip-10-0-130-35.ec2.internal\" (UID: \"9093750e6d24bbef1ba3b0def477f9fe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal"
Jul 15 21:01:39.429024 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.428954    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9093750e6d24bbef1ba3b0def477f9fe-config\") pod \"kube-apiserver-proxy-ip-10-0-130-35.ec2.internal\" (UID: \"9093750e6d24bbef1ba3b0def477f9fe\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal"
Jul 15 21:01:39.429024 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.429008    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e4dbfad2ee44e7e791b99af789a46fa-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal\" (UID: \"9e4dbfad2ee44e7e791b99af789a46fa\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal"
Jul 15 21:01:39.471582 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:39.471549    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-35.ec2.internal\" not found"
Jul 15 21:01:39.559345 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.559308    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal"
Jul 15 21:01:39.562723 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.562704    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal"
Jul 15 21:01:39.572668 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:39.572647    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-35.ec2.internal\" not found"
Jul 15 21:01:39.674216 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:39.674111    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-35.ec2.internal\" not found"
Jul 15 21:01:39.774463 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:39.774424    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-35.ec2.internal\" not found"
Jul 15 21:01:39.877855 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:39.877806    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-35.ec2.internal\" not found"
Jul 15 21:01:39.917044 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.917012    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 21:01:39.917187 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:39.917167    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 21:01:39.978456 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:39.978376    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-35.ec2.internal\" not found"
Jul 15 21:01:40.010656 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.010610    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 20:56:39 +0000 UTC" deadline="2027-12-23 04:09:17.52483544 +0000 UTC"
Jul 15 21:01:40.010656 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.010650    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12607h7m37.514190488s"
Jul 15 21:01:40.078500 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:40.078463    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-35.ec2.internal\" not found"
Jul 15 21:01:40.180462 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:40.180415    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-35.ec2.internal\" not found"
Jul 15 21:01:40.281110 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:40.281046    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-35.ec2.internal\" not found"
Jul 15 21:01:40.356683 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:40.356635    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e4dbfad2ee44e7e791b99af789a46fa.slice/crio-c4f6bfd478bbf827c118960768b60247b1311e9fdf606b2e8ad1f72b3df69553 WatchSource:0}: Error finding container c4f6bfd478bbf827c118960768b60247b1311e9fdf606b2e8ad1f72b3df69553: Status 404 returned error can't find the container with id c4f6bfd478bbf827c118960768b60247b1311e9fdf606b2e8ad1f72b3df69553
Jul 15 21:01:40.362780 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:40.362748    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9093750e6d24bbef1ba3b0def477f9fe.slice/crio-b3047db3feb608fb81da1881a0aced0b380f16a0dc3a7e49e726ae6080016e67 WatchSource:0}: Error finding container b3047db3feb608fb81da1881a0aced0b380f16a0dc3a7e49e726ae6080016e67: Status 404 returned error can't find the container with id b3047db3feb608fb81da1881a0aced0b380f16a0dc3a7e49e726ae6080016e67
Jul 15 21:01:40.365379 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.365360    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 21:01:40.381137 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:40.381109    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-35.ec2.internal\" not found"
Jul 15 21:01:40.430962 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.430938    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 21:01:40.460590 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.460568    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 21:01:40.481783 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:40.481758    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-35.ec2.internal\" not found"
Jul 15 21:01:40.514803 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.514778    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 21:01:40.584787 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.584694    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal"
Jul 15 21:01:40.598480 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.598454    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 21:01:40.599728 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.599714    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal"
Jul 15 21:01:40.607989 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.607973    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 21:01:40.963551 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.963467    2580 apiserver.go:52] "Watching apiserver"
Jul 15 21:01:40.969380 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.969351    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 21:01:40.969776 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.969753    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs","openshift-cluster-node-tuning-operator/tuned-smt2r","openshift-dns/node-resolver-pj9tk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal","openshift-multus/multus-additional-cni-plugins-fkfzt","openshift-image-registry/node-ca-9hqht","openshift-multus/multus-gqnb8","openshift-multus/network-metrics-daemon-gxj8k","openshift-network-diagnostics/network-check-target-jdds4","openshift-network-operator/iptables-alerter-vs2l4","openshift-ovn-kubernetes/ovnkube-node-dhz54","kube-system/global-pull-secret-syncer-bctvr","kube-system/konnectivity-agent-pw62m","kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal"]
Jul 15 21:01:40.972416 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.972396    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vs2l4"
Jul 15 21:01:40.974770 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.974742    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pw62m"
Jul 15 21:01:40.976428 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.976407    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 21:01:40.976515 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.976434    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 21:01:40.976606 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.976592    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 21:01:40.976725 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.976707    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cq9vw\""
Jul 15 21:01:40.977168 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.977150    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pj9tk"
Jul 15 21:01:40.977272 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.977248    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nd9wk\""
Jul 15 21:01:40.977475 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.977456    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 21:01:40.977793 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.977774    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 21:01:40.980031 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.979615    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:01:40.980031 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:40.979786    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gxj8k" podUID="8ca7d5c9-37f4-444b-9e21-7659e695968a"
Jul 15 21:01:40.980707 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.980542    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 21:01:40.981195 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.981019    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-w5dmv\""
Jul 15 21:01:40.981195 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.981068    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 21:01:40.983110 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.982940    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 21:01:40.984306 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.983906    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:40.984482 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.984457    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9hqht"
Jul 15 21:01:40.986473 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.986405    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 21:01:40.986473 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.986430    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 21:01:40.986634 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.986614    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 21:01:40.986696 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.986641    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 21:01:40.986880 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.986852    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 21:01:40.986992 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.986916    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-v65k9\""
Jul 15 21:01:40.987166 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.987147    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 21:01:40.987250 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.987197    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:01:40.987250 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.987237    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 21:01:40.987365 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.987252    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kk7mp\""
Jul 15 21:01:40.987365 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:40.987261    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdds4" podUID="76c132a0-854b-44a6-87bf-a4f07da94fba"
Jul 15 21:01:40.987365 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.987351    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 21:01:40.992681 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.992661    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:40.995302 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.994899    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:40.997148 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.997076    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 21:01:40.998432 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.997117    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-grr45\""
Jul 15 21:01:40.998432 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.997694    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:40.998432 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.997850    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 21:01:40.998432 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.997944    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2gwfp\""
Jul 15 21:01:40.998710 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:40.998484    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 21:01:41.000220 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.000197    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 21:01:41.000418 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.000397    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 21:01:41.001759 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.000912    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 21:01:41.001759 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.001145    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d7vs5\""
Jul 15 21:01:41.002659 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.002373    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.003295 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.003274    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 21:01:41.004237 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.004216    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 21:01:41.005189 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.004938    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:41.005189 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:41.005012    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bctvr" podUID="1a69c601-b5b2-4177-8781-16090abbd7f6"
Jul 15 21:01:41.006211 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.006176    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fpkdl\""
Jul 15 21:01:41.006444 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.006424    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 21:01:41.006664 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.006644    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 21:01:41.006911 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.006890    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 21:01:41.007237 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.007217    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 21:01:41.007437 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.007416    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 21:01:41.038321 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.038134    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bvnhn"
Jul 15 21:01:41.043640 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.043616    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5lkp\" (UniqueName: \"kubernetes.io/projected/e2f6dde8-4759-43cd-82e1-77de08121820-kube-api-access-p5lkp\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.043738 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.043662    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6mwq\" (UniqueName: \"kubernetes.io/projected/5f7e6700-77fa-402a-be9f-e4150afad410-kube-api-access-p6mwq\") pod \"iptables-alerter-vs2l4\" (UID: \"5f7e6700-77fa-402a-be9f-e4150afad410\") " pod="openshift-network-operator/iptables-alerter-vs2l4"
Jul 15 21:01:41.043738 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.043693    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/394a0fde-3d6c-48e7-9d13-0325ad6ae285-konnectivity-ca\") pod \"konnectivity-agent-pw62m\" (UID: \"394a0fde-3d6c-48e7-9d13-0325ad6ae285\") " pod="kube-system/konnectivity-agent-pw62m"
Jul 15 21:01:41.043738 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.043721    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffrkt\" (UniqueName: \"kubernetes.io/projected/8ca7d5c9-37f4-444b-9e21-7659e695968a-kube-api-access-ffrkt\") pod \"network-metrics-daemon-gxj8k\" (UID: \"8ca7d5c9-37f4-444b-9e21-7659e695968a\") " pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:01:41.043900 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.043748    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e2f6dde8-4759-43cd-82e1-77de08121820-cni-binary-copy\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.043900 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.043772    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e2f6dde8-4759-43cd-82e1-77de08121820-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.043900 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.043798    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f3f398c-10c8-43f7-ba9f-1049f774d568-host\") pod \"node-ca-9hqht\" (UID: \"3f3f398c-10c8-43f7-ba9f-1049f774d568\") " pod="openshift-image-registry/node-ca-9hqht"
Jul 15 21:01:41.043900 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.043821    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3f3f398c-10c8-43f7-ba9f-1049f774d568-serviceca\") pod \"node-ca-9hqht\" (UID: \"3f3f398c-10c8-43f7-ba9f-1049f774d568\") " pod="openshift-image-registry/node-ca-9hqht"
Jul 15 21:01:41.043900 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.043847    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a806e68-abc4-414a-96ac-843e728e77b9-tmp-dir\") pod \"node-resolver-pj9tk\" (UID: \"1a806e68-abc4-414a-96ac-843e728e77b9\") " pod="openshift-dns/node-resolver-pj9tk"
Jul 15 21:01:41.043900 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.043872    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs\") pod \"network-metrics-daemon-gxj8k\" (UID: \"8ca7d5c9-37f4-444b-9e21-7659e695968a\") " pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:01:41.044215 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.043918    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e2f6dde8-4759-43cd-82e1-77de08121820-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.044215 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.043958    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e2f6dde8-4759-43cd-82e1-77de08121820-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.044215 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.043985    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7z7c\" (UniqueName: \"kubernetes.io/projected/3f3f398c-10c8-43f7-ba9f-1049f774d568-kube-api-access-w7z7c\") pod \"node-ca-9hqht\" (UID: \"3f3f398c-10c8-43f7-ba9f-1049f774d568\") " pod="openshift-image-registry/node-ca-9hqht"
Jul 15 21:01:41.044215 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.044009    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a806e68-abc4-414a-96ac-843e728e77b9-hosts-file\") pod \"node-resolver-pj9tk\" (UID: \"1a806e68-abc4-414a-96ac-843e728e77b9\") " pod="openshift-dns/node-resolver-pj9tk"
Jul 15 21:01:41.044215 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.044086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2f6dde8-4759-43cd-82e1-77de08121820-system-cni-dir\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.044215 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.044135    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e2f6dde8-4759-43cd-82e1-77de08121820-cnibin\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.044215 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.044186    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e2f6dde8-4759-43cd-82e1-77de08121820-os-release\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.044622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.044228    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f7e6700-77fa-402a-be9f-e4150afad410-iptables-alerter-script\") pod \"iptables-alerter-vs2l4\" (UID: \"5f7e6700-77fa-402a-be9f-e4150afad410\") " pod="openshift-network-operator/iptables-alerter-vs2l4"
Jul 15 21:01:41.044622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.044257    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f7e6700-77fa-402a-be9f-e4150afad410-host-slash\") pod \"iptables-alerter-vs2l4\" (UID: \"5f7e6700-77fa-402a-be9f-e4150afad410\") " pod="openshift-network-operator/iptables-alerter-vs2l4"
Jul 15 21:01:41.044622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.044297    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/394a0fde-3d6c-48e7-9d13-0325ad6ae285-agent-certs\") pod \"konnectivity-agent-pw62m\" (UID: \"394a0fde-3d6c-48e7-9d13-0325ad6ae285\") " pod="kube-system/konnectivity-agent-pw62m"
Jul 15 21:01:41.044622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.044322    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq7jr\" (UniqueName: \"kubernetes.io/projected/1a806e68-abc4-414a-96ac-843e728e77b9-kube-api-access-rq7jr\") pod \"node-resolver-pj9tk\" (UID: \"1a806e68-abc4-414a-96ac-843e728e77b9\") " pod="openshift-dns/node-resolver-pj9tk"
Jul 15 21:01:41.053861 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.053838    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bvnhn"
Jul 15 21:01:41.062661 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.062566    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal" event={"ID":"9093750e6d24bbef1ba3b0def477f9fe","Type":"ContainerStarted","Data":"b3047db3feb608fb81da1881a0aced0b380f16a0dc3a7e49e726ae6080016e67"}
Jul 15 21:01:41.063867 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.063797    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal" event={"ID":"9e4dbfad2ee44e7e791b99af789a46fa","Type":"ContainerStarted","Data":"c4f6bfd478bbf827c118960768b60247b1311e9fdf606b2e8ad1f72b3df69553"}
Jul 15 21:01:41.084486 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.084465    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 21:01:41.145121 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.145048    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-host-run-k8s-cni-cncf-io\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.145121 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.145099    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-host-run-netns\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.145121 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.145124    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-host-cni-bin\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.145409 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.145141    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-ovnkube-script-lib\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.145409 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.145164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f7e6700-77fa-402a-be9f-e4150afad410-iptables-alerter-script\") pod \"iptables-alerter-vs2l4\" (UID: \"5f7e6700-77fa-402a-be9f-e4150afad410\") " pod="openshift-network-operator/iptables-alerter-vs2l4"
Jul 15 21:01:41.145409 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.145188    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f7e6700-77fa-402a-be9f-e4150afad410-host-slash\") pod \"iptables-alerter-vs2l4\" (UID: \"5f7e6700-77fa-402a-be9f-e4150afad410\") " pod="openshift-network-operator/iptables-alerter-vs2l4"
Jul 15 21:01:41.145409 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.145223    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5e36b0da-c3e9-43ce-9f26-9b9962d8e195-sys-fs\") pod \"aws-ebs-csi-driver-node-kncxs\" (UID: \"5e36b0da-c3e9-43ce-9f26-9b9962d8e195\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:41.145409 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.145266    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5f7e6700-77fa-402a-be9f-e4150afad410-host-slash\") pod \"iptables-alerter-vs2l4\" (UID: \"5f7e6700-77fa-402a-be9f-e4150afad410\") " pod="openshift-network-operator/iptables-alerter-vs2l4"
Jul 15 21:01:41.145409 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.145366    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-etc-modprobe-d\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.145409 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.145407    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-etc-sysconfig\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.145748 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.145432    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-etc-sysctl-d\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.145748 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.145473    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-run-systemd\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.145748 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.145496    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6m9l\" (UniqueName: \"kubernetes.io/projected/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-kube-api-access-d6m9l\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.145748 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.145522    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/394a0fde-3d6c-48e7-9d13-0325ad6ae285-konnectivity-ca\") pod \"konnectivity-agent-pw62m\" (UID: \"394a0fde-3d6c-48e7-9d13-0325ad6ae285\") " pod="kube-system/konnectivity-agent-pw62m"
Jul 15 21:01:41.145748 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.145541    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-host-var-lib-kubelet\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.146038 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.146014    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5f7e6700-77fa-402a-be9f-e4150afad410-iptables-alerter-script\") pod \"iptables-alerter-vs2l4\" (UID: \"5f7e6700-77fa-402a-be9f-e4150afad410\") " pod="openshift-network-operator/iptables-alerter-vs2l4"
Jul 15 21:01:41.146222 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.146101    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-hostroot\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.146222 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.146101    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/394a0fde-3d6c-48e7-9d13-0325ad6ae285-konnectivity-ca\") pod \"konnectivity-agent-pw62m\" (UID: \"394a0fde-3d6c-48e7-9d13-0325ad6ae285\") " pod="kube-system/konnectivity-agent-pw62m"
Jul 15 21:01:41.146694 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.146136    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-host-run-multus-certs\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.146817 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.146718    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfclb\" (UniqueName: \"kubernetes.io/projected/b202fca4-2178-47ab-9b2a-98d494879d5f-kube-api-access-tfclb\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.146817 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.146743    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-etc-sysctl-conf\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.146817 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.146767    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-lib-modules\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.146817 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.146792    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-systemd-units\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.147064 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.146843    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a806e68-abc4-414a-96ac-843e728e77b9-tmp-dir\") pod \"node-resolver-pj9tk\" (UID: \"1a806e68-abc4-414a-96ac-843e728e77b9\") " pod="openshift-dns/node-resolver-pj9tk"
Jul 15 21:01:41.147064 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.146980    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5e36b0da-c3e9-43ce-9f26-9b9962d8e195-registration-dir\") pod \"aws-ebs-csi-driver-node-kncxs\" (UID: \"5e36b0da-c3e9-43ce-9f26-9b9962d8e195\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:41.147064 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147015    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b202fca4-2178-47ab-9b2a-98d494879d5f-cni-binary-copy\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.147064 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147039    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-var-lib-kubelet\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.147064 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147063    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5e36b0da-c3e9-43ce-9f26-9b9962d8e195-socket-dir\") pod \"aws-ebs-csi-driver-node-kncxs\" (UID: \"5e36b0da-c3e9-43ce-9f26-9b9962d8e195\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:41.147316 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-sys\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.147316 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147145    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a806e68-abc4-414a-96ac-843e728e77b9-tmp-dir\") pod \"node-resolver-pj9tk\" (UID: \"1a806e68-abc4-414a-96ac-843e728e77b9\") " pod="openshift-dns/node-resolver-pj9tk"
Jul 15 21:01:41.147316 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147147    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2f6dde8-4759-43cd-82e1-77de08121820-system-cni-dir\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.147316 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147194    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e2f6dde8-4759-43cd-82e1-77de08121820-system-cni-dir\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.147316 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b202fca4-2178-47ab-9b2a-98d494879d5f-multus-daemon-config\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.147316 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147293    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb44ed96-9b5a-4f52-b349-f64452562c6b-etc-tuned\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.147622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147327    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5lkp\" (UniqueName: \"kubernetes.io/projected/e2f6dde8-4759-43cd-82e1-77de08121820-kube-api-access-p5lkp\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.147622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147361    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6mwq\" (UniqueName: \"kubernetes.io/projected/5f7e6700-77fa-402a-be9f-e4150afad410-kube-api-access-p6mwq\") pod \"iptables-alerter-vs2l4\" (UID: \"5f7e6700-77fa-402a-be9f-e4150afad410\") " pod="openshift-network-operator/iptables-alerter-vs2l4"
Jul 15 21:01:41.147622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147407    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5e36b0da-c3e9-43ce-9f26-9b9962d8e195-device-dir\") pod \"aws-ebs-csi-driver-node-kncxs\" (UID: \"5e36b0da-c3e9-43ce-9f26-9b9962d8e195\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:41.147622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147436    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-cnibin\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.147622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147534    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-host\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.147622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147568    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-host-slash\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.147622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147596    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-var-lib-openvswitch\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.148024 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147625    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f3f398c-10c8-43f7-ba9f-1049f774d568-host\") pod \"node-ca-9hqht\" (UID: \"3f3f398c-10c8-43f7-ba9f-1049f774d568\") " pod="openshift-image-registry/node-ca-9hqht"
Jul 15 21:01:41.148024 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147674    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3f3f398c-10c8-43f7-ba9f-1049f774d568-host\") pod \"node-ca-9hqht\" (UID: \"3f3f398c-10c8-43f7-ba9f-1049f774d568\") " pod="openshift-image-registry/node-ca-9hqht"
Jul 15 21:01:41.148024 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147703    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-system-cni-dir\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.148024 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147737    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-host-run-netns\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.148024 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147773    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-run-openvswitch\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.148024 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147802    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-run-ovn\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.148024 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147832    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7z7c\" (UniqueName: \"kubernetes.io/projected/3f3f398c-10c8-43f7-ba9f-1049f774d568-kube-api-access-w7z7c\") pod \"node-ca-9hqht\" (UID: \"3f3f398c-10c8-43f7-ba9f-1049f774d568\") " pod="openshift-image-registry/node-ca-9hqht"
Jul 15 21:01:41.148024 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147858    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb44ed96-9b5a-4f52-b349-f64452562c6b-tmp\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.148024 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147898    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42knm\" (UniqueName: \"kubernetes.io/projected/eb44ed96-9b5a-4f52-b349-f64452562c6b-kube-api-access-42knm\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.148024 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147927    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-host-kubelet\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.148024 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.147961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-log-socket\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.148024 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148019    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/394a0fde-3d6c-48e7-9d13-0325ad6ae285-agent-certs\") pod \"konnectivity-agent-pw62m\" (UID: \"394a0fde-3d6c-48e7-9d13-0325ad6ae285\") " pod="kube-system/konnectivity-agent-pw62m"
Jul 15 21:01:41.148486 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq7jr\" (UniqueName: \"kubernetes.io/projected/1a806e68-abc4-414a-96ac-843e728e77b9-kube-api-access-rq7jr\") pod \"node-resolver-pj9tk\" (UID: \"1a806e68-abc4-414a-96ac-843e728e77b9\") " pod="openshift-dns/node-resolver-pj9tk"
Jul 15 21:01:41.148486 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148072    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffrkt\" (UniqueName: \"kubernetes.io/projected/8ca7d5c9-37f4-444b-9e21-7659e695968a-kube-api-access-ffrkt\") pod \"network-metrics-daemon-gxj8k\" (UID: \"8ca7d5c9-37f4-444b-9e21-7659e695968a\") " pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:01:41.148486 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148138    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-os-release\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.148486 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148169    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-host-var-lib-cni-multus\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.148486 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148194    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-host-cni-netd\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.148486 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148224    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e2f6dde8-4759-43cd-82e1-77de08121820-cni-binary-copy\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.148486 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148273    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret\") pod \"global-pull-secret-syncer-bctvr\" (UID: \"1a69c601-b5b2-4177-8781-16090abbd7f6\") " pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:41.148486 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148405    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5e36b0da-c3e9-43ce-9f26-9b9962d8e195-etc-selinux\") pod \"aws-ebs-csi-driver-node-kncxs\" (UID: \"5e36b0da-c3e9-43ce-9f26-9b9962d8e195\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:41.148486 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148444    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7rsq\" (UniqueName: \"kubernetes.io/projected/5e36b0da-c3e9-43ce-9f26-9b9962d8e195-kube-api-access-d7rsq\") pod \"aws-ebs-csi-driver-node-kncxs\" (UID: \"5e36b0da-c3e9-43ce-9f26-9b9962d8e195\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:41.148949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148499    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-multus-socket-dir-parent\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.148949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148531    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e2f6dde8-4759-43cd-82e1-77de08121820-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.148949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148639    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 21:01:41.148949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148631    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5e36b0da-c3e9-43ce-9f26-9b9962d8e195-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kncxs\" (UID: \"5e36b0da-c3e9-43ce-9f26-9b9962d8e195\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:41.148949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148718    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-host-var-lib-cni-bin\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.148949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148743    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-multus-conf-dir\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.148949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148785    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e2f6dde8-4759-43cd-82e1-77de08121820-cni-binary-copy\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.148949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148796    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-etc-kubernetes\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.148949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148838    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-etc-openvswitch\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.148949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148869    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-node-log\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.148949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148898    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e2f6dde8-4759-43cd-82e1-77de08121820-cnibin\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.148949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e2f6dde8-4759-43cd-82e1-77de08121820-os-release\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.149529 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.148972    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.149529 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.149001    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-env-overrides\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.149529 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.149029    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a69c601-b5b2-4177-8781-16090abbd7f6-kubelet-config\") pod \"global-pull-secret-syncer-bctvr\" (UID: \"1a69c601-b5b2-4177-8781-16090abbd7f6\") " pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:41.149529 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.149033    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e2f6dde8-4759-43cd-82e1-77de08121820-cnibin\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.149529 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.149055    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a69c601-b5b2-4177-8781-16090abbd7f6-dbus\") pod \"global-pull-secret-syncer-bctvr\" (UID: \"1a69c601-b5b2-4177-8781-16090abbd7f6\") " pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:41.149529 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.149070    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e2f6dde8-4759-43cd-82e1-77de08121820-os-release\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.149529 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.149079    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-etc-kubernetes\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.149529 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.149155    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-host-run-ovn-kubernetes\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.149529 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.149198    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e2f6dde8-4759-43cd-82e1-77de08121820-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.149529 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.149187    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-ovnkube-config\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.149529 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.149256    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e2f6dde8-4759-43cd-82e1-77de08121820-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.149529 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.149281    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3f3f398c-10c8-43f7-ba9f-1049f774d568-serviceca\") pod \"node-ca-9hqht\" (UID: \"3f3f398c-10c8-43f7-ba9f-1049f774d568\") " pod="openshift-image-registry/node-ca-9hqht"
Jul 15 21:01:41.149529 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.149306    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs\") pod \"network-metrics-daemon-gxj8k\" (UID: \"8ca7d5c9-37f4-444b-9e21-7659e695968a\") " pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:01:41.149529 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:41.149394    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:01:41.150254 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:41.149464    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs podName:8ca7d5c9-37f4-444b-9e21-7659e695968a nodeName:}" failed. No retries permitted until 2026-07-15 21:01:41.649443269 +0000 UTC m=+3.077402913 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs") pod "network-metrics-daemon-gxj8k" (UID: "8ca7d5c9-37f4-444b-9e21-7659e695968a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:01:41.150254 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.149467    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e2f6dde8-4759-43cd-82e1-77de08121820-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.150254 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.149508    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8tth\" (UniqueName: \"kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth\") pod \"network-check-target-jdds4\" (UID: \"76c132a0-854b-44a6-87bf-a4f07da94fba\") " pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:01:41.150254 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.149534    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-etc-systemd\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.150254 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.149561    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-run\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.150254 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.149589    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-ovn-node-metrics-cert\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.150254 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.149627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e2f6dde8-4759-43cd-82e1-77de08121820-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.150254 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.149666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a806e68-abc4-414a-96ac-843e728e77b9-hosts-file\") pod \"node-resolver-pj9tk\" (UID: \"1a806e68-abc4-414a-96ac-843e728e77b9\") " pod="openshift-dns/node-resolver-pj9tk"
Jul 15 21:01:41.150254 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.149698    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-multus-cni-dir\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.150254 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.149774    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3f3f398c-10c8-43f7-ba9f-1049f774d568-serviceca\") pod \"node-ca-9hqht\" (UID: \"3f3f398c-10c8-43f7-ba9f-1049f774d568\") " pod="openshift-image-registry/node-ca-9hqht"
Jul 15 21:01:41.150254 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.149787    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/1a806e68-abc4-414a-96ac-843e728e77b9-hosts-file\") pod \"node-resolver-pj9tk\" (UID: \"1a806e68-abc4-414a-96ac-843e728e77b9\") " pod="openshift-dns/node-resolver-pj9tk"
Jul 15 21:01:41.150254 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.150138    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e2f6dde8-4759-43cd-82e1-77de08121820-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.153426 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.153405    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/394a0fde-3d6c-48e7-9d13-0325ad6ae285-agent-certs\") pod \"konnectivity-agent-pw62m\" (UID: \"394a0fde-3d6c-48e7-9d13-0325ad6ae285\") " pod="kube-system/konnectivity-agent-pw62m"
Jul 15 21:01:41.157508 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.157485    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7z7c\" (UniqueName: \"kubernetes.io/projected/3f3f398c-10c8-43f7-ba9f-1049f774d568-kube-api-access-w7z7c\") pod \"node-ca-9hqht\" (UID: \"3f3f398c-10c8-43f7-ba9f-1049f774d568\") " pod="openshift-image-registry/node-ca-9hqht"
Jul 15 21:01:41.161882 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.161795    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5lkp\" (UniqueName: \"kubernetes.io/projected/e2f6dde8-4759-43cd-82e1-77de08121820-kube-api-access-p5lkp\") pod \"multus-additional-cni-plugins-fkfzt\" (UID: \"e2f6dde8-4759-43cd-82e1-77de08121820\") " pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.162318 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.162279    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6mwq\" (UniqueName: \"kubernetes.io/projected/5f7e6700-77fa-402a-be9f-e4150afad410-kube-api-access-p6mwq\") pod \"iptables-alerter-vs2l4\" (UID: \"5f7e6700-77fa-402a-be9f-e4150afad410\") " pod="openshift-network-operator/iptables-alerter-vs2l4"
Jul 15 21:01:41.163884 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.163859    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffrkt\" (UniqueName: \"kubernetes.io/projected/8ca7d5c9-37f4-444b-9e21-7659e695968a-kube-api-access-ffrkt\") pod \"network-metrics-daemon-gxj8k\" (UID: \"8ca7d5c9-37f4-444b-9e21-7659e695968a\") " pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:01:41.164242 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.164220    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq7jr\" (UniqueName: \"kubernetes.io/projected/1a806e68-abc4-414a-96ac-843e728e77b9-kube-api-access-rq7jr\") pod \"node-resolver-pj9tk\" (UID: \"1a806e68-abc4-414a-96ac-843e728e77b9\") " pod="openshift-dns/node-resolver-pj9tk"
Jul 15 21:01:41.250961 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.250875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5e36b0da-c3e9-43ce-9f26-9b9962d8e195-device-dir\") pod \"aws-ebs-csi-driver-node-kncxs\" (UID: \"5e36b0da-c3e9-43ce-9f26-9b9962d8e195\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:41.250961 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.250924    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-cnibin\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.250961 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.250947    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-host\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.250961 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.250963    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-host-slash\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.251286 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.250981    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-var-lib-openvswitch\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.251286 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.250988    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5e36b0da-c3e9-43ce-9f26-9b9962d8e195-device-dir\") pod \"aws-ebs-csi-driver-node-kncxs\" (UID: \"5e36b0da-c3e9-43ce-9f26-9b9962d8e195\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:41.251286 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.250997    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-system-cni-dir\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.251286 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251035    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-host-run-netns\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.251286 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251041    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-system-cni-dir\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.251286 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251057    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-run-openvswitch\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.251286 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251075    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-run-ovn\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.251286 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251088    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-cnibin\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.251286 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251095    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb44ed96-9b5a-4f52-b349-f64452562c6b-tmp\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.251286 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42knm\" (UniqueName: \"kubernetes.io/projected/eb44ed96-9b5a-4f52-b349-f64452562c6b-kube-api-access-42knm\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.251286 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251130    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-host-slash\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.251286 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251140    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-host-kubelet\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.251286 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251161    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-log-socket\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.251286 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251168    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-var-lib-openvswitch\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.251286 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251178    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-os-release\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.252067 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251196    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-host-var-lib-cni-multus\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.252067 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251219    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-host-cni-netd\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.252067 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251248    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret\") pod \"global-pull-secret-syncer-bctvr\" (UID: \"1a69c601-b5b2-4177-8781-16090abbd7f6\") " pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:41.252067 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251275    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5e36b0da-c3e9-43ce-9f26-9b9962d8e195-etc-selinux\") pod \"aws-ebs-csi-driver-node-kncxs\" (UID: \"5e36b0da-c3e9-43ce-9f26-9b9962d8e195\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:41.252067 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251277    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-host\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.252067 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251301    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7rsq\" (UniqueName: \"kubernetes.io/projected/5e36b0da-c3e9-43ce-9f26-9b9962d8e195-kube-api-access-d7rsq\") pod \"aws-ebs-csi-driver-node-kncxs\" (UID: \"5e36b0da-c3e9-43ce-9f26-9b9962d8e195\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:41.252067 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251333    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-multus-socket-dir-parent\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.252067 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251359    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5e36b0da-c3e9-43ce-9f26-9b9962d8e195-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kncxs\" (UID: \"5e36b0da-c3e9-43ce-9f26-9b9962d8e195\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:41.252067 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251396    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-host-var-lib-cni-bin\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.252067 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251423    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-multus-conf-dir\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.252067 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251446    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-etc-kubernetes\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.252067 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251471    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-etc-openvswitch\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.252067 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251496    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-node-log\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.252067 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251525    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.252788 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251566    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-env-overrides\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.252788 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251571    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-host-var-lib-cni-bin\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.252788 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:41.251589    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 21:01:41.252788 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251607    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a69c601-b5b2-4177-8781-16090abbd7f6-kubelet-config\") pod \"global-pull-secret-syncer-bctvr\" (UID: \"1a69c601-b5b2-4177-8781-16090abbd7f6\") " pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:41.252788 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251634    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a69c601-b5b2-4177-8781-16090abbd7f6-dbus\") pod \"global-pull-secret-syncer-bctvr\" (UID: \"1a69c601-b5b2-4177-8781-16090abbd7f6\") " pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:41.252788 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:41.251672    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret podName:1a69c601-b5b2-4177-8781-16090abbd7f6 nodeName:}" failed. No retries permitted until 2026-07-15 21:01:41.751647853 +0000 UTC m=+3.179607492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret") pod "global-pull-secret-syncer-bctvr" (UID: "1a69c601-b5b2-4177-8781-16090abbd7f6") : object "kube-system"/"original-pull-secret" not registered
Jul 15 21:01:41.252788 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251701    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-etc-kubernetes\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.252788 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251742    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-host-run-ovn-kubernetes\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.252788 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251773    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-ovnkube-config\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.252788 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251822    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8tth\" (UniqueName: \"kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth\") pod \"network-check-target-jdds4\" (UID: \"76c132a0-854b-44a6-87bf-a4f07da94fba\") " pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:01:41.252788 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251852    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-etc-systemd\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.252788 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251862    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1a69c601-b5b2-4177-8781-16090abbd7f6-dbus\") pod \"global-pull-secret-syncer-bctvr\" (UID: \"1a69c601-b5b2-4177-8781-16090abbd7f6\") " pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:41.252788 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251880    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-run\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.252788 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251908    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-ovn-node-metrics-cert\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.253528 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251962    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-multus-cni-dir\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.253528 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251989    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5e36b0da-c3e9-43ce-9f26-9b9962d8e195-etc-selinux\") pod \"aws-ebs-csi-driver-node-kncxs\" (UID: \"5e36b0da-c3e9-43ce-9f26-9b9962d8e195\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:41.253528 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252012    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-multus-socket-dir-parent\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.253528 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252026    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-env-overrides\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.253528 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252036    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-host-run-k8s-cni-cncf-io\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.253528 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252049    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-log-socket\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.253528 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252090    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5e36b0da-c3e9-43ce-9f26-9b9962d8e195-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kncxs\" (UID: \"5e36b0da-c3e9-43ce-9f26-9b9962d8e195\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:41.253528 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252098    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-etc-openvswitch\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.253528 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252130    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-multus-conf-dir\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.253528 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252132    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-os-release\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.253528 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.251994    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-host-run-k8s-cni-cncf-io\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.253528 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252149    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-node-log\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.253528 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252205    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-host-var-lib-cni-multus\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.253528 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252207    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-etc-kubernetes\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.253528 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252233    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-host-run-netns\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.254298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252266    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-host-run-netns\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.254298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-host-cni-bin\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.254298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252299    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-ovnkube-script-lib\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.254298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252296    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-host-kubelet\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.254298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252305    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-host-run-ovn-kubernetes\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.254298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252333    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5e36b0da-c3e9-43ce-9f26-9b9962d8e195-sys-fs\") pod \"aws-ebs-csi-driver-node-kncxs\" (UID: \"5e36b0da-c3e9-43ce-9f26-9b9962d8e195\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:41.254298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252361    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-etc-modprobe-d\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.254298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252366    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-run-openvswitch\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.254298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252370    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-run-ovn\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.254298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252387    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-etc-sysconfig\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.254298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-etc-sysctl-d\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.254298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252424    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-run\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.254298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252416    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-host-run-netns\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.254298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252444    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-run-systemd\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.254298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252472    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-etc-kubernetes\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.255036 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252479    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-host-cni-bin\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.255036 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252482    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6m9l\" (UniqueName: \"kubernetes.io/projected/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-kube-api-access-d6m9l\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.255036 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252515    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-host-var-lib-kubelet\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.255036 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252544    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-hostroot\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.255036 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252556    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1a69c601-b5b2-4177-8781-16090abbd7f6-kubelet-config\") pod \"global-pull-secret-syncer-bctvr\" (UID: \"1a69c601-b5b2-4177-8781-16090abbd7f6\") " pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:41.255036 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252574    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-host-run-multus-certs\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.255036 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252604    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfclb\" (UniqueName: \"kubernetes.io/projected/b202fca4-2178-47ab-9b2a-98d494879d5f-kube-api-access-tfclb\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.255036 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252633    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-etc-sysctl-conf\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.255036 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-run-systemd\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.255036 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252663    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-lib-modules\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.255036 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252694    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-systemd-units\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.255036 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252702    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-etc-systemd\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.255036 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252725    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5e36b0da-c3e9-43ce-9f26-9b9962d8e195-registration-dir\") pod \"aws-ebs-csi-driver-node-kncxs\" (UID: \"5e36b0da-c3e9-43ce-9f26-9b9962d8e195\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:41.255036 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252780    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b202fca4-2178-47ab-9b2a-98d494879d5f-cni-binary-copy\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.255036 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252809    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-var-lib-kubelet\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.255686 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252822    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-etc-modprobe-d\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.255686 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252831    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-etc-sysconfig\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.255686 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252910    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5e36b0da-c3e9-43ce-9f26-9b9962d8e195-sys-fs\") pod \"aws-ebs-csi-driver-node-kncxs\" (UID: \"5e36b0da-c3e9-43ce-9f26-9b9962d8e195\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:41.255686 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5e36b0da-c3e9-43ce-9f26-9b9962d8e195-socket-dir\") pod \"aws-ebs-csi-driver-node-kncxs\" (UID: \"5e36b0da-c3e9-43ce-9f26-9b9962d8e195\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:41.255686 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252952    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-sys\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.255686 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252976    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5e36b0da-c3e9-43ce-9f26-9b9962d8e195-socket-dir\") pod \"aws-ebs-csi-driver-node-kncxs\" (UID: \"5e36b0da-c3e9-43ce-9f26-9b9962d8e195\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:41.255686 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252983    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b202fca4-2178-47ab-9b2a-98d494879d5f-multus-daemon-config\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.255686 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252990    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-etc-sysctl-d\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.255686 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252607    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-multus-cni-dir\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.255686 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.253159    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-etc-sysctl-conf\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.255686 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.253205    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-ovnkube-script-lib\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.255686 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.252516    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-host-cni-netd\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.255686 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.253273    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-lib-modules\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.255686 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.253345    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-host-var-lib-kubelet\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.255686 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.253376    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-hostroot\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.256432 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.253426    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b202fca4-2178-47ab-9b2a-98d494879d5f-host-run-multus-certs\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.256432 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.253467    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-sys\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.256432 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.253549    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-ovnkube-config\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.256432 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.253635    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eb44ed96-9b5a-4f52-b349-f64452562c6b-tmp\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.256432 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.253668    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-systemd-units\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.256432 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.253724    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb44ed96-9b5a-4f52-b349-f64452562c6b-var-lib-kubelet\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.256432 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.253702    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.256432 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.253735    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5e36b0da-c3e9-43ce-9f26-9b9962d8e195-registration-dir\") pod \"aws-ebs-csi-driver-node-kncxs\" (UID: \"5e36b0da-c3e9-43ce-9f26-9b9962d8e195\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:41.256432 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.253749    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb44ed96-9b5a-4f52-b349-f64452562c6b-etc-tuned\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.256432 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.254056    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b202fca4-2178-47ab-9b2a-98d494879d5f-multus-daemon-config\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.256432 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.254058    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b202fca4-2178-47ab-9b2a-98d494879d5f-cni-binary-copy\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.256432 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.254920    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-ovn-node-metrics-cert\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.256432 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.256205    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/eb44ed96-9b5a-4f52-b349-f64452562c6b-etc-tuned\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.261247 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:41.261209    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 21:01:41.261247 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:41.261235    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 21:01:41.261430 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:41.261269    2580 projected.go:196] Error preparing data for projected volume kube-api-access-r8tth for pod openshift-network-diagnostics/network-check-target-jdds4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:01:41.261430 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:41.261331    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth podName:76c132a0-854b-44a6-87bf-a4f07da94fba nodeName:}" failed. No retries permitted until 2026-07-15 21:01:41.761312768 +0000 UTC m=+3.189272386 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-r8tth" (UniqueName: "kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth") pod "network-check-target-jdds4" (UID: "76c132a0-854b-44a6-87bf-a4f07da94fba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:01:41.262109 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.262085    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 21:01:41.263968 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.263935    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6m9l\" (UniqueName: \"kubernetes.io/projected/0b444f82-3531-4cf8-8bbd-f36aeb5b6c29-kube-api-access-d6m9l\") pod \"ovnkube-node-dhz54\" (UID: \"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29\") " pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.263968 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.263944    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7rsq\" (UniqueName: \"kubernetes.io/projected/5e36b0da-c3e9-43ce-9f26-9b9962d8e195-kube-api-access-d7rsq\") pod \"aws-ebs-csi-driver-node-kncxs\" (UID: \"5e36b0da-c3e9-43ce-9f26-9b9962d8e195\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:41.264183 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.264160    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42knm\" (UniqueName: \"kubernetes.io/projected/eb44ed96-9b5a-4f52-b349-f64452562c6b-kube-api-access-42knm\") pod \"tuned-smt2r\" (UID: \"eb44ed96-9b5a-4f52-b349-f64452562c6b\") " pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.265095 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.265074    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfclb\" (UniqueName: \"kubernetes.io/projected/b202fca4-2178-47ab-9b2a-98d494879d5f-kube-api-access-tfclb\") pod \"multus-gqnb8\" (UID: \"b202fca4-2178-47ab-9b2a-98d494879d5f\") " pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.289560 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.289526    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vs2l4"
Jul 15 21:01:41.301384 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.301364    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pw62m"
Jul 15 21:01:41.313301 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.313279    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-gqnb8"
Jul 15 21:01:41.322180 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.322161    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pj9tk"
Jul 15 21:01:41.329933 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.329903    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fkfzt"
Jul 15 21:01:41.338623 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.338603    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9hqht"
Jul 15 21:01:41.348462 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.348440    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-smt2r"
Jul 15 21:01:41.356524 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.356505    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs"
Jul 15 21:01:41.362524 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.362504    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:01:41.657261 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.657170    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs\") pod \"network-metrics-daemon-gxj8k\" (UID: \"8ca7d5c9-37f4-444b-9e21-7659e695968a\") " pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:01:41.657418 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:41.657369    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:01:41.657476 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:41.657453    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs podName:8ca7d5c9-37f4-444b-9e21-7659e695968a nodeName:}" failed. No retries permitted until 2026-07-15 21:01:42.657430273 +0000 UTC m=+4.085389908 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs") pod "network-metrics-daemon-gxj8k" (UID: "8ca7d5c9-37f4-444b-9e21-7659e695968a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:01:41.758702 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.758655    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret\") pod \"global-pull-secret-syncer-bctvr\" (UID: \"1a69c601-b5b2-4177-8781-16090abbd7f6\") " pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:41.758909 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:41.758795    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 21:01:41.758909 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:41.758866    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret podName:1a69c601-b5b2-4177-8781-16090abbd7f6 nodeName:}" failed. No retries permitted until 2026-07-15 21:01:42.758845357 +0000 UTC m=+4.186804992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret") pod "global-pull-secret-syncer-bctvr" (UID: "1a69c601-b5b2-4177-8781-16090abbd7f6") : object "kube-system"/"original-pull-secret" not registered
Jul 15 21:01:41.859795 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:41.859755    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8tth\" (UniqueName: \"kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth\") pod \"network-check-target-jdds4\" (UID: \"76c132a0-854b-44a6-87bf-a4f07da94fba\") " pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:01:41.859988 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:41.859960    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 21:01:41.859988 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:41.859986    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 21:01:41.860065 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:41.859997    2580 projected.go:196] Error preparing data for projected volume kube-api-access-r8tth for pod openshift-network-diagnostics/network-check-target-jdds4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:01:41.860065 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:41.860054    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth podName:76c132a0-854b-44a6-87bf-a4f07da94fba nodeName:}" failed. No retries permitted until 2026-07-15 21:01:42.860038259 +0000 UTC m=+4.287997881 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-r8tth" (UniqueName: "kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth") pod "network-check-target-jdds4" (UID: "76c132a0-854b-44a6-87bf-a4f07da94fba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:01:42.057173 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:42.057080    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 20:56:41 +0000 UTC" deadline="2028-05-01 00:36:17.50853137 +0000 UTC"
Jul 15 21:01:42.057173 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:42.057120    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15723h34m35.451414929s"
Jul 15 21:01:42.057402 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:42.057225    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:42.057402 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:42.057364    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bctvr" podUID="1a69c601-b5b2-4177-8781-16090abbd7f6"
Jul 15 21:01:42.331112 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:42.331020    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb202fca4_2178_47ab_9b2a_98d494879d5f.slice/crio-644bf41eb416230491eb213dd8a1ff173d8c3fcff5acaf77989999be05b94df6 WatchSource:0}: Error finding container 644bf41eb416230491eb213dd8a1ff173d8c3fcff5acaf77989999be05b94df6: Status 404 returned error can't find the container with id 644bf41eb416230491eb213dd8a1ff173d8c3fcff5acaf77989999be05b94df6
Jul 15 21:01:42.335796 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:42.335711    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b444f82_3531_4cf8_8bbd_f36aeb5b6c29.slice/crio-e93f3af85f5a145eea99a3c5660eb504960d3350ee1c4bd2f2641a34b337b290 WatchSource:0}: Error finding container e93f3af85f5a145eea99a3c5660eb504960d3350ee1c4bd2f2641a34b337b290: Status 404 returned error can't find the container with id e93f3af85f5a145eea99a3c5660eb504960d3350ee1c4bd2f2641a34b337b290
Jul 15 21:01:42.337970 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:42.337766    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2f6dde8_4759_43cd_82e1_77de08121820.slice/crio-d1da41c483555008dfe7deb20e576e49c26d528482566dcfdb66b83975969d31 WatchSource:0}: Error finding container d1da41c483555008dfe7deb20e576e49c26d528482566dcfdb66b83975969d31: Status 404 returned error can't find the container with id d1da41c483555008dfe7deb20e576e49c26d528482566dcfdb66b83975969d31
Jul 15 21:01:42.338952 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:42.338927    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod394a0fde_3d6c_48e7_9d13_0325ad6ae285.slice/crio-668acc223be3060c2763bf37a081ab1a9ef9ac217924a2a533eddeb366593cbf WatchSource:0}: Error finding container 668acc223be3060c2763bf37a081ab1a9ef9ac217924a2a533eddeb366593cbf: Status 404 returned error can't find the container with id 668acc223be3060c2763bf37a081ab1a9ef9ac217924a2a533eddeb366593cbf
Jul 15 21:01:42.339810 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:42.339784    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f7e6700_77fa_402a_be9f_e4150afad410.slice/crio-19c7ef5f0e4d9360e653f6d146bd31469b66fabbdf6418bbd70e1dfbfb18b348 WatchSource:0}: Error finding container 19c7ef5f0e4d9360e653f6d146bd31469b66fabbdf6418bbd70e1dfbfb18b348: Status 404 returned error can't find the container with id 19c7ef5f0e4d9360e653f6d146bd31469b66fabbdf6418bbd70e1dfbfb18b348
Jul 15 21:01:42.362522 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:42.362082    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f3f398c_10c8_43f7_ba9f_1049f774d568.slice/crio-3be8f4da6808444f517726293c04b4f73dca209863830a0d50f8c21400e5b3af WatchSource:0}: Error finding container 3be8f4da6808444f517726293c04b4f73dca209863830a0d50f8c21400e5b3af: Status 404 returned error can't find the container with id 3be8f4da6808444f517726293c04b4f73dca209863830a0d50f8c21400e5b3af
Jul 15 21:01:42.364405 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:42.364386    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e36b0da_c3e9_43ce_9f26_9b9962d8e195.slice/crio-d00f8e93afd173993d53f7b5263bc97874be5488badcfe26851a5c4ddfb406f6 WatchSource:0}: Error finding container d00f8e93afd173993d53f7b5263bc97874be5488badcfe26851a5c4ddfb406f6: Status 404 returned error can't find the container with id d00f8e93afd173993d53f7b5263bc97874be5488badcfe26851a5c4ddfb406f6
Jul 15 21:01:42.365201 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:42.365180    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a806e68_abc4_414a_96ac_843e728e77b9.slice/crio-a05cf08e6093b70990367b9af04d0e2709d2c29e38e61f64af613a10e107241c WatchSource:0}: Error finding container a05cf08e6093b70990367b9af04d0e2709d2c29e38e61f64af613a10e107241c: Status 404 returned error can't find the container with id a05cf08e6093b70990367b9af04d0e2709d2c29e38e61f64af613a10e107241c
Jul 15 21:01:42.367258 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:01:42.367220    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb44ed96_9b5a_4f52_b349_f64452562c6b.slice/crio-a03d90484fbc36d4d885dad2f138074f571efd3edf659c35aecda6ff36fb2277 WatchSource:0}: Error finding container a03d90484fbc36d4d885dad2f138074f571efd3edf659c35aecda6ff36fb2277: Status 404 returned error can't find the container with id a03d90484fbc36d4d885dad2f138074f571efd3edf659c35aecda6ff36fb2277
Jul 15 21:01:42.666312 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:42.666279    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs\") pod \"network-metrics-daemon-gxj8k\" (UID: \"8ca7d5c9-37f4-444b-9e21-7659e695968a\") " pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:01:42.666449 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:42.666428    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:01:42.666512 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:42.666502    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs podName:8ca7d5c9-37f4-444b-9e21-7659e695968a nodeName:}" failed. No retries permitted until 2026-07-15 21:01:44.666484007 +0000 UTC m=+6.094443638 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs") pod "network-metrics-daemon-gxj8k" (UID: "8ca7d5c9-37f4-444b-9e21-7659e695968a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:01:42.766875 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:42.766832    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret\") pod \"global-pull-secret-syncer-bctvr\" (UID: \"1a69c601-b5b2-4177-8781-16090abbd7f6\") " pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:42.767040 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:42.767007    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 21:01:42.767107 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:42.767091    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret podName:1a69c601-b5b2-4177-8781-16090abbd7f6 nodeName:}" failed. No retries permitted until 2026-07-15 21:01:44.767069794 +0000 UTC m=+6.195029431 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret") pod "global-pull-secret-syncer-bctvr" (UID: "1a69c601-b5b2-4177-8781-16090abbd7f6") : object "kube-system"/"original-pull-secret" not registered
Jul 15 21:01:42.867848 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:42.867733    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8tth\" (UniqueName: \"kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth\") pod \"network-check-target-jdds4\" (UID: \"76c132a0-854b-44a6-87bf-a4f07da94fba\") " pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:01:42.868027 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:42.867986    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 21:01:42.868027 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:42.868007    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 21:01:42.868027 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:42.868020    2580 projected.go:196] Error preparing data for projected volume kube-api-access-r8tth for pod openshift-network-diagnostics/network-check-target-jdds4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:01:42.868184 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:42.868087    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth podName:76c132a0-854b-44a6-87bf-a4f07da94fba nodeName:}" failed. No retries permitted until 2026-07-15 21:01:44.868065013 +0000 UTC m=+6.296024654 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-r8tth" (UniqueName: "kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth") pod "network-check-target-jdds4" (UID: "76c132a0-854b-44a6-87bf-a4f07da94fba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:01:43.068836 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:43.067856    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:01:43.068836 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:43.068004    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdds4" podUID="76c132a0-854b-44a6-87bf-a4f07da94fba"
Jul 15 21:01:43.068836 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:43.068452    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:01:43.068836 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:43.068618    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gxj8k" podUID="8ca7d5c9-37f4-444b-9e21-7659e695968a"
Jul 15 21:01:43.068836 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:43.069019    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 20:56:41 +0000 UTC" deadline="2028-03-26 17:09:37.926040898 +0000 UTC"
Jul 15 21:01:43.068836 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:43.069064    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14876h7m54.856981099s"
Jul 15 21:01:43.081360 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:43.081327    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkfzt" event={"ID":"e2f6dde8-4759-43cd-82e1-77de08121820","Type":"ContainerStarted","Data":"d1da41c483555008dfe7deb20e576e49c26d528482566dcfdb66b83975969d31"}
Jul 15 21:01:43.086167 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:43.086137    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal" event={"ID":"9093750e6d24bbef1ba3b0def477f9fe","Type":"ContainerStarted","Data":"a7fe3c6863a3f6e55bebe3a339faa7fee8aafcb5ad0a45b15f4f7440475fd0d9"}
Jul 15 21:01:43.092673 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:43.092610    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-smt2r" event={"ID":"eb44ed96-9b5a-4f52-b349-f64452562c6b","Type":"ContainerStarted","Data":"a03d90484fbc36d4d885dad2f138074f571efd3edf659c35aecda6ff36fb2277"}
Jul 15 21:01:43.095402 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:43.095311    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pj9tk" event={"ID":"1a806e68-abc4-414a-96ac-843e728e77b9","Type":"ContainerStarted","Data":"a05cf08e6093b70990367b9af04d0e2709d2c29e38e61f64af613a10e107241c"}
Jul 15 21:01:43.103860 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:43.103833    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9hqht" event={"ID":"3f3f398c-10c8-43f7-ba9f-1049f774d568","Type":"ContainerStarted","Data":"3be8f4da6808444f517726293c04b4f73dca209863830a0d50f8c21400e5b3af"}
Jul 15 21:01:43.113429 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:43.113402    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vs2l4" event={"ID":"5f7e6700-77fa-402a-be9f-e4150afad410","Type":"ContainerStarted","Data":"19c7ef5f0e4d9360e653f6d146bd31469b66fabbdf6418bbd70e1dfbfb18b348"}
Jul 15 21:01:43.121241 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:43.121112    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhz54" event={"ID":"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29","Type":"ContainerStarted","Data":"e93f3af85f5a145eea99a3c5660eb504960d3350ee1c4bd2f2641a34b337b290"}
Jul 15 21:01:43.133827 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:43.133777    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gqnb8" event={"ID":"b202fca4-2178-47ab-9b2a-98d494879d5f","Type":"ContainerStarted","Data":"644bf41eb416230491eb213dd8a1ff173d8c3fcff5acaf77989999be05b94df6"}
Jul 15 21:01:43.143559 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:43.143511    2580 generic.go:356] "Generic (PLEG): container finished" podID="9e4dbfad2ee44e7e791b99af789a46fa" containerID="c1200769484531eb7ee9bfa3d7065023acadc176340110b34dafab4dc7f83313" exitCode=0
Jul 15 21:01:43.143674 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:43.143618    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal" event={"ID":"9e4dbfad2ee44e7e791b99af789a46fa","Type":"ContainerDied","Data":"c1200769484531eb7ee9bfa3d7065023acadc176340110b34dafab4dc7f83313"}
Jul 15 21:01:43.147707 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:43.147627    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs" event={"ID":"5e36b0da-c3e9-43ce-9f26-9b9962d8e195","Type":"ContainerStarted","Data":"d00f8e93afd173993d53f7b5263bc97874be5488badcfe26851a5c4ddfb406f6"}
Jul 15 21:01:43.152624 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:43.152545    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pw62m" event={"ID":"394a0fde-3d6c-48e7-9d13-0325ad6ae285","Type":"ContainerStarted","Data":"668acc223be3060c2763bf37a081ab1a9ef9ac217924a2a533eddeb366593cbf"}
Jul 15 21:01:43.162152 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:43.161374    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-35.ec2.internal" podStartSLOduration=2.161359379 podStartE2EDuration="2.161359379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:01:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:01:43.103409762 +0000 UTC m=+4.531369404" watchObservedRunningTime="2026-07-15 21:01:43.161359379 +0000 UTC m=+4.589319019"
Jul 15 21:01:44.057896 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:44.057855    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:44.058909 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:44.058027    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bctvr" podUID="1a69c601-b5b2-4177-8781-16090abbd7f6"
Jul 15 21:01:44.169509 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:44.169470    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal" event={"ID":"9e4dbfad2ee44e7e791b99af789a46fa","Type":"ContainerStarted","Data":"5fdcde2ed2d8210f3a70ad25ba6881e31a55c254766509cb08b2ca59619a1ab3"}
Jul 15 21:01:44.684700 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:44.684661    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs\") pod \"network-metrics-daemon-gxj8k\" (UID: \"8ca7d5c9-37f4-444b-9e21-7659e695968a\") " pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:01:44.684992 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:44.684840    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:01:44.684992 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:44.684939    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs podName:8ca7d5c9-37f4-444b-9e21-7659e695968a nodeName:}" failed. No retries permitted until 2026-07-15 21:01:48.684917147 +0000 UTC m=+10.112876781 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs") pod "network-metrics-daemon-gxj8k" (UID: "8ca7d5c9-37f4-444b-9e21-7659e695968a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:01:44.785488 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:44.785449    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret\") pod \"global-pull-secret-syncer-bctvr\" (UID: \"1a69c601-b5b2-4177-8781-16090abbd7f6\") " pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:44.785675 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:44.785612    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 21:01:44.785742 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:44.785700    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret podName:1a69c601-b5b2-4177-8781-16090abbd7f6 nodeName:}" failed. No retries permitted until 2026-07-15 21:01:48.785678836 +0000 UTC m=+10.213638473 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret") pod "global-pull-secret-syncer-bctvr" (UID: "1a69c601-b5b2-4177-8781-16090abbd7f6") : object "kube-system"/"original-pull-secret" not registered
Jul 15 21:01:44.886512 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:44.886440    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8tth\" (UniqueName: \"kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth\") pod \"network-check-target-jdds4\" (UID: \"76c132a0-854b-44a6-87bf-a4f07da94fba\") " pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:01:44.886711 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:44.886630    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 21:01:44.886711 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:44.886655    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 21:01:44.886711 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:44.886670    2580 projected.go:196] Error preparing data for projected volume kube-api-access-r8tth for pod openshift-network-diagnostics/network-check-target-jdds4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:01:44.886880 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:44.886738    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth podName:76c132a0-854b-44a6-87bf-a4f07da94fba nodeName:}" failed. No retries permitted until 2026-07-15 21:01:48.886717278 +0000 UTC m=+10.314676914 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-r8tth" (UniqueName: "kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth") pod "network-check-target-jdds4" (UID: "76c132a0-854b-44a6-87bf-a4f07da94fba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:01:45.057054 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:45.056970    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:01:45.057234 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:45.057122    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gxj8k" podUID="8ca7d5c9-37f4-444b-9e21-7659e695968a"
Jul 15 21:01:45.059939 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:45.059753    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:01:45.059939 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:45.059873    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdds4" podUID="76c132a0-854b-44a6-87bf-a4f07da94fba"
Jul 15 21:01:46.058241 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:46.057664    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:46.058241 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:46.057816    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bctvr" podUID="1a69c601-b5b2-4177-8781-16090abbd7f6"
Jul 15 21:01:47.057639 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:47.057596    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:01:47.057639 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:47.057640    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:01:47.058185 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:47.057749    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdds4" podUID="76c132a0-854b-44a6-87bf-a4f07da94fba"
Jul 15 21:01:47.058185 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:47.057936    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gxj8k" podUID="8ca7d5c9-37f4-444b-9e21-7659e695968a"
Jul 15 21:01:48.059753 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:48.057376    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:48.059753 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:48.057527    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bctvr" podUID="1a69c601-b5b2-4177-8781-16090abbd7f6"
Jul 15 21:01:48.719472 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:48.719393    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs\") pod \"network-metrics-daemon-gxj8k\" (UID: \"8ca7d5c9-37f4-444b-9e21-7659e695968a\") " pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:01:48.719683 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:48.719574    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:01:48.719683 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:48.719662    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs podName:8ca7d5c9-37f4-444b-9e21-7659e695968a nodeName:}" failed. No retries permitted until 2026-07-15 21:01:56.719636544 +0000 UTC m=+18.147596183 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs") pod "network-metrics-daemon-gxj8k" (UID: "8ca7d5c9-37f4-444b-9e21-7659e695968a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:01:48.820384 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:48.819782    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret\") pod \"global-pull-secret-syncer-bctvr\" (UID: \"1a69c601-b5b2-4177-8781-16090abbd7f6\") " pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:48.820384 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:48.820027    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 21:01:48.820384 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:48.820096    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret podName:1a69c601-b5b2-4177-8781-16090abbd7f6 nodeName:}" failed. No retries permitted until 2026-07-15 21:01:56.820075104 +0000 UTC m=+18.248034738 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret") pod "global-pull-secret-syncer-bctvr" (UID: "1a69c601-b5b2-4177-8781-16090abbd7f6") : object "kube-system"/"original-pull-secret" not registered
Jul 15 21:01:48.920576 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:48.920481    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8tth\" (UniqueName: \"kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth\") pod \"network-check-target-jdds4\" (UID: \"76c132a0-854b-44a6-87bf-a4f07da94fba\") " pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:01:48.920784 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:48.920680    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 21:01:48.920784 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:48.920705    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 21:01:48.920784 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:48.920719    2580 projected.go:196] Error preparing data for projected volume kube-api-access-r8tth for pod openshift-network-diagnostics/network-check-target-jdds4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:01:48.920984 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:48.920790    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth podName:76c132a0-854b-44a6-87bf-a4f07da94fba nodeName:}" failed. No retries permitted until 2026-07-15 21:01:56.920767585 +0000 UTC m=+18.348727214 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-r8tth" (UniqueName: "kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth") pod "network-check-target-jdds4" (UID: "76c132a0-854b-44a6-87bf-a4f07da94fba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:01:49.061050 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:49.060972    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:01:49.061050 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:49.060990    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:01:49.061605 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:49.061128    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gxj8k" podUID="8ca7d5c9-37f4-444b-9e21-7659e695968a"
Jul 15 21:01:49.061605 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:49.061232    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdds4" podUID="76c132a0-854b-44a6-87bf-a4f07da94fba"
Jul 15 21:01:50.056664 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:50.056632    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:50.056867 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:50.056759    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bctvr" podUID="1a69c601-b5b2-4177-8781-16090abbd7f6"
Jul 15 21:01:51.057736 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:51.057093    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:01:51.057736 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:51.057245    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gxj8k" podUID="8ca7d5c9-37f4-444b-9e21-7659e695968a"
Jul 15 21:01:51.057736 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:51.057091    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:01:51.057736 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:51.057699    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdds4" podUID="76c132a0-854b-44a6-87bf-a4f07da94fba"
Jul 15 21:01:52.056943 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:52.056884    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:52.057126 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:52.057021    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bctvr" podUID="1a69c601-b5b2-4177-8781-16090abbd7f6"
Jul 15 21:01:53.056831 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:53.056794    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:01:53.057264 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:53.056962    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gxj8k" podUID="8ca7d5c9-37f4-444b-9e21-7659e695968a"
Jul 15 21:01:53.057264 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:53.057005    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:01:53.057264 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:53.057123    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdds4" podUID="76c132a0-854b-44a6-87bf-a4f07da94fba"
Jul 15 21:01:54.057591 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:54.057555    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:54.058071 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:54.057664    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bctvr" podUID="1a69c601-b5b2-4177-8781-16090abbd7f6"
Jul 15 21:01:55.056724 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:55.056690    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:01:55.056927 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:55.056821    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdds4" podUID="76c132a0-854b-44a6-87bf-a4f07da94fba"
Jul 15 21:01:55.056927 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:55.056884    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:01:55.057059 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:55.057008    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gxj8k" podUID="8ca7d5c9-37f4-444b-9e21-7659e695968a"
Jul 15 21:01:56.057370 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:56.057341    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:56.057876 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:56.057451    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bctvr" podUID="1a69c601-b5b2-4177-8781-16090abbd7f6"
Jul 15 21:01:56.783513 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:56.783481    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs\") pod \"network-metrics-daemon-gxj8k\" (UID: \"8ca7d5c9-37f4-444b-9e21-7659e695968a\") " pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:01:56.783724 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:56.783651    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:01:56.783793 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:56.783728    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs podName:8ca7d5c9-37f4-444b-9e21-7659e695968a nodeName:}" failed. No retries permitted until 2026-07-15 21:02:12.783707272 +0000 UTC m=+34.211666888 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs") pod "network-metrics-daemon-gxj8k" (UID: "8ca7d5c9-37f4-444b-9e21-7659e695968a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:01:56.884507 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:56.884419    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret\") pod \"global-pull-secret-syncer-bctvr\" (UID: \"1a69c601-b5b2-4177-8781-16090abbd7f6\") " pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:56.884670 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:56.884566    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 21:01:56.884670 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:56.884641    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret podName:1a69c601-b5b2-4177-8781-16090abbd7f6 nodeName:}" failed. No retries permitted until 2026-07-15 21:02:12.88461928 +0000 UTC m=+34.312578909 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret") pod "global-pull-secret-syncer-bctvr" (UID: "1a69c601-b5b2-4177-8781-16090abbd7f6") : object "kube-system"/"original-pull-secret" not registered
Jul 15 21:01:56.985187 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:56.985158    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8tth\" (UniqueName: \"kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth\") pod \"network-check-target-jdds4\" (UID: \"76c132a0-854b-44a6-87bf-a4f07da94fba\") " pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:01:56.985348 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:56.985299    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 21:01:56.985348 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:56.985314    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 21:01:56.985348 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:56.985323    2580 projected.go:196] Error preparing data for projected volume kube-api-access-r8tth for pod openshift-network-diagnostics/network-check-target-jdds4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:01:56.985459 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:56.985371    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth podName:76c132a0-854b-44a6-87bf-a4f07da94fba nodeName:}" failed. No retries permitted until 2026-07-15 21:02:12.985357229 +0000 UTC m=+34.413316856 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-r8tth" (UniqueName: "kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth") pod "network-check-target-jdds4" (UID: "76c132a0-854b-44a6-87bf-a4f07da94fba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:01:57.057537 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:57.057503    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:01:57.057537 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:57.057538    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:01:57.058083 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:57.057626    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdds4" podUID="76c132a0-854b-44a6-87bf-a4f07da94fba"
Jul 15 21:01:57.058083 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:57.057746    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gxj8k" podUID="8ca7d5c9-37f4-444b-9e21-7659e695968a"
Jul 15 21:01:58.057484 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:58.057452    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:01:58.057675 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:58.057591    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bctvr" podUID="1a69c601-b5b2-4177-8781-16090abbd7f6"
Jul 15 21:01:59.057823 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:59.057783    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:01:59.058322 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:01:59.057894    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:01:59.058322 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:59.057920    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdds4" podUID="76c132a0-854b-44a6-87bf-a4f07da94fba"
Jul 15 21:01:59.058322 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:01:59.058042    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gxj8k" podUID="8ca7d5c9-37f4-444b-9e21-7659e695968a"
Jul 15 21:02:00.057018 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:00.056988    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:02:00.057203 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:00.057113    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bctvr" podUID="1a69c601-b5b2-4177-8781-16090abbd7f6"
Jul 15 21:02:01.057314 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:01.057250    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:02:01.057314 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:01.057290    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:02:01.057790 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:01.057385    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gxj8k" podUID="8ca7d5c9-37f4-444b-9e21-7659e695968a"
Jul 15 21:02:01.057790 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:01.057495    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdds4" podUID="76c132a0-854b-44a6-87bf-a4f07da94fba"
Jul 15 21:02:02.057198 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:02.056988    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:02:02.057316 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:02.057295    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bctvr" podUID="1a69c601-b5b2-4177-8781-16090abbd7f6"
Jul 15 21:02:02.217029 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:02.216998    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-smt2r" event={"ID":"eb44ed96-9b5a-4f52-b349-f64452562c6b","Type":"ContainerStarted","Data":"9b8ce77c6f0b50419f99d95315cbb688662a9dcddb3e11dcf090a5f669c951b5"}
Jul 15 21:02:02.218419 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:02.218394    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pj9tk" event={"ID":"1a806e68-abc4-414a-96ac-843e728e77b9","Type":"ContainerStarted","Data":"a4784efcfa475b58afdf8b70889ea0c0e2b3b8328a7ad46df04dfc46621e1e7f"}
Jul 15 21:02:02.219652 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:02.219629    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9hqht" event={"ID":"3f3f398c-10c8-43f7-ba9f-1049f774d568","Type":"ContainerStarted","Data":"4a2ac4d1a50b7a3f19b9946ef7be544a489144e17fa09f79e989c639b74b73f5"}
Jul 15 21:02:02.221801 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:02.221784    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:02:02.222166 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:02.222143    2580 generic.go:356] "Generic (PLEG): container finished" podID="0b444f82-3531-4cf8-8bbd-f36aeb5b6c29" containerID="86ffbc289f0209d16597e8c7f290493212f64bf1ca6f33a02f3bc1b08560dd03" exitCode=1
Jul 15 21:02:02.222240 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:02.222205    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhz54" event={"ID":"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29","Type":"ContainerStarted","Data":"2f185c3cd04a296c8805902c5369c19faafbd915facb144db846919ba5fa7c51"}
Jul 15 21:02:02.222354 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:02.222339    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhz54" event={"ID":"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29","Type":"ContainerStarted","Data":"6518b8a4123b3de246241e4760b0f1ad80247a1302446ad983828a905dfaf12c"}
Jul 15 21:02:02.222417 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:02.222399    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhz54" event={"ID":"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29","Type":"ContainerStarted","Data":"1d487555f64170861b683980779da254fd542157cbaf296d7c6b31b937a30a81"}
Jul 15 21:02:02.222465 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:02.222436    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhz54" event={"ID":"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29","Type":"ContainerDied","Data":"86ffbc289f0209d16597e8c7f290493212f64bf1ca6f33a02f3bc1b08560dd03"}
Jul 15 21:02:02.222518 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:02.222499    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhz54" event={"ID":"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29","Type":"ContainerStarted","Data":"1c18e997e32ff438cefc795aa6837c2d9d221c8db6ba1e0aa61962c77e9d76f6"}
Jul 15 21:02:02.223564 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:02.223538    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-gqnb8" event={"ID":"b202fca4-2178-47ab-9b2a-98d494879d5f","Type":"ContainerStarted","Data":"f503e3fbd2e6c003d4dd8d30a336c80eba4630207f435c0748274b34cd3a242c"}
Jul 15 21:02:02.224816 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:02.224797    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs" event={"ID":"5e36b0da-c3e9-43ce-9f26-9b9962d8e195","Type":"ContainerStarted","Data":"7702886b2c15160e859c72c9d505151898673033095a9733730736c369214377"}
Jul 15 21:02:02.225913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:02.225895    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pw62m" event={"ID":"394a0fde-3d6c-48e7-9d13-0325ad6ae285","Type":"ContainerStarted","Data":"fd627c2fa800a6afcb30af9bb5e5a273fe5f5a68f3a61551158e75f8c023a7f8"}
Jul 15 21:02:02.227183 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:02.227160    2580 generic.go:356] "Generic (PLEG): container finished" podID="e2f6dde8-4759-43cd-82e1-77de08121820" containerID="a48542984ce89283e3a57cf9dd724b4e64ba02f74f0e9b86dd86469fe08c3d93" exitCode=0
Jul 15 21:02:02.227252 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:02.227188    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkfzt" event={"ID":"e2f6dde8-4759-43cd-82e1-77de08121820","Type":"ContainerDied","Data":"a48542984ce89283e3a57cf9dd724b4e64ba02f74f0e9b86dd86469fe08c3d93"}
Jul 15 21:02:02.235614 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:02.235574    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-smt2r" podStartSLOduration=2.945790098 podStartE2EDuration="22.235562991s" totalImagesPullingTime="19.289772893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:02:02.235225875 +0000 UTC m=+23.663185523" watchObservedRunningTime="2026-07-15 21:02:02.235562991 +0000 UTC m=+23.663522628"
Jul 15 21:02:02.235714 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:02.235695    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-35.ec2.internal" podStartSLOduration=21.235689921 podStartE2EDuration="21.235689921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:01:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:01:44.191694187 +0000 UTC m=+5.619653831" watchObservedRunningTime="2026-07-15 21:02:02.235689921 +0000 UTC m=+23.663649559"
Jul 15 21:02:02.249243 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:02.249198    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pw62m" podStartSLOduration=2.955821456 podStartE2EDuration="22.249186878s" totalImagesPullingTime="19.293365422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:02:02.248771683 +0000 UTC m=+23.676731343" watchObservedRunningTime="2026-07-15 21:02:02.249186878 +0000 UTC m=+23.677146515"
Jul 15 21:02:02.288627 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:02.288588    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pj9tk" podStartSLOduration=3.001871619 podStartE2EDuration="22.288573599s" totalImagesPullingTime="19.28670198s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:02:02.264709272 +0000 UTC m=+23.692668909" watchObservedRunningTime="2026-07-15 21:02:02.288573599 +0000 UTC m=+23.716533213"
Jul 15 21:02:02.302510 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:02.302470    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9hqht" podStartSLOduration=3.01528979 podStartE2EDuration="22.30245717s" totalImagesPullingTime="19.28716738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:02:02.30201934 +0000 UTC m=+23.729978978" watchObservedRunningTime="2026-07-15 21:02:02.30245717 +0000 UTC m=+23.730416806"
Jul 15 21:02:03.057526 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:03.057488    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:02:03.057785 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:03.057509    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:02:03.057785 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:03.057628    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdds4" podUID="76c132a0-854b-44a6-87bf-a4f07da94fba"
Jul 15 21:02:03.057785 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:03.057706    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gxj8k" podUID="8ca7d5c9-37f4-444b-9e21-7659e695968a"
Jul 15 21:02:03.231429 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:03.231391    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vs2l4" event={"ID":"5f7e6700-77fa-402a-be9f-e4150afad410","Type":"ContainerStarted","Data":"d1f45ee80a766eae342d0ea77483b7bea114179f0d08f443f181af81ac559e27"}
Jul 15 21:02:03.237457 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:03.237439    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:02:03.238029 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:03.238003    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhz54" event={"ID":"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29","Type":"ContainerStarted","Data":"c3c27540be29994e414ece202b71fefd6f32b0af92d0e92776ae6ece59746f90"}
Jul 15 21:02:03.246876 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:03.246826    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 21:02:03.250175 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:03.250122    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-gqnb8" podStartSLOduration=3.913141678 podStartE2EDuration="23.250102887s" totalImagesPullingTime="19.336961209s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:02:02.324623076 +0000 UTC m=+23.752582712" watchObservedRunningTime="2026-07-15 21:02:03.250102887 +0000 UTC m=+24.678062525"
Jul 15 21:02:03.781655 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:03.781620    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pw62m"
Jul 15 21:02:03.782243 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:03.782221    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pw62m"
Jul 15 21:02:03.798141 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:03.798090    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vs2l4" podStartSLOduration=4.504995755 podStartE2EDuration="23.798073062s" totalImagesPullingTime="19.293077307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:02:03.249501086 +0000 UTC m=+24.677460725" watchObservedRunningTime="2026-07-15 21:02:03.798073062 +0000 UTC m=+25.226032699"
Jul 15 21:02:04.057642 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:04.057568    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:02:04.057798 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:04.057676    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bctvr" podUID="1a69c601-b5b2-4177-8781-16090abbd7f6"
Jul 15 21:02:04.080134 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:04.080038    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T21:02:03.246874079Z","UUID":"b21ca1cc-13a7-4610-ba3f-41a318c17ee1","Handler":null,"Name":"","Endpoint":""}
Jul 15 21:02:04.081658 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:04.081632    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 21:02:04.081765 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:04.081696    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 21:02:04.242248 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:04.242208    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs" event={"ID":"5e36b0da-c3e9-43ce-9f26-9b9962d8e195","Type":"ContainerStarted","Data":"0997058632c9111652bae052cac2a9e3ed8ad202022b7b020a9d54ddf4fba688"}
Jul 15 21:02:04.242696 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:04.242556    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pw62m"
Jul 15 21:02:04.242940 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:04.242923    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pw62m"
Jul 15 21:02:05.057739 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:05.057706    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:02:05.057921 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:05.057705    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:02:05.057921 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:05.057870    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gxj8k" podUID="8ca7d5c9-37f4-444b-9e21-7659e695968a"
Jul 15 21:02:05.058007 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:05.057928    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdds4" podUID="76c132a0-854b-44a6-87bf-a4f07da94fba"
Jul 15 21:02:05.247924 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:05.247892    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:02:05.248381 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:05.248355    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhz54" event={"ID":"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29","Type":"ContainerStarted","Data":"0dde700b60247dae1f735daab67b04896a7de547e9a72fc5943c3e7416f01871"}
Jul 15 21:02:06.057560 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:06.057316    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:02:06.057739 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:06.057670    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bctvr" podUID="1a69c601-b5b2-4177-8781-16090abbd7f6"
Jul 15 21:02:07.056949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:07.056918    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:02:07.057605 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:07.057099    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdds4" podUID="76c132a0-854b-44a6-87bf-a4f07da94fba"
Jul 15 21:02:07.057605 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:07.057143    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:02:07.057605 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:07.057278    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gxj8k" podUID="8ca7d5c9-37f4-444b-9e21-7659e695968a"
Jul 15 21:02:07.254305 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:07.254192    2580 generic.go:356] "Generic (PLEG): container finished" podID="e2f6dde8-4759-43cd-82e1-77de08121820" containerID="4536884418a4fafd236f01dbb8dcf3707da8e3654f16ef6ac6ef0adaa2f522d2" exitCode=0
Jul 15 21:02:07.254305 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:07.254280    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkfzt" event={"ID":"e2f6dde8-4759-43cd-82e1-77de08121820","Type":"ContainerDied","Data":"4536884418a4fafd236f01dbb8dcf3707da8e3654f16ef6ac6ef0adaa2f522d2"}
Jul 15 21:02:07.257773 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:07.257759    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:02:07.258158 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:07.258135    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhz54" event={"ID":"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29","Type":"ContainerStarted","Data":"ab2cad4c9ba5f7968b4dacccdfd4e5f13fe5bda0609e93ea9d57a69c27b42ac9"}
Jul 15 21:02:07.258347 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:07.258335    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:02:07.258528 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:07.258513    2580 scope.go:117] "RemoveContainer" containerID="86ffbc289f0209d16597e8c7f290493212f64bf1ca6f33a02f3bc1b08560dd03"
Jul 15 21:02:07.260392 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:07.260370    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs" event={"ID":"5e36b0da-c3e9-43ce-9f26-9b9962d8e195","Type":"ContainerStarted","Data":"9ebc44e0c30b82ca7c0db937d6c2a3a888e5f4fca6235b18365ad1af586db574"}
Jul 15 21:02:07.274389 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:07.274359    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:02:07.378043 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:07.377994    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kncxs" podStartSLOduration=3.244717154 podStartE2EDuration="27.377978318s" totalImagesPullingTime="24.133261164s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:01:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:02:07.377749964 +0000 UTC m=+28.805709601" watchObservedRunningTime="2026-07-15 21:02:07.377978318 +0000 UTC m=+28.805937968"
Jul 15 21:02:08.057562 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:08.057536    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:02:08.057991 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:08.057629    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bctvr" podUID="1a69c601-b5b2-4177-8781-16090abbd7f6"
Jul 15 21:02:08.266177 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:08.266149    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:02:08.266527 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:08.266508    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dhz54" event={"ID":"0b444f82-3531-4cf8-8bbd-f36aeb5b6c29","Type":"ContainerStarted","Data":"f64a8a27aa3b5ee35f542cdf98055ea5b44dda4d5a76484639dec52e4dcca108"}
Jul 15 21:02:08.266945 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:08.266869    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:02:08.267064 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:08.266957    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:02:08.282149 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:08.282128    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:02:08.424354 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:08.424300    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dhz54" podStartSLOduration=9.037548848 podStartE2EDuration="28.42428151s" totalImagesPullingTime="19.386732662s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:02:08.417561442 +0000 UTC m=+29.845521080" watchObservedRunningTime="2026-07-15 21:02:08.42428151 +0000 UTC m=+29.852241156"
Jul 15 21:02:09.060392 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:09.058477    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:02:09.060392 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:09.058644    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gxj8k" podUID="8ca7d5c9-37f4-444b-9e21-7659e695968a"
Jul 15 21:02:09.060392 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:09.059091    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:02:09.060392 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:09.059199    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdds4" podUID="76c132a0-854b-44a6-87bf-a4f07da94fba"
Jul 15 21:02:09.258636 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:09.258576    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gxj8k"]
Jul 15 21:02:09.261645 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:09.261622    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jdds4"]
Jul 15 21:02:09.264351 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:09.264300    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bctvr"]
Jul 15 21:02:09.264464 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:09.264409    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:02:09.264882 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:09.264517    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bctvr" podUID="1a69c601-b5b2-4177-8781-16090abbd7f6"
Jul 15 21:02:09.268986 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:09.268963    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:02:09.269092 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:09.269073    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdds4" podUID="76c132a0-854b-44a6-87bf-a4f07da94fba"
Jul 15 21:02:09.269163 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:09.269104    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:02:09.269694 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:09.269648    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gxj8k" podUID="8ca7d5c9-37f4-444b-9e21-7659e695968a"
Jul 15 21:02:10.273369 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:10.273153    2580 generic.go:356] "Generic (PLEG): container finished" podID="e2f6dde8-4759-43cd-82e1-77de08121820" containerID="29e656f377e13148554ef200c5a4ea9c2bdbc29db15eb7f4d455a091aa68c239" exitCode=0
Jul 15 21:02:10.273369 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:10.273236    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkfzt" event={"ID":"e2f6dde8-4759-43cd-82e1-77de08121820","Type":"ContainerDied","Data":"29e656f377e13148554ef200c5a4ea9c2bdbc29db15eb7f4d455a091aa68c239"}
Jul 15 21:02:11.057062 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:11.057024    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:02:11.057234 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:11.057024    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:02:11.057234 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:11.057170    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:02:11.057234 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:11.057165    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bctvr" podUID="1a69c601-b5b2-4177-8781-16090abbd7f6"
Jul 15 21:02:11.057452 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:11.057265    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gxj8k" podUID="8ca7d5c9-37f4-444b-9e21-7659e695968a"
Jul 15 21:02:11.057452 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:11.057336    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdds4" podUID="76c132a0-854b-44a6-87bf-a4f07da94fba"
Jul 15 21:02:11.278192 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:11.278165    2580 generic.go:356] "Generic (PLEG): container finished" podID="e2f6dde8-4759-43cd-82e1-77de08121820" containerID="73a18ea8225902d07c3d38de0b9496b1c3572a03caffa2848e8c235de567a8d6" exitCode=0
Jul 15 21:02:11.278192 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:11.278199    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkfzt" event={"ID":"e2f6dde8-4759-43cd-82e1-77de08121820","Type":"ContainerDied","Data":"73a18ea8225902d07c3d38de0b9496b1c3572a03caffa2848e8c235de567a8d6"}
Jul 15 21:02:12.791509 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:12.791464    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs\") pod \"network-metrics-daemon-gxj8k\" (UID: \"8ca7d5c9-37f4-444b-9e21-7659e695968a\") " pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:02:12.792010 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:12.791602    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:02:12.792010 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:12.791675    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs podName:8ca7d5c9-37f4-444b-9e21-7659e695968a nodeName:}" failed. No retries permitted until 2026-07-15 21:02:44.791654173 +0000 UTC m=+66.219613805 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs") pod "network-metrics-daemon-gxj8k" (UID: "8ca7d5c9-37f4-444b-9e21-7659e695968a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 21:02:12.892394 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:12.892363    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret\") pod \"global-pull-secret-syncer-bctvr\" (UID: \"1a69c601-b5b2-4177-8781-16090abbd7f6\") " pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:02:12.892579 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:12.892487    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 21:02:12.892579 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:12.892551    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret podName:1a69c601-b5b2-4177-8781-16090abbd7f6 nodeName:}" failed. No retries permitted until 2026-07-15 21:02:44.892533478 +0000 UTC m=+66.320493107 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret") pod "global-pull-secret-syncer-bctvr" (UID: "1a69c601-b5b2-4177-8781-16090abbd7f6") : object "kube-system"/"original-pull-secret" not registered
Jul 15 21:02:12.993723 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:12.993686    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8tth\" (UniqueName: \"kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth\") pod \"network-check-target-jdds4\" (UID: \"76c132a0-854b-44a6-87bf-a4f07da94fba\") " pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:02:12.993898 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:12.993865    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 21:02:12.993898 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:12.993889    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 21:02:12.993898 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:12.993899    2580 projected.go:196] Error preparing data for projected volume kube-api-access-r8tth for pod openshift-network-diagnostics/network-check-target-jdds4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:02:12.994070 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:12.993960    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth podName:76c132a0-854b-44a6-87bf-a4f07da94fba nodeName:}" failed. No retries permitted until 2026-07-15 21:02:44.993941181 +0000 UTC m=+66.421900796 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-r8tth" (UniqueName: "kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth") pod "network-check-target-jdds4" (UID: "76c132a0-854b-44a6-87bf-a4f07da94fba") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 21:02:13.057738 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:13.057630    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:02:13.057738 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:13.057629    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:02:13.057943 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:13.057762    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jdds4" podUID="76c132a0-854b-44a6-87bf-a4f07da94fba"
Jul 15 21:02:13.057943 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:13.057788    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:02:13.057943 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:13.057904    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bctvr" podUID="1a69c601-b5b2-4177-8781-16090abbd7f6"
Jul 15 21:02:13.058046 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:13.057978    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gxj8k" podUID="8ca7d5c9-37f4-444b-9e21-7659e695968a"
Jul 15 21:02:14.348742 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.348716    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-35.ec2.internal" event="NodeReady"
Jul 15 21:02:14.349311 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.348878    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 21:02:14.410201 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.410111    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f7694"]
Jul 15 21:02:14.413570 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.413547    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dlmz6"]
Jul 15 21:02:14.413689 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.413668    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f7694"
Jul 15 21:02:14.416134 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.416110    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 21:02:14.416259 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.416187    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p4nfw\""
Jul 15 21:02:14.416875 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.416811    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dlmz6"
Jul 15 21:02:14.419146 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.419123    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 21:02:14.419581 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.419562    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8p5p2\""
Jul 15 21:02:14.419680 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.419657    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 21:02:14.419759 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.419689    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 21:02:14.420132 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.420107    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 21:02:14.425108 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.425076    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f7694"]
Jul 15 21:02:14.428821 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.428801    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dlmz6"]
Jul 15 21:02:14.505409 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.505382    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls\") pod \"dns-default-f7694\" (UID: \"d1fb00d7-6201-4dfb-b60f-9364a0230149\") " pod="openshift-dns/dns-default-f7694"
Jul 15 21:02:14.505594 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.505423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb5sv\" (UniqueName: \"kubernetes.io/projected/8bce08f0-aff4-4d40-ab8d-7b9223412b0b-kube-api-access-mb5sv\") pod \"ingress-canary-dlmz6\" (UID: \"8bce08f0-aff4-4d40-ab8d-7b9223412b0b\") " pod="openshift-ingress-canary/ingress-canary-dlmz6"
Jul 15 21:02:14.505594 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.505470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8wvm\" (UniqueName: \"kubernetes.io/projected/d1fb00d7-6201-4dfb-b60f-9364a0230149-kube-api-access-v8wvm\") pod \"dns-default-f7694\" (UID: \"d1fb00d7-6201-4dfb-b60f-9364a0230149\") " pod="openshift-dns/dns-default-f7694"
Jul 15 21:02:14.505594 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.505494    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bce08f0-aff4-4d40-ab8d-7b9223412b0b-cert\") pod \"ingress-canary-dlmz6\" (UID: \"8bce08f0-aff4-4d40-ab8d-7b9223412b0b\") " pod="openshift-ingress-canary/ingress-canary-dlmz6"
Jul 15 21:02:14.505594 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.505551    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1fb00d7-6201-4dfb-b60f-9364a0230149-tmp-dir\") pod \"dns-default-f7694\" (UID: \"d1fb00d7-6201-4dfb-b60f-9364a0230149\") " pod="openshift-dns/dns-default-f7694"
Jul 15 21:02:14.505767 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.505619    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1fb00d7-6201-4dfb-b60f-9364a0230149-config-volume\") pod \"dns-default-f7694\" (UID: \"d1fb00d7-6201-4dfb-b60f-9364a0230149\") " pod="openshift-dns/dns-default-f7694"
Jul 15 21:02:14.606737 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.606701    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1fb00d7-6201-4dfb-b60f-9364a0230149-config-volume\") pod \"dns-default-f7694\" (UID: \"d1fb00d7-6201-4dfb-b60f-9364a0230149\") " pod="openshift-dns/dns-default-f7694"
Jul 15 21:02:14.606956 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.606757    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls\") pod \"dns-default-f7694\" (UID: \"d1fb00d7-6201-4dfb-b60f-9364a0230149\") " pod="openshift-dns/dns-default-f7694"
Jul 15 21:02:14.606956 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.606798    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb5sv\" (UniqueName: \"kubernetes.io/projected/8bce08f0-aff4-4d40-ab8d-7b9223412b0b-kube-api-access-mb5sv\") pod \"ingress-canary-dlmz6\" (UID: \"8bce08f0-aff4-4d40-ab8d-7b9223412b0b\") " pod="openshift-ingress-canary/ingress-canary-dlmz6"
Jul 15 21:02:14.606956 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.606855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8wvm\" (UniqueName: \"kubernetes.io/projected/d1fb00d7-6201-4dfb-b60f-9364a0230149-kube-api-access-v8wvm\") pod \"dns-default-f7694\" (UID: \"d1fb00d7-6201-4dfb-b60f-9364a0230149\") " pod="openshift-dns/dns-default-f7694"
Jul 15 21:02:14.606956 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.606885    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bce08f0-aff4-4d40-ab8d-7b9223412b0b-cert\") pod \"ingress-canary-dlmz6\" (UID: \"8bce08f0-aff4-4d40-ab8d-7b9223412b0b\") " pod="openshift-ingress-canary/ingress-canary-dlmz6"
Jul 15 21:02:14.606956 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:14.606911    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 21:02:14.606956 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.606933    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1fb00d7-6201-4dfb-b60f-9364a0230149-tmp-dir\") pod \"dns-default-f7694\" (UID: \"d1fb00d7-6201-4dfb-b60f-9364a0230149\") " pod="openshift-dns/dns-default-f7694"
Jul 15 21:02:14.607275 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:14.607005    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls podName:d1fb00d7-6201-4dfb-b60f-9364a0230149 nodeName:}" failed. No retries permitted until 2026-07-15 21:02:15.106988745 +0000 UTC m=+36.534948382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls") pod "dns-default-f7694" (UID: "d1fb00d7-6201-4dfb-b60f-9364a0230149") : secret "dns-default-metrics-tls" not found
Jul 15 21:02:14.607275 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.607178    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1fb00d7-6201-4dfb-b60f-9364a0230149-tmp-dir\") pod \"dns-default-f7694\" (UID: \"d1fb00d7-6201-4dfb-b60f-9364a0230149\") " pod="openshift-dns/dns-default-f7694"
Jul 15 21:02:14.607429 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.607399    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d1fb00d7-6201-4dfb-b60f-9364a0230149-config-volume\") pod \"dns-default-f7694\" (UID: \"d1fb00d7-6201-4dfb-b60f-9364a0230149\") " pod="openshift-dns/dns-default-f7694"
Jul 15 21:02:14.611963 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.611943    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8bce08f0-aff4-4d40-ab8d-7b9223412b0b-cert\") pod \"ingress-canary-dlmz6\" (UID: \"8bce08f0-aff4-4d40-ab8d-7b9223412b0b\") " pod="openshift-ingress-canary/ingress-canary-dlmz6"
Jul 15 21:02:14.618646 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.618626    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8wvm\" (UniqueName: \"kubernetes.io/projected/d1fb00d7-6201-4dfb-b60f-9364a0230149-kube-api-access-v8wvm\") pod \"dns-default-f7694\" (UID: \"d1fb00d7-6201-4dfb-b60f-9364a0230149\") " pod="openshift-dns/dns-default-f7694"
Jul 15 21:02:14.619278 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.619255    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb5sv\" (UniqueName: \"kubernetes.io/projected/8bce08f0-aff4-4d40-ab8d-7b9223412b0b-kube-api-access-mb5sv\") pod \"ingress-canary-dlmz6\" (UID: \"8bce08f0-aff4-4d40-ab8d-7b9223412b0b\") " pod="openshift-ingress-canary/ingress-canary-dlmz6"
Jul 15 21:02:14.732029 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.731993    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dlmz6"
Jul 15 21:02:14.892130 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:14.891894    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dlmz6"]
Jul 15 21:02:14.895904 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:02:14.895877    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bce08f0_aff4_4d40_ab8d_7b9223412b0b.slice/crio-c5e9ce27a58af23f7c7e51482e35a8e7438e5e7f61d8a9cd2cd2858606098785 WatchSource:0}: Error finding container c5e9ce27a58af23f7c7e51482e35a8e7438e5e7f61d8a9cd2cd2858606098785: Status 404 returned error can't find the container with id c5e9ce27a58af23f7c7e51482e35a8e7438e5e7f61d8a9cd2cd2858606098785
Jul 15 21:02:15.057405 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:15.057294    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:02:15.057405 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:15.057316    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:02:15.057405 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:15.057294    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:02:15.060434 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:15.060096    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 21:02:15.060434 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:15.060110    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jfzc2\""
Jul 15 21:02:15.060434 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:15.060138    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 21:02:15.061077 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:15.061052    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 21:02:15.061210 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:15.061100    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 21:02:15.061330 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:15.061307    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rwswm\""
Jul 15 21:02:15.112262 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:15.112234    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls\") pod \"dns-default-f7694\" (UID: \"d1fb00d7-6201-4dfb-b60f-9364a0230149\") " pod="openshift-dns/dns-default-f7694"
Jul 15 21:02:15.112404 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:15.112389    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 21:02:15.112475 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:15.112462    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls podName:d1fb00d7-6201-4dfb-b60f-9364a0230149 nodeName:}" failed. No retries permitted until 2026-07-15 21:02:16.112441373 +0000 UTC m=+37.540401002 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls") pod "dns-default-f7694" (UID: "d1fb00d7-6201-4dfb-b60f-9364a0230149") : secret "dns-default-metrics-tls" not found
Jul 15 21:02:15.289474 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:15.289437    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dlmz6" event={"ID":"8bce08f0-aff4-4d40-ab8d-7b9223412b0b","Type":"ContainerStarted","Data":"c5e9ce27a58af23f7c7e51482e35a8e7438e5e7f61d8a9cd2cd2858606098785"}
Jul 15 21:02:16.120208 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:16.120164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls\") pod \"dns-default-f7694\" (UID: \"d1fb00d7-6201-4dfb-b60f-9364a0230149\") " pod="openshift-dns/dns-default-f7694"
Jul 15 21:02:16.120778 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:16.120348    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 21:02:16.120778 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:16.120443    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls podName:d1fb00d7-6201-4dfb-b60f-9364a0230149 nodeName:}" failed. No retries permitted until 2026-07-15 21:02:18.120419869 +0000 UTC m=+39.548379508 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls") pod "dns-default-f7694" (UID: "d1fb00d7-6201-4dfb-b60f-9364a0230149") : secret "dns-default-metrics-tls" not found
Jul 15 21:02:17.297628 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:17.297595    2580 generic.go:356] "Generic (PLEG): container finished" podID="e2f6dde8-4759-43cd-82e1-77de08121820" containerID="acd339e4fc753cd0d43955374feff0e5e932ae2aa68fd00bf9fc3568a296dff5" exitCode=0
Jul 15 21:02:17.298058 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:17.297633    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkfzt" event={"ID":"e2f6dde8-4759-43cd-82e1-77de08121820","Type":"ContainerDied","Data":"acd339e4fc753cd0d43955374feff0e5e932ae2aa68fd00bf9fc3568a296dff5"}
Jul 15 21:02:18.135442 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:18.135401    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls\") pod \"dns-default-f7694\" (UID: \"d1fb00d7-6201-4dfb-b60f-9364a0230149\") " pod="openshift-dns/dns-default-f7694"
Jul 15 21:02:18.135641 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:18.135547    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 21:02:18.135641 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:18.135630    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls podName:d1fb00d7-6201-4dfb-b60f-9364a0230149 nodeName:}" failed. No retries permitted until 2026-07-15 21:02:22.135607955 +0000 UTC m=+43.563567575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls") pod "dns-default-f7694" (UID: "d1fb00d7-6201-4dfb-b60f-9364a0230149") : secret "dns-default-metrics-tls" not found
Jul 15 21:02:18.304379 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:18.304345    2580 generic.go:356] "Generic (PLEG): container finished" podID="e2f6dde8-4759-43cd-82e1-77de08121820" containerID="f6ef21cb0044b6898d8e1867974b9a0d543c523cda7351ac99fe908513856437" exitCode=0
Jul 15 21:02:18.304379 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:18.304384    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkfzt" event={"ID":"e2f6dde8-4759-43cd-82e1-77de08121820","Type":"ContainerDied","Data":"f6ef21cb0044b6898d8e1867974b9a0d543c523cda7351ac99fe908513856437"}
Jul 15 21:02:19.308650 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:19.308342    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dlmz6" event={"ID":"8bce08f0-aff4-4d40-ab8d-7b9223412b0b","Type":"ContainerStarted","Data":"3512687ae24e20968815a49a62db9e67903d0d07d79942cdc2e13fc6f7dd8490"}
Jul 15 21:02:19.311406 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:19.311376    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fkfzt" event={"ID":"e2f6dde8-4759-43cd-82e1-77de08121820","Type":"ContainerStarted","Data":"89596d27c11de0a679f699d67f16a6b163d9bd6dc6f2b369ed09070b003e5dbb"}
Jul 15 21:02:19.324936 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:19.324886    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dlmz6" podStartSLOduration=1.279353682 podStartE2EDuration="5.324872703s" totalImagesPullingTime="4.045519021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:02:19.324505796 +0000 UTC m=+40.752465450" watchObservedRunningTime="2026-07-15 21:02:19.324872703 +0000 UTC m=+40.752832340"
Jul 15 21:02:19.350258 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:19.350208    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fkfzt" podStartSLOduration=6.756767288 podStartE2EDuration="39.350189309s" totalImagesPullingTime="32.593422021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:01:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:02:19.347905213 +0000 UTC m=+40.775864850" watchObservedRunningTime="2026-07-15 21:02:19.350189309 +0000 UTC m=+40.778148946"
Jul 15 21:02:22.163494 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:22.163454    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls\") pod \"dns-default-f7694\" (UID: \"d1fb00d7-6201-4dfb-b60f-9364a0230149\") " pod="openshift-dns/dns-default-f7694"
Jul 15 21:02:22.163874 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:22.163577    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 21:02:22.163874 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:22.163627    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls podName:d1fb00d7-6201-4dfb-b60f-9364a0230149 nodeName:}" failed. No retries permitted until 2026-07-15 21:02:30.163613595 +0000 UTC m=+51.591573223 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls") pod "dns-default-f7694" (UID: "d1fb00d7-6201-4dfb-b60f-9364a0230149") : secret "dns-default-metrics-tls" not found
Jul 15 21:02:30.215648 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:30.215607    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls\") pod \"dns-default-f7694\" (UID: \"d1fb00d7-6201-4dfb-b60f-9364a0230149\") " pod="openshift-dns/dns-default-f7694"
Jul 15 21:02:30.216112 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:30.215754    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 21:02:30.216112 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:30.215818    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls podName:d1fb00d7-6201-4dfb-b60f-9364a0230149 nodeName:}" failed. No retries permitted until 2026-07-15 21:02:46.215800049 +0000 UTC m=+67.643759667 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls") pod "dns-default-f7694" (UID: "d1fb00d7-6201-4dfb-b60f-9364a0230149") : secret "dns-default-metrics-tls" not found
Jul 15 21:02:40.293125 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:40.293097    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dhz54"
Jul 15 21:02:44.824655 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:44.824598    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs\") pod \"network-metrics-daemon-gxj8k\" (UID: \"8ca7d5c9-37f4-444b-9e21-7659e695968a\") " pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:02:44.826630 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:44.826610    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 21:02:44.835187 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:44.835164    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 15 21:02:44.835261 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:44.835232    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs podName:8ca7d5c9-37f4-444b-9e21-7659e695968a nodeName:}" failed. No retries permitted until 2026-07-15 21:03:48.835211414 +0000 UTC m=+130.263171043 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs") pod "network-metrics-daemon-gxj8k" (UID: "8ca7d5c9-37f4-444b-9e21-7659e695968a") : secret "metrics-daemon-secret" not found
Jul 15 21:02:44.926034 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:44.926000    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret\") pod \"global-pull-secret-syncer-bctvr\" (UID: \"1a69c601-b5b2-4177-8781-16090abbd7f6\") " pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:02:44.928421 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:44.928401    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 21:02:44.940822 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:44.940798    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1a69c601-b5b2-4177-8781-16090abbd7f6-original-pull-secret\") pod \"global-pull-secret-syncer-bctvr\" (UID: \"1a69c601-b5b2-4177-8781-16090abbd7f6\") " pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:02:45.026928 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:45.026890    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8tth\" (UniqueName: \"kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth\") pod \"network-check-target-jdds4\" (UID: \"76c132a0-854b-44a6-87bf-a4f07da94fba\") " pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:02:45.028982 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:45.028964    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 21:02:45.040170 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:45.040142    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 21:02:45.050039 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:45.050019    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8tth\" (UniqueName: \"kubernetes.io/projected/76c132a0-854b-44a6-87bf-a4f07da94fba-kube-api-access-r8tth\") pod \"network-check-target-jdds4\" (UID: \"76c132a0-854b-44a6-87bf-a4f07da94fba\") " pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:02:45.082994 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:45.082915    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jfzc2\""
Jul 15 21:02:45.084709 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:45.084691    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bctvr"
Jul 15 21:02:45.089742 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:45.089728    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:02:45.235334 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:45.235301    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jdds4"]
Jul 15 21:02:45.238417 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:02:45.238388    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76c132a0_854b_44a6_87bf_a4f07da94fba.slice/crio-8c4602e869d447a32c5bd613d5c0fd8af226232df68c56530fe66aa917d505fe WatchSource:0}: Error finding container 8c4602e869d447a32c5bd613d5c0fd8af226232df68c56530fe66aa917d505fe: Status 404 returned error can't find the container with id 8c4602e869d447a32c5bd613d5c0fd8af226232df68c56530fe66aa917d505fe
Jul 15 21:02:45.251162 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:45.251136    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bctvr"]
Jul 15 21:02:45.254556 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:02:45.254532    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a69c601_b5b2_4177_8781_16090abbd7f6.slice/crio-63cc628cbb09e089868ce3fb2fc9bd51e2f191441e947c0dc75fe5533bf40ef7 WatchSource:0}: Error finding container 63cc628cbb09e089868ce3fb2fc9bd51e2f191441e947c0dc75fe5533bf40ef7: Status 404 returned error can't find the container with id 63cc628cbb09e089868ce3fb2fc9bd51e2f191441e947c0dc75fe5533bf40ef7
Jul 15 21:02:45.372260 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:45.372164    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jdds4" event={"ID":"76c132a0-854b-44a6-87bf-a4f07da94fba","Type":"ContainerStarted","Data":"8c4602e869d447a32c5bd613d5c0fd8af226232df68c56530fe66aa917d505fe"}
Jul 15 21:02:45.373222 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:45.373200    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bctvr" event={"ID":"1a69c601-b5b2-4177-8781-16090abbd7f6","Type":"ContainerStarted","Data":"63cc628cbb09e089868ce3fb2fc9bd51e2f191441e947c0dc75fe5533bf40ef7"}
Jul 15 21:02:46.154635 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.153832    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kl8w7"]
Jul 15 21:02:46.156721 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.156693    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6"]
Jul 15 21:02:46.156862 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.156827    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kl8w7"
Jul 15 21:02:46.159211 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.159182    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 15 21:02:46.159211 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.159205    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-74d5dc7b48-vx9t7"]
Jul 15 21:02:46.159358 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.159262    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 15 21:02:46.159358 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.159329    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6"
Jul 15 21:02:46.159358 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.159184    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-w52d2\""
Jul 15 21:02:46.161790 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.161726    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:02:46.162009 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.161988    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 21:02:46.162707 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.162613    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 21:02:46.184150 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.184125    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 15 21:02:46.184263 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.184170    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 21:02:46.184397 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.184379    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 15 21:02:46.184463 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.184453    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 15 21:02:46.184786 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.184768    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 15 21:02:46.184905 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.184800    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-zv2np\""
Jul 15 21:02:46.185407 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.185221    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 15 21:02:46.210084 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.210052    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kl8w7"]
Jul 15 21:02:46.214279 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.214177    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 15 21:02:46.214519 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.214481    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wnpnk\""
Jul 15 21:02:46.214624 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.214480    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 21:02:46.215329 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.215306    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6"]
Jul 15 21:02:46.231966 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.231935    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-74d5dc7b48-vx9t7"]
Jul 15 21:02:46.237132 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.237102    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls\") pod \"dns-default-f7694\" (UID: \"d1fb00d7-6201-4dfb-b60f-9364a0230149\") " pod="openshift-dns/dns-default-f7694"
Jul 15 21:02:46.237298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.237149    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w5rb\" (UniqueName: \"kubernetes.io/projected/0c3324df-13f7-41ea-9145-aee63d6bc31c-kube-api-access-8w5rb\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:02:46.237298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.237182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvp82\" (UniqueName: \"kubernetes.io/projected/9a87abc1-b350-47cc-8e22-3e947ede13ea-kube-api-access-gvp82\") pod \"volume-data-source-validator-78495597f6-kl8w7\" (UID: \"9a87abc1-b350-47cc-8e22-3e947ede13ea\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kl8w7"
Jul 15 21:02:46.237298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.237224    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c3324df-13f7-41ea-9145-aee63d6bc31c-service-ca-bundle\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:02:46.237460 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:46.237321    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 21:02:46.237460 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.237323    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95680620-6e1c-4356-b790-949697705f91-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vwjr6\" (UID: \"95680620-6e1c-4356-b790-949697705f91\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6"
Jul 15 21:02:46.237460 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:46.237391    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls podName:d1fb00d7-6201-4dfb-b60f-9364a0230149 nodeName:}" failed. No retries permitted until 2026-07-15 21:03:18.237368297 +0000 UTC m=+99.665327927 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls") pod "dns-default-f7694" (UID: "d1fb00d7-6201-4dfb-b60f-9364a0230149") : secret "dns-default-metrics-tls" not found
Jul 15 21:02:46.237460 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.237443    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6npms\" (UniqueName: \"kubernetes.io/projected/95680620-6e1c-4356-b790-949697705f91-kube-api-access-6npms\") pod \"cluster-monitoring-operator-5f7f494dd4-vwjr6\" (UID: \"95680620-6e1c-4356-b790-949697705f91\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6"
Jul 15 21:02:46.237632 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.237472    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-default-certificate\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:02:46.237632 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.237555    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/95680620-6e1c-4356-b790-949697705f91-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-vwjr6\" (UID: \"95680620-6e1c-4356-b790-949697705f91\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6"
Jul 15 21:02:46.237632 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.237580    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-stats-auth\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:02:46.237632 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.237615    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-metrics-certs\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:02:46.338392 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.338346    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w5rb\" (UniqueName: \"kubernetes.io/projected/0c3324df-13f7-41ea-9145-aee63d6bc31c-kube-api-access-8w5rb\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:02:46.338589 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.338404    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvp82\" (UniqueName: \"kubernetes.io/projected/9a87abc1-b350-47cc-8e22-3e947ede13ea-kube-api-access-gvp82\") pod \"volume-data-source-validator-78495597f6-kl8w7\" (UID: \"9a87abc1-b350-47cc-8e22-3e947ede13ea\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kl8w7"
Jul 15 21:02:46.338589 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.338440    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c3324df-13f7-41ea-9145-aee63d6bc31c-service-ca-bundle\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:02:46.338589 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.338479    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95680620-6e1c-4356-b790-949697705f91-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vwjr6\" (UID: \"95680620-6e1c-4356-b790-949697705f91\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6"
Jul 15 21:02:46.338589 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.338511    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6npms\" (UniqueName: \"kubernetes.io/projected/95680620-6e1c-4356-b790-949697705f91-kube-api-access-6npms\") pod \"cluster-monitoring-operator-5f7f494dd4-vwjr6\" (UID: \"95680620-6e1c-4356-b790-949697705f91\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6"
Jul 15 21:02:46.338589 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.338534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-default-certificate\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:02:46.338874 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.338592    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/95680620-6e1c-4356-b790-949697705f91-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-vwjr6\" (UID: \"95680620-6e1c-4356-b790-949697705f91\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6"
Jul 15 21:02:46.338874 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.338615    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-stats-auth\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:02:46.338874 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.338639    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-metrics-certs\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:02:46.338874 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:46.338759    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 21:02:46.338874 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:46.338820    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-metrics-certs podName:0c3324df-13f7-41ea-9145-aee63d6bc31c nodeName:}" failed. No retries permitted until 2026-07-15 21:02:46.838800196 +0000 UTC m=+68.266759828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-metrics-certs") pod "router-default-74d5dc7b48-vx9t7" (UID: "0c3324df-13f7-41ea-9145-aee63d6bc31c") : secret "router-metrics-certs-default" not found
Jul 15 21:02:46.339336 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:46.339277    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 21:02:46.339450 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:46.339334    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c3324df-13f7-41ea-9145-aee63d6bc31c-service-ca-bundle podName:0c3324df-13f7-41ea-9145-aee63d6bc31c nodeName:}" failed. No retries permitted until 2026-07-15 21:02:46.83931284 +0000 UTC m=+68.267272477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0c3324df-13f7-41ea-9145-aee63d6bc31c-service-ca-bundle") pod "router-default-74d5dc7b48-vx9t7" (UID: "0c3324df-13f7-41ea-9145-aee63d6bc31c") : configmap references non-existent config key: service-ca.crt
Jul 15 21:02:46.339450 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:46.339360    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95680620-6e1c-4356-b790-949697705f91-cluster-monitoring-operator-tls podName:95680620-6e1c-4356-b790-949697705f91 nodeName:}" failed. No retries permitted until 2026-07-15 21:02:46.839351274 +0000 UTC m=+68.267310889 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95680620-6e1c-4356-b790-949697705f91-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-vwjr6" (UID: "95680620-6e1c-4356-b790-949697705f91") : secret "cluster-monitoring-operator-tls" not found
Jul 15 21:02:46.340079 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.340051    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/95680620-6e1c-4356-b790-949697705f91-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-vwjr6\" (UID: \"95680620-6e1c-4356-b790-949697705f91\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6"
Jul 15 21:02:46.342018 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.341993    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-default-certificate\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:02:46.342125 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.341993    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-stats-auth\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:02:46.357191 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.357139    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w5rb\" (UniqueName: \"kubernetes.io/projected/0c3324df-13f7-41ea-9145-aee63d6bc31c-kube-api-access-8w5rb\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:02:46.358406 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.358372    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvp82\" (UniqueName: \"kubernetes.io/projected/9a87abc1-b350-47cc-8e22-3e947ede13ea-kube-api-access-gvp82\") pod \"volume-data-source-validator-78495597f6-kl8w7\" (UID: \"9a87abc1-b350-47cc-8e22-3e947ede13ea\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kl8w7"
Jul 15 21:02:46.358669 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.358624    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6npms\" (UniqueName: \"kubernetes.io/projected/95680620-6e1c-4356-b790-949697705f91-kube-api-access-6npms\") pod \"cluster-monitoring-operator-5f7f494dd4-vwjr6\" (UID: \"95680620-6e1c-4356-b790-949697705f91\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6"
Jul 15 21:02:46.369107 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.368940    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-7dmjx"]
Jul 15 21:02:46.373062 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.373037    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx"
Jul 15 21:02:46.387492 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.387246    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mnk2n\""
Jul 15 21:02:46.387492 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.387291    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 21:02:46.387492 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.387249    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-7dmjx"]
Jul 15 21:02:46.387492 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.387454    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 15 21:02:46.387776 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.387675    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 15 21:02:46.387776 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.387692    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 15 21:02:46.387933 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.387916    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 21:02:46.471330 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.471291    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kl8w7"
Jul 15 21:02:46.540312 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.540279    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95389d21-5271-4dda-bcf4-147a2f14832a-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-7dmjx\" (UID: \"95389d21-5271-4dda-bcf4-147a2f14832a\") " pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx"
Jul 15 21:02:46.540451 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.540420    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/95389d21-5271-4dda-bcf4-147a2f14832a-snapshots\") pod \"insights-operator-68d9dd94cf-7dmjx\" (UID: \"95389d21-5271-4dda-bcf4-147a2f14832a\") " pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx"
Jul 15 21:02:46.540518 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.540478    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95389d21-5271-4dda-bcf4-147a2f14832a-tmp\") pod \"insights-operator-68d9dd94cf-7dmjx\" (UID: \"95389d21-5271-4dda-bcf4-147a2f14832a\") " pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx"
Jul 15 21:02:46.540518 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.540504    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95389d21-5271-4dda-bcf4-147a2f14832a-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-7dmjx\" (UID: \"95389d21-5271-4dda-bcf4-147a2f14832a\") " pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx"
Jul 15 21:02:46.540622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.540529    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/95389d21-5271-4dda-bcf4-147a2f14832a-serving-cert\") pod \"insights-operator-68d9dd94cf-7dmjx\" (UID: \"95389d21-5271-4dda-bcf4-147a2f14832a\") " pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx"
Jul 15 21:02:46.540622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.540555    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4ddv\" (UniqueName: \"kubernetes.io/projected/95389d21-5271-4dda-bcf4-147a2f14832a-kube-api-access-k4ddv\") pod \"insights-operator-68d9dd94cf-7dmjx\" (UID: \"95389d21-5271-4dda-bcf4-147a2f14832a\") " pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx"
Jul 15 21:02:46.616887 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.616854    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kl8w7"]
Jul 15 21:02:46.620459 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:02:46.620419    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a87abc1_b350_47cc_8e22_3e947ede13ea.slice/crio-84fb7618f820e17e0e5a81517e6b9b2a6584c8a62b3bb40dab9295741c88d110 WatchSource:0}: Error finding container 84fb7618f820e17e0e5a81517e6b9b2a6584c8a62b3bb40dab9295741c88d110: Status 404 returned error can't find the container with id 84fb7618f820e17e0e5a81517e6b9b2a6584c8a62b3bb40dab9295741c88d110
Jul 15 21:02:46.641509 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.641475    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95389d21-5271-4dda-bcf4-147a2f14832a-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-7dmjx\" (UID: \"95389d21-5271-4dda-bcf4-147a2f14832a\") " pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx"
Jul 15 21:02:46.641637 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.641594    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/95389d21-5271-4dda-bcf4-147a2f14832a-snapshots\") pod \"insights-operator-68d9dd94cf-7dmjx\" (UID: \"95389d21-5271-4dda-bcf4-147a2f14832a\") " pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx"
Jul 15 21:02:46.641701 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.641653    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95389d21-5271-4dda-bcf4-147a2f14832a-tmp\") pod \"insights-operator-68d9dd94cf-7dmjx\" (UID: \"95389d21-5271-4dda-bcf4-147a2f14832a\") " pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx"
Jul 15 21:02:46.641701 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.641681    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95389d21-5271-4dda-bcf4-147a2f14832a-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-7dmjx\" (UID: \"95389d21-5271-4dda-bcf4-147a2f14832a\") " pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx"
Jul 15 21:02:46.641795 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.641703    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/95389d21-5271-4dda-bcf4-147a2f14832a-serving-cert\") pod \"insights-operator-68d9dd94cf-7dmjx\" (UID: \"95389d21-5271-4dda-bcf4-147a2f14832a\") " pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx"
Jul 15 21:02:46.641795 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.641727    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4ddv\" (UniqueName: \"kubernetes.io/projected/95389d21-5271-4dda-bcf4-147a2f14832a-kube-api-access-k4ddv\") pod \"insights-operator-68d9dd94cf-7dmjx\" (UID: \"95389d21-5271-4dda-bcf4-147a2f14832a\") " pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx"
Jul 15 21:02:46.642270 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.642244    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95389d21-5271-4dda-bcf4-147a2f14832a-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-7dmjx\" (UID: \"95389d21-5271-4dda-bcf4-147a2f14832a\") " pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx"
Jul 15 21:02:46.642387 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.642352    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/95389d21-5271-4dda-bcf4-147a2f14832a-tmp\") pod \"insights-operator-68d9dd94cf-7dmjx\" (UID: \"95389d21-5271-4dda-bcf4-147a2f14832a\") " pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx"
Jul 15 21:02:46.642451 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.642436    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/95389d21-5271-4dda-bcf4-147a2f14832a-snapshots\") pod \"insights-operator-68d9dd94cf-7dmjx\" (UID: \"95389d21-5271-4dda-bcf4-147a2f14832a\") " pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx"
Jul 15 21:02:46.642506 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.642490    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95389d21-5271-4dda-bcf4-147a2f14832a-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-7dmjx\" (UID: \"95389d21-5271-4dda-bcf4-147a2f14832a\") " pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx"
Jul 15 21:02:46.644626 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.644605    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/95389d21-5271-4dda-bcf4-147a2f14832a-serving-cert\") pod \"insights-operator-68d9dd94cf-7dmjx\" (UID: \"95389d21-5271-4dda-bcf4-147a2f14832a\") " pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx"
Jul 15 21:02:46.651132 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.651106    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4ddv\" (UniqueName: \"kubernetes.io/projected/95389d21-5271-4dda-bcf4-147a2f14832a-kube-api-access-k4ddv\") pod \"insights-operator-68d9dd94cf-7dmjx\" (UID: \"95389d21-5271-4dda-bcf4-147a2f14832a\") " pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx"
Jul 15 21:02:46.684987 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.684955    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx"
Jul 15 21:02:46.840996 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.840962    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-7dmjx"]
Jul 15 21:02:46.844291 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.844265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-metrics-certs\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:02:46.844694 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:46.844416    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 21:02:46.844694 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.844445    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c3324df-13f7-41ea-9145-aee63d6bc31c-service-ca-bundle\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:02:46.844694 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:46.844497    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-metrics-certs podName:0c3324df-13f7-41ea-9145-aee63d6bc31c nodeName:}" failed. No retries permitted until 2026-07-15 21:02:47.844473849 +0000 UTC m=+69.272433480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-metrics-certs") pod "router-default-74d5dc7b48-vx9t7" (UID: "0c3324df-13f7-41ea-9145-aee63d6bc31c") : secret "router-metrics-certs-default" not found
Jul 15 21:02:46.844694 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:46.844544    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95680620-6e1c-4356-b790-949697705f91-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vwjr6\" (UID: \"95680620-6e1c-4356-b790-949697705f91\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6"
Jul 15 21:02:46.844694 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:46.844594    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c3324df-13f7-41ea-9145-aee63d6bc31c-service-ca-bundle podName:0c3324df-13f7-41ea-9145-aee63d6bc31c nodeName:}" failed. No retries permitted until 2026-07-15 21:02:47.844577322 +0000 UTC m=+69.272536943 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0c3324df-13f7-41ea-9145-aee63d6bc31c-service-ca-bundle") pod "router-default-74d5dc7b48-vx9t7" (UID: "0c3324df-13f7-41ea-9145-aee63d6bc31c") : configmap references non-existent config key: service-ca.crt
Jul 15 21:02:46.844694 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:46.844636    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 21:02:46.844694 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:46.844673    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95680620-6e1c-4356-b790-949697705f91-cluster-monitoring-operator-tls podName:95680620-6e1c-4356-b790-949697705f91 nodeName:}" failed. No retries permitted until 2026-07-15 21:02:47.84466106 +0000 UTC m=+69.272620690 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95680620-6e1c-4356-b790-949697705f91-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-vwjr6" (UID: "95680620-6e1c-4356-b790-949697705f91") : secret "cluster-monitoring-operator-tls" not found
Jul 15 21:02:46.847764 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:02:46.847739    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95389d21_5271_4dda_bcf4_147a2f14832a.slice/crio-d1ef72a8e2c2113f376264618b9724c5a3d307929b598aabbb507f40a20c44f2 WatchSource:0}: Error finding container d1ef72a8e2c2113f376264618b9724c5a3d307929b598aabbb507f40a20c44f2: Status 404 returned error can't find the container with id d1ef72a8e2c2113f376264618b9724c5a3d307929b598aabbb507f40a20c44f2
Jul 15 21:02:47.380422 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:47.380376    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx" event={"ID":"95389d21-5271-4dda-bcf4-147a2f14832a","Type":"ContainerStarted","Data":"d1ef72a8e2c2113f376264618b9724c5a3d307929b598aabbb507f40a20c44f2"}
Jul 15 21:02:47.381786 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:47.381735    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kl8w7" event={"ID":"9a87abc1-b350-47cc-8e22-3e947ede13ea","Type":"ContainerStarted","Data":"84fb7618f820e17e0e5a81517e6b9b2a6584c8a62b3bb40dab9295741c88d110"}
Jul 15 21:02:47.852987 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:47.852941    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c3324df-13f7-41ea-9145-aee63d6bc31c-service-ca-bundle\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:02:47.853149 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:47.853009    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95680620-6e1c-4356-b790-949697705f91-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vwjr6\" (UID: \"95680620-6e1c-4356-b790-949697705f91\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6"
Jul 15 21:02:47.853149 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:47.853062    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-metrics-certs\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:02:47.853276 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:47.853158    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c3324df-13f7-41ea-9145-aee63d6bc31c-service-ca-bundle podName:0c3324df-13f7-41ea-9145-aee63d6bc31c nodeName:}" failed. No retries permitted until 2026-07-15 21:02:49.853135791 +0000 UTC m=+71.281095406 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0c3324df-13f7-41ea-9145-aee63d6bc31c-service-ca-bundle") pod "router-default-74d5dc7b48-vx9t7" (UID: "0c3324df-13f7-41ea-9145-aee63d6bc31c") : configmap references non-existent config key: service-ca.crt
Jul 15 21:02:47.853276 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:47.853177    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 21:02:47.853276 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:47.853180    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 21:02:47.853276 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:47.853240    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95680620-6e1c-4356-b790-949697705f91-cluster-monitoring-operator-tls podName:95680620-6e1c-4356-b790-949697705f91 nodeName:}" failed. No retries permitted until 2026-07-15 21:02:49.853223997 +0000 UTC m=+71.281183637 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95680620-6e1c-4356-b790-949697705f91-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-vwjr6" (UID: "95680620-6e1c-4356-b790-949697705f91") : secret "cluster-monitoring-operator-tls" not found
Jul 15 21:02:47.853276 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:47.853266    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-metrics-certs podName:0c3324df-13f7-41ea-9145-aee63d6bc31c nodeName:}" failed. No retries permitted until 2026-07-15 21:02:49.853250094 +0000 UTC m=+71.281209732 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-metrics-certs") pod "router-default-74d5dc7b48-vx9t7" (UID: "0c3324df-13f7-41ea-9145-aee63d6bc31c") : secret "router-metrics-certs-default" not found
Jul 15 21:02:49.869574 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:49.869527    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-metrics-certs\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:02:49.870015 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:49.869607    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c3324df-13f7-41ea-9145-aee63d6bc31c-service-ca-bundle\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:02:49.870015 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:49.869643    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95680620-6e1c-4356-b790-949697705f91-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vwjr6\" (UID: \"95680620-6e1c-4356-b790-949697705f91\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6"
Jul 15 21:02:49.870015 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:49.869706    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 21:02:49.870015 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:49.869731    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 21:02:49.870015 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:49.869782    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95680620-6e1c-4356-b790-949697705f91-cluster-monitoring-operator-tls podName:95680620-6e1c-4356-b790-949697705f91 nodeName:}" failed. No retries permitted until 2026-07-15 21:02:53.869767918 +0000 UTC m=+75.297727533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95680620-6e1c-4356-b790-949697705f91-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-vwjr6" (UID: "95680620-6e1c-4356-b790-949697705f91") : secret "cluster-monitoring-operator-tls" not found
Jul 15 21:02:49.870015 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:49.869796    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-metrics-certs podName:0c3324df-13f7-41ea-9145-aee63d6bc31c nodeName:}" failed. No retries permitted until 2026-07-15 21:02:53.869789564 +0000 UTC m=+75.297749179 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-metrics-certs") pod "router-default-74d5dc7b48-vx9t7" (UID: "0c3324df-13f7-41ea-9145-aee63d6bc31c") : secret "router-metrics-certs-default" not found
Jul 15 21:02:49.870015 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:49.869806    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c3324df-13f7-41ea-9145-aee63d6bc31c-service-ca-bundle podName:0c3324df-13f7-41ea-9145-aee63d6bc31c nodeName:}" failed. No retries permitted until 2026-07-15 21:02:53.869801456 +0000 UTC m=+75.297761071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0c3324df-13f7-41ea-9145-aee63d6bc31c-service-ca-bundle") pod "router-default-74d5dc7b48-vx9t7" (UID: "0c3324df-13f7-41ea-9145-aee63d6bc31c") : configmap references non-existent config key: service-ca.crt
Jul 15 21:02:51.395401 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:51.395303    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx" event={"ID":"95389d21-5271-4dda-bcf4-147a2f14832a","Type":"ContainerStarted","Data":"056fb279f366cb4dc181d9f43a9f3075bab5c72ce73a352d14b6bb4da8903cf9"}
Jul 15 21:02:51.397011 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:51.396987    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jdds4" event={"ID":"76c132a0-854b-44a6-87bf-a4f07da94fba","Type":"ContainerStarted","Data":"b5f65cc5e12dd6712c271ae7b30aec435a27c5691a5b179d2bdc18a69af39054"}
Jul 15 21:02:51.397138 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:51.397038    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:02:51.400775 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:51.400742    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kl8w7" event={"ID":"9a87abc1-b350-47cc-8e22-3e947ede13ea","Type":"ContainerStarted","Data":"a26a5ac1308410c0825169d0314ee81d9d977db32245043d5c9f2ceb362cdd86"}
Jul 15 21:02:51.402137 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:51.402115    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bctvr" event={"ID":"1a69c601-b5b2-4177-8781-16090abbd7f6","Type":"ContainerStarted","Data":"397ba49c5b2f75548f76630938e9516c1e8254b669821396ab1fd84b52cd189f"}
Jul 15 21:02:51.418036 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:51.417966    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx" podStartSLOduration=1.328948774 podStartE2EDuration="5.417944961s" totalImagesPullingTime="4.088996187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:02:51.417902055 +0000 UTC m=+72.845861692" watchObservedRunningTime="2026-07-15 21:02:51.417944961 +0000 UTC m=+72.845904600"
Jul 15 21:02:51.438250 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:51.438190    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bctvr" podStartSLOduration=66.033601367 podStartE2EDuration="1m11.438168683s" totalImagesPullingTime="5.404567316s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:02:51.437402429 +0000 UTC m=+72.865362068" watchObservedRunningTime="2026-07-15 21:02:51.438168683 +0000 UTC m=+72.866128325"
Jul 15 21:02:51.459751 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:51.459693    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-kl8w7" podStartSLOduration=1.1053001 podStartE2EDuration="5.459671048s" totalImagesPullingTime="4.354370948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:02:51.458496544 +0000 UTC m=+72.886456182" watchObservedRunningTime="2026-07-15 21:02:51.459671048 +0000 UTC m=+72.887630686"
Jul 15 21:02:51.486463 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:51.486414    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jdds4" podStartSLOduration=66.066034164 podStartE2EDuration="1m11.486390094s" totalImagesPullingTime="5.42035593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:02:51.486378249 +0000 UTC m=+72.914337889" watchObservedRunningTime="2026-07-15 21:02:51.486390094 +0000 UTC m=+72.914349774"
Jul 15 21:02:52.177544 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:52.177509    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-v9sgz"]
Jul 15 21:02:52.181180 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:52.181157    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:02:52.185384 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:52.185146    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 21:02:52.185384 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:52.185385    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 21:02:52.185680 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:52.185659    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-s5tt8\""
Jul 15 21:02:52.199101 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:52.199075    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v9sgz"]
Jul 15 21:02:52.290889 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:52.290851    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-data-volume\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:02:52.290889 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:52.290884    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hth5x\" (UniqueName: \"kubernetes.io/projected/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-kube-api-access-hth5x\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:02:52.291083 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:52.290921    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:02:52.291083 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:52.291011    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:02:52.291083 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:52.291028    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-crio-socket\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:02:52.392238 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:52.392196    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-data-volume\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:02:52.392238 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:52.392240    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hth5x\" (UniqueName: \"kubernetes.io/projected/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-kube-api-access-hth5x\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:02:52.392447 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:52.392309    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:02:52.392447 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:52.392404    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:02:52.392447 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:52.392428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-crio-socket\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:02:52.392551 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:52.392470    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 21:02:52.392551 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:52.392527    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-insights-runtime-extractor-tls podName:b3fa2ce3-fc47-44d8-b72e-228967dfde6d nodeName:}" failed. No retries permitted until 2026-07-15 21:02:52.89251251 +0000 UTC m=+74.320472143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v9sgz" (UID: "b3fa2ce3-fc47-44d8-b72e-228967dfde6d") : secret "insights-runtime-extractor-tls" not found
Jul 15 21:02:52.392551 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:52.392527    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-crio-socket\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:02:52.392666 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:52.392552    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 21:02:52.392666 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:52.392617    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-kube-rbac-proxy-cm podName:b3fa2ce3-fc47-44d8-b72e-228967dfde6d nodeName:}" failed. No retries permitted until 2026-07-15 21:02:52.892603763 +0000 UTC m=+74.320563391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v9sgz" (UID: "b3fa2ce3-fc47-44d8-b72e-228967dfde6d") : configmap "kube-rbac-proxy" not found
Jul 15 21:02:52.392831 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:52.392810    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-data-volume\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:02:52.400608 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:52.400586    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hth5x\" (UniqueName: \"kubernetes.io/projected/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-kube-api-access-hth5x\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:02:52.895853 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:52.895796    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:02:52.896164 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:52.895959    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 21:02:52.896164 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:52.895994    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:02:52.896164 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:52.896037    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-insights-runtime-extractor-tls podName:b3fa2ce3-fc47-44d8-b72e-228967dfde6d nodeName:}" failed. No retries permitted until 2026-07-15 21:02:53.896020806 +0000 UTC m=+75.323980421 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v9sgz" (UID: "b3fa2ce3-fc47-44d8-b72e-228967dfde6d") : secret "insights-runtime-extractor-tls" not found
Jul 15 21:02:52.896164 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:52.896059    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 21:02:52.896164 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:52.896127    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-kube-rbac-proxy-cm podName:b3fa2ce3-fc47-44d8-b72e-228967dfde6d nodeName:}" failed. No retries permitted until 2026-07-15 21:02:53.896116146 +0000 UTC m=+75.324075789 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v9sgz" (UID: "b3fa2ce3-fc47-44d8-b72e-228967dfde6d") : configmap "kube-rbac-proxy" not found
Jul 15 21:02:53.905054 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:53.905013    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c3324df-13f7-41ea-9145-aee63d6bc31c-service-ca-bundle\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:02:53.905054 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:53.905055    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:02:53.905479 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:53.905086    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95680620-6e1c-4356-b790-949697705f91-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vwjr6\" (UID: \"95680620-6e1c-4356-b790-949697705f91\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6"
Jul 15 21:02:53.905479 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:53.905145    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-metrics-certs\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:02:53.905479 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:53.905174    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:02:53.905479 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:53.905185    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0c3324df-13f7-41ea-9145-aee63d6bc31c-service-ca-bundle podName:0c3324df-13f7-41ea-9145-aee63d6bc31c nodeName:}" failed. No retries permitted until 2026-07-15 21:03:01.905168527 +0000 UTC m=+83.333128143 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/0c3324df-13f7-41ea-9145-aee63d6bc31c-service-ca-bundle") pod "router-default-74d5dc7b48-vx9t7" (UID: "0c3324df-13f7-41ea-9145-aee63d6bc31c") : configmap references non-existent config key: service-ca.crt
Jul 15 21:02:53.905479 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:53.905199    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 21:02:53.905479 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:53.905220    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 21:02:53.905479 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:53.905263    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 21:02:53.905479 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:53.905272    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 21:02:53.905479 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:53.905279    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-kube-rbac-proxy-cm podName:b3fa2ce3-fc47-44d8-b72e-228967dfde6d nodeName:}" failed. No retries permitted until 2026-07-15 21:02:55.905267993 +0000 UTC m=+77.333227612 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v9sgz" (UID: "b3fa2ce3-fc47-44d8-b72e-228967dfde6d") : configmap "kube-rbac-proxy" not found
Jul 15 21:02:53.905479 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:53.905333    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-insights-runtime-extractor-tls podName:b3fa2ce3-fc47-44d8-b72e-228967dfde6d nodeName:}" failed. No retries permitted until 2026-07-15 21:02:55.905319966 +0000 UTC m=+77.333279590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v9sgz" (UID: "b3fa2ce3-fc47-44d8-b72e-228967dfde6d") : secret "insights-runtime-extractor-tls" not found
Jul 15 21:02:53.905479 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:53.905344    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95680620-6e1c-4356-b790-949697705f91-cluster-monitoring-operator-tls podName:95680620-6e1c-4356-b790-949697705f91 nodeName:}" failed. No retries permitted until 2026-07-15 21:03:01.905338362 +0000 UTC m=+83.333297976 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95680620-6e1c-4356-b790-949697705f91-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-vwjr6" (UID: "95680620-6e1c-4356-b790-949697705f91") : secret "cluster-monitoring-operator-tls" not found
Jul 15 21:02:53.905479 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:53.905356    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-metrics-certs podName:0c3324df-13f7-41ea-9145-aee63d6bc31c nodeName:}" failed. No retries permitted until 2026-07-15 21:03:01.905350072 +0000 UTC m=+83.333309686 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-metrics-certs") pod "router-default-74d5dc7b48-vx9t7" (UID: "0c3324df-13f7-41ea-9145-aee63d6bc31c") : secret "router-metrics-certs-default" not found
Jul 15 21:02:54.375438 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:54.375411    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pj9tk_1a806e68-abc4-414a-96ac-843e728e77b9/dns-node-resolver/0.log"
Jul 15 21:02:54.977684 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:54.977657    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9hqht_3f3f398c-10c8-43f7-ba9f-1049f774d568/node-ca/0.log"
Jul 15 21:02:55.922519 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:55.922482    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:02:55.922718 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:55.922599    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:02:55.922718 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:55.922642    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 21:02:55.922718 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:55.922699    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 21:02:55.922718 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:55.922713    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-insights-runtime-extractor-tls podName:b3fa2ce3-fc47-44d8-b72e-228967dfde6d nodeName:}" failed. No retries permitted until 2026-07-15 21:02:59.922698443 +0000 UTC m=+81.350658087 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v9sgz" (UID: "b3fa2ce3-fc47-44d8-b72e-228967dfde6d") : secret "insights-runtime-extractor-tls" not found
Jul 15 21:02:55.922967 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:55.922750    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-kube-rbac-proxy-cm podName:b3fa2ce3-fc47-44d8-b72e-228967dfde6d nodeName:}" failed. No retries permitted until 2026-07-15 21:02:59.922735913 +0000 UTC m=+81.350695550 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v9sgz" (UID: "b3fa2ce3-fc47-44d8-b72e-228967dfde6d") : configmap "kube-rbac-proxy" not found
Jul 15 21:02:55.992194 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:55.992167    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dlmz6_8bce08f0-aff4-4d40-ab8d-7b9223412b0b/serve-healthcheck-canary/0.log"
Jul 15 21:02:59.956926 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:59.956872    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:02:59.957367 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:02:59.956968    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:02:59.957367 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:59.956978    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 21:02:59.957367 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:59.957035    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-kube-rbac-proxy-cm podName:b3fa2ce3-fc47-44d8-b72e-228967dfde6d nodeName:}" failed. No retries permitted until 2026-07-15 21:03:07.957021598 +0000 UTC m=+89.384981234 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-v9sgz" (UID: "b3fa2ce3-fc47-44d8-b72e-228967dfde6d") : configmap "kube-rbac-proxy" not found
Jul 15 21:02:59.957367 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:59.957111    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 21:02:59.957367 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:02:59.957165    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-insights-runtime-extractor-tls podName:b3fa2ce3-fc47-44d8-b72e-228967dfde6d nodeName:}" failed. No retries permitted until 2026-07-15 21:03:07.957150767 +0000 UTC m=+89.385110395 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-v9sgz" (UID: "b3fa2ce3-fc47-44d8-b72e-228967dfde6d") : secret "insights-runtime-extractor-tls" not found
Jul 15 21:03:01.971038 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:01.970922    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-metrics-certs\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:03:01.971038 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:01.970985    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c3324df-13f7-41ea-9145-aee63d6bc31c-service-ca-bundle\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:03:01.971038 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:01.971017    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95680620-6e1c-4356-b790-949697705f91-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vwjr6\" (UID: \"95680620-6e1c-4356-b790-949697705f91\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6"
Jul 15 21:03:01.971650 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:03:01.971099    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 21:03:01.971650 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:03:01.971152    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95680620-6e1c-4356-b790-949697705f91-cluster-monitoring-operator-tls podName:95680620-6e1c-4356-b790-949697705f91 nodeName:}" failed. No retries permitted until 2026-07-15 21:03:17.971139083 +0000 UTC m=+99.399098711 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/95680620-6e1c-4356-b790-949697705f91-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-vwjr6" (UID: "95680620-6e1c-4356-b790-949697705f91") : secret "cluster-monitoring-operator-tls" not found
Jul 15 21:03:01.971722 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:01.971696    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c3324df-13f7-41ea-9145-aee63d6bc31c-service-ca-bundle\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:03:01.973385 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:01.973353    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c3324df-13f7-41ea-9145-aee63d6bc31c-metrics-certs\") pod \"router-default-74d5dc7b48-vx9t7\" (UID: \"0c3324df-13f7-41ea-9145-aee63d6bc31c\") " pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:03:02.087084 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:02.087049    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:03:02.215425 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:02.215360    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-74d5dc7b48-vx9t7"]
Jul 15 21:03:02.218925 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:03:02.218900    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c3324df_13f7_41ea_9145_aee63d6bc31c.slice/crio-7de51e78fa8613e703c797bcd0fb0fd438d69f802d19fc7d376667f9cffbbfaa WatchSource:0}: Error finding container 7de51e78fa8613e703c797bcd0fb0fd438d69f802d19fc7d376667f9cffbbfaa: Status 404 returned error can't find the container with id 7de51e78fa8613e703c797bcd0fb0fd438d69f802d19fc7d376667f9cffbbfaa
Jul 15 21:03:02.436218 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:02.436174    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-74d5dc7b48-vx9t7" event={"ID":"0c3324df-13f7-41ea-9145-aee63d6bc31c","Type":"ContainerStarted","Data":"468e380cbfe2becef6cd62a98218ad3ca71c54f0cb3f92e1f119b2a6a32cb243"}
Jul 15 21:03:02.436393 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:02.436228    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-74d5dc7b48-vx9t7" event={"ID":"0c3324df-13f7-41ea-9145-aee63d6bc31c","Type":"ContainerStarted","Data":"7de51e78fa8613e703c797bcd0fb0fd438d69f802d19fc7d376667f9cffbbfaa"}
Jul 15 21:03:02.456404 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:02.456355    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-74d5dc7b48-vx9t7" podStartSLOduration=16.456339065 podStartE2EDuration="16.456339065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:02:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:03:02.456275526 +0000 UTC m=+83.884235157" watchObservedRunningTime="2026-07-15 21:03:02.456339065 +0000 UTC m=+83.884298728"
Jul 15 21:03:03.087800 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:03.087772    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:03:03.090145 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:03.090124    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:03:03.439446 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:03.439416    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:03:03.440664 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:03.440645    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-74d5dc7b48-vx9t7"
Jul 15 21:03:08.012948 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:08.012914    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:03:08.013352 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:08.012964    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:03:08.013545 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:08.013526    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:03:08.015320 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:08.015298    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b3fa2ce3-fc47-44d8-b72e-228967dfde6d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-v9sgz\" (UID: \"b3fa2ce3-fc47-44d8-b72e-228967dfde6d\") " pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:03:08.094607 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:08.094562    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-v9sgz"
Jul 15 21:03:08.226233 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:08.226199    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-v9sgz"]
Jul 15 21:03:08.229396 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:03:08.229356    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3fa2ce3_fc47_44d8_b72e_228967dfde6d.slice/crio-9b70e6c3cbd311057372fb521eb5d61c81ca8316605e3fb1bc97be51118c7cf4 WatchSource:0}: Error finding container 9b70e6c3cbd311057372fb521eb5d61c81ca8316605e3fb1bc97be51118c7cf4: Status 404 returned error can't find the container with id 9b70e6c3cbd311057372fb521eb5d61c81ca8316605e3fb1bc97be51118c7cf4
Jul 15 21:03:08.456187 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:08.456150    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v9sgz" event={"ID":"b3fa2ce3-fc47-44d8-b72e-228967dfde6d","Type":"ContainerStarted","Data":"9b70e6c3cbd311057372fb521eb5d61c81ca8316605e3fb1bc97be51118c7cf4"}
Jul 15 21:03:13.474431 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:13.474395    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v9sgz" event={"ID":"b3fa2ce3-fc47-44d8-b72e-228967dfde6d","Type":"ContainerStarted","Data":"e9e3647315ba3f58d888231835cfeb9a6124f799dd9a6fddacafd4291b1deefd"}
Jul 15 21:03:16.703578 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:16.703542    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd64bf4dd-svgv8"]
Jul 15 21:03:16.706655 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:16.706635    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd64bf4dd-svgv8"
Jul 15 21:03:16.710999 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:16.710978    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-5pnsb\""
Jul 15 21:03:16.711084 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:16.711022    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 15 21:03:16.712190 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:16.712170    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 15 21:03:16.713053 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:16.713033    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 15 21:03:16.713144 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:16.713037    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 15 21:03:16.742672 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:16.742638    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd64bf4dd-svgv8"]
Jul 15 21:03:16.780088 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:16.780053    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79bbccda-7502-4892-8417-861afd313041-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5fd64bf4dd-svgv8\" (UID: \"79bbccda-7502-4892-8417-861afd313041\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd64bf4dd-svgv8"
Jul 15 21:03:16.780250 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:16.780098    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfw8q\" (UniqueName: \"kubernetes.io/projected/79bbccda-7502-4892-8417-861afd313041-kube-api-access-tfw8q\") pod \"managed-serviceaccount-addon-agent-5fd64bf4dd-svgv8\" (UID: \"79bbccda-7502-4892-8417-861afd313041\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd64bf4dd-svgv8"
Jul 15 21:03:16.881593 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:16.881497    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79bbccda-7502-4892-8417-861afd313041-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5fd64bf4dd-svgv8\" (UID: \"79bbccda-7502-4892-8417-861afd313041\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd64bf4dd-svgv8"
Jul 15 21:03:16.881593 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:16.881543    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfw8q\" (UniqueName: \"kubernetes.io/projected/79bbccda-7502-4892-8417-861afd313041-kube-api-access-tfw8q\") pod \"managed-serviceaccount-addon-agent-5fd64bf4dd-svgv8\" (UID: \"79bbccda-7502-4892-8417-861afd313041\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd64bf4dd-svgv8"
Jul 15 21:03:16.884002 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:16.883978    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/79bbccda-7502-4892-8417-861afd313041-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5fd64bf4dd-svgv8\" (UID: \"79bbccda-7502-4892-8417-861afd313041\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd64bf4dd-svgv8"
Jul 15 21:03:16.909291 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:16.909262    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfw8q\" (UniqueName: \"kubernetes.io/projected/79bbccda-7502-4892-8417-861afd313041-kube-api-access-tfw8q\") pod \"managed-serviceaccount-addon-agent-5fd64bf4dd-svgv8\" (UID: \"79bbccda-7502-4892-8417-861afd313041\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd64bf4dd-svgv8"
Jul 15 21:03:17.023194 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:17.023161    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd64bf4dd-svgv8"
Jul 15 21:03:17.203830 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:17.203807    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd64bf4dd-svgv8"]
Jul 15 21:03:17.205794 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:03:17.205770    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod79bbccda_7502_4892_8417_861afd313041.slice/crio-8ad0dae3cf6398af683dc864b657f6e0fb1dce193f907a3762cda42771904871 WatchSource:0}: Error finding container 8ad0dae3cf6398af683dc864b657f6e0fb1dce193f907a3762cda42771904871: Status 404 returned error can't find the container with id 8ad0dae3cf6398af683dc864b657f6e0fb1dce193f907a3762cda42771904871
Jul 15 21:03:17.489422 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:17.489331    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v9sgz" event={"ID":"b3fa2ce3-fc47-44d8-b72e-228967dfde6d","Type":"ContainerStarted","Data":"4c90f96a0eb07ac13cec9b2dd8ac73ad5f23f240540002ae5f91bfb828d944eb"}
Jul 15 21:03:17.490617 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:17.490591    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd64bf4dd-svgv8" event={"ID":"79bbccda-7502-4892-8417-861afd313041","Type":"ContainerStarted","Data":"8ad0dae3cf6398af683dc864b657f6e0fb1dce193f907a3762cda42771904871"}
Jul 15 21:03:17.991341 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:17.991299    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95680620-6e1c-4356-b790-949697705f91-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vwjr6\" (UID: \"95680620-6e1c-4356-b790-949697705f91\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6"
Jul 15 21:03:17.997754 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:17.997724    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/95680620-6e1c-4356-b790-949697705f91-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-vwjr6\" (UID: \"95680620-6e1c-4356-b790-949697705f91\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6"
Jul 15 21:03:18.280155 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:18.280077    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6"
Jul 15 21:03:18.294039 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:18.293580    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls\") pod \"dns-default-f7694\" (UID: \"d1fb00d7-6201-4dfb-b60f-9364a0230149\") " pod="openshift-dns/dns-default-f7694"
Jul 15 21:03:18.297349 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:18.297299    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d1fb00d7-6201-4dfb-b60f-9364a0230149-metrics-tls\") pod \"dns-default-f7694\" (UID: \"d1fb00d7-6201-4dfb-b60f-9364a0230149\") " pod="openshift-dns/dns-default-f7694"
Jul 15 21:03:18.327785 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:18.327584    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p4nfw\""
Jul 15 21:03:18.336223 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:18.335924    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f7694"
Jul 15 21:03:18.470797 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:18.470736    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6"]
Jul 15 21:03:18.476459 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:03:18.476428    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95680620_6e1c_4356_b790_949697705f91.slice/crio-6c2817dab1c2b6626ec03a02e81dc944f5b932dabd5c0fe6f68ecf0dd8e56ae9 WatchSource:0}: Error finding container 6c2817dab1c2b6626ec03a02e81dc944f5b932dabd5c0fe6f68ecf0dd8e56ae9: Status 404 returned error can't find the container with id 6c2817dab1c2b6626ec03a02e81dc944f5b932dabd5c0fe6f68ecf0dd8e56ae9
Jul 15 21:03:18.499386 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:18.499354    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6" event={"ID":"95680620-6e1c-4356-b790-949697705f91","Type":"ContainerStarted","Data":"6c2817dab1c2b6626ec03a02e81dc944f5b932dabd5c0fe6f68ecf0dd8e56ae9"}
Jul 15 21:03:18.547401 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:18.547320    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f7694"]
Jul 15 21:03:20.221971 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:03:20.221931    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1fb00d7_6201_4dfb_b60f_9364a0230149.slice/crio-db1dd6371ab8f059f8383a298e1814cdf6790a6eea4a44aa0b304e2188b7f3af WatchSource:0}: Error finding container db1dd6371ab8f059f8383a298e1814cdf6790a6eea4a44aa0b304e2188b7f3af: Status 404 returned error can't find the container with id db1dd6371ab8f059f8383a298e1814cdf6790a6eea4a44aa0b304e2188b7f3af
Jul 15 21:03:20.507978 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:20.507891    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f7694" event={"ID":"d1fb00d7-6201-4dfb-b60f-9364a0230149","Type":"ContainerStarted","Data":"db1dd6371ab8f059f8383a298e1814cdf6790a6eea4a44aa0b304e2188b7f3af"}
Jul 15 21:03:21.515500 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:21.515267    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-v9sgz" event={"ID":"b3fa2ce3-fc47-44d8-b72e-228967dfde6d","Type":"ContainerStarted","Data":"b18cc7b2ff06c4735cb4150e45434239bb75a322813c5e96c4acb605854e843c"}
Jul 15 21:03:21.518523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:21.518485    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd64bf4dd-svgv8" event={"ID":"79bbccda-7502-4892-8417-861afd313041","Type":"ContainerStarted","Data":"1178fda07bc4286c1ab452fd285b8e8efbbf469a35884e0d9b7e0754bc10986d"}
Jul 15 21:03:21.541917 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:21.541808    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-v9sgz" podStartSLOduration=16.595739299 podStartE2EDuration="29.541787972s" totalImagesPullingTime="12.946048673s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:02:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:03:21.541545129 +0000 UTC m=+102.969504767" watchObservedRunningTime="2026-07-15 21:03:21.541787972 +0000 UTC m=+102.969747609"
Jul 15 21:03:21.562259 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:21.562188    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd64bf4dd-svgv8" podStartSLOduration=1.419706309 podStartE2EDuration="5.562165813s" totalImagesPullingTime="4.142459504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:03:21.56178584 +0000 UTC m=+102.989745477" watchObservedRunningTime="2026-07-15 21:03:21.562165813 +0000 UTC m=+102.990125451"
Jul 15 21:03:22.408616 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:22.408589    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jdds4"
Jul 15 21:03:23.530573 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:23.530497    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f7694" event={"ID":"d1fb00d7-6201-4dfb-b60f-9364a0230149","Type":"ContainerStarted","Data":"387c1acfcadf2105cb9ed1dc17854d4a1b982830085dc316109907770c04f071"}
Jul 15 21:03:23.532431 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:23.532383    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6" event={"ID":"95680620-6e1c-4356-b790-949697705f91","Type":"ContainerStarted","Data":"c0348895fe71930221b39f70233c9ab507d7c9bd9475ae65296717a40372e60e"}
Jul 15 21:03:23.560629 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:23.560578    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-vwjr6" podStartSLOduration=32.720147775 podStartE2EDuration="37.560561872s" totalImagesPullingTime="4.840414097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:02:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:03:23.560404599 +0000 UTC m=+104.988364240" watchObservedRunningTime="2026-07-15 21:03:23.560561872 +0000 UTC m=+104.988521509"
Jul 15 21:03:23.946887 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:23.946823    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f225"]
Jul 15 21:03:23.969516 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:23.969481    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f225"]
Jul 15 21:03:23.969646 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:23.969576    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f225"
Jul 15 21:03:23.971725 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:23.971702    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 15 21:03:23.972048 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:23.972031    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-z4wrv\""
Jul 15 21:03:24.041025 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:24.040987    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bb3c0559-7c33-4c2e-80db-64c85ce44dbb-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-9f225\" (UID: \"bb3c0559-7c33-4c2e-80db-64c85ce44dbb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f225"
Jul 15 21:03:24.141784 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:24.141745    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bb3c0559-7c33-4c2e-80db-64c85ce44dbb-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-9f225\" (UID: \"bb3c0559-7c33-4c2e-80db-64c85ce44dbb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f225"
Jul 15 21:03:24.144173 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:24.144149    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bb3c0559-7c33-4c2e-80db-64c85ce44dbb-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-9f225\" (UID: \"bb3c0559-7c33-4c2e-80db-64c85ce44dbb\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f225"
Jul 15 21:03:24.279019 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:24.278930    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f225"
Jul 15 21:03:24.425893 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:24.425861    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f225"]
Jul 15 21:03:24.428947 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:03:24.428920    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb3c0559_7c33_4c2e_80db_64c85ce44dbb.slice/crio-1bf54206cc912e91a2c8624aa3ee48f05150e2bdc0ab943dffc90ab68aaa5abd WatchSource:0}: Error finding container 1bf54206cc912e91a2c8624aa3ee48f05150e2bdc0ab943dffc90ab68aaa5abd: Status 404 returned error can't find the container with id 1bf54206cc912e91a2c8624aa3ee48f05150e2bdc0ab943dffc90ab68aaa5abd
Jul 15 21:03:24.536757 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:24.536666    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f225" event={"ID":"bb3c0559-7c33-4c2e-80db-64c85ce44dbb","Type":"ContainerStarted","Data":"1bf54206cc912e91a2c8624aa3ee48f05150e2bdc0ab943dffc90ab68aaa5abd"}
Jul 15 21:03:24.538298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:24.538270    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f7694" event={"ID":"d1fb00d7-6201-4dfb-b60f-9364a0230149","Type":"ContainerStarted","Data":"227639c3ce173365bb84b574598de7e50b31b96a91fba6b2806339ffc90b50d7"}
Jul 15 21:03:24.557910 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:24.557868    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-f7694" podStartSLOduration=67.457270808 podStartE2EDuration="1m10.557851682s" totalImagesPullingTime="3.100580874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:02:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:03:24.55694677 +0000 UTC m=+105.984906425" watchObservedRunningTime="2026-07-15 21:03:24.557851682 +0000 UTC m=+105.985811310"
Jul 15 21:03:25.541593 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:25.541556    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f7694"
Jul 15 21:03:26.546695 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:26.546653    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f225" event={"ID":"bb3c0559-7c33-4c2e-80db-64c85ce44dbb","Type":"ContainerStarted","Data":"dc356d98a7979c35347225002d4444fc7791a87368d505864b7bee2d103ca469"}
Jul 15 21:03:26.547163 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:26.546880    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f225"
Jul 15 21:03:26.551746 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:26.551726    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f225"
Jul 15 21:03:26.564417 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:26.564375    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-9f225" podStartSLOduration=1.871791174 podStartE2EDuration="3.56436312s" totalImagesPullingTime="1.692571946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:03:26.562734499 +0000 UTC m=+107.990694138" watchObservedRunningTime="2026-07-15 21:03:26.56436312 +0000 UTC m=+107.992322756"
Jul 15 21:03:26.998359 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:26.998324    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-m4gz8"]
Jul 15 21:03:27.000750 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:27.000734    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-m4gz8"
Jul 15 21:03:27.003618 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:27.003589    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 15 21:03:27.004109 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:27.004090    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 15 21:03:27.004220 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:27.004112    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 21:03:27.004220 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:27.004092    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-b5nsw\""
Jul 15 21:03:27.018409 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:27.018379    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-m4gz8"]
Jul 15 21:03:27.065180 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:27.065145    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85d654e3-d853-4286-afc1-415e945349a9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-m4gz8\" (UID: \"85d654e3-d853-4286-afc1-415e945349a9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m4gz8"
Jul 15 21:03:27.065351 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:27.065201    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85d654e3-d853-4286-afc1-415e945349a9-metrics-client-ca\") pod \"prometheus-operator-64785b6675-m4gz8\" (UID: \"85d654e3-d853-4286-afc1-415e945349a9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m4gz8"
Jul 15 21:03:27.065351 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:27.065222    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/85d654e3-d853-4286-afc1-415e945349a9-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-m4gz8\" (UID: \"85d654e3-d853-4286-afc1-415e945349a9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m4gz8"
Jul 15 21:03:27.065351 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:27.065243    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fqrg\" (UniqueName: \"kubernetes.io/projected/85d654e3-d853-4286-afc1-415e945349a9-kube-api-access-6fqrg\") pod \"prometheus-operator-64785b6675-m4gz8\" (UID: \"85d654e3-d853-4286-afc1-415e945349a9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m4gz8"
Jul 15 21:03:27.165594 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:27.165554    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85d654e3-d853-4286-afc1-415e945349a9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-m4gz8\" (UID: \"85d654e3-d853-4286-afc1-415e945349a9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m4gz8"
Jul 15 21:03:27.165750 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:27.165615    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85d654e3-d853-4286-afc1-415e945349a9-metrics-client-ca\") pod \"prometheus-operator-64785b6675-m4gz8\" (UID: \"85d654e3-d853-4286-afc1-415e945349a9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m4gz8"
Jul 15 21:03:27.165750 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:27.165632    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/85d654e3-d853-4286-afc1-415e945349a9-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-m4gz8\" (UID: \"85d654e3-d853-4286-afc1-415e945349a9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m4gz8"
Jul 15 21:03:27.165750 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:27.165654    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fqrg\" (UniqueName: \"kubernetes.io/projected/85d654e3-d853-4286-afc1-415e945349a9-kube-api-access-6fqrg\") pod \"prometheus-operator-64785b6675-m4gz8\" (UID: \"85d654e3-d853-4286-afc1-415e945349a9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m4gz8"
Jul 15 21:03:27.166410 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:27.166389    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85d654e3-d853-4286-afc1-415e945349a9-metrics-client-ca\") pod \"prometheus-operator-64785b6675-m4gz8\" (UID: \"85d654e3-d853-4286-afc1-415e945349a9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m4gz8"
Jul 15 21:03:27.168074 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:27.168045    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85d654e3-d853-4286-afc1-415e945349a9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-m4gz8\" (UID: \"85d654e3-d853-4286-afc1-415e945349a9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m4gz8"
Jul 15 21:03:27.168237 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:27.168217    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/85d654e3-d853-4286-afc1-415e945349a9-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-m4gz8\" (UID: \"85d654e3-d853-4286-afc1-415e945349a9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m4gz8"
Jul 15 21:03:27.175353 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:27.175329    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fqrg\" (UniqueName: \"kubernetes.io/projected/85d654e3-d853-4286-afc1-415e945349a9-kube-api-access-6fqrg\") pod \"prometheus-operator-64785b6675-m4gz8\" (UID: \"85d654e3-d853-4286-afc1-415e945349a9\") " pod="openshift-monitoring/prometheus-operator-64785b6675-m4gz8"
Jul 15 21:03:27.309757 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:27.309655    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-m4gz8"
Jul 15 21:03:27.432387 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:27.432359    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-m4gz8"]
Jul 15 21:03:27.435499 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:03:27.435476    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85d654e3_d853_4286_afc1_415e945349a9.slice/crio-1a73d7fc40f8ce3373704a2d1443b4b8f202623085efab3e7d551b75241b9dff WatchSource:0}: Error finding container 1a73d7fc40f8ce3373704a2d1443b4b8f202623085efab3e7d551b75241b9dff: Status 404 returned error can't find the container with id 1a73d7fc40f8ce3373704a2d1443b4b8f202623085efab3e7d551b75241b9dff
Jul 15 21:03:27.556060 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:27.556025    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-m4gz8" event={"ID":"85d654e3-d853-4286-afc1-415e945349a9","Type":"ContainerStarted","Data":"1a73d7fc40f8ce3373704a2d1443b4b8f202623085efab3e7d551b75241b9dff"}
Jul 15 21:03:29.563579 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:29.563538    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-m4gz8" event={"ID":"85d654e3-d853-4286-afc1-415e945349a9","Type":"ContainerStarted","Data":"8c1446d96156beb8d001544edfa9498e0668d4f16256217f820ab3ef497c06a6"}
Jul 15 21:03:29.564020 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:29.563591    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-m4gz8" event={"ID":"85d654e3-d853-4286-afc1-415e945349a9","Type":"ContainerStarted","Data":"7707bd144d1d0fc276864d0ad94cad5074bb8ce0604a3efe69fa6cdcf72a55e1"}
Jul 15 21:03:30.510747 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:30.510695    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-m4gz8" podStartSLOduration=3.290639623 podStartE2EDuration="4.51067581s" totalImagesPullingTime="1.220036187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:03:29.586599649 +0000 UTC m=+111.014559297" watchObservedRunningTime="2026-07-15 21:03:30.51067581 +0000 UTC m=+111.938635446"
Jul 15 21:03:30.510978 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:30.510910    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-zxqkh"]
Jul 15 21:03:30.514018 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:30.513997    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-zxqkh"
Jul 15 21:03:30.529119 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:30.529092    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 21:03:30.529588 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:30.529574    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 21:03:30.529703 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:30.529688    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-vk2qw\""
Jul 15 21:03:30.549761 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:30.549734    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-zxqkh"]
Jul 15 21:03:30.593298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:30.593265    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhhz6\" (UniqueName: \"kubernetes.io/projected/3098d13b-e3aa-49c7-9118-c70ba055523d-kube-api-access-vhhz6\") pod \"downloads-68c9cbb497-zxqkh\" (UID: \"3098d13b-e3aa-49c7-9118-c70ba055523d\") " pod="openshift-console/downloads-68c9cbb497-zxqkh"
Jul 15 21:03:30.694308 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:30.694268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhhz6\" (UniqueName: \"kubernetes.io/projected/3098d13b-e3aa-49c7-9118-c70ba055523d-kube-api-access-vhhz6\") pod \"downloads-68c9cbb497-zxqkh\" (UID: \"3098d13b-e3aa-49c7-9118-c70ba055523d\") " pod="openshift-console/downloads-68c9cbb497-zxqkh"
Jul 15 21:03:30.704965 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:30.704936    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhhz6\" (UniqueName: \"kubernetes.io/projected/3098d13b-e3aa-49c7-9118-c70ba055523d-kube-api-access-vhhz6\") pod \"downloads-68c9cbb497-zxqkh\" (UID: \"3098d13b-e3aa-49c7-9118-c70ba055523d\") " pod="openshift-console/downloads-68c9cbb497-zxqkh"
Jul 15 21:03:30.822240 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:30.822156    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-zxqkh"
Jul 15 21:03:30.956628 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:30.956596    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-zxqkh"]
Jul 15 21:03:30.959423 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:03:30.959396    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3098d13b_e3aa_49c7_9118_c70ba055523d.slice/crio-5878fcb476d777ea7baf17e8a1f0c4163538624a01ef80d6a045f6696173d5cf WatchSource:0}: Error finding container 5878fcb476d777ea7baf17e8a1f0c4163538624a01ef80d6a045f6696173d5cf: Status 404 returned error can't find the container with id 5878fcb476d777ea7baf17e8a1f0c4163538624a01ef80d6a045f6696173d5cf
Jul 15 21:03:31.416615 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.416576    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-4xx52"]
Jul 15 21:03:31.420130 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.420099    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4xx52"
Jul 15 21:03:31.426478 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.426438    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 15 21:03:31.426621 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.426551    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-v2ws2\""
Jul 15 21:03:31.426877 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.426860    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 15 21:03:31.446433 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.446404    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-4xx52"]
Jul 15 21:03:31.480421 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.480384    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-thv55"]
Jul 15 21:03:31.484092 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.484069    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.488195 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.488159    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 21:03:31.488195 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.488163    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lhkbt\""
Jul 15 21:03:31.488371 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.488216    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 21:03:31.488371 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.488173    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 21:03:31.502353 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.502323    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gg2l\" (UniqueName: \"kubernetes.io/projected/ccde4391-22cf-430f-a8b6-d919aeec3c96-kube-api-access-8gg2l\") pod \"openshift-state-metrics-84bd68b896-4xx52\" (UID: \"ccde4391-22cf-430f-a8b6-d919aeec3c96\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4xx52"
Jul 15 21:03:31.502530 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.502380    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccde4391-22cf-430f-a8b6-d919aeec3c96-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-4xx52\" (UID: \"ccde4391-22cf-430f-a8b6-d919aeec3c96\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4xx52"
Jul 15 21:03:31.502530 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.502422    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccde4391-22cf-430f-a8b6-d919aeec3c96-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-4xx52\" (UID: \"ccde4391-22cf-430f-a8b6-d919aeec3c96\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4xx52"
Jul 15 21:03:31.502530 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.502500    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccde4391-22cf-430f-a8b6-d919aeec3c96-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-4xx52\" (UID: \"ccde4391-22cf-430f-a8b6-d919aeec3c96\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4xx52"
Jul 15 21:03:31.574478 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.574432    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-zxqkh" event={"ID":"3098d13b-e3aa-49c7-9118-c70ba055523d","Type":"ContainerStarted","Data":"5878fcb476d777ea7baf17e8a1f0c4163538624a01ef80d6a045f6696173d5cf"}
Jul 15 21:03:31.603512 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.603473    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58533952-e1cd-482a-919c-be6f0d5440d2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.603983 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.603521    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58533952-e1cd-482a-919c-be6f0d5440d2-sys\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.603983 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.603547    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58533952-e1cd-482a-919c-be6f0d5440d2-node-exporter-textfile\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.603983 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.603585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58533952-e1cd-482a-919c-be6f0d5440d2-node-exporter-accelerators-collector-config\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.603983 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.603609    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58533952-e1cd-482a-919c-be6f0d5440d2-root\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.603983 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.603706    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58533952-e1cd-482a-919c-be6f0d5440d2-node-exporter-tls\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.603983 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.603753    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccde4391-22cf-430f-a8b6-d919aeec3c96-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-4xx52\" (UID: \"ccde4391-22cf-430f-a8b6-d919aeec3c96\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4xx52"
Jul 15 21:03:31.603983 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.603774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gg2l\" (UniqueName: \"kubernetes.io/projected/ccde4391-22cf-430f-a8b6-d919aeec3c96-kube-api-access-8gg2l\") pod \"openshift-state-metrics-84bd68b896-4xx52\" (UID: \"ccde4391-22cf-430f-a8b6-d919aeec3c96\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4xx52"
Jul 15 21:03:31.603983 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.603799    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58533952-e1cd-482a-919c-be6f0d5440d2-node-exporter-wtmp\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.603983 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.603818    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc4gx\" (UniqueName: \"kubernetes.io/projected/58533952-e1cd-482a-919c-be6f0d5440d2-kube-api-access-qc4gx\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.603983 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.603882    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccde4391-22cf-430f-a8b6-d919aeec3c96-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-4xx52\" (UID: \"ccde4391-22cf-430f-a8b6-d919aeec3c96\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4xx52"
Jul 15 21:03:31.603983 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.603935    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58533952-e1cd-482a-919c-be6f0d5440d2-metrics-client-ca\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.603983 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.603984    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccde4391-22cf-430f-a8b6-d919aeec3c96-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-4xx52\" (UID: \"ccde4391-22cf-430f-a8b6-d919aeec3c96\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4xx52"
Jul 15 21:03:31.604678 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.604631    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccde4391-22cf-430f-a8b6-d919aeec3c96-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-4xx52\" (UID: \"ccde4391-22cf-430f-a8b6-d919aeec3c96\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4xx52"
Jul 15 21:03:31.606446 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.606425    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccde4391-22cf-430f-a8b6-d919aeec3c96-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-4xx52\" (UID: \"ccde4391-22cf-430f-a8b6-d919aeec3c96\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4xx52"
Jul 15 21:03:31.606762 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.606741    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccde4391-22cf-430f-a8b6-d919aeec3c96-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-4xx52\" (UID: \"ccde4391-22cf-430f-a8b6-d919aeec3c96\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4xx52"
Jul 15 21:03:31.621894 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.621859    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gg2l\" (UniqueName: \"kubernetes.io/projected/ccde4391-22cf-430f-a8b6-d919aeec3c96-kube-api-access-8gg2l\") pod \"openshift-state-metrics-84bd68b896-4xx52\" (UID: \"ccde4391-22cf-430f-a8b6-d919aeec3c96\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4xx52"
Jul 15 21:03:31.704777 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.704735    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58533952-e1cd-482a-919c-be6f0d5440d2-sys\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.704988 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.704789    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58533952-e1cd-482a-919c-be6f0d5440d2-node-exporter-textfile\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.704988 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.704833    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58533952-e1cd-482a-919c-be6f0d5440d2-node-exporter-accelerators-collector-config\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.704988 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.704876    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58533952-e1cd-482a-919c-be6f0d5440d2-root\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.704988 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.704873    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/58533952-e1cd-482a-919c-be6f0d5440d2-sys\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.704988 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.704914    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58533952-e1cd-482a-919c-be6f0d5440d2-node-exporter-tls\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.704988 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.704951    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58533952-e1cd-482a-919c-be6f0d5440d2-node-exporter-wtmp\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.704988 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.704975    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc4gx\" (UniqueName: \"kubernetes.io/projected/58533952-e1cd-482a-919c-be6f0d5440d2-kube-api-access-qc4gx\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.705319 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.705022    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58533952-e1cd-482a-919c-be6f0d5440d2-metrics-client-ca\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.705319 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.705030    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/58533952-e1cd-482a-919c-be6f0d5440d2-root\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.705319 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.705065    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58533952-e1cd-482a-919c-be6f0d5440d2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.705319 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.705206    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/58533952-e1cd-482a-919c-be6f0d5440d2-node-exporter-wtmp\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.705552 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.705524    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/58533952-e1cd-482a-919c-be6f0d5440d2-node-exporter-textfile\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.705552 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.705534    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/58533952-e1cd-482a-919c-be6f0d5440d2-node-exporter-accelerators-collector-config\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.705891 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.705862    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/58533952-e1cd-482a-919c-be6f0d5440d2-metrics-client-ca\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.707711 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.707691    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/58533952-e1cd-482a-919c-be6f0d5440d2-node-exporter-tls\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.707901 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.707877    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/58533952-e1cd-482a-919c-be6f0d5440d2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.722211 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.722150    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc4gx\" (UniqueName: \"kubernetes.io/projected/58533952-e1cd-482a-919c-be6f0d5440d2-kube-api-access-qc4gx\") pod \"node-exporter-thv55\" (UID: \"58533952-e1cd-482a-919c-be6f0d5440d2\") " pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.732017 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.731988    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4xx52"
Jul 15 21:03:31.796206 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.796154    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-thv55"
Jul 15 21:03:31.808236 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:03:31.808202    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58533952_e1cd_482a_919c_be6f0d5440d2.slice/crio-bcb073d5331c5cb15b2a5cd105f6cf8733d468216d451b7fa744bd6ee7669111 WatchSource:0}: Error finding container bcb073d5331c5cb15b2a5cd105f6cf8733d468216d451b7fa744bd6ee7669111: Status 404 returned error can't find the container with id bcb073d5331c5cb15b2a5cd105f6cf8733d468216d451b7fa744bd6ee7669111
Jul 15 21:03:31.878126 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:31.877896    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-4xx52"]
Jul 15 21:03:31.880606 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:03:31.880577    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccde4391_22cf_430f_a8b6_d919aeec3c96.slice/crio-ddf740b98620ae6813d92eb4ddb78ce684565e364621040739b5462d8a8a4d67 WatchSource:0}: Error finding container ddf740b98620ae6813d92eb4ddb78ce684565e364621040739b5462d8a8a4d67: Status 404 returned error can't find the container with id ddf740b98620ae6813d92eb4ddb78ce684565e364621040739b5462d8a8a4d67
Jul 15 21:03:32.514343 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.514313    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 21:03:32.518163 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.518140    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.520857 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.520814    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qp5mp\""
Jul 15 21:03:32.521210 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.521105    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 15 21:03:32.521210 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.521187    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 15 21:03:32.521546 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.521529    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 15 21:03:32.522730 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.521875    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 15 21:03:32.522730 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.522140    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 15 21:03:32.522730 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.522170    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 15 21:03:32.522730 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.522342    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 15 21:03:32.522730 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.522545    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 15 21:03:32.522730 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.522551    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 15 21:03:32.542279 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.542250    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 21:03:32.581094 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.581051    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-thv55" event={"ID":"58533952-e1cd-482a-919c-be6f0d5440d2","Type":"ContainerStarted","Data":"bcb073d5331c5cb15b2a5cd105f6cf8733d468216d451b7fa744bd6ee7669111"}
Jul 15 21:03:32.583737 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.583603    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4xx52" event={"ID":"ccde4391-22cf-430f-a8b6-d919aeec3c96","Type":"ContainerStarted","Data":"22bc6b7905e5145f8e57b14ed6b505ebc925633acfcb2d5a2ef53dd0035e2055"}
Jul 15 21:03:32.583737 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.583670    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4xx52" event={"ID":"ccde4391-22cf-430f-a8b6-d919aeec3c96","Type":"ContainerStarted","Data":"08f8311b5a13a610ddddce446407d0956164136f0ca88d8e8916935bd1044832"}
Jul 15 21:03:32.583737 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.583698    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4xx52" event={"ID":"ccde4391-22cf-430f-a8b6-d919aeec3c96","Type":"ContainerStarted","Data":"ddf740b98620ae6813d92eb4ddb78ce684565e364621040739b5462d8a8a4d67"}
Jul 15 21:03:32.612685 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.612646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.613190 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.612697    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-config-volume\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.613190 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.612723    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.613190 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.612779    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63e53be7-c48c-46bf-bacd-8a71a213e50e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.613190 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.612892    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63e53be7-c48c-46bf-bacd-8a71a213e50e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.613190 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.613130    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.613190 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.613172    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qkpz\" (UniqueName: \"kubernetes.io/projected/63e53be7-c48c-46bf-bacd-8a71a213e50e-kube-api-access-9qkpz\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.613462 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.613219    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63e53be7-c48c-46bf-bacd-8a71a213e50e-config-out\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.613462 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.613270    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-web-config\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.613462 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.613315    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63e53be7-c48c-46bf-bacd-8a71a213e50e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.613462 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.613366    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.613462 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.613442    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63e53be7-c48c-46bf-bacd-8a71a213e50e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.613646 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.613511    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.714928 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.714883    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63e53be7-c48c-46bf-bacd-8a71a213e50e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.715105 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.714939    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.715105 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.714969    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qkpz\" (UniqueName: \"kubernetes.io/projected/63e53be7-c48c-46bf-bacd-8a71a213e50e-kube-api-access-9qkpz\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.715105 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.715007    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63e53be7-c48c-46bf-bacd-8a71a213e50e-config-out\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.715105 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.715031    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-web-config\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.715105 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.715053    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63e53be7-c48c-46bf-bacd-8a71a213e50e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.715105 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.715077    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.715105 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.715105    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63e53be7-c48c-46bf-bacd-8a71a213e50e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.715403 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.715167    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.715403 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.715203    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.715403 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.715236    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-config-volume\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.715403 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.715268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.715403 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.715313    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63e53be7-c48c-46bf-bacd-8a71a213e50e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.715812 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.715788    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63e53be7-c48c-46bf-bacd-8a71a213e50e-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.716138 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.716118    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63e53be7-c48c-46bf-bacd-8a71a213e50e-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.719727 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.719697    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.722069 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.722044    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63e53be7-c48c-46bf-bacd-8a71a213e50e-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.727376 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.727317    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.727496 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.727443    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.728129 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.728038    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qkpz\" (UniqueName: \"kubernetes.io/projected/63e53be7-c48c-46bf-bacd-8a71a213e50e-kube-api-access-9qkpz\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.735362 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.735307    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63e53be7-c48c-46bf-bacd-8a71a213e50e-config-out\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.735866 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.735501    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-web-config\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.735866 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.735520    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-config-volume\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.735866 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.735589    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.735866 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.735813    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63e53be7-c48c-46bf-bacd-8a71a213e50e-tls-assets\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.748217 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.748163    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:32.835802 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:32.835662    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:03:33.022368 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:33.022290    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 21:03:33.231820 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:03:33.231776    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63e53be7_c48c_46bf_bacd_8a71a213e50e.slice/crio-dc142eb38632f9d1eebe13a2c9c118bdfc6e472fe3224d103dddb4b50c8528ce WatchSource:0}: Error finding container dc142eb38632f9d1eebe13a2c9c118bdfc6e472fe3224d103dddb4b50c8528ce: Status 404 returned error can't find the container with id dc142eb38632f9d1eebe13a2c9c118bdfc6e472fe3224d103dddb4b50c8528ce
Jul 15 21:03:33.592968 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:33.592869    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63e53be7-c48c-46bf-bacd-8a71a213e50e","Type":"ContainerStarted","Data":"dc142eb38632f9d1eebe13a2c9c118bdfc6e472fe3224d103dddb4b50c8528ce"}
Jul 15 21:03:33.594707 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:33.594678    2580 generic.go:356] "Generic (PLEG): container finished" podID="58533952-e1cd-482a-919c-be6f0d5440d2" containerID="4f1318658237cccaa57327bcf248ec0ea542270017941fef1804d79a1ca8e90a" exitCode=0
Jul 15 21:03:33.594893 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:33.594761    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-thv55" event={"ID":"58533952-e1cd-482a-919c-be6f0d5440d2","Type":"ContainerDied","Data":"4f1318658237cccaa57327bcf248ec0ea542270017941fef1804d79a1ca8e90a"}
Jul 15 21:03:33.597262 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:33.597227    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4xx52" event={"ID":"ccde4391-22cf-430f-a8b6-d919aeec3c96","Type":"ContainerStarted","Data":"c291952b578e35af0941a2b5fe387e01379ba9a13b4e1b8ebf6d122ce1dd7165"}
Jul 15 21:03:33.636907 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:33.636823    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4xx52" podStartSLOduration=1.386430155 podStartE2EDuration="2.636800424s" totalImagesPullingTime="1.250370269s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:03:33.635265804 +0000 UTC m=+115.063225442" watchObservedRunningTime="2026-07-15 21:03:33.636800424 +0000 UTC m=+115.064760064"
Jul 15 21:03:34.605104 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:34.605061    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-thv55" event={"ID":"58533952-e1cd-482a-919c-be6f0d5440d2","Type":"ContainerStarted","Data":"9683a57696a645026109b3079aae9644adc0e37d68251426e634c73d4ed931b2"}
Jul 15 21:03:34.605291 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:34.605120    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-thv55" event={"ID":"58533952-e1cd-482a-919c-be6f0d5440d2","Type":"ContainerStarted","Data":"5ca607c3876b8ec2c64fe8e7ef8d9f5b8cae6929d06060c32cc1aceb5ef2419e"}
Jul 15 21:03:34.634022 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:34.633957    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-thv55" podStartSLOduration=2.465842273 podStartE2EDuration="3.633940228s" totalImagesPullingTime="1.09236539s" totalInitContainerRuntime="75.732565ms" isStatefulPod=true podCreationTimestamp="2026-07-15 21:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:03:34.633628851 +0000 UTC m=+116.061588487" watchObservedRunningTime="2026-07-15 21:03:34.633940228 +0000 UTC m=+116.061899865"
Jul 15 21:03:35.549298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:35.549266    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f7694"
Jul 15 21:03:35.611186 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:35.611143    2580 generic.go:356] "Generic (PLEG): container finished" podID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerID="732c007ea2c551d19fbe49a7464f681e962db514688af362d81f7c789838e3b8" exitCode=0
Jul 15 21:03:35.611366 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:35.611236    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63e53be7-c48c-46bf-bacd-8a71a213e50e","Type":"ContainerDied","Data":"732c007ea2c551d19fbe49a7464f681e962db514688af362d81f7c789838e3b8"}
Jul 15 21:03:36.186824 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:36.186228    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-5pl7s"]
Jul 15 21:03:36.193326 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:36.193299    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5pl7s"
Jul 15 21:03:36.196221 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:36.196096    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-kflkc\""
Jul 15 21:03:36.196754 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:36.196290    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 15 21:03:36.198941 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:36.198885    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-5pl7s"]
Jul 15 21:03:36.250738 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:36.250685    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlrvj\" (UniqueName: \"kubernetes.io/projected/4cf114db-5f8f-41c1-8b84-3ea18ec8b69d-kube-api-access-qlrvj\") pod \"monitoring-plugin-5f68df7f58-5pl7s\" (UID: \"4cf114db-5f8f-41c1-8b84-3ea18ec8b69d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5pl7s"
Jul 15 21:03:36.250951 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:36.250797    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4cf114db-5f8f-41c1-8b84-3ea18ec8b69d-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-5pl7s\" (UID: \"4cf114db-5f8f-41c1-8b84-3ea18ec8b69d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5pl7s"
Jul 15 21:03:36.352304 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:36.352265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlrvj\" (UniqueName: \"kubernetes.io/projected/4cf114db-5f8f-41c1-8b84-3ea18ec8b69d-kube-api-access-qlrvj\") pod \"monitoring-plugin-5f68df7f58-5pl7s\" (UID: \"4cf114db-5f8f-41c1-8b84-3ea18ec8b69d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5pl7s"
Jul 15 21:03:36.352496 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:36.352328    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4cf114db-5f8f-41c1-8b84-3ea18ec8b69d-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-5pl7s\" (UID: \"4cf114db-5f8f-41c1-8b84-3ea18ec8b69d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5pl7s"
Jul 15 21:03:36.355102 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:36.355070    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4cf114db-5f8f-41c1-8b84-3ea18ec8b69d-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-5pl7s\" (UID: \"4cf114db-5f8f-41c1-8b84-3ea18ec8b69d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5pl7s"
Jul 15 21:03:36.364171 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:36.364144    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlrvj\" (UniqueName: \"kubernetes.io/projected/4cf114db-5f8f-41c1-8b84-3ea18ec8b69d-kube-api-access-qlrvj\") pod \"monitoring-plugin-5f68df7f58-5pl7s\" (UID: \"4cf114db-5f8f-41c1-8b84-3ea18ec8b69d\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5pl7s"
Jul 15 21:03:36.510590 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:36.510505    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5pl7s"
Jul 15 21:03:36.674041 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:36.674009    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-5pl7s"]
Jul 15 21:03:36.677033 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:03:36.676983    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cf114db_5f8f_41c1_8b84_3ea18ec8b69d.slice/crio-8e1beb9c89c43692a320b15ee53e2faeda2602fcfc629b133ce4067be645ac0d WatchSource:0}: Error finding container 8e1beb9c89c43692a320b15ee53e2faeda2602fcfc629b133ce4067be645ac0d: Status 404 returned error can't find the container with id 8e1beb9c89c43692a320b15ee53e2faeda2602fcfc629b133ce4067be645ac0d
Jul 15 21:03:37.631045 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.630868    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5pl7s" event={"ID":"4cf114db-5f8f-41c1-8b84-3ea18ec8b69d","Type":"ContainerStarted","Data":"8e1beb9c89c43692a320b15ee53e2faeda2602fcfc629b133ce4067be645ac0d"}
Jul 15 21:03:37.636297 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.636258    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63e53be7-c48c-46bf-bacd-8a71a213e50e","Type":"ContainerStarted","Data":"72053c9076a3d589452e23c57ce0edd9a242d99f7f7a8c80632bb52e9099fd63"}
Jul 15 21:03:37.636464 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.636336    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63e53be7-c48c-46bf-bacd-8a71a213e50e","Type":"ContainerStarted","Data":"2c5ba02a970a3809b28acaa15785af3b74f1b2cbbedaf5090e0175208d791dd7"}
Jul 15 21:03:37.636464 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.636375    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63e53be7-c48c-46bf-bacd-8a71a213e50e","Type":"ContainerStarted","Data":"32c6b955ce4ed64f12bfe1083dd96cbe1291146313c1692cbe5a8a68c738a042"}
Jul 15 21:03:37.636464 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.636411    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63e53be7-c48c-46bf-bacd-8a71a213e50e","Type":"ContainerStarted","Data":"e44110e0776884e56e5ba9808e5bedd358900162b392bcfc65a4e23e1605ad0e"}
Jul 15 21:03:37.636464 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.636448    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63e53be7-c48c-46bf-bacd-8a71a213e50e","Type":"ContainerStarted","Data":"d5a193642d45b4c602cfd56100e367de32fcfd9440fdeabbe6a59a61c172c06e"}
Jul 15 21:03:37.835004 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.832691    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 21:03:37.837547 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.837517    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:37.841263 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.841227    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 15 21:03:37.842258 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.841537    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 15 21:03:37.842258 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.841561    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 15 21:03:37.842258 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.841567    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 15 21:03:37.842258 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.841744    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 15 21:03:37.844034 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.843294    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8hvxc\""
Jul 15 21:03:37.847136 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.847086    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 15 21:03:37.847474 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.847406    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 15 21:03:37.847562 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.847472    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 15 21:03:37.847562 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.847549    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 15 21:03:37.847669 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.847414    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 15 21:03:37.847669 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.847474    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 15 21:03:37.847784 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.847766    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 15 21:03:37.848510 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.848491    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 15 21:03:37.848702 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.848683    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 15 21:03:37.848929 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.848903    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-apu0vlcmnnjan\""
Jul 15 21:03:37.849780 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.849731    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 15 21:03:37.864970 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.864938    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 21:03:37.971194 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.971158    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:37.971382 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.971212    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:37.971382 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.971240    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:37.971382 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.971342    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86z89\" (UniqueName: \"kubernetes.io/projected/d93acbc9-cf78-423d-a792-80c793429053-kube-api-access-86z89\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:37.971536 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.971387    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:37.971536 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.971419    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d93acbc9-cf78-423d-a792-80c793429053-config-out\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:37.971536 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.971443    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:37.971536 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.971495    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:37.971734 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.971537    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:37.971734 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.971581    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:37.971734 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.971649    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-config\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:37.971734 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.971687    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:37.971734 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.971714    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:37.972004 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.971738    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:37.972004 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.971808    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:37.972004 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.971834    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d93acbc9-cf78-423d-a792-80c793429053-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:37.972004 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.971872    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-web-config\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:37.972004 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.971908    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:37.972004 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.971932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:37.972279 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:37.971957    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.074525 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.074483    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86z89\" (UniqueName: \"kubernetes.io/projected/d93acbc9-cf78-423d-a792-80c793429053-kube-api-access-86z89\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.074710 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.074534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.074710 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.074563    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d93acbc9-cf78-423d-a792-80c793429053-config-out\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.074710 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.074587    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.074710 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.074613    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.074710 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.074644    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.074710 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.074673    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.075048 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.074716    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-config\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.075048 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.074756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.075048 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.074784    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.075048 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.074806    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.075048 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.074862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.075048 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.074888    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d93acbc9-cf78-423d-a792-80c793429053-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.075048 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.074908    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-web-config\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.075048 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.074938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.075048 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.074963    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.075048 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.074990    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.075048 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.075047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.078034 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.075078    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.078034 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.075105    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.078034 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.075877    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.078034 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.075969    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.078034 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.076698    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.078034 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.076822    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.078034 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.077018    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.082867 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.081965    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.082867 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.082011    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-config\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.082867 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.082049    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d93acbc9-cf78-423d-a792-80c793429053-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.082867 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.082643    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.082867 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.082725    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.082867 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.082793    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d93acbc9-cf78-423d-a792-80c793429053-config-out\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.082867 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.082817    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.084392 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.083883    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.084392 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.084255    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-web-config\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.084577 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.084483    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.085261 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.085209    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.086318 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.086279    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.086505 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.086475    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86z89\" (UniqueName: \"kubernetes.io/projected/d93acbc9-cf78-423d-a792-80c793429053-kube-api-access-86z89\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.086911 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.086870    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.088208 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.088184    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.152106 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.152002    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:03:38.514298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.514132    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 21:03:38.517490 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:03:38.517461    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd93acbc9_cf78_423d_a792_80c793429053.slice/crio-d5e972be52f9cf0e3c46970577e16a14aad5d681e2fad7bbb3b014fede06a722 WatchSource:0}: Error finding container d5e972be52f9cf0e3c46970577e16a14aad5d681e2fad7bbb3b014fede06a722: Status 404 returned error can't find the container with id d5e972be52f9cf0e3c46970577e16a14aad5d681e2fad7bbb3b014fede06a722
Jul 15 21:03:38.643643 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.643366    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5pl7s" event={"ID":"4cf114db-5f8f-41c1-8b84-3ea18ec8b69d","Type":"ContainerStarted","Data":"6188479a7c75c703c3b36e5af73c82ec8671b3e1251cd3d82e7fbe0dbf83def7"}
Jul 15 21:03:38.643643 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.643569    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5pl7s"
Jul 15 21:03:38.645578 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.645546    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d93acbc9-cf78-423d-a792-80c793429053","Type":"ContainerStarted","Data":"31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53"}
Jul 15 21:03:38.645716 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.645618    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d93acbc9-cf78-423d-a792-80c793429053","Type":"ContainerStarted","Data":"d5e972be52f9cf0e3c46970577e16a14aad5d681e2fad7bbb3b014fede06a722"}
Jul 15 21:03:38.650410 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.650386    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5pl7s"
Jul 15 21:03:38.662762 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:38.662334    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-5pl7s" podStartSLOduration=0.936968165 podStartE2EDuration="2.662315442s" totalImagesPullingTime="1.725347277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:03:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:03:38.65924168 +0000 UTC m=+120.087201319" watchObservedRunningTime="2026-07-15 21:03:38.662315442 +0000 UTC m=+120.090275080"
Jul 15 21:03:39.651868 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:39.651812    2580 generic.go:356] "Generic (PLEG): container finished" podID="d93acbc9-cf78-423d-a792-80c793429053" containerID="31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53" exitCode=0
Jul 15 21:03:39.652302 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:39.651884    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d93acbc9-cf78-423d-a792-80c793429053","Type":"ContainerDied","Data":"31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53"}
Jul 15 21:03:39.656337 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:39.656306    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63e53be7-c48c-46bf-bacd-8a71a213e50e","Type":"ContainerStarted","Data":"72deebf077c022f4f9fedf90f129da34634a698120a474269a4d402f5c4e04dc"}
Jul 15 21:03:39.730517 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:39.730440    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.098855691 podStartE2EDuration="7.730425089s" totalImagesPullingTime="4.613461343s" totalInitContainerRuntime="18.108055ms" isStatefulPod=false podCreationTimestamp="2026-07-15 21:03:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:03:39.730169544 +0000 UTC m=+121.158129192" watchObservedRunningTime="2026-07-15 21:03:39.730425089 +0000 UTC m=+121.158384725"
Jul 15 21:03:48.884762 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:48.884710    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs\") pod \"network-metrics-daemon-gxj8k\" (UID: \"8ca7d5c9-37f4-444b-9e21-7659e695968a\") " pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:03:48.887280 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:48.887250    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8ca7d5c9-37f4-444b-9e21-7659e695968a-metrics-certs\") pod \"network-metrics-daemon-gxj8k\" (UID: \"8ca7d5c9-37f4-444b-9e21-7659e695968a\") " pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:03:48.971669 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:48.971638    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rwswm\""
Jul 15 21:03:48.980285 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:48.980259    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gxj8k"
Jul 15 21:03:50.353426 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:50.353334    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gxj8k"]
Jul 15 21:03:50.356225 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:03:50.356195    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ca7d5c9_37f4_444b_9e21_7659e695968a.slice/crio-972ba2a65f03213a52d31fc76775f4b8508903c100b382bd069fcb7072790911 WatchSource:0}: Error finding container 972ba2a65f03213a52d31fc76775f4b8508903c100b382bd069fcb7072790911: Status 404 returned error can't find the container with id 972ba2a65f03213a52d31fc76775f4b8508903c100b382bd069fcb7072790911
Jul 15 21:03:50.706618 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:50.706583    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gxj8k" event={"ID":"8ca7d5c9-37f4-444b-9e21-7659e695968a","Type":"ContainerStarted","Data":"972ba2a65f03213a52d31fc76775f4b8508903c100b382bd069fcb7072790911"}
Jul 15 21:03:50.708511 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:50.708487    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-zxqkh" event={"ID":"3098d13b-e3aa-49c7-9118-c70ba055523d","Type":"ContainerStarted","Data":"2479d3051e989fc423182d93e857b4cb0e8e9f00d691e552410d9b7b9bf00a1d"}
Jul 15 21:03:50.708971 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:50.708827    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-zxqkh"
Jul 15 21:03:50.711277 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:50.711258    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d93acbc9-cf78-423d-a792-80c793429053","Type":"ContainerStarted","Data":"98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73"}
Jul 15 21:03:50.711369 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:50.711309    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d93acbc9-cf78-423d-a792-80c793429053","Type":"ContainerStarted","Data":"b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be"}
Jul 15 21:03:50.721789 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:50.721763    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-zxqkh"
Jul 15 21:03:50.729120 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:50.729071    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-zxqkh" podStartSLOduration=1.460097808 podStartE2EDuration="20.729059243s" totalImagesPullingTime="19.268961435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:03:50.727204151 +0000 UTC m=+132.155163787" watchObservedRunningTime="2026-07-15 21:03:50.729059243 +0000 UTC m=+132.157018880"
Jul 15 21:03:52.723363 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:52.723326    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gxj8k" event={"ID":"8ca7d5c9-37f4-444b-9e21-7659e695968a","Type":"ContainerStarted","Data":"bf914f7172f4694f5a07bc8a433a53d3a5ad0d5ddac865331af0bcae4bc27478"}
Jul 15 21:03:52.723785 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:52.723387    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gxj8k" event={"ID":"8ca7d5c9-37f4-444b-9e21-7659e695968a","Type":"ContainerStarted","Data":"df2c41510438301248480fa3b6fc4df2e57d8f091d6bf8557a2b3cbac19ecdcf"}
Jul 15 21:03:52.745391 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:52.745338    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gxj8k" podStartSLOduration=131.008927204 podStartE2EDuration="2m12.745316973s" totalImagesPullingTime="1.736389769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:03:52.743963363 +0000 UTC m=+134.171923001" watchObservedRunningTime="2026-07-15 21:03:52.745316973 +0000 UTC m=+134.173276611"
Jul 15 21:03:54.738951 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:54.738916    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d93acbc9-cf78-423d-a792-80c793429053","Type":"ContainerStarted","Data":"10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27"}
Jul 15 21:03:54.739455 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:54.739029    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d93acbc9-cf78-423d-a792-80c793429053","Type":"ContainerStarted","Data":"663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7"}
Jul 15 21:03:54.739455 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:54.739059    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d93acbc9-cf78-423d-a792-80c793429053","Type":"ContainerStarted","Data":"23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6"}
Jul 15 21:03:54.739455 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:54.739084    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d93acbc9-cf78-423d-a792-80c793429053","Type":"ContainerStarted","Data":"58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770"}
Jul 15 21:03:54.778604 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:54.778538    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.8459638529999998 podStartE2EDuration="17.778516404s" totalImagesPullingTime="13.909218063s" totalInitContainerRuntime="23.334488ms" isStatefulPod=false podCreationTimestamp="2026-07-15 21:03:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:03:54.775996159 +0000 UTC m=+136.203955822" watchObservedRunningTime="2026-07-15 21:03:54.778516404 +0000 UTC m=+136.206476044"
Jul 15 21:03:58.152495 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:03:58.152464    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:11.808936 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:11.808894    2580 generic.go:356] "Generic (PLEG): container finished" podID="95389d21-5271-4dda-bcf4-147a2f14832a" containerID="056fb279f366cb4dc181d9f43a9f3075bab5c72ce73a352d14b6bb4da8903cf9" exitCode=0
Jul 15 21:04:11.809425 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:11.808957    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx" event={"ID":"95389d21-5271-4dda-bcf4-147a2f14832a","Type":"ContainerDied","Data":"056fb279f366cb4dc181d9f43a9f3075bab5c72ce73a352d14b6bb4da8903cf9"}
Jul 15 21:04:11.809509 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:11.809431    2580 scope.go:117] "RemoveContainer" containerID="056fb279f366cb4dc181d9f43a9f3075bab5c72ce73a352d14b6bb4da8903cf9"
Jul 15 21:04:12.815133 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:12.815094    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-7dmjx" event={"ID":"95389d21-5271-4dda-bcf4-147a2f14832a","Type":"ContainerStarted","Data":"3cd883a394155d0bb983fa1d1b1a8127274a2b35c8c237e84ab485385cd3a964"}
Jul 15 21:04:38.153192 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:38.153096    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:38.168710 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:38.168688    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:38.936574 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:38.936538    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:51.848748 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:51.848710    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 21:04:51.849283 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:51.849026    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="alertmanager" containerID="cri-o://d5a193642d45b4c602cfd56100e367de32fcfd9440fdeabbe6a59a61c172c06e" gracePeriod=120
Jul 15 21:04:51.849283 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:51.849111    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="kube-rbac-proxy-web" containerID="cri-o://32c6b955ce4ed64f12bfe1083dd96cbe1291146313c1692cbe5a8a68c738a042" gracePeriod=120
Jul 15 21:04:51.849283 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:51.849155    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="prom-label-proxy" containerID="cri-o://72deebf077c022f4f9fedf90f129da34634a698120a474269a4d402f5c4e04dc" gracePeriod=120
Jul 15 21:04:51.849283 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:51.849148    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="config-reloader" containerID="cri-o://e44110e0776884e56e5ba9808e5bedd358900162b392bcfc65a4e23e1605ad0e" gracePeriod=120
Jul 15 21:04:51.849283 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:51.849175    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="kube-rbac-proxy" containerID="cri-o://2c5ba02a970a3809b28acaa15785af3b74f1b2cbbedaf5090e0175208d791dd7" gracePeriod=120
Jul 15 21:04:51.849283 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:51.849102    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="kube-rbac-proxy-metric" containerID="cri-o://72053c9076a3d589452e23c57ce0edd9a242d99f7f7a8c80632bb52e9099fd63" gracePeriod=120
Jul 15 21:04:51.975692 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:51.975661    2580 generic.go:356] "Generic (PLEG): container finished" podID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerID="72deebf077c022f4f9fedf90f129da34634a698120a474269a4d402f5c4e04dc" exitCode=0
Jul 15 21:04:51.975692 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:51.975683    2580 generic.go:356] "Generic (PLEG): container finished" podID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerID="2c5ba02a970a3809b28acaa15785af3b74f1b2cbbedaf5090e0175208d791dd7" exitCode=0
Jul 15 21:04:51.975692 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:51.975692    2580 generic.go:356] "Generic (PLEG): container finished" podID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerID="e44110e0776884e56e5ba9808e5bedd358900162b392bcfc65a4e23e1605ad0e" exitCode=0
Jul 15 21:04:51.975983 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:51.975701    2580 generic.go:356] "Generic (PLEG): container finished" podID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerID="d5a193642d45b4c602cfd56100e367de32fcfd9440fdeabbe6a59a61c172c06e" exitCode=0
Jul 15 21:04:51.975983 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:51.975734    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63e53be7-c48c-46bf-bacd-8a71a213e50e","Type":"ContainerDied","Data":"72deebf077c022f4f9fedf90f129da34634a698120a474269a4d402f5c4e04dc"}
Jul 15 21:04:51.975983 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:51.975817    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63e53be7-c48c-46bf-bacd-8a71a213e50e","Type":"ContainerDied","Data":"2c5ba02a970a3809b28acaa15785af3b74f1b2cbbedaf5090e0175208d791dd7"}
Jul 15 21:04:51.975983 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:51.975884    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63e53be7-c48c-46bf-bacd-8a71a213e50e","Type":"ContainerDied","Data":"e44110e0776884e56e5ba9808e5bedd358900162b392bcfc65a4e23e1605ad0e"}
Jul 15 21:04:51.975983 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:51.975929    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63e53be7-c48c-46bf-bacd-8a71a213e50e","Type":"ContainerDied","Data":"d5a193642d45b4c602cfd56100e367de32fcfd9440fdeabbe6a59a61c172c06e"}
Jul 15 21:04:52.983296 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:52.983261    2580 generic.go:356] "Generic (PLEG): container finished" podID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerID="72053c9076a3d589452e23c57ce0edd9a242d99f7f7a8c80632bb52e9099fd63" exitCode=0
Jul 15 21:04:52.983296 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:52.983287    2580 generic.go:356] "Generic (PLEG): container finished" podID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerID="32c6b955ce4ed64f12bfe1083dd96cbe1291146313c1692cbe5a8a68c738a042" exitCode=0
Jul 15 21:04:52.983679 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:52.983309    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63e53be7-c48c-46bf-bacd-8a71a213e50e","Type":"ContainerDied","Data":"72053c9076a3d589452e23c57ce0edd9a242d99f7f7a8c80632bb52e9099fd63"}
Jul 15 21:04:52.983679 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:52.983359    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63e53be7-c48c-46bf-bacd-8a71a213e50e","Type":"ContainerDied","Data":"32c6b955ce4ed64f12bfe1083dd96cbe1291146313c1692cbe5a8a68c738a042"}
Jul 15 21:04:53.089272 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.089248    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:53.148598 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.148564    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-main-tls\") pod \"63e53be7-c48c-46bf-bacd-8a71a213e50e\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") "
Jul 15 21:04:53.148598 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.148604    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-kube-rbac-proxy-web\") pod \"63e53be7-c48c-46bf-bacd-8a71a213e50e\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") "
Jul 15 21:04:53.148833 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.148637    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63e53be7-c48c-46bf-bacd-8a71a213e50e-metrics-client-ca\") pod \"63e53be7-c48c-46bf-bacd-8a71a213e50e\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") "
Jul 15 21:04:53.148833 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.148665    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63e53be7-c48c-46bf-bacd-8a71a213e50e-config-out\") pod \"63e53be7-c48c-46bf-bacd-8a71a213e50e\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") "
Jul 15 21:04:53.148833 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.148692    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-web-config\") pod \"63e53be7-c48c-46bf-bacd-8a71a213e50e\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") "
Jul 15 21:04:53.148833 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.148713    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-cluster-tls-config\") pod \"63e53be7-c48c-46bf-bacd-8a71a213e50e\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") "
Jul 15 21:04:53.148833 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.148743    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63e53be7-c48c-46bf-bacd-8a71a213e50e-alertmanager-trusted-ca-bundle\") pod \"63e53be7-c48c-46bf-bacd-8a71a213e50e\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") "
Jul 15 21:04:53.148833 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.148776    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-kube-rbac-proxy\") pod \"63e53be7-c48c-46bf-bacd-8a71a213e50e\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") "
Jul 15 21:04:53.148833 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.148826    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63e53be7-c48c-46bf-bacd-8a71a213e50e-alertmanager-main-db\") pod \"63e53be7-c48c-46bf-bacd-8a71a213e50e\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") "
Jul 15 21:04:53.149662 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.148874    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63e53be7-c48c-46bf-bacd-8a71a213e50e-tls-assets\") pod \"63e53be7-c48c-46bf-bacd-8a71a213e50e\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") "
Jul 15 21:04:53.149662 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.148923    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qkpz\" (UniqueName: \"kubernetes.io/projected/63e53be7-c48c-46bf-bacd-8a71a213e50e-kube-api-access-9qkpz\") pod \"63e53be7-c48c-46bf-bacd-8a71a213e50e\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") "
Jul 15 21:04:53.149662 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.148973    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-kube-rbac-proxy-metric\") pod \"63e53be7-c48c-46bf-bacd-8a71a213e50e\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") "
Jul 15 21:04:53.149662 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.149008    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-config-volume\") pod \"63e53be7-c48c-46bf-bacd-8a71a213e50e\" (UID: \"63e53be7-c48c-46bf-bacd-8a71a213e50e\") "
Jul 15 21:04:53.149662 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.149064    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63e53be7-c48c-46bf-bacd-8a71a213e50e-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "63e53be7-c48c-46bf-bacd-8a71a213e50e" (UID: "63e53be7-c48c-46bf-bacd-8a71a213e50e"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:04:53.149662 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.149311    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63e53be7-c48c-46bf-bacd-8a71a213e50e-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "63e53be7-c48c-46bf-bacd-8a71a213e50e" (UID: "63e53be7-c48c-46bf-bacd-8a71a213e50e"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:04:53.149662 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.149444    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63e53be7-c48c-46bf-bacd-8a71a213e50e-metrics-client-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:53.149662 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.149464    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/63e53be7-c48c-46bf-bacd-8a71a213e50e-alertmanager-main-db\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:53.150105 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.149903    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63e53be7-c48c-46bf-bacd-8a71a213e50e-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "63e53be7-c48c-46bf-bacd-8a71a213e50e" (UID: "63e53be7-c48c-46bf-bacd-8a71a213e50e"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:04:53.151751 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.151728    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-config-volume" (OuterVolumeSpecName: "config-volume") pod "63e53be7-c48c-46bf-bacd-8a71a213e50e" (UID: "63e53be7-c48c-46bf-bacd-8a71a213e50e"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:04:53.152278 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.152238    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "63e53be7-c48c-46bf-bacd-8a71a213e50e" (UID: "63e53be7-c48c-46bf-bacd-8a71a213e50e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:04:53.152606 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.152559    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63e53be7-c48c-46bf-bacd-8a71a213e50e-config-out" (OuterVolumeSpecName: "config-out") pod "63e53be7-c48c-46bf-bacd-8a71a213e50e" (UID: "63e53be7-c48c-46bf-bacd-8a71a213e50e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:04:53.152808 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.152771    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "63e53be7-c48c-46bf-bacd-8a71a213e50e" (UID: "63e53be7-c48c-46bf-bacd-8a71a213e50e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:04:53.153675 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.153639    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "63e53be7-c48c-46bf-bacd-8a71a213e50e" (UID: "63e53be7-c48c-46bf-bacd-8a71a213e50e"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:04:53.154927 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.154820    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63e53be7-c48c-46bf-bacd-8a71a213e50e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "63e53be7-c48c-46bf-bacd-8a71a213e50e" (UID: "63e53be7-c48c-46bf-bacd-8a71a213e50e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:04:53.155417 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.155380    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "63e53be7-c48c-46bf-bacd-8a71a213e50e" (UID: "63e53be7-c48c-46bf-bacd-8a71a213e50e"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:04:53.155617 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.155583    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63e53be7-c48c-46bf-bacd-8a71a213e50e-kube-api-access-9qkpz" (OuterVolumeSpecName: "kube-api-access-9qkpz") pod "63e53be7-c48c-46bf-bacd-8a71a213e50e" (UID: "63e53be7-c48c-46bf-bacd-8a71a213e50e"). InnerVolumeSpecName "kube-api-access-9qkpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:04:53.160356 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.160322    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "63e53be7-c48c-46bf-bacd-8a71a213e50e" (UID: "63e53be7-c48c-46bf-bacd-8a71a213e50e"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:04:53.168814 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.168777    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-web-config" (OuterVolumeSpecName: "web-config") pod "63e53be7-c48c-46bf-bacd-8a71a213e50e" (UID: "63e53be7-c48c-46bf-bacd-8a71a213e50e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:04:53.250765 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.250670    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/63e53be7-c48c-46bf-bacd-8a71a213e50e-tls-assets\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:53.250765 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.250707    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qkpz\" (UniqueName: \"kubernetes.io/projected/63e53be7-c48c-46bf-bacd-8a71a213e50e-kube-api-access-9qkpz\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:53.250765 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.250719    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:53.250765 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.250727    2580 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-config-volume\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:53.250765 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.250738    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-main-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:53.250765 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.250748    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:53.250765 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.250757    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/63e53be7-c48c-46bf-bacd-8a71a213e50e-config-out\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:53.250765 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.250767    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-web-config\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:53.250765 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.250775    2580 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-cluster-tls-config\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:53.251180 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.250783    2580 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/63e53be7-c48c-46bf-bacd-8a71a213e50e-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:53.251180 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.250792    2580 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63e53be7-c48c-46bf-bacd-8a71a213e50e-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:53.989808 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.989776    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"63e53be7-c48c-46bf-bacd-8a71a213e50e","Type":"ContainerDied","Data":"dc142eb38632f9d1eebe13a2c9c118bdfc6e472fe3224d103dddb4b50c8528ce"}
Jul 15 21:04:53.990201 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.989818    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:53.990201 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.989861    2580 scope.go:117] "RemoveContainer" containerID="72deebf077c022f4f9fedf90f129da34634a698120a474269a4d402f5c4e04dc"
Jul 15 21:04:53.999980 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:53.999440    2580 scope.go:117] "RemoveContainer" containerID="72053c9076a3d589452e23c57ce0edd9a242d99f7f7a8c80632bb52e9099fd63"
Jul 15 21:04:54.007656 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.007637    2580 scope.go:117] "RemoveContainer" containerID="2c5ba02a970a3809b28acaa15785af3b74f1b2cbbedaf5090e0175208d791dd7"
Jul 15 21:04:54.014603 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.014579    2580 scope.go:117] "RemoveContainer" containerID="32c6b955ce4ed64f12bfe1083dd96cbe1291146313c1692cbe5a8a68c738a042"
Jul 15 21:04:54.020023 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.020000    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 21:04:54.022160 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.022144    2580 scope.go:117] "RemoveContainer" containerID="e44110e0776884e56e5ba9808e5bedd358900162b392bcfc65a4e23e1605ad0e"
Jul 15 21:04:54.027543 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.027510    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 21:04:54.030075 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.030059    2580 scope.go:117] "RemoveContainer" containerID="d5a193642d45b4c602cfd56100e367de32fcfd9440fdeabbe6a59a61c172c06e"
Jul 15 21:04:54.037363 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.037344    2580 scope.go:117] "RemoveContainer" containerID="732c007ea2c551d19fbe49a7464f681e962db514688af362d81f7c789838e3b8"
Jul 15 21:04:54.058443 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.058415    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 21:04:54.058724 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.058713    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="prom-label-proxy"
Jul 15 21:04:54.058765 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.058727    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="prom-label-proxy"
Jul 15 21:04:54.058765 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.058738    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="init-config-reloader"
Jul 15 21:04:54.058765 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.058744    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="init-config-reloader"
Jul 15 21:04:54.058765 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.058749    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="config-reloader"
Jul 15 21:04:54.058765 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.058756    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="config-reloader"
Jul 15 21:04:54.058765 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.058766    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="alertmanager"
Jul 15 21:04:54.058949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.058773    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="alertmanager"
Jul 15 21:04:54.058949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.058782    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="kube-rbac-proxy-metric"
Jul 15 21:04:54.058949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.058787    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="kube-rbac-proxy-metric"
Jul 15 21:04:54.058949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.058794    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="kube-rbac-proxy"
Jul 15 21:04:54.058949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.058800    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="kube-rbac-proxy"
Jul 15 21:04:54.058949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.058806    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="kube-rbac-proxy-web"
Jul 15 21:04:54.058949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.058812    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="kube-rbac-proxy-web"
Jul 15 21:04:54.058949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.058875    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="kube-rbac-proxy"
Jul 15 21:04:54.058949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.058884    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="prom-label-proxy"
Jul 15 21:04:54.058949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.058889    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="kube-rbac-proxy-metric"
Jul 15 21:04:54.058949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.058895    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="kube-rbac-proxy-web"
Jul 15 21:04:54.058949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.058901    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="alertmanager"
Jul 15 21:04:54.058949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.058906    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" containerName="config-reloader"
Jul 15 21:04:54.063905 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.063887    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.067953 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.067928    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 15 21:04:54.068093 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.067960    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 15 21:04:54.068263 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.068242    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 15 21:04:54.068366 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.068244    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 15 21:04:54.068608 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.068585    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 15 21:04:54.068698 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.068626    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qp5mp\""
Jul 15 21:04:54.068698 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.068659    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 15 21:04:54.068698 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.068660    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 15 21:04:54.068978 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.068965    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 15 21:04:54.075952 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.075931    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 15 21:04:54.081398 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.081367    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 21:04:54.158050 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.158018    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/51c2f071-9922-43a0-9c39-4f6cb653bb69-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.158218 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.158062    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51c2f071-9922-43a0-9c39-4f6cb653bb69-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.158218 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.158083    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gglfp\" (UniqueName: \"kubernetes.io/projected/51c2f071-9922-43a0-9c39-4f6cb653bb69-kube-api-access-gglfp\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.158218 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.158141    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51c2f071-9922-43a0-9c39-4f6cb653bb69-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.158218 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.158188    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51c2f071-9922-43a0-9c39-4f6cb653bb69-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.158218 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.158211    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51c2f071-9922-43a0-9c39-4f6cb653bb69-config-out\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.158379 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.158235    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/51c2f071-9922-43a0-9c39-4f6cb653bb69-config-volume\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.158379 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.158266    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/51c2f071-9922-43a0-9c39-4f6cb653bb69-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.158379 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.158287    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/51c2f071-9922-43a0-9c39-4f6cb653bb69-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.158379 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.158320    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51c2f071-9922-43a0-9c39-4f6cb653bb69-web-config\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.158379 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.158370    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51c2f071-9922-43a0-9c39-4f6cb653bb69-tls-assets\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.158531 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.158398    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51c2f071-9922-43a0-9c39-4f6cb653bb69-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.158531 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.158419    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/51c2f071-9922-43a0-9c39-4f6cb653bb69-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.259601 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.259516    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51c2f071-9922-43a0-9c39-4f6cb653bb69-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.259601 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.259556    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51c2f071-9922-43a0-9c39-4f6cb653bb69-config-out\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.259601 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.259576    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/51c2f071-9922-43a0-9c39-4f6cb653bb69-config-volume\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.259860 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.259646    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/51c2f071-9922-43a0-9c39-4f6cb653bb69-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.259860 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.259685    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/51c2f071-9922-43a0-9c39-4f6cb653bb69-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.259860 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.259721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51c2f071-9922-43a0-9c39-4f6cb653bb69-web-config\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.259860 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.259745    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51c2f071-9922-43a0-9c39-4f6cb653bb69-tls-assets\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.260053 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.259861    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51c2f071-9922-43a0-9c39-4f6cb653bb69-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.260053 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.259894    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/51c2f071-9922-43a0-9c39-4f6cb653bb69-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.260053 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.259944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/51c2f071-9922-43a0-9c39-4f6cb653bb69-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.260053 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.259994    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51c2f071-9922-43a0-9c39-4f6cb653bb69-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.260053 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.260021    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gglfp\" (UniqueName: \"kubernetes.io/projected/51c2f071-9922-43a0-9c39-4f6cb653bb69-kube-api-access-gglfp\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.260053 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.260045    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51c2f071-9922-43a0-9c39-4f6cb653bb69-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.260342 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.260142    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/51c2f071-9922-43a0-9c39-4f6cb653bb69-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.261380 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.261351    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51c2f071-9922-43a0-9c39-4f6cb653bb69-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.262038 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.262010    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51c2f071-9922-43a0-9c39-4f6cb653bb69-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.262669 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.262637    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51c2f071-9922-43a0-9c39-4f6cb653bb69-config-out\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.262770 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.262747    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51c2f071-9922-43a0-9c39-4f6cb653bb69-web-config\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.262835 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.262821    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/51c2f071-9922-43a0-9c39-4f6cb653bb69-config-volume\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.263102 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.263078    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/51c2f071-9922-43a0-9c39-4f6cb653bb69-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.263179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.263153    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51c2f071-9922-43a0-9c39-4f6cb653bb69-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.263282 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.263260    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/51c2f071-9922-43a0-9c39-4f6cb653bb69-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.263391 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.263338    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51c2f071-9922-43a0-9c39-4f6cb653bb69-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.264874 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.264856    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/51c2f071-9922-43a0-9c39-4f6cb653bb69-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.265129 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.265111    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51c2f071-9922-43a0-9c39-4f6cb653bb69-tls-assets\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.270878 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.270859    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gglfp\" (UniqueName: \"kubernetes.io/projected/51c2f071-9922-43a0-9c39-4f6cb653bb69-kube-api-access-gglfp\") pod \"alertmanager-main-0\" (UID: \"51c2f071-9922-43a0-9c39-4f6cb653bb69\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.377034 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.376995    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 21:04:54.520920 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.520891    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 21:04:54.523102 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:04:54.523075    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51c2f071_9922_43a0_9c39_4f6cb653bb69.slice/crio-86e02274f2e912591b97e014d9973bc16f546af8d2a5b335a3a2b2d685b25db5 WatchSource:0}: Error finding container 86e02274f2e912591b97e014d9973bc16f546af8d2a5b335a3a2b2d685b25db5: Status 404 returned error can't find the container with id 86e02274f2e912591b97e014d9973bc16f546af8d2a5b335a3a2b2d685b25db5
Jul 15 21:04:54.996318 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.996275    2580 generic.go:356] "Generic (PLEG): container finished" podID="51c2f071-9922-43a0-9c39-4f6cb653bb69" containerID="928e07cd8c4b4f288058ea955d3aabc448b18be286a7332a92d6737e7f78ad21" exitCode=0
Jul 15 21:04:54.996702 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.996360    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51c2f071-9922-43a0-9c39-4f6cb653bb69","Type":"ContainerDied","Data":"928e07cd8c4b4f288058ea955d3aabc448b18be286a7332a92d6737e7f78ad21"}
Jul 15 21:04:54.996702 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:54.996440    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51c2f071-9922-43a0-9c39-4f6cb653bb69","Type":"ContainerStarted","Data":"86e02274f2e912591b97e014d9973bc16f546af8d2a5b335a3a2b2d685b25db5"}
Jul 15 21:04:55.071677 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:55.071591    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63e53be7-c48c-46bf-bacd-8a71a213e50e" path="/var/lib/kubelet/pods/63e53be7-c48c-46bf-bacd-8a71a213e50e/volumes"
Jul 15 21:04:56.004004 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.003972    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51c2f071-9922-43a0-9c39-4f6cb653bb69","Type":"ContainerStarted","Data":"2f1eaabe718d9332a76346bf492a020bc4d7c382ad27c064d579d936ab94a979"}
Jul 15 21:04:56.004399 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.004035    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51c2f071-9922-43a0-9c39-4f6cb653bb69","Type":"ContainerStarted","Data":"37284436b6fe8126d459a63a08fd311696484e3a32ddf543cbcbc4e6e9234832"}
Jul 15 21:04:56.004399 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.004061    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51c2f071-9922-43a0-9c39-4f6cb653bb69","Type":"ContainerStarted","Data":"7da7cac28d69837599007d43a37398753b22200cca1b3c49855a5925de121545"}
Jul 15 21:04:56.004399 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.004085    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51c2f071-9922-43a0-9c39-4f6cb653bb69","Type":"ContainerStarted","Data":"cd826c46a63aadaa582d81c5b18acf84dc7498a069d34370c9de1cd9baa0ffcc"}
Jul 15 21:04:56.004399 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.004113    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51c2f071-9922-43a0-9c39-4f6cb653bb69","Type":"ContainerStarted","Data":"07dc6df9f0796aa53b9202850a0f7dc14f9e70410f898f027c59f39664537173"}
Jul 15 21:04:56.004399 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.004137    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"51c2f071-9922-43a0-9c39-4f6cb653bb69","Type":"ContainerStarted","Data":"6590077af167d0b653aaa0e8bcd0271506d9bccd7cf9227c72caf6ff95f18108"}
Jul 15 21:04:56.051035 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.050969    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.032571973 podStartE2EDuration="2.050947316s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.375343ms" isStatefulPod=false podCreationTimestamp="2026-07-15 21:04:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:04:56.049282638 +0000 UTC m=+197.477242278" watchObservedRunningTime="2026-07-15 21:04:56.050947316 +0000 UTC m=+197.478906955"
Jul 15 21:04:56.280526 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.280409    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 21:04:56.280906 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.280868    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="kube-rbac-proxy-thanos" containerID="cri-o://10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27" gracePeriod=600
Jul 15 21:04:56.281322 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.281290    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="kube-rbac-proxy-web" containerID="cri-o://23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6" gracePeriod=600
Jul 15 21:04:56.281456 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.281432    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="kube-rbac-proxy" containerID="cri-o://663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7" gracePeriod=600
Jul 15 21:04:56.281565 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.281545    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="thanos-sidecar" containerID="cri-o://58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770" gracePeriod=600
Jul 15 21:04:56.281663 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.281645    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="config-reloader" containerID="cri-o://98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73" gracePeriod=600
Jul 15 21:04:56.282043 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.282008    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="prometheus" containerID="cri-o://b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be" gracePeriod=600
Jul 15 21:04:56.524283 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.524251    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:56.583087 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.581502    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d93acbc9-cf78-423d-a792-80c793429053-config-out\") pod \"d93acbc9-cf78-423d-a792-80c793429053\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") "
Jul 15 21:04:56.583087 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.581572    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-grpc-tls\") pod \"d93acbc9-cf78-423d-a792-80c793429053\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") "
Jul 15 21:04:56.583087 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.581602    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-rulefiles-1\") pod \"d93acbc9-cf78-423d-a792-80c793429053\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") "
Jul 15 21:04:56.583087 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.581629    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-metrics-client-certs\") pod \"d93acbc9-cf78-423d-a792-80c793429053\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") "
Jul 15 21:04:56.583087 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.581660    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-configmap-metrics-client-ca\") pod \"d93acbc9-cf78-423d-a792-80c793429053\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") "
Jul 15 21:04:56.583087 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.581697    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-db\") pod \"d93acbc9-cf78-423d-a792-80c793429053\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") "
Jul 15 21:04:56.583087 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.581720    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d93acbc9-cf78-423d-a792-80c793429053\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") "
Jul 15 21:04:56.583087 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.581749    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d93acbc9-cf78-423d-a792-80c793429053-tls-assets\") pod \"d93acbc9-cf78-423d-a792-80c793429053\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") "
Jul 15 21:04:56.583087 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.581777    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-configmap-serving-certs-ca-bundle\") pod \"d93acbc9-cf78-423d-a792-80c793429053\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") "
Jul 15 21:04:56.583087 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.581803    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-prometheus-k8s-tls\") pod \"d93acbc9-cf78-423d-a792-80c793429053\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") "
Jul 15 21:04:56.583087 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.581825    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-config\") pod \"d93acbc9-cf78-423d-a792-80c793429053\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") "
Jul 15 21:04:56.583087 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.581884    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-configmap-kubelet-serving-ca-bundle\") pod \"d93acbc9-cf78-423d-a792-80c793429053\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") "
Jul 15 21:04:56.583087 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.581924    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-kube-rbac-proxy\") pod \"d93acbc9-cf78-423d-a792-80c793429053\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") "
Jul 15 21:04:56.583087 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.581966    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-rulefiles-2\") pod \"d93acbc9-cf78-423d-a792-80c793429053\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") "
Jul 15 21:04:56.583087 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.582011    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-thanos-prometheus-http-client-file\") pod \"d93acbc9-cf78-423d-a792-80c793429053\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") "
Jul 15 21:04:56.583924 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.582044    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-rulefiles-0\") pod \"d93acbc9-cf78-423d-a792-80c793429053\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") "
Jul 15 21:04:56.583924 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.582076    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d93acbc9-cf78-423d-a792-80c793429053\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") "
Jul 15 21:04:56.583924 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.582102    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-trusted-ca-bundle\") pod \"d93acbc9-cf78-423d-a792-80c793429053\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") "
Jul 15 21:04:56.583924 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.582140    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86z89\" (UniqueName: \"kubernetes.io/projected/d93acbc9-cf78-423d-a792-80c793429053-kube-api-access-86z89\") pod \"d93acbc9-cf78-423d-a792-80c793429053\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") "
Jul 15 21:04:56.583924 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.582167    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-web-config\") pod \"d93acbc9-cf78-423d-a792-80c793429053\" (UID: \"d93acbc9-cf78-423d-a792-80c793429053\") "
Jul 15 21:04:56.583924 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.583389    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d93acbc9-cf78-423d-a792-80c793429053" (UID: "d93acbc9-cf78-423d-a792-80c793429053"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:04:56.583924 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.583638    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "d93acbc9-cf78-423d-a792-80c793429053" (UID: "d93acbc9-cf78-423d-a792-80c793429053"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:04:56.583924 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.583807    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d93acbc9-cf78-423d-a792-80c793429053" (UID: "d93acbc9-cf78-423d-a792-80c793429053"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:04:56.584304 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.584286    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d93acbc9-cf78-423d-a792-80c793429053" (UID: "d93acbc9-cf78-423d-a792-80c793429053"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:04:56.585213 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.585180    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d93acbc9-cf78-423d-a792-80c793429053" (UID: "d93acbc9-cf78-423d-a792-80c793429053"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:04:56.585476 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.585454    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d93acbc9-cf78-423d-a792-80c793429053" (UID: "d93acbc9-cf78-423d-a792-80c793429053"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:04:56.586797 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.586749    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "d93acbc9-cf78-423d-a792-80c793429053" (UID: "d93acbc9-cf78-423d-a792-80c793429053"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:04:56.587422 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.587394    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d93acbc9-cf78-423d-a792-80c793429053" (UID: "d93acbc9-cf78-423d-a792-80c793429053"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:04:56.588071 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.588033    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d93acbc9-cf78-423d-a792-80c793429053-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d93acbc9-cf78-423d-a792-80c793429053" (UID: "d93acbc9-cf78-423d-a792-80c793429053"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:04:56.589562 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.589423    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-config" (OuterVolumeSpecName: "config") pod "d93acbc9-cf78-423d-a792-80c793429053" (UID: "d93acbc9-cf78-423d-a792-80c793429053"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:04:56.589562 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.589462    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d93acbc9-cf78-423d-a792-80c793429053" (UID: "d93acbc9-cf78-423d-a792-80c793429053"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:04:56.589562 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.589498    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d93acbc9-cf78-423d-a792-80c793429053" (UID: "d93acbc9-cf78-423d-a792-80c793429053"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:04:56.589562 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.589523    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d93acbc9-cf78-423d-a792-80c793429053" (UID: "d93acbc9-cf78-423d-a792-80c793429053"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:04:56.589796 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.589579    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d93acbc9-cf78-423d-a792-80c793429053" (UID: "d93acbc9-cf78-423d-a792-80c793429053"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:04:56.591689 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.591653    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d93acbc9-cf78-423d-a792-80c793429053" (UID: "d93acbc9-cf78-423d-a792-80c793429053"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:04:56.591689 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.591668    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d93acbc9-cf78-423d-a792-80c793429053-config-out" (OuterVolumeSpecName: "config-out") pod "d93acbc9-cf78-423d-a792-80c793429053" (UID: "d93acbc9-cf78-423d-a792-80c793429053"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:04:56.591689 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.591672    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d93acbc9-cf78-423d-a792-80c793429053-kube-api-access-86z89" (OuterVolumeSpecName: "kube-api-access-86z89") pod "d93acbc9-cf78-423d-a792-80c793429053" (UID: "d93acbc9-cf78-423d-a792-80c793429053"). InnerVolumeSpecName "kube-api-access-86z89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:04:56.591991 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.591959    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d93acbc9-cf78-423d-a792-80c793429053" (UID: "d93acbc9-cf78-423d-a792-80c793429053"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:04:56.592090 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.592045    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d93acbc9-cf78-423d-a792-80c793429053" (UID: "d93acbc9-cf78-423d-a792-80c793429053"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:04:56.603335 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.603308    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-web-config" (OuterVolumeSpecName: "web-config") pod "d93acbc9-cf78-423d-a792-80c793429053" (UID: "d93acbc9-cf78-423d-a792-80c793429053"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:04:56.683481 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.683446    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-db\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:56.683481 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.683473    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:56.683481 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.683484    2580 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d93acbc9-cf78-423d-a792-80c793429053-tls-assets\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:56.683693 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.683494    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:56.683693 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.683504    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:56.683693 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.683513    2580 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-config\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:56.683693 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.683521    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:56.683693 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.683530    2580 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-kube-rbac-proxy\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:56.683693 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.683538    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:56.683693 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.683546    2580 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:56.683693 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.683554    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:56.683693 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.683562    2580 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:56.683693 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.683573    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:56.683693 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.683581    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86z89\" (UniqueName: \"kubernetes.io/projected/d93acbc9-cf78-423d-a792-80c793429053-kube-api-access-86z89\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:56.683693 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.683590    2580 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-web-config\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:56.683693 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.683599    2580 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d93acbc9-cf78-423d-a792-80c793429053-config-out\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:56.683693 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.683606    2580 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-grpc-tls\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:56.683693 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.683616    2580 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:56.683693 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.683624    2580 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d93acbc9-cf78-423d-a792-80c793429053-secret-metrics-client-certs\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:56.683693 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:56.683632    2580 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d93acbc9-cf78-423d-a792-80c793429053-configmap-metrics-client-ca\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:04:57.011303 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.011271    2580 generic.go:356] "Generic (PLEG): container finished" podID="d93acbc9-cf78-423d-a792-80c793429053" containerID="10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27" exitCode=0
Jul 15 21:04:57.011303 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.011298    2580 generic.go:356] "Generic (PLEG): container finished" podID="d93acbc9-cf78-423d-a792-80c793429053" containerID="663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7" exitCode=0
Jul 15 21:04:57.011303 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.011305    2580 generic.go:356] "Generic (PLEG): container finished" podID="d93acbc9-cf78-423d-a792-80c793429053" containerID="23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6" exitCode=0
Jul 15 21:04:57.011303 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.011311    2580 generic.go:356] "Generic (PLEG): container finished" podID="d93acbc9-cf78-423d-a792-80c793429053" containerID="58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770" exitCode=0
Jul 15 21:04:57.011749 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.011316    2580 generic.go:356] "Generic (PLEG): container finished" podID="d93acbc9-cf78-423d-a792-80c793429053" containerID="98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73" exitCode=0
Jul 15 21:04:57.011749 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.011320    2580 generic.go:356] "Generic (PLEG): container finished" podID="d93acbc9-cf78-423d-a792-80c793429053" containerID="b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be" exitCode=0
Jul 15 21:04:57.011749 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.011353    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.011749 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.011351    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d93acbc9-cf78-423d-a792-80c793429053","Type":"ContainerDied","Data":"10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27"}
Jul 15 21:04:57.011749 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.011511    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d93acbc9-cf78-423d-a792-80c793429053","Type":"ContainerDied","Data":"663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7"}
Jul 15 21:04:57.011749 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.011560    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d93acbc9-cf78-423d-a792-80c793429053","Type":"ContainerDied","Data":"23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6"}
Jul 15 21:04:57.011749 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.011566    2580 scope.go:117] "RemoveContainer" containerID="10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27"
Jul 15 21:04:57.011749 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.011603    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d93acbc9-cf78-423d-a792-80c793429053","Type":"ContainerDied","Data":"58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770"}
Jul 15 21:04:57.011749 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.011641    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d93acbc9-cf78-423d-a792-80c793429053","Type":"ContainerDied","Data":"98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73"}
Jul 15 21:04:57.011749 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.011683    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d93acbc9-cf78-423d-a792-80c793429053","Type":"ContainerDied","Data":"b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be"}
Jul 15 21:04:57.011749 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.011723    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d93acbc9-cf78-423d-a792-80c793429053","Type":"ContainerDied","Data":"d5e972be52f9cf0e3c46970577e16a14aad5d681e2fad7bbb3b014fede06a722"}
Jul 15 21:04:57.019400 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.019380    2580 scope.go:117] "RemoveContainer" containerID="663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7"
Jul 15 21:04:57.030264 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.030237    2580 scope.go:117] "RemoveContainer" containerID="23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6"
Jul 15 21:04:57.040352 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.040321    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 21:04:57.041080 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.041056    2580 scope.go:117] "RemoveContainer" containerID="58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770"
Jul 15 21:04:57.044261 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.044241    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 21:04:57.048539 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.048523    2580 scope.go:117] "RemoveContainer" containerID="98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73"
Jul 15 21:04:57.055169 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.055154    2580 scope.go:117] "RemoveContainer" containerID="b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be"
Jul 15 21:04:57.061595 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.061568    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d93acbc9-cf78-423d-a792-80c793429053" path="/var/lib/kubelet/pods/d93acbc9-cf78-423d-a792-80c793429053/volumes"
Jul 15 21:04:57.062203 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.062189    2580 scope.go:117] "RemoveContainer" containerID="31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53"
Jul 15 21:04:57.068684 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.068664    2580 scope.go:117] "RemoveContainer" containerID="10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27"
Jul 15 21:04:57.069026 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:04:57.068999    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27\": container with ID starting with 10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27 not found: ID does not exist" containerID="10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27"
Jul 15 21:04:57.069091 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.069035    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27"} err="failed to get container status \"10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27\": rpc error: code = NotFound desc = could not find container \"10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27\": container with ID starting with 10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27 not found: ID does not exist"
Jul 15 21:04:57.069091 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.069082    2580 scope.go:117] "RemoveContainer" containerID="663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7"
Jul 15 21:04:57.069349 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:04:57.069326    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7\": container with ID starting with 663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7 not found: ID does not exist" containerID="663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7"
Jul 15 21:04:57.069382 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.069360    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7"} err="failed to get container status \"663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7\": rpc error: code = NotFound desc = could not find container \"663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7\": container with ID starting with 663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7 not found: ID does not exist"
Jul 15 21:04:57.069413 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.069384    2580 scope.go:117] "RemoveContainer" containerID="23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6"
Jul 15 21:04:57.069627 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:04:57.069610    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6\": container with ID starting with 23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6 not found: ID does not exist" containerID="23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6"
Jul 15 21:04:57.069716 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.069629    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6"} err="failed to get container status \"23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6\": rpc error: code = NotFound desc = could not find container \"23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6\": container with ID starting with 23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6 not found: ID does not exist"
Jul 15 21:04:57.069716 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.069641    2580 scope.go:117] "RemoveContainer" containerID="58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770"
Jul 15 21:04:57.069904 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:04:57.069887    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770\": container with ID starting with 58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770 not found: ID does not exist" containerID="58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770"
Jul 15 21:04:57.069964 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.069908    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770"} err="failed to get container status \"58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770\": rpc error: code = NotFound desc = could not find container \"58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770\": container with ID starting with 58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770 not found: ID does not exist"
Jul 15 21:04:57.069964 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.069922    2580 scope.go:117] "RemoveContainer" containerID="98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73"
Jul 15 21:04:57.070168 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:04:57.070149    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73\": container with ID starting with 98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73 not found: ID does not exist" containerID="98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73"
Jul 15 21:04:57.070211 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.070173    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73"} err="failed to get container status \"98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73\": rpc error: code = NotFound desc = could not find container \"98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73\": container with ID starting with 98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73 not found: ID does not exist"
Jul 15 21:04:57.070211 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.070187    2580 scope.go:117] "RemoveContainer" containerID="b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be"
Jul 15 21:04:57.070402 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:04:57.070385    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be\": container with ID starting with b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be not found: ID does not exist" containerID="b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be"
Jul 15 21:04:57.070438 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.070406    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be"} err="failed to get container status \"b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be\": rpc error: code = NotFound desc = could not find container \"b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be\": container with ID starting with b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be not found: ID does not exist"
Jul 15 21:04:57.070438 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.070419    2580 scope.go:117] "RemoveContainer" containerID="31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53"
Jul 15 21:04:57.070620 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:04:57.070605    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53\": container with ID starting with 31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53 not found: ID does not exist" containerID="31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53"
Jul 15 21:04:57.070664 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.070624    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53"} err="failed to get container status \"31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53\": rpc error: code = NotFound desc = could not find container \"31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53\": container with ID starting with 31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53 not found: ID does not exist"
Jul 15 21:04:57.070664 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.070638    2580 scope.go:117] "RemoveContainer" containerID="10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27"
Jul 15 21:04:57.070897 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.070877    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27"} err="failed to get container status \"10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27\": rpc error: code = NotFound desc = could not find container \"10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27\": container with ID starting with 10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27 not found: ID does not exist"
Jul 15 21:04:57.070963 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.070900    2580 scope.go:117] "RemoveContainer" containerID="663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7"
Jul 15 21:04:57.071123 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.071107    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7"} err="failed to get container status \"663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7\": rpc error: code = NotFound desc = could not find container \"663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7\": container with ID starting with 663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7 not found: ID does not exist"
Jul 15 21:04:57.071168 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.071123    2580 scope.go:117] "RemoveContainer" containerID="23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6"
Jul 15 21:04:57.071302 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.071286    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6"} err="failed to get container status \"23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6\": rpc error: code = NotFound desc = could not find container \"23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6\": container with ID starting with 23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6 not found: ID does not exist"
Jul 15 21:04:57.071345 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.071302    2580 scope.go:117] "RemoveContainer" containerID="58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770"
Jul 15 21:04:57.071483 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.071466    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770"} err="failed to get container status \"58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770\": rpc error: code = NotFound desc = could not find container \"58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770\": container with ID starting with 58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770 not found: ID does not exist"
Jul 15 21:04:57.071549 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.071484    2580 scope.go:117] "RemoveContainer" containerID="98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73"
Jul 15 21:04:57.071679 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.071664    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73"} err="failed to get container status \"98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73\": rpc error: code = NotFound desc = could not find container \"98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73\": container with ID starting with 98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73 not found: ID does not exist"
Jul 15 21:04:57.071722 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.071680    2580 scope.go:117] "RemoveContainer" containerID="b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be"
Jul 15 21:04:57.071874 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.071858    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be"} err="failed to get container status \"b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be\": rpc error: code = NotFound desc = could not find container \"b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be\": container with ID starting with b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be not found: ID does not exist"
Jul 15 21:04:57.071926 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.071874    2580 scope.go:117] "RemoveContainer" containerID="31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53"
Jul 15 21:04:57.072060 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.072044    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53"} err="failed to get container status \"31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53\": rpc error: code = NotFound desc = could not find container \"31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53\": container with ID starting with 31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53 not found: ID does not exist"
Jul 15 21:04:57.072120 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.072060    2580 scope.go:117] "RemoveContainer" containerID="10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27"
Jul 15 21:04:57.072252 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.072237    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27"} err="failed to get container status \"10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27\": rpc error: code = NotFound desc = could not find container \"10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27\": container with ID starting with 10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27 not found: ID does not exist"
Jul 15 21:04:57.072288 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.072252    2580 scope.go:117] "RemoveContainer" containerID="663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7"
Jul 15 21:04:57.072491 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.072469    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7"} err="failed to get container status \"663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7\": rpc error: code = NotFound desc = could not find container \"663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7\": container with ID starting with 663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7 not found: ID does not exist"
Jul 15 21:04:57.072491 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.072490    2580 scope.go:117] "RemoveContainer" containerID="23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6"
Jul 15 21:04:57.072747 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.072730    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6"} err="failed to get container status \"23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6\": rpc error: code = NotFound desc = could not find container \"23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6\": container with ID starting with 23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6 not found: ID does not exist"
Jul 15 21:04:57.072828 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.072749    2580 scope.go:117] "RemoveContainer" containerID="58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770"
Jul 15 21:04:57.073091 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.073072    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770"} err="failed to get container status \"58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770\": rpc error: code = NotFound desc = could not find container \"58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770\": container with ID starting with 58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770 not found: ID does not exist"
Jul 15 21:04:57.073091 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.073094    2580 scope.go:117] "RemoveContainer" containerID="98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73"
Jul 15 21:04:57.073287 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.073269    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73"} err="failed to get container status \"98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73\": rpc error: code = NotFound desc = could not find container \"98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73\": container with ID starting with 98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73 not found: ID does not exist"
Jul 15 21:04:57.073347 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.073288    2580 scope.go:117] "RemoveContainer" containerID="b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be"
Jul 15 21:04:57.073534 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.073514    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be"} err="failed to get container status \"b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be\": rpc error: code = NotFound desc = could not find container \"b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be\": container with ID starting with b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be not found: ID does not exist"
Jul 15 21:04:57.073585 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.073535    2580 scope.go:117] "RemoveContainer" containerID="31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53"
Jul 15 21:04:57.073747 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.073728    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53"} err="failed to get container status \"31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53\": rpc error: code = NotFound desc = could not find container \"31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53\": container with ID starting with 31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53 not found: ID does not exist"
Jul 15 21:04:57.073793 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.073748    2580 scope.go:117] "RemoveContainer" containerID="10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27"
Jul 15 21:04:57.073985 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.073968    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27"} err="failed to get container status \"10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27\": rpc error: code = NotFound desc = could not find container \"10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27\": container with ID starting with 10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27 not found: ID does not exist"
Jul 15 21:04:57.074055 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.073987    2580 scope.go:117] "RemoveContainer" containerID="663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7"
Jul 15 21:04:57.074225 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.074209    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7"} err="failed to get container status \"663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7\": rpc error: code = NotFound desc = could not find container \"663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7\": container with ID starting with 663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7 not found: ID does not exist"
Jul 15 21:04:57.074277 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.074226    2580 scope.go:117] "RemoveContainer" containerID="23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6"
Jul 15 21:04:57.074447 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.074429    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6"} err="failed to get container status \"23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6\": rpc error: code = NotFound desc = could not find container \"23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6\": container with ID starting with 23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6 not found: ID does not exist"
Jul 15 21:04:57.074490 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.074447    2580 scope.go:117] "RemoveContainer" containerID="58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770"
Jul 15 21:04:57.074654 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.074635    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770"} err="failed to get container status \"58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770\": rpc error: code = NotFound desc = could not find container \"58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770\": container with ID starting with 58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770 not found: ID does not exist"
Jul 15 21:04:57.074714 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.074656    2580 scope.go:117] "RemoveContainer" containerID="98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73"
Jul 15 21:04:57.074875 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.074858    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73"} err="failed to get container status \"98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73\": rpc error: code = NotFound desc = could not find container \"98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73\": container with ID starting with 98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73 not found: ID does not exist"
Jul 15 21:04:57.074926 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.074876    2580 scope.go:117] "RemoveContainer" containerID="b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be"
Jul 15 21:04:57.075088 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.075072    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be"} err="failed to get container status \"b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be\": rpc error: code = NotFound desc = could not find container \"b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be\": container with ID starting with b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be not found: ID does not exist"
Jul 15 21:04:57.075130 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.075089    2580 scope.go:117] "RemoveContainer" containerID="31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53"
Jul 15 21:04:57.075284 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.075267    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53"} err="failed to get container status \"31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53\": rpc error: code = NotFound desc = could not find container \"31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53\": container with ID starting with 31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53 not found: ID does not exist"
Jul 15 21:04:57.075326 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.075285    2580 scope.go:117] "RemoveContainer" containerID="10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27"
Jul 15 21:04:57.075478 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.075459    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27"} err="failed to get container status \"10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27\": rpc error: code = NotFound desc = could not find container \"10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27\": container with ID starting with 10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27 not found: ID does not exist"
Jul 15 21:04:57.075520 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.075480    2580 scope.go:117] "RemoveContainer" containerID="663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7"
Jul 15 21:04:57.075692 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.075675    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7"} err="failed to get container status \"663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7\": rpc error: code = NotFound desc = could not find container \"663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7\": container with ID starting with 663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7 not found: ID does not exist"
Jul 15 21:04:57.075751 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.075694    2580 scope.go:117] "RemoveContainer" containerID="23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6"
Jul 15 21:04:57.075954 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.075934    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6"} err="failed to get container status \"23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6\": rpc error: code = NotFound desc = could not find container \"23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6\": container with ID starting with 23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6 not found: ID does not exist"
Jul 15 21:04:57.076013 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.075955    2580 scope.go:117] "RemoveContainer" containerID="58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770"
Jul 15 21:04:57.076125 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.076109    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770"} err="failed to get container status \"58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770\": rpc error: code = NotFound desc = could not find container \"58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770\": container with ID starting with 58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770 not found: ID does not exist"
Jul 15 21:04:57.076167 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.076126    2580 scope.go:117] "RemoveContainer" containerID="98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73"
Jul 15 21:04:57.076328 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.076312    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73"} err="failed to get container status \"98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73\": rpc error: code = NotFound desc = could not find container \"98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73\": container with ID starting with 98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73 not found: ID does not exist"
Jul 15 21:04:57.076386 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.076330    2580 scope.go:117] "RemoveContainer" containerID="b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be"
Jul 15 21:04:57.076539 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.076521    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be"} err="failed to get container status \"b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be\": rpc error: code = NotFound desc = could not find container \"b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be\": container with ID starting with b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be not found: ID does not exist"
Jul 15 21:04:57.076604 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.076540    2580 scope.go:117] "RemoveContainer" containerID="31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53"
Jul 15 21:04:57.076756 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.076739    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53"} err="failed to get container status \"31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53\": rpc error: code = NotFound desc = could not find container \"31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53\": container with ID starting with 31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53 not found: ID does not exist"
Jul 15 21:04:57.076813 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.076757    2580 scope.go:117] "RemoveContainer" containerID="10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27"
Jul 15 21:04:57.076972 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.076955    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27"} err="failed to get container status \"10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27\": rpc error: code = NotFound desc = could not find container \"10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27\": container with ID starting with 10b3ef90d052d9ab57e44bd7e3f609c3644e627f9f116927f84777940d732f27 not found: ID does not exist"
Jul 15 21:04:57.077013 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.076973    2580 scope.go:117] "RemoveContainer" containerID="663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7"
Jul 15 21:04:57.077179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.077158    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7"} err="failed to get container status \"663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7\": rpc error: code = NotFound desc = could not find container \"663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7\": container with ID starting with 663f86cf932ea70b601ee59d32cc2f6c803635433a233afe43d0a16814b82fe7 not found: ID does not exist"
Jul 15 21:04:57.077216 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.077180    2580 scope.go:117] "RemoveContainer" containerID="23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6"
Jul 15 21:04:57.077380 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.077364    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6"} err="failed to get container status \"23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6\": rpc error: code = NotFound desc = could not find container \"23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6\": container with ID starting with 23ad83b8d91ddaaa0b2725b7ba03b1ba98c7061c690c5310f7d71dc5532366b6 not found: ID does not exist"
Jul 15 21:04:57.077436 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.077381    2580 scope.go:117] "RemoveContainer" containerID="58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770"
Jul 15 21:04:57.077600 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.077583    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770"} err="failed to get container status \"58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770\": rpc error: code = NotFound desc = could not find container \"58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770\": container with ID starting with 58853db976446eb1e68c31a8fec0eb63fe30491059f2efa713a4f7aba3dd3770 not found: ID does not exist"
Jul 15 21:04:57.077640 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.077600    2580 scope.go:117] "RemoveContainer" containerID="98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73"
Jul 15 21:04:57.077782 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.077765    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73"} err="failed to get container status \"98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73\": rpc error: code = NotFound desc = could not find container \"98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73\": container with ID starting with 98401408d3994197c24a857db8f5d52b25ebf9bc5c381c9e5dee7076c6f26f73 not found: ID does not exist"
Jul 15 21:04:57.077782 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.077781    2580 scope.go:117] "RemoveContainer" containerID="b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be"
Jul 15 21:04:57.077965 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.077945    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be"} err="failed to get container status \"b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be\": rpc error: code = NotFound desc = could not find container \"b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be\": container with ID starting with b285d3d0577ea6f4ab4355ad801d35a62dbf4e6b8d1969933fca0970491446be not found: ID does not exist"
Jul 15 21:04:57.078026 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.077967    2580 scope.go:117] "RemoveContainer" containerID="31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53"
Jul 15 21:04:57.078167 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.078152    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53"} err="failed to get container status \"31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53\": rpc error: code = NotFound desc = could not find container \"31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53\": container with ID starting with 31e627d9096ecf6c987090ee54c817a96ebcb99d01f29d3c4e610c05115cdc53 not found: ID does not exist"
Jul 15 21:04:57.083420 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.083400    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 21:04:57.083677 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.083666    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="thanos-sidecar"
Jul 15 21:04:57.083717 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.083679    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="thanos-sidecar"
Jul 15 21:04:57.083717 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.083689    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="kube-rbac-proxy"
Jul 15 21:04:57.083717 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.083695    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="kube-rbac-proxy"
Jul 15 21:04:57.083717 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.083703    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="kube-rbac-proxy-web"
Jul 15 21:04:57.083717 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.083709    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="kube-rbac-proxy-web"
Jul 15 21:04:57.083717 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.083717    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="prometheus"
Jul 15 21:04:57.083897 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.083723    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="prometheus"
Jul 15 21:04:57.083897 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.083729    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="init-config-reloader"
Jul 15 21:04:57.083897 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.083735    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="init-config-reloader"
Jul 15 21:04:57.083897 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.083746    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="config-reloader"
Jul 15 21:04:57.083897 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.083752    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="config-reloader"
Jul 15 21:04:57.083897 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.083760    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="kube-rbac-proxy-thanos"
Jul 15 21:04:57.083897 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.083765    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="kube-rbac-proxy-thanos"
Jul 15 21:04:57.083897 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.083814    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="kube-rbac-proxy"
Jul 15 21:04:57.083897 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.083822    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="config-reloader"
Jul 15 21:04:57.083897 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.083828    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="kube-rbac-proxy-thanos"
Jul 15 21:04:57.083897 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.083834    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="prometheus"
Jul 15 21:04:57.083897 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.083859    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="thanos-sidecar"
Jul 15 21:04:57.083897 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.083866    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d93acbc9-cf78-423d-a792-80c793429053" containerName="kube-rbac-proxy-web"
Jul 15 21:04:57.089332 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.089315    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.092597 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.092581    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 15 21:04:57.092889 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.092869    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 15 21:04:57.092993 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.092871    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 15 21:04:57.092993 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.092907    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 15 21:04:57.092993 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.092928    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 15 21:04:57.092993 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.092931    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 15 21:04:57.092993 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.092960    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 15 21:04:57.093281 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.093201    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 15 21:04:57.093281 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.093236    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 15 21:04:57.093281 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.093270    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 15 21:04:57.093281 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.093280    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8hvxc\""
Jul 15 21:04:57.093655 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.093638    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-apu0vlcmnnjan\""
Jul 15 21:04:57.094872 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.094824    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 15 21:04:57.094951 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.094829    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 15 21:04:57.095119 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.095103    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 15 21:04:57.096163 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.096147    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 15 21:04:57.102043 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.102028    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 15 21:04:57.107872 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.107820    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 21:04:57.189413 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.189372    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.189580 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.189423    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9w4r\" (UniqueName: \"kubernetes.io/projected/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-kube-api-access-v9w4r\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.189580 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.189485    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.189580 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.189514    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.189580 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.189555    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.189901 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.189581    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.189901 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.189604    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.189901 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.189640    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.189901 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.189663    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.189901 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.189690    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.189901 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.189721    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.189901 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.189756    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.189901 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.189821    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.189901 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.189881    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.190209 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.189906    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-config\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.190209 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.189932    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.190209 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.189954    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.190209 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.189967    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.190209 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.190022    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.190209 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.190039    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.290397 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.290321    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.290397 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.290364    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.290397 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.290384    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.290622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.290401    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-config\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.290622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.290416    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.290622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.290433    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.290622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.290447    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.290622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.290477    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.290622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.290492    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.290923 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.290784    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.293931 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.291152    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.293931 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.291197    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.293931 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.291205    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.293931 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.291273    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9w4r\" (UniqueName: \"kubernetes.io/projected/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-kube-api-access-v9w4r\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.293931 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.291304    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.293931 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.291328    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.293931 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.291365    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.293931 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.291388    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.293931 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.291416    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.293931 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.291459    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.293931 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.291484    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.293931 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.291513    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.293931 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.291546    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.293931 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.291641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.294739 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.292262    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.294739 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.292692    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.294739 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.292904    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.294739 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.293603    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.294739 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.294103    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-config\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.294739 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.294145    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-web-config\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.295063 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.294982    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.295773 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.295548    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.295773 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.295684    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.295773 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.295709    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.296021 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.295905    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.296021 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.295972    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.296258 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.296240    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.296881 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.296860    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-config-out\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.297229 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.297212    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.301604 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.301588    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9w4r\" (UniqueName: \"kubernetes.io/projected/408d8984-44d2-4b58-8546-dcdb7a8ee6a5-kube-api-access-v9w4r\") pod \"prometheus-k8s-0\" (UID: \"408d8984-44d2-4b58-8546-dcdb7a8ee6a5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.399935 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.399900    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:04:57.566182 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:57.566019    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 21:04:57.568117 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:04:57.568092    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod408d8984_44d2_4b58_8546_dcdb7a8ee6a5.slice/crio-e82b4792aa8dd370af99efb6c093b9db6b3a0b0ed7bd2ce638642b48e7634f21 WatchSource:0}: Error finding container e82b4792aa8dd370af99efb6c093b9db6b3a0b0ed7bd2ce638642b48e7634f21: Status 404 returned error can't find the container with id e82b4792aa8dd370af99efb6c093b9db6b3a0b0ed7bd2ce638642b48e7634f21
Jul 15 21:04:58.016422 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:58.016388    2580 generic.go:356] "Generic (PLEG): container finished" podID="408d8984-44d2-4b58-8546-dcdb7a8ee6a5" containerID="b7a87829d98bad44d7e74c44490df1ef4d74a7906860cd69487f1abffdd51bee" exitCode=0
Jul 15 21:04:58.016871 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:58.016478    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"408d8984-44d2-4b58-8546-dcdb7a8ee6a5","Type":"ContainerDied","Data":"b7a87829d98bad44d7e74c44490df1ef4d74a7906860cd69487f1abffdd51bee"}
Jul 15 21:04:58.016871 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:58.016566    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"408d8984-44d2-4b58-8546-dcdb7a8ee6a5","Type":"ContainerStarted","Data":"e82b4792aa8dd370af99efb6c093b9db6b3a0b0ed7bd2ce638642b48e7634f21"}
Jul 15 21:04:59.024217 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:59.024179    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"408d8984-44d2-4b58-8546-dcdb7a8ee6a5","Type":"ContainerStarted","Data":"cda4372c2cbae6221dbc21f0b397f0a6c6cdeca90c9f16ffe8d24f83133c50e5"}
Jul 15 21:04:59.024598 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:59.024293    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"408d8984-44d2-4b58-8546-dcdb7a8ee6a5","Type":"ContainerStarted","Data":"7a04e80bf75253e6da6ae1ba5988dcb84aca94c87519ffb7a4bc352a0828341f"}
Jul 15 21:04:59.024598 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:59.024338    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"408d8984-44d2-4b58-8546-dcdb7a8ee6a5","Type":"ContainerStarted","Data":"4944c771864fddd343184ef99dbde966c597e2d68d0170584b3e72e95b208b84"}
Jul 15 21:04:59.024598 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:59.024373    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"408d8984-44d2-4b58-8546-dcdb7a8ee6a5","Type":"ContainerStarted","Data":"d2f2801e89393e6077eb8f834acd231f2dba17c5ba3bc57681e21338baa7f7a1"}
Jul 15 21:04:59.024598 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:59.024408    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"408d8984-44d2-4b58-8546-dcdb7a8ee6a5","Type":"ContainerStarted","Data":"261530ad4f5dfdd0011d4e4b545ad37ea4a93d0bc0796efa7ce362bc208f245a"}
Jul 15 21:04:59.024598 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:59.024444    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"408d8984-44d2-4b58-8546-dcdb7a8ee6a5","Type":"ContainerStarted","Data":"a262c838c225ec1ab065bc472cb9c3bf109f10a6c2f52a706ce2f4df8098278a"}
Jul 15 21:04:59.061357 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:04:59.061278    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.043015104 podStartE2EDuration="2.061258194s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.24309ms" isStatefulPod=false podCreationTimestamp="2026-07-15 21:04:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:04:59.0595511 +0000 UTC m=+200.487510737" watchObservedRunningTime="2026-07-15 21:04:59.061258194 +0000 UTC m=+200.489217834"
Jul 15 21:05:02.400331 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:05:02.400273    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:05:57.400512 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:05:57.400466    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:05:57.415708 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:05:57.415682    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:05:58.267698 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:05:58.267664    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 21:06:39.000630 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:06:39.000598    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:06:39.010097 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:06:39.010071    2580 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 21:06:39.011657 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:06:39.011632    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:08:07.117061 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.116983    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4"]
Jul 15 21:08:07.120379 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.120363    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4"
Jul 15 21:08:07.132391 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.132372    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 21:08:07.132626 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.132608    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 21:08:07.132717 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.132615    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 21:08:07.132717 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.132669    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cfr2c\""
Jul 15 21:08:07.132717 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.132678    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 21:08:07.178167 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.178138    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4"]
Jul 15 21:08:07.256481 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.256444    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwzjq\" (UniqueName: \"kubernetes.io/projected/51f20288-4267-45e2-b596-2ec3f89d5ca6-kube-api-access-mwzjq\") pod \"opendatahub-operator-controller-manager-65c67f598f-76ms4\" (UID: \"51f20288-4267-45e2-b596-2ec3f89d5ca6\") " pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4"
Jul 15 21:08:07.256676 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.256490    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/51f20288-4267-45e2-b596-2ec3f89d5ca6-manifests\") pod \"opendatahub-operator-controller-manager-65c67f598f-76ms4\" (UID: \"51f20288-4267-45e2-b596-2ec3f89d5ca6\") " pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4"
Jul 15 21:08:07.256676 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.256625    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51f20288-4267-45e2-b596-2ec3f89d5ca6-webhook-cert\") pod \"opendatahub-operator-controller-manager-65c67f598f-76ms4\" (UID: \"51f20288-4267-45e2-b596-2ec3f89d5ca6\") " pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4"
Jul 15 21:08:07.256792 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.256678    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51f20288-4267-45e2-b596-2ec3f89d5ca6-tmp\") pod \"opendatahub-operator-controller-manager-65c67f598f-76ms4\" (UID: \"51f20288-4267-45e2-b596-2ec3f89d5ca6\") " pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4"
Jul 15 21:08:07.256792 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.256704    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/51f20288-4267-45e2-b596-2ec3f89d5ca6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65c67f598f-76ms4\" (UID: \"51f20288-4267-45e2-b596-2ec3f89d5ca6\") " pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4"
Jul 15 21:08:07.357648 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.357610    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51f20288-4267-45e2-b596-2ec3f89d5ca6-webhook-cert\") pod \"opendatahub-operator-controller-manager-65c67f598f-76ms4\" (UID: \"51f20288-4267-45e2-b596-2ec3f89d5ca6\") " pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4"
Jul 15 21:08:07.357835 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.357660    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51f20288-4267-45e2-b596-2ec3f89d5ca6-tmp\") pod \"opendatahub-operator-controller-manager-65c67f598f-76ms4\" (UID: \"51f20288-4267-45e2-b596-2ec3f89d5ca6\") " pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4"
Jul 15 21:08:07.357835 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.357676    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/51f20288-4267-45e2-b596-2ec3f89d5ca6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65c67f598f-76ms4\" (UID: \"51f20288-4267-45e2-b596-2ec3f89d5ca6\") " pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4"
Jul 15 21:08:07.357835 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.357709    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwzjq\" (UniqueName: \"kubernetes.io/projected/51f20288-4267-45e2-b596-2ec3f89d5ca6-kube-api-access-mwzjq\") pod \"opendatahub-operator-controller-manager-65c67f598f-76ms4\" (UID: \"51f20288-4267-45e2-b596-2ec3f89d5ca6\") " pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4"
Jul 15 21:08:07.357835 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.357738    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/51f20288-4267-45e2-b596-2ec3f89d5ca6-manifests\") pod \"opendatahub-operator-controller-manager-65c67f598f-76ms4\" (UID: \"51f20288-4267-45e2-b596-2ec3f89d5ca6\") " pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4"
Jul 15 21:08:07.358183 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.358157    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/51f20288-4267-45e2-b596-2ec3f89d5ca6-manifests\") pod \"opendatahub-operator-controller-manager-65c67f598f-76ms4\" (UID: \"51f20288-4267-45e2-b596-2ec3f89d5ca6\") " pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4"
Jul 15 21:08:07.360183 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.360164    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/51f20288-4267-45e2-b596-2ec3f89d5ca6-webhook-cert\") pod \"opendatahub-operator-controller-manager-65c67f598f-76ms4\" (UID: \"51f20288-4267-45e2-b596-2ec3f89d5ca6\") " pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4"
Jul 15 21:08:07.360344 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.360324    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/51f20288-4267-45e2-b596-2ec3f89d5ca6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-65c67f598f-76ms4\" (UID: \"51f20288-4267-45e2-b596-2ec3f89d5ca6\") " pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4"
Jul 15 21:08:07.360578 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.360557    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/51f20288-4267-45e2-b596-2ec3f89d5ca6-tmp\") pod \"opendatahub-operator-controller-manager-65c67f598f-76ms4\" (UID: \"51f20288-4267-45e2-b596-2ec3f89d5ca6\") " pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4"
Jul 15 21:08:07.366667 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.366634    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwzjq\" (UniqueName: \"kubernetes.io/projected/51f20288-4267-45e2-b596-2ec3f89d5ca6-kube-api-access-mwzjq\") pod \"opendatahub-operator-controller-manager-65c67f598f-76ms4\" (UID: \"51f20288-4267-45e2-b596-2ec3f89d5ca6\") " pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4"
Jul 15 21:08:07.430734 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.430709    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4"
Jul 15 21:08:07.566623 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.566600    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4"]
Jul 15 21:08:07.569602 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:08:07.569576    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51f20288_4267_45e2_b596_2ec3f89d5ca6.slice/crio-3128cd15473140a24214318c4ae90b8e8bc22f4f9a6d422bb785e2210fdf91cf WatchSource:0}: Error finding container 3128cd15473140a24214318c4ae90b8e8bc22f4f9a6d422bb785e2210fdf91cf: Status 404 returned error can't find the container with id 3128cd15473140a24214318c4ae90b8e8bc22f4f9a6d422bb785e2210fdf91cf
Jul 15 21:08:07.571533 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.571513    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 21:08:07.764921 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:07.764805    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4" event={"ID":"51f20288-4267-45e2-b596-2ec3f89d5ca6","Type":"ContainerStarted","Data":"3128cd15473140a24214318c4ae90b8e8bc22f4f9a6d422bb785e2210fdf91cf"}
Jul 15 21:08:10.781150 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:10.781071    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4" event={"ID":"51f20288-4267-45e2-b596-2ec3f89d5ca6","Type":"ContainerStarted","Data":"d62cd4b97c3bc60db72b10609500e51e4061bdf07b3da17befcddec4ec605a36"}
Jul 15 21:08:11.786499 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:11.786466    2580 generic.go:356] "Generic (PLEG): container finished" podID="51f20288-4267-45e2-b596-2ec3f89d5ca6" containerID="d62cd4b97c3bc60db72b10609500e51e4061bdf07b3da17befcddec4ec605a36" exitCode=0
Jul 15 21:08:11.786903 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:11.786554    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4" event={"ID":"51f20288-4267-45e2-b596-2ec3f89d5ca6","Type":"ContainerDied","Data":"d62cd4b97c3bc60db72b10609500e51e4061bdf07b3da17befcddec4ec605a36"}
Jul 15 21:08:12.792599 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:12.792563    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4" event={"ID":"51f20288-4267-45e2-b596-2ec3f89d5ca6","Type":"ContainerStarted","Data":"5f64a5ab097ef191eb5270f4b573f31433c57f1e808a4683297f508138032682"}
Jul 15 21:08:12.793099 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:12.792674    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4"
Jul 15 21:08:12.819547 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:12.819496    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4" podStartSLOduration=1.455329598 podStartE2EDuration="5.81947921s" totalImagesPullingTime="3.318132217s" totalInitContainerRuntime="1.046017395s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:08:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:08:12.817351477 +0000 UTC m=+394.245311113" watchObservedRunningTime="2026-07-15 21:08:12.81947921 +0000 UTC m=+394.247438914"
Jul 15 21:08:23.798554 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:23.798520    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-65c67f598f-76ms4"
Jul 15 21:08:27.082989 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.082955    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw"]
Jul 15 21:08:27.096764 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.096736    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw"
Jul 15 21:08:27.098443 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.098414    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw"]
Jul 15 21:08:27.098870 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.098852    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 21:08:27.099526 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.099505    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 21:08:27.099631 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.099606    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-r52kh\""
Jul 15 21:08:27.099698 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.099516    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 21:08:27.099698 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.099568    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 21:08:27.099698 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.099577    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 21:08:27.225798 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.225769    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7f5e9da4-a3dc-40b0-8865-bdc244ec7035-manager-config\") pod \"lws-controller-manager-5ccd478559-sq9fw\" (UID: \"7f5e9da4-a3dc-40b0-8865-bdc244ec7035\") " pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw"
Jul 15 21:08:27.225798 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.225800    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmkr9\" (UniqueName: \"kubernetes.io/projected/7f5e9da4-a3dc-40b0-8865-bdc244ec7035-kube-api-access-jmkr9\") pod \"lws-controller-manager-5ccd478559-sq9fw\" (UID: \"7f5e9da4-a3dc-40b0-8865-bdc244ec7035\") " pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw"
Jul 15 21:08:27.226032 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.225830    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f5e9da4-a3dc-40b0-8865-bdc244ec7035-cert\") pod \"lws-controller-manager-5ccd478559-sq9fw\" (UID: \"7f5e9da4-a3dc-40b0-8865-bdc244ec7035\") " pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw"
Jul 15 21:08:27.226032 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.226002    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f5e9da4-a3dc-40b0-8865-bdc244ec7035-metrics-cert\") pod \"lws-controller-manager-5ccd478559-sq9fw\" (UID: \"7f5e9da4-a3dc-40b0-8865-bdc244ec7035\") " pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw"
Jul 15 21:08:27.327035 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.326996    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f5e9da4-a3dc-40b0-8865-bdc244ec7035-cert\") pod \"lws-controller-manager-5ccd478559-sq9fw\" (UID: \"7f5e9da4-a3dc-40b0-8865-bdc244ec7035\") " pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw"
Jul 15 21:08:27.327231 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.327088    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f5e9da4-a3dc-40b0-8865-bdc244ec7035-metrics-cert\") pod \"lws-controller-manager-5ccd478559-sq9fw\" (UID: \"7f5e9da4-a3dc-40b0-8865-bdc244ec7035\") " pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw"
Jul 15 21:08:27.327231 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.327114    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7f5e9da4-a3dc-40b0-8865-bdc244ec7035-manager-config\") pod \"lws-controller-manager-5ccd478559-sq9fw\" (UID: \"7f5e9da4-a3dc-40b0-8865-bdc244ec7035\") " pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw"
Jul 15 21:08:27.327231 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.327131    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmkr9\" (UniqueName: \"kubernetes.io/projected/7f5e9da4-a3dc-40b0-8865-bdc244ec7035-kube-api-access-jmkr9\") pod \"lws-controller-manager-5ccd478559-sq9fw\" (UID: \"7f5e9da4-a3dc-40b0-8865-bdc244ec7035\") " pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw"
Jul 15 21:08:27.327767 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.327743    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7f5e9da4-a3dc-40b0-8865-bdc244ec7035-manager-config\") pod \"lws-controller-manager-5ccd478559-sq9fw\" (UID: \"7f5e9da4-a3dc-40b0-8865-bdc244ec7035\") " pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw"
Jul 15 21:08:27.329520 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.329495    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7f5e9da4-a3dc-40b0-8865-bdc244ec7035-cert\") pod \"lws-controller-manager-5ccd478559-sq9fw\" (UID: \"7f5e9da4-a3dc-40b0-8865-bdc244ec7035\") " pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw"
Jul 15 21:08:27.329683 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.329664    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7f5e9da4-a3dc-40b0-8865-bdc244ec7035-metrics-cert\") pod \"lws-controller-manager-5ccd478559-sq9fw\" (UID: \"7f5e9da4-a3dc-40b0-8865-bdc244ec7035\") " pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw"
Jul 15 21:08:27.334549 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.334506    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmkr9\" (UniqueName: \"kubernetes.io/projected/7f5e9da4-a3dc-40b0-8865-bdc244ec7035-kube-api-access-jmkr9\") pod \"lws-controller-manager-5ccd478559-sq9fw\" (UID: \"7f5e9da4-a3dc-40b0-8865-bdc244ec7035\") " pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw"
Jul 15 21:08:27.406740 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.406716    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw"
Jul 15 21:08:27.546745 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.546721    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw"]
Jul 15 21:08:27.549138 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:08:27.549116    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5e9da4_a3dc_40b0_8865_bdc244ec7035.slice/crio-8cb523f53086c82a119c65193646a0e4d2ce7ef8fcd1eae3ed71aab21c548de5 WatchSource:0}: Error finding container 8cb523f53086c82a119c65193646a0e4d2ce7ef8fcd1eae3ed71aab21c548de5: Status 404 returned error can't find the container with id 8cb523f53086c82a119c65193646a0e4d2ce7ef8fcd1eae3ed71aab21c548de5
Jul 15 21:08:27.855568 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:27.855519    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw" event={"ID":"7f5e9da4-a3dc-40b0-8865-bdc244ec7035","Type":"ContainerStarted","Data":"8cb523f53086c82a119c65193646a0e4d2ce7ef8fcd1eae3ed71aab21c548de5"}
Jul 15 21:08:30.873758 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:30.873722    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw" event={"ID":"7f5e9da4-a3dc-40b0-8865-bdc244ec7035","Type":"ContainerStarted","Data":"84b2316a05e63da4e1480323ee86f90f07fc9ebcc109176f41ffa8f631245d7e"}
Jul 15 21:08:30.874152 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:30.873871    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw"
Jul 15 21:08:30.908150 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:30.908099    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw" podStartSLOduration=1.214043476 podStartE2EDuration="3.908085087s" totalImagesPullingTime="2.694041611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:08:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:08:30.906508848 +0000 UTC m=+412.334468488" watchObservedRunningTime="2026-07-15 21:08:30.908085087 +0000 UTC m=+412.336044723"
Jul 15 21:08:31.515724 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:31.515694    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6f6cc69c87-ls8nd"]
Jul 15 21:08:31.523939 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:31.523917    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f6cc69c87-ls8nd"
Jul 15 21:08:31.526290 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:31.526257    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 21:08:31.526449 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:31.526320    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 21:08:31.526449 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:31.526424    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-p2qjl\""
Jul 15 21:08:31.527369 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:31.527347    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f6cc69c87-ls8nd"]
Jul 15 21:08:31.559807 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:31.559777    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z6mn\" (UniqueName: \"kubernetes.io/projected/2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7-kube-api-access-2z6mn\") pod \"kube-auth-proxy-6f6cc69c87-ls8nd\" (UID: \"2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7\") " pod="openshift-ingress/kube-auth-proxy-6f6cc69c87-ls8nd"
Jul 15 21:08:31.559807 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:31.559808    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7-tmp\") pod \"kube-auth-proxy-6f6cc69c87-ls8nd\" (UID: \"2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7\") " pod="openshift-ingress/kube-auth-proxy-6f6cc69c87-ls8nd"
Jul 15 21:08:31.559982 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:31.559855    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7-tls-certs\") pod \"kube-auth-proxy-6f6cc69c87-ls8nd\" (UID: \"2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7\") " pod="openshift-ingress/kube-auth-proxy-6f6cc69c87-ls8nd"
Jul 15 21:08:31.660875 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:31.660820    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7-tmp\") pod \"kube-auth-proxy-6f6cc69c87-ls8nd\" (UID: \"2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7\") " pod="openshift-ingress/kube-auth-proxy-6f6cc69c87-ls8nd"
Jul 15 21:08:31.661015 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:31.660897    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7-tls-certs\") pod \"kube-auth-proxy-6f6cc69c87-ls8nd\" (UID: \"2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7\") " pod="openshift-ingress/kube-auth-proxy-6f6cc69c87-ls8nd"
Jul 15 21:08:31.661015 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:31.660969    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z6mn\" (UniqueName: \"kubernetes.io/projected/2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7-kube-api-access-2z6mn\") pod \"kube-auth-proxy-6f6cc69c87-ls8nd\" (UID: \"2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7\") " pod="openshift-ingress/kube-auth-proxy-6f6cc69c87-ls8nd"
Jul 15 21:08:31.661087 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:08:31.661046    2580 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 15 21:08:31.661120 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:08:31.661113    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7-tls-certs podName:2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7 nodeName:}" failed. No retries permitted until 2026-07-15 21:08:32.161095632 +0000 UTC m=+413.589055250 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7-tls-certs") pod "kube-auth-proxy-6f6cc69c87-ls8nd" (UID: "2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7") : secret "kube-auth-proxy-tls" not found
Jul 15 21:08:31.663052 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:31.663025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7-tmp\") pod \"kube-auth-proxy-6f6cc69c87-ls8nd\" (UID: \"2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7\") " pod="openshift-ingress/kube-auth-proxy-6f6cc69c87-ls8nd"
Jul 15 21:08:31.669337 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:31.669311    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z6mn\" (UniqueName: \"kubernetes.io/projected/2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7-kube-api-access-2z6mn\") pod \"kube-auth-proxy-6f6cc69c87-ls8nd\" (UID: \"2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7\") " pod="openshift-ingress/kube-auth-proxy-6f6cc69c87-ls8nd"
Jul 15 21:08:32.165607 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:32.165572    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7-tls-certs\") pod \"kube-auth-proxy-6f6cc69c87-ls8nd\" (UID: \"2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7\") " pod="openshift-ingress/kube-auth-proxy-6f6cc69c87-ls8nd"
Jul 15 21:08:32.168072 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:32.168051    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7-tls-certs\") pod \"kube-auth-proxy-6f6cc69c87-ls8nd\" (UID: \"2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7\") " pod="openshift-ingress/kube-auth-proxy-6f6cc69c87-ls8nd"
Jul 15 21:08:32.434732 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:32.434708    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6f6cc69c87-ls8nd"
Jul 15 21:08:32.571316 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:32.571292    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6f6cc69c87-ls8nd"]
Jul 15 21:08:32.573521 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:08:32.573482    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ce63cb9_b5dc_4c15_81b8_8500fbf0d7b7.slice/crio-b93dfd6e457a0202d97ed60c254aa2b13cd646fe36b2409f6b89c8fd925c49b8 WatchSource:0}: Error finding container b93dfd6e457a0202d97ed60c254aa2b13cd646fe36b2409f6b89c8fd925c49b8: Status 404 returned error can't find the container with id b93dfd6e457a0202d97ed60c254aa2b13cd646fe36b2409f6b89c8fd925c49b8
Jul 15 21:08:32.884301 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:32.884212    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f6cc69c87-ls8nd" event={"ID":"2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7","Type":"ContainerStarted","Data":"b93dfd6e457a0202d97ed60c254aa2b13cd646fe36b2409f6b89c8fd925c49b8"}
Jul 15 21:08:34.894358 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:34.894324    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6f6cc69c87-ls8nd" event={"ID":"2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7","Type":"ContainerStarted","Data":"c32a3048ab098f0963fc19095e3a99cec7f2aa45448f91f295cb55e313e737b0"}
Jul 15 21:08:34.912076 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:34.912028    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6f6cc69c87-ls8nd" podStartSLOduration=1.722218315 podStartE2EDuration="3.912013586s" totalImagesPullingTime="2.189795271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:08:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:08:34.910429938 +0000 UTC m=+416.338389574" watchObservedRunningTime="2026-07-15 21:08:34.912013586 +0000 UTC m=+416.339973222"
Jul 15 21:08:41.880699 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:08:41.880661    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw"
Jul 15 21:10:07.556639 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:07.556601    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9wvtn"]
Jul 15 21:10:07.560045 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:07.560023    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wvtn"
Jul 15 21:10:07.567276 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:07.567257    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 15 21:10:07.567920 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:07.567905    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 21:10:07.568448 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:07.568431    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 15 21:10:07.570771 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:07.570755    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-22259\""
Jul 15 21:10:07.572411 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:07.572398    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 21:10:07.598189 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:07.598160    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e9178c21-45d2-4537-85ad-2ae9fd1e84a6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9wvtn\" (UID: \"e9178c21-45d2-4537-85ad-2ae9fd1e84a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wvtn"
Jul 15 21:10:07.598324 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:07.598223    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9178c21-45d2-4537-85ad-2ae9fd1e84a6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9wvtn\" (UID: \"e9178c21-45d2-4537-85ad-2ae9fd1e84a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wvtn"
Jul 15 21:10:07.598366 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:07.598319    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwnbq\" (UniqueName: \"kubernetes.io/projected/e9178c21-45d2-4537-85ad-2ae9fd1e84a6-kube-api-access-jwnbq\") pod \"kuadrant-console-plugin-66b5774985-9wvtn\" (UID: \"e9178c21-45d2-4537-85ad-2ae9fd1e84a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wvtn"
Jul 15 21:10:07.606889 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:07.606863    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9wvtn"]
Jul 15 21:10:07.698949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:07.698912    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e9178c21-45d2-4537-85ad-2ae9fd1e84a6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9wvtn\" (UID: \"e9178c21-45d2-4537-85ad-2ae9fd1e84a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wvtn"
Jul 15 21:10:07.699131 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:07.699013    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9178c21-45d2-4537-85ad-2ae9fd1e84a6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9wvtn\" (UID: \"e9178c21-45d2-4537-85ad-2ae9fd1e84a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wvtn"
Jul 15 21:10:07.699131 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:07.699048    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwnbq\" (UniqueName: \"kubernetes.io/projected/e9178c21-45d2-4537-85ad-2ae9fd1e84a6-kube-api-access-jwnbq\") pod \"kuadrant-console-plugin-66b5774985-9wvtn\" (UID: \"e9178c21-45d2-4537-85ad-2ae9fd1e84a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wvtn"
Jul 15 21:10:07.699246 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:10:07.699168    2580 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 15 21:10:07.699296 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:10:07.699255    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9178c21-45d2-4537-85ad-2ae9fd1e84a6-plugin-serving-cert podName:e9178c21-45d2-4537-85ad-2ae9fd1e84a6 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:08.199233752 +0000 UTC m=+509.627193380 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/e9178c21-45d2-4537-85ad-2ae9fd1e84a6-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-9wvtn" (UID: "e9178c21-45d2-4537-85ad-2ae9fd1e84a6") : secret "plugin-serving-cert" not found
Jul 15 21:10:07.699634 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:07.699614    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e9178c21-45d2-4537-85ad-2ae9fd1e84a6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9wvtn\" (UID: \"e9178c21-45d2-4537-85ad-2ae9fd1e84a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wvtn"
Jul 15 21:10:07.722722 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:07.722700    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwnbq\" (UniqueName: \"kubernetes.io/projected/e9178c21-45d2-4537-85ad-2ae9fd1e84a6-kube-api-access-jwnbq\") pod \"kuadrant-console-plugin-66b5774985-9wvtn\" (UID: \"e9178c21-45d2-4537-85ad-2ae9fd1e84a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wvtn"
Jul 15 21:10:08.203534 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:08.203487    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9178c21-45d2-4537-85ad-2ae9fd1e84a6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9wvtn\" (UID: \"e9178c21-45d2-4537-85ad-2ae9fd1e84a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wvtn"
Jul 15 21:10:08.205881 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:08.205855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/e9178c21-45d2-4537-85ad-2ae9fd1e84a6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9wvtn\" (UID: \"e9178c21-45d2-4537-85ad-2ae9fd1e84a6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wvtn"
Jul 15 21:10:08.468758 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:08.468667    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wvtn"
Jul 15 21:10:08.747346 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:10:08.747314    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9178c21_45d2_4537_85ad_2ae9fd1e84a6.slice/crio-66ebbe83dbbf534b097d8f9120a4bf37c04682ceb781eff6c7d22bd52ef4184a WatchSource:0}: Error finding container 66ebbe83dbbf534b097d8f9120a4bf37c04682ceb781eff6c7d22bd52ef4184a: Status 404 returned error can't find the container with id 66ebbe83dbbf534b097d8f9120a4bf37c04682ceb781eff6c7d22bd52ef4184a
Jul 15 21:10:08.748804 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:08.748782    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9wvtn"]
Jul 15 21:10:09.298102 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:09.298071    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wvtn" event={"ID":"e9178c21-45d2-4537-85ad-2ae9fd1e84a6","Type":"ContainerStarted","Data":"66ebbe83dbbf534b097d8f9120a4bf37c04682ceb781eff6c7d22bd52ef4184a"}
Jul 15 21:10:31.414034 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:31.413993    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wvtn" event={"ID":"e9178c21-45d2-4537-85ad-2ae9fd1e84a6","Type":"ContainerStarted","Data":"75a402ce02d92a52fe3f018515c37beb23742a23907db3c208ea59e11fd64014"}
Jul 15 21:10:31.454435 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:31.454377    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9wvtn" podStartSLOduration=1.987945067 podStartE2EDuration="24.454355144s" totalImagesPullingTime="22.466410077s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:31.454356612 +0000 UTC m=+532.882316249" watchObservedRunningTime="2026-07-15 21:10:31.454355144 +0000 UTC m=+532.882314782"
Jul 15 21:10:51.681064 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:51.681027    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zkcqc"]
Jul 15 21:10:51.743500 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:51.743468    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zkcqc"]
Jul 15 21:10:51.743650 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:51.743584    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkcqc"
Jul 15 21:10:51.748698 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:51.748671    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 21:10:51.775279 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:51.775249    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zkcqc"]
Jul 15 21:10:51.796922 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:51.796891    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6-config-file\") pod \"limitador-limitador-64c94fd64f-zkcqc\" (UID: \"8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zkcqc"
Jul 15 21:10:51.797092 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:51.797029    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpbzn\" (UniqueName: \"kubernetes.io/projected/8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6-kube-api-access-kpbzn\") pod \"limitador-limitador-64c94fd64f-zkcqc\" (UID: \"8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zkcqc"
Jul 15 21:10:51.898268 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:51.898228    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpbzn\" (UniqueName: \"kubernetes.io/projected/8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6-kube-api-access-kpbzn\") pod \"limitador-limitador-64c94fd64f-zkcqc\" (UID: \"8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zkcqc"
Jul 15 21:10:51.898435 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:51.898288    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6-config-file\") pod \"limitador-limitador-64c94fd64f-zkcqc\" (UID: \"8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zkcqc"
Jul 15 21:10:51.898887 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:51.898870    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6-config-file\") pod \"limitador-limitador-64c94fd64f-zkcqc\" (UID: \"8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zkcqc"
Jul 15 21:10:51.910325 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:51.910307    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpbzn\" (UniqueName: \"kubernetes.io/projected/8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6-kube-api-access-kpbzn\") pod \"limitador-limitador-64c94fd64f-zkcqc\" (UID: \"8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-zkcqc"
Jul 15 21:10:52.054798 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:52.054711    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkcqc"
Jul 15 21:10:52.225678 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:52.225654    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zkcqc"]
Jul 15 21:10:52.227777 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:10:52.227754    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b82e3b0_2337_4b1c_b086_d5ce5a1edbb6.slice/crio-225ce900ef60925c01c9142e332df70c48c81bcc29966060b939b1992682979c WatchSource:0}: Error finding container 225ce900ef60925c01c9142e332df70c48c81bcc29966060b939b1992682979c: Status 404 returned error can't find the container with id 225ce900ef60925c01c9142e332df70c48c81bcc29966060b939b1992682979c
Jul 15 21:10:52.510887 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:52.510848    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkcqc" event={"ID":"8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6","Type":"ContainerStarted","Data":"225ce900ef60925c01c9142e332df70c48c81bcc29966060b939b1992682979c"}
Jul 15 21:10:52.740146 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:52.740112    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-7kzp9"]
Jul 15 21:10:52.743292 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:52.743274    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7kzp9"
Jul 15 21:10:52.754615 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:52.754593    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jjhd7\""
Jul 15 21:10:52.756924 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:52.756904    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7kzp9"]
Jul 15 21:10:52.805103 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:52.805040    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzc9w\" (UniqueName: \"kubernetes.io/projected/b7b35041-ba18-4448-9be2-82758f816420-kube-api-access-jzc9w\") pod \"authorino-58cd955675-7kzp9\" (UID: \"b7b35041-ba18-4448-9be2-82758f816420\") " pod="kuadrant-system/authorino-58cd955675-7kzp9"
Jul 15 21:10:52.906475 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:52.906439    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzc9w\" (UniqueName: \"kubernetes.io/projected/b7b35041-ba18-4448-9be2-82758f816420-kube-api-access-jzc9w\") pod \"authorino-58cd955675-7kzp9\" (UID: \"b7b35041-ba18-4448-9be2-82758f816420\") " pod="kuadrant-system/authorino-58cd955675-7kzp9"
Jul 15 21:10:52.921600 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:52.921567    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzc9w\" (UniqueName: \"kubernetes.io/projected/b7b35041-ba18-4448-9be2-82758f816420-kube-api-access-jzc9w\") pod \"authorino-58cd955675-7kzp9\" (UID: \"b7b35041-ba18-4448-9be2-82758f816420\") " pod="kuadrant-system/authorino-58cd955675-7kzp9"
Jul 15 21:10:53.052360 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:53.052327    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7kzp9"
Jul 15 21:10:53.247693 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:53.247666    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7kzp9"]
Jul 15 21:10:53.250587 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:10:53.250554    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7b35041_ba18_4448_9be2_82758f816420.slice/crio-ffb3189e2955412f2268882ac9536a4212c179d4ea02c23d7b41037e23b50db1 WatchSource:0}: Error finding container ffb3189e2955412f2268882ac9536a4212c179d4ea02c23d7b41037e23b50db1: Status 404 returned error can't find the container with id ffb3189e2955412f2268882ac9536a4212c179d4ea02c23d7b41037e23b50db1
Jul 15 21:10:53.517962 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:53.517916    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7kzp9" event={"ID":"b7b35041-ba18-4448-9be2-82758f816420","Type":"ContainerStarted","Data":"ffb3189e2955412f2268882ac9536a4212c179d4ea02c23d7b41037e23b50db1"}
Jul 15 21:10:55.532915 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:55.532877    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkcqc" event={"ID":"8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6","Type":"ContainerStarted","Data":"c21d84d47f0b555e3c6f5b98aa72a63426c49fe36cb0f3b247629f113063a7b9"}
Jul 15 21:10:55.533349 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:55.533018    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkcqc"
Jul 15 21:10:55.563386 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:55.563327    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkcqc" podStartSLOduration=1.748655383 podStartE2EDuration="4.563305878s" totalImagesPullingTime="2.814650495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:55.561374136 +0000 UTC m=+556.989333779" watchObservedRunningTime="2026-07-15 21:10:55.563305878 +0000 UTC m=+556.991265516"
Jul 15 21:10:57.543449 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:57.543413    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7kzp9" event={"ID":"b7b35041-ba18-4448-9be2-82758f816420","Type":"ContainerStarted","Data":"2e36fb570804b4ef3e9a632d95a46dd3177a821c09162fa742d0c552b27a4344"}
Jul 15 21:10:57.569685 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:57.569640    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-7kzp9" podStartSLOduration=1.4533992470000001 podStartE2EDuration="5.569624655s" totalImagesPullingTime="4.116225408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:57.568211275 +0000 UTC m=+558.996170911" watchObservedRunningTime="2026-07-15 21:10:57.569624655 +0000 UTC m=+558.997584290"
Jul 15 21:10:58.539174 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:58.539144    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7kzp9"]
Jul 15 21:10:59.551913 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:59.551831    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-7kzp9" podUID="b7b35041-ba18-4448-9be2-82758f816420" containerName="authorino" containerID="cri-o://2e36fb570804b4ef3e9a632d95a46dd3177a821c09162fa742d0c552b27a4344" gracePeriod=30
Jul 15 21:10:59.863449 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:59.863415    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7kzp9"
Jul 15 21:10:59.972235 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:59.972201    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzc9w\" (UniqueName: \"kubernetes.io/projected/b7b35041-ba18-4448-9be2-82758f816420-kube-api-access-jzc9w\") pod \"b7b35041-ba18-4448-9be2-82758f816420\" (UID: \"b7b35041-ba18-4448-9be2-82758f816420\") "
Jul 15 21:10:59.974452 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:10:59.974418    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7b35041-ba18-4448-9be2-82758f816420-kube-api-access-jzc9w" (OuterVolumeSpecName: "kube-api-access-jzc9w") pod "b7b35041-ba18-4448-9be2-82758f816420" (UID: "b7b35041-ba18-4448-9be2-82758f816420"). InnerVolumeSpecName "kube-api-access-jzc9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:11:00.072933 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:00.072862    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzc9w\" (UniqueName: \"kubernetes.io/projected/b7b35041-ba18-4448-9be2-82758f816420-kube-api-access-jzc9w\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:11:00.558492 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:00.558459    2580 generic.go:356] "Generic (PLEG): container finished" podID="b7b35041-ba18-4448-9be2-82758f816420" containerID="2e36fb570804b4ef3e9a632d95a46dd3177a821c09162fa742d0c552b27a4344" exitCode=0
Jul 15 21:11:00.558916 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:00.558503    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7kzp9"
Jul 15 21:11:00.558916 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:00.558535    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7kzp9" event={"ID":"b7b35041-ba18-4448-9be2-82758f816420","Type":"ContainerDied","Data":"2e36fb570804b4ef3e9a632d95a46dd3177a821c09162fa742d0c552b27a4344"}
Jul 15 21:11:00.558916 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:00.558568    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7kzp9" event={"ID":"b7b35041-ba18-4448-9be2-82758f816420","Type":"ContainerDied","Data":"ffb3189e2955412f2268882ac9536a4212c179d4ea02c23d7b41037e23b50db1"}
Jul 15 21:11:00.558916 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:00.558585    2580 scope.go:117] "RemoveContainer" containerID="2e36fb570804b4ef3e9a632d95a46dd3177a821c09162fa742d0c552b27a4344"
Jul 15 21:11:00.567987 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:00.567972    2580 scope.go:117] "RemoveContainer" containerID="2e36fb570804b4ef3e9a632d95a46dd3177a821c09162fa742d0c552b27a4344"
Jul 15 21:11:00.568245 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:11:00.568224    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e36fb570804b4ef3e9a632d95a46dd3177a821c09162fa742d0c552b27a4344\": container with ID starting with 2e36fb570804b4ef3e9a632d95a46dd3177a821c09162fa742d0c552b27a4344 not found: ID does not exist" containerID="2e36fb570804b4ef3e9a632d95a46dd3177a821c09162fa742d0c552b27a4344"
Jul 15 21:11:00.568308 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:00.568256    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e36fb570804b4ef3e9a632d95a46dd3177a821c09162fa742d0c552b27a4344"} err="failed to get container status \"2e36fb570804b4ef3e9a632d95a46dd3177a821c09162fa742d0c552b27a4344\": rpc error: code = NotFound desc = could not find container \"2e36fb570804b4ef3e9a632d95a46dd3177a821c09162fa742d0c552b27a4344\": container with ID starting with 2e36fb570804b4ef3e9a632d95a46dd3177a821c09162fa742d0c552b27a4344 not found: ID does not exist"
Jul 15 21:11:00.590085 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:00.590054    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7kzp9"]
Jul 15 21:11:00.599985 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:00.599959    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-7kzp9"]
Jul 15 21:11:01.063218 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:01.063177    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7b35041-ba18-4448-9be2-82758f816420" path="/var/lib/kubelet/pods/b7b35041-ba18-4448-9be2-82758f816420/volumes"
Jul 15 21:11:06.530566 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:06.530534    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zkcqc"]
Jul 15 21:11:06.530977 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:06.530735    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkcqc" podUID="8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6" containerName="limitador" containerID="cri-o://c21d84d47f0b555e3c6f5b98aa72a63426c49fe36cb0f3b247629f113063a7b9" gracePeriod=30
Jul 15 21:11:06.531459 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:06.531440    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkcqc"
Jul 15 21:11:07.082393 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:07.082366    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkcqc"
Jul 15 21:11:07.134895 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:07.134797    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6-config-file\") pod \"8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6\" (UID: \"8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6\") "
Jul 15 21:11:07.134895 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:07.134829    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpbzn\" (UniqueName: \"kubernetes.io/projected/8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6-kube-api-access-kpbzn\") pod \"8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6\" (UID: \"8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6\") "
Jul 15 21:11:07.135223 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:07.135197    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6-config-file" (OuterVolumeSpecName: "config-file") pod "8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6" (UID: "8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 21:11:07.136898 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:07.136878    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6-kube-api-access-kpbzn" (OuterVolumeSpecName: "kube-api-access-kpbzn") pod "8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6" (UID: "8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6"). InnerVolumeSpecName "kube-api-access-kpbzn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:11:07.236508 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:07.236471    2580 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6-config-file\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:11:07.236508 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:07.236501    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpbzn\" (UniqueName: \"kubernetes.io/projected/8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6-kube-api-access-kpbzn\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:11:07.591971 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:07.591934    2580 generic.go:356] "Generic (PLEG): container finished" podID="8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6" containerID="c21d84d47f0b555e3c6f5b98aa72a63426c49fe36cb0f3b247629f113063a7b9" exitCode=0
Jul 15 21:11:07.592421 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:07.591977    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkcqc"
Jul 15 21:11:07.592421 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:07.591986    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkcqc" event={"ID":"8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6","Type":"ContainerDied","Data":"c21d84d47f0b555e3c6f5b98aa72a63426c49fe36cb0f3b247629f113063a7b9"}
Jul 15 21:11:07.592421 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:07.592036    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-zkcqc" event={"ID":"8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6","Type":"ContainerDied","Data":"225ce900ef60925c01c9142e332df70c48c81bcc29966060b939b1992682979c"}
Jul 15 21:11:07.592421 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:07.592066    2580 scope.go:117] "RemoveContainer" containerID="c21d84d47f0b555e3c6f5b98aa72a63426c49fe36cb0f3b247629f113063a7b9"
Jul 15 21:11:07.600518 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:07.600499    2580 scope.go:117] "RemoveContainer" containerID="c21d84d47f0b555e3c6f5b98aa72a63426c49fe36cb0f3b247629f113063a7b9"
Jul 15 21:11:07.600748 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:11:07.600729    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c21d84d47f0b555e3c6f5b98aa72a63426c49fe36cb0f3b247629f113063a7b9\": container with ID starting with c21d84d47f0b555e3c6f5b98aa72a63426c49fe36cb0f3b247629f113063a7b9 not found: ID does not exist" containerID="c21d84d47f0b555e3c6f5b98aa72a63426c49fe36cb0f3b247629f113063a7b9"
Jul 15 21:11:07.600807 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:07.600758    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c21d84d47f0b555e3c6f5b98aa72a63426c49fe36cb0f3b247629f113063a7b9"} err="failed to get container status \"c21d84d47f0b555e3c6f5b98aa72a63426c49fe36cb0f3b247629f113063a7b9\": rpc error: code = NotFound desc = could not find container \"c21d84d47f0b555e3c6f5b98aa72a63426c49fe36cb0f3b247629f113063a7b9\": container with ID starting with c21d84d47f0b555e3c6f5b98aa72a63426c49fe36cb0f3b247629f113063a7b9 not found: ID does not exist"
Jul 15 21:11:07.626240 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:07.626211    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zkcqc"]
Jul 15 21:11:07.632067 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:07.632040    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-zkcqc"]
Jul 15 21:11:08.299726 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:08.299693    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qhpgd"]
Jul 15 21:11:08.300166 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:08.300148    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7b35041-ba18-4448-9be2-82758f816420" containerName="authorino"
Jul 15 21:11:08.300259 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:08.300168    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7b35041-ba18-4448-9be2-82758f816420" containerName="authorino"
Jul 15 21:11:08.300259 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:08.300190    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6" containerName="limitador"
Jul 15 21:11:08.300259 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:08.300197    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6" containerName="limitador"
Jul 15 21:11:08.300398 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:08.300277    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7b35041-ba18-4448-9be2-82758f816420" containerName="authorino"
Jul 15 21:11:08.300398 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:08.300291    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6" containerName="limitador"
Jul 15 21:11:08.308793 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:08.308762    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhpgd"
Jul 15 21:11:08.313214 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:08.313195    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 15 21:11:08.318249 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:08.318228    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 21:11:08.323635 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:08.323618    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-pv4q7\""
Jul 15 21:11:08.326583 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:08.326566    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 21:11:08.331304 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:08.331283    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qhpgd"]
Jul 15 21:11:08.346378 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:08.346347    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ab5f8941-98d4-4aca-9d76-206271a0b20b-data\") pod \"postgres-69fb4594cf-qhpgd\" (UID: \"ab5f8941-98d4-4aca-9d76-206271a0b20b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhpgd"
Jul 15 21:11:08.346503 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:08.346383    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m72x9\" (UniqueName: \"kubernetes.io/projected/ab5f8941-98d4-4aca-9d76-206271a0b20b-kube-api-access-m72x9\") pod \"postgres-69fb4594cf-qhpgd\" (UID: \"ab5f8941-98d4-4aca-9d76-206271a0b20b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhpgd"
Jul 15 21:11:08.447481 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:08.447447    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ab5f8941-98d4-4aca-9d76-206271a0b20b-data\") pod \"postgres-69fb4594cf-qhpgd\" (UID: \"ab5f8941-98d4-4aca-9d76-206271a0b20b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhpgd"
Jul 15 21:11:08.447481 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:08.447481    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m72x9\" (UniqueName: \"kubernetes.io/projected/ab5f8941-98d4-4aca-9d76-206271a0b20b-kube-api-access-m72x9\") pod \"postgres-69fb4594cf-qhpgd\" (UID: \"ab5f8941-98d4-4aca-9d76-206271a0b20b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhpgd"
Jul 15 21:11:08.447873 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:08.447830    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ab5f8941-98d4-4aca-9d76-206271a0b20b-data\") pod \"postgres-69fb4594cf-qhpgd\" (UID: \"ab5f8941-98d4-4aca-9d76-206271a0b20b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhpgd"
Jul 15 21:11:08.455493 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:08.455466    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m72x9\" (UniqueName: \"kubernetes.io/projected/ab5f8941-98d4-4aca-9d76-206271a0b20b-kube-api-access-m72x9\") pod \"postgres-69fb4594cf-qhpgd\" (UID: \"ab5f8941-98d4-4aca-9d76-206271a0b20b\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhpgd"
Jul 15 21:11:08.619259 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:08.619165    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhpgd"
Jul 15 21:11:08.752659 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:08.752635    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qhpgd"]
Jul 15 21:11:08.754711 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:11:08.754682    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab5f8941_98d4_4aca_9d76_206271a0b20b.slice/crio-b2c67de405ddd82c99ba09a61d4d30189effab7632f38d4c981a64ea6d53c90b WatchSource:0}: Error finding container b2c67de405ddd82c99ba09a61d4d30189effab7632f38d4c981a64ea6d53c90b: Status 404 returned error can't find the container with id b2c67de405ddd82c99ba09a61d4d30189effab7632f38d4c981a64ea6d53c90b
Jul 15 21:11:09.062048 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:09.062015    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6" path="/var/lib/kubelet/pods/8b82e3b0-2337-4b1c-b086-d5ce5a1edbb6/volumes"
Jul 15 21:11:09.603012 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:09.602977    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhpgd" event={"ID":"ab5f8941-98d4-4aca-9d76-206271a0b20b","Type":"ContainerStarted","Data":"b2c67de405ddd82c99ba09a61d4d30189effab7632f38d4c981a64ea6d53c90b"}
Jul 15 21:11:14.631060 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:14.631026    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhpgd" event={"ID":"ab5f8941-98d4-4aca-9d76-206271a0b20b","Type":"ContainerStarted","Data":"e1c4e8c7db6471fae4feb6d4e987ab8f115faa47bee4b13c471f6e86f2e88a4f"}
Jul 15 21:11:14.631443 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:14.631132    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhpgd"
Jul 15 21:11:14.669320 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:14.669229    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhpgd" podStartSLOduration=1.031326338 podStartE2EDuration="6.669211181s" totalImagesPullingTime="5.637884843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:11:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:14.668835764 +0000 UTC m=+576.096795401" watchObservedRunningTime="2026-07-15 21:11:14.669211181 +0000 UTC m=+576.097170816"
Jul 15 21:11:20.666819 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:20.666790    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qhpgd"
Jul 15 21:11:21.192079 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.192044    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zm9d8"]
Jul 15 21:11:21.198327 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.198281    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zm9d8"
Jul 15 21:11:21.200292 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.200266    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zm9d8"]
Jul 15 21:11:21.200482 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.200469    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jjhd7\""
Jul 15 21:11:21.362044 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.362008    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6plj\" (UniqueName: \"kubernetes.io/projected/750a6a5e-d6c1-4444-aa27-eea32966d975-kube-api-access-d6plj\") pod \"authorino-5d4b67c446-zm9d8\" (UID: \"750a6a5e-d6c1-4444-aa27-eea32966d975\") " pod="kuadrant-system/authorino-5d4b67c446-zm9d8"
Jul 15 21:11:21.431114 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.431080    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zm9d8"]
Jul 15 21:11:21.431350 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:11:21.431333    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-d6plj], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-zm9d8" podUID="750a6a5e-d6c1-4444-aa27-eea32966d975"
Jul 15 21:11:21.461675 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.461605    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-64f5866b76-cx4b7"]
Jul 15 21:11:21.463391 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.463372    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6plj\" (UniqueName: \"kubernetes.io/projected/750a6a5e-d6c1-4444-aa27-eea32966d975-kube-api-access-d6plj\") pod \"authorino-5d4b67c446-zm9d8\" (UID: \"750a6a5e-d6c1-4444-aa27-eea32966d975\") " pod="kuadrant-system/authorino-5d4b67c446-zm9d8"
Jul 15 21:11:21.465600 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.465586    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64f5866b76-cx4b7"
Jul 15 21:11:21.473968 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.473945    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64f5866b76-cx4b7"]
Jul 15 21:11:21.475677 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.475652    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6plj\" (UniqueName: \"kubernetes.io/projected/750a6a5e-d6c1-4444-aa27-eea32966d975-kube-api-access-d6plj\") pod \"authorino-5d4b67c446-zm9d8\" (UID: \"750a6a5e-d6c1-4444-aa27-eea32966d975\") " pod="kuadrant-system/authorino-5d4b67c446-zm9d8"
Jul 15 21:11:21.564631 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.564593    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z6vh\" (UniqueName: \"kubernetes.io/projected/1e65dacf-a467-4dac-adb7-8f727acae9e6-kube-api-access-9z6vh\") pod \"authorino-64f5866b76-cx4b7\" (UID: \"1e65dacf-a467-4dac-adb7-8f727acae9e6\") " pod="kuadrant-system/authorino-64f5866b76-cx4b7"
Jul 15 21:11:21.637241 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.637206    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64f5866b76-cx4b7"]
Jul 15 21:11:21.637469 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:11:21.637451    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-9z6vh], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-64f5866b76-cx4b7" podUID="1e65dacf-a467-4dac-adb7-8f727acae9e6"
Jul 15 21:11:21.662234 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.662205    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64f5866b76-cx4b7"
Jul 15 21:11:21.662439 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.662205    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zm9d8"
Jul 15 21:11:21.665570 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.665551    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z6vh\" (UniqueName: \"kubernetes.io/projected/1e65dacf-a467-4dac-adb7-8f727acae9e6-kube-api-access-9z6vh\") pod \"authorino-64f5866b76-cx4b7\" (UID: \"1e65dacf-a467-4dac-adb7-8f727acae9e6\") " pod="kuadrant-system/authorino-64f5866b76-cx4b7"
Jul 15 21:11:21.670229 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.670212    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64f5866b76-cx4b7"
Jul 15 21:11:21.673106 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.673090    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zm9d8"
Jul 15 21:11:21.682074 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.682049    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z6vh\" (UniqueName: \"kubernetes.io/projected/1e65dacf-a467-4dac-adb7-8f727acae9e6-kube-api-access-9z6vh\") pod \"authorino-64f5866b76-cx4b7\" (UID: \"1e65dacf-a467-4dac-adb7-8f727acae9e6\") " pod="kuadrant-system/authorino-64f5866b76-cx4b7"
Jul 15 21:11:21.766550 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.766463    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z6vh\" (UniqueName: \"kubernetes.io/projected/1e65dacf-a467-4dac-adb7-8f727acae9e6-kube-api-access-9z6vh\") pod \"1e65dacf-a467-4dac-adb7-8f727acae9e6\" (UID: \"1e65dacf-a467-4dac-adb7-8f727acae9e6\") "
Jul 15 21:11:21.766550 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.766517    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6plj\" (UniqueName: \"kubernetes.io/projected/750a6a5e-d6c1-4444-aa27-eea32966d975-kube-api-access-d6plj\") pod \"750a6a5e-d6c1-4444-aa27-eea32966d975\" (UID: \"750a6a5e-d6c1-4444-aa27-eea32966d975\") "
Jul 15 21:11:21.768582 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.768548    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/750a6a5e-d6c1-4444-aa27-eea32966d975-kube-api-access-d6plj" (OuterVolumeSpecName: "kube-api-access-d6plj") pod "750a6a5e-d6c1-4444-aa27-eea32966d975" (UID: "750a6a5e-d6c1-4444-aa27-eea32966d975"). InnerVolumeSpecName "kube-api-access-d6plj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:11:21.768710 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.768640    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e65dacf-a467-4dac-adb7-8f727acae9e6-kube-api-access-9z6vh" (OuterVolumeSpecName: "kube-api-access-9z6vh") pod "1e65dacf-a467-4dac-adb7-8f727acae9e6" (UID: "1e65dacf-a467-4dac-adb7-8f727acae9e6"). InnerVolumeSpecName "kube-api-access-9z6vh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:11:21.867232 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.867192    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z6vh\" (UniqueName: \"kubernetes.io/projected/1e65dacf-a467-4dac-adb7-8f727acae9e6-kube-api-access-9z6vh\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:11:21.867232 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:21.867224    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6plj\" (UniqueName: \"kubernetes.io/projected/750a6a5e-d6c1-4444-aa27-eea32966d975-kube-api-access-d6plj\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:11:22.667145 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:22.667116    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-zm9d8"
Jul 15 21:11:22.667312 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:22.667120    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64f5866b76-cx4b7"
Jul 15 21:11:22.705555 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:22.705523    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zm9d8"]
Jul 15 21:11:22.708854 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:22.708818    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-zm9d8"]
Jul 15 21:11:22.731795 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:22.731760    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64f5866b76-cx4b7"]
Jul 15 21:11:22.736350 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:22.736310    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-64f5866b76-cx4b7"]
Jul 15 21:11:23.062562 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:23.062527    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e65dacf-a467-4dac-adb7-8f727acae9e6" path="/var/lib/kubelet/pods/1e65dacf-a467-4dac-adb7-8f727acae9e6/volumes"
Jul 15 21:11:23.062766 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:23.062754    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="750a6a5e-d6c1-4444-aa27-eea32966d975" path="/var/lib/kubelet/pods/750a6a5e-d6c1-4444-aa27-eea32966d975/volumes"
Jul 15 21:11:39.036538 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:39.036511    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:11:39.037307 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:11:39.037288    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:12:36.823392 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:36.822856    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"]
Jul 15 21:12:36.828073 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:36.828050    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:36.830477 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:12:36.830449    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2\" is forbidden: User \"system:node:ip-10-0-130-35.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-130-35.ec2.internal' and this object" podUID="3e1f92c1-228a-4ad4-9603-01b2bf070468" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:36.830687 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:12:36.830667    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-35.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-130-35.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 15 21:12:36.830746 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:12:36.830684    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-mxvc9\" is forbidden: User \"system:node:ip-10-0-130-35.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-130-35.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"llm\"/\"default-dockercfg-mxvc9\"" type="*v1.Secret"
Jul 15 21:12:36.831062 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:12:36.831044    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"e2e-distinct-2-simulated-kserve-self-signed-certs\" is forbidden: User \"system:node:ip-10-0-130-35.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-130-35.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" type="*v1.Secret"
Jul 15 21:12:36.836744 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:12:36.836721    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-130-35.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"llm\": no relationship found between node 'ip-10-0-130-35.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"llm\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 15 21:12:36.857550 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:36.857525    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"]
Jul 15 21:12:36.902491 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:36.902459    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e1f92c1-228a-4ad4-9603-01b2bf070468-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2\" (UID: \"3e1f92c1-228a-4ad4-9603-01b2bf070468\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:36.902649 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:36.902506    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e1f92c1-228a-4ad4-9603-01b2bf070468-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2\" (UID: \"3e1f92c1-228a-4ad4-9603-01b2bf070468\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:36.902649 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:36.902533    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e1f92c1-228a-4ad4-9603-01b2bf070468-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2\" (UID: \"3e1f92c1-228a-4ad4-9603-01b2bf070468\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:36.902649 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:36.902557    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e1f92c1-228a-4ad4-9603-01b2bf070468-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2\" (UID: \"3e1f92c1-228a-4ad4-9603-01b2bf070468\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:36.902649 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:36.902592    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e1f92c1-228a-4ad4-9603-01b2bf070468-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2\" (UID: \"3e1f92c1-228a-4ad4-9603-01b2bf070468\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:36.902789 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:36.902688    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjs8v\" (UniqueName: \"kubernetes.io/projected/3e1f92c1-228a-4ad4-9603-01b2bf070468-kube-api-access-bjs8v\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2\" (UID: \"3e1f92c1-228a-4ad4-9603-01b2bf070468\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:37.003210 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:37.003179    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e1f92c1-228a-4ad4-9603-01b2bf070468-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2\" (UID: \"3e1f92c1-228a-4ad4-9603-01b2bf070468\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:37.003392 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:37.003220    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e1f92c1-228a-4ad4-9603-01b2bf070468-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2\" (UID: \"3e1f92c1-228a-4ad4-9603-01b2bf070468\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:37.003392 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:37.003237    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e1f92c1-228a-4ad4-9603-01b2bf070468-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2\" (UID: \"3e1f92c1-228a-4ad4-9603-01b2bf070468\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:37.003392 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:37.003272    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e1f92c1-228a-4ad4-9603-01b2bf070468-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2\" (UID: \"3e1f92c1-228a-4ad4-9603-01b2bf070468\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:37.003392 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:37.003297    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e1f92c1-228a-4ad4-9603-01b2bf070468-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2\" (UID: \"3e1f92c1-228a-4ad4-9603-01b2bf070468\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:37.003392 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:37.003350    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjs8v\" (UniqueName: \"kubernetes.io/projected/3e1f92c1-228a-4ad4-9603-01b2bf070468-kube-api-access-bjs8v\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2\" (UID: \"3e1f92c1-228a-4ad4-9603-01b2bf070468\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:37.003675 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:37.003658    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3e1f92c1-228a-4ad4-9603-01b2bf070468-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2\" (UID: \"3e1f92c1-228a-4ad4-9603-01b2bf070468\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:37.003719 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:37.003685    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3e1f92c1-228a-4ad4-9603-01b2bf070468-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2\" (UID: \"3e1f92c1-228a-4ad4-9603-01b2bf070468\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:37.003758 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:37.003720    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3e1f92c1-228a-4ad4-9603-01b2bf070468-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2\" (UID: \"3e1f92c1-228a-4ad4-9603-01b2bf070468\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:37.005461 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:37.005445    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3e1f92c1-228a-4ad4-9603-01b2bf070468-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2\" (UID: \"3e1f92c1-228a-4ad4-9603-01b2bf070468\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:37.829041 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:37.829005    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 21:12:37.932748 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:37.932719    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mxvc9\""
Jul 15 21:12:38.004291 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:12:38.004263    2580 secret.go:189] Couldn't get secret llm/e2e-distinct-2-simulated-kserve-self-signed-certs: failed to sync secret cache: timed out waiting for the condition
Jul 15 21:12:38.004439 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:12:38.004345    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e1f92c1-228a-4ad4-9603-01b2bf070468-tls-certs podName:3e1f92c1-228a-4ad4-9603-01b2bf070468 nodeName:}" failed. No retries permitted until 2026-07-15 21:12:38.504328553 +0000 UTC m=+659.932288167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3e1f92c1-228a-4ad4-9603-01b2bf070468-tls-certs") pod "e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2" (UID: "3e1f92c1-228a-4ad4-9603-01b2bf070468") : failed to sync secret cache: timed out waiting for the condition
Jul 15 21:12:38.013186 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:12:38.013168    2580 projected.go:291] Couldn't get configMap llm/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jul 15 21:12:38.013244 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:12:38.013200    2580 projected.go:196] Error preparing data for projected volume kube-api-access-bjs8v for pod llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2: failed to sync configmap cache: timed out waiting for the condition
Jul 15 21:12:38.013279 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:12:38.013255    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3e1f92c1-228a-4ad4-9603-01b2bf070468-kube-api-access-bjs8v podName:3e1f92c1-228a-4ad4-9603-01b2bf070468 nodeName:}" failed. No retries permitted until 2026-07-15 21:12:38.513240704 +0000 UTC m=+659.941200318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bjs8v" (UniqueName: "kubernetes.io/projected/3e1f92c1-228a-4ad4-9603-01b2bf070468-kube-api-access-bjs8v") pod "e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2" (UID: "3e1f92c1-228a-4ad4-9603-01b2bf070468") : failed to sync configmap cache: timed out waiting for the condition
Jul 15 21:12:38.231474 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:38.231448    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 15 21:12:38.263943 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:38.263919    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 21:12:38.518489 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:38.518395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e1f92c1-228a-4ad4-9603-01b2bf070468-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2\" (UID: \"3e1f92c1-228a-4ad4-9603-01b2bf070468\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:38.518489 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:38.518465    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjs8v\" (UniqueName: \"kubernetes.io/projected/3e1f92c1-228a-4ad4-9603-01b2bf070468-kube-api-access-bjs8v\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2\" (UID: \"3e1f92c1-228a-4ad4-9603-01b2bf070468\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:38.521018 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:38.520989    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3e1f92c1-228a-4ad4-9603-01b2bf070468-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2\" (UID: \"3e1f92c1-228a-4ad4-9603-01b2bf070468\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:38.521018 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:38.521006    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjs8v\" (UniqueName: \"kubernetes.io/projected/3e1f92c1-228a-4ad4-9603-01b2bf070468-kube-api-access-bjs8v\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2\" (UID: \"3e1f92c1-228a-4ad4-9603-01b2bf070468\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:38.637686 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:38.637635    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:38.767059 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:38.767033    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"]
Jul 15 21:12:38.769688 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:12:38.769634    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e1f92c1_228a_4ad4_9603_01b2bf070468.slice/crio-a1282d5b20cd6e043f95878dd46b7028340deb51c9fd3c1e87cf42f3460854db WatchSource:0}: Error finding container a1282d5b20cd6e043f95878dd46b7028340deb51c9fd3c1e87cf42f3460854db: Status 404 returned error can't find the container with id a1282d5b20cd6e043f95878dd46b7028340deb51c9fd3c1e87cf42f3460854db
Jul 15 21:12:39.003523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:39.003474    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2" event={"ID":"3e1f92c1-228a-4ad4-9603-01b2bf070468","Type":"ContainerStarted","Data":"a1282d5b20cd6e043f95878dd46b7028340deb51c9fd3c1e87cf42f3460854db"}
Jul 15 21:12:41.016029 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:41.015993    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2" event={"ID":"3e1f92c1-228a-4ad4-9603-01b2bf070468","Type":"ContainerStarted","Data":"7c64134b01194ba14048d22f2a1f514d522bddfe6757d8447a7c55587f02d74d"}
Jul 15 21:12:41.055444 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:41.055390    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2" podStartSLOduration=3.879410041 podStartE2EDuration="5.055374035s" totalImagesPullingTime="1.175963994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:12:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:12:41.05404808 +0000 UTC m=+662.482007716" watchObservedRunningTime="2026-07-15 21:12:41.055374035 +0000 UTC m=+662.483333671"
Jul 15 21:12:43.984470 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:43.984436    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"]
Jul 15 21:12:43.988160 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:43.988138    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:43.990484 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:43.990463    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 15 21:12:43.998164 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:43.998142    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"]
Jul 15 21:12:44.067512 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:44.067485    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63b1ca43-9b89-4fdd-9477-deebda98468a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d74ck\" (UID: \"63b1ca43-9b89-4fdd-9477-deebda98468a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:44.067687 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:44.067517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krb8m\" (UniqueName: \"kubernetes.io/projected/63b1ca43-9b89-4fdd-9477-deebda98468a-kube-api-access-krb8m\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d74ck\" (UID: \"63b1ca43-9b89-4fdd-9477-deebda98468a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:44.067687 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:44.067555    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63b1ca43-9b89-4fdd-9477-deebda98468a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d74ck\" (UID: \"63b1ca43-9b89-4fdd-9477-deebda98468a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:44.067687 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:44.067579    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63b1ca43-9b89-4fdd-9477-deebda98468a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d74ck\" (UID: \"63b1ca43-9b89-4fdd-9477-deebda98468a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:44.067687 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:44.067641    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63b1ca43-9b89-4fdd-9477-deebda98468a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d74ck\" (UID: \"63b1ca43-9b89-4fdd-9477-deebda98468a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:44.067687 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:44.067677    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63b1ca43-9b89-4fdd-9477-deebda98468a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d74ck\" (UID: \"63b1ca43-9b89-4fdd-9477-deebda98468a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:44.168964 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:44.168913    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63b1ca43-9b89-4fdd-9477-deebda98468a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d74ck\" (UID: \"63b1ca43-9b89-4fdd-9477-deebda98468a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:44.168964 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:44.168961    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63b1ca43-9b89-4fdd-9477-deebda98468a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d74ck\" (UID: \"63b1ca43-9b89-4fdd-9477-deebda98468a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:44.169177 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:44.169009    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63b1ca43-9b89-4fdd-9477-deebda98468a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d74ck\" (UID: \"63b1ca43-9b89-4fdd-9477-deebda98468a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:44.169177 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:44.169029    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krb8m\" (UniqueName: \"kubernetes.io/projected/63b1ca43-9b89-4fdd-9477-deebda98468a-kube-api-access-krb8m\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d74ck\" (UID: \"63b1ca43-9b89-4fdd-9477-deebda98468a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:44.169177 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:44.169057    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63b1ca43-9b89-4fdd-9477-deebda98468a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d74ck\" (UID: \"63b1ca43-9b89-4fdd-9477-deebda98468a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:44.169177 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:44.169074    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63b1ca43-9b89-4fdd-9477-deebda98468a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d74ck\" (UID: \"63b1ca43-9b89-4fdd-9477-deebda98468a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:44.169398 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:44.169373    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/63b1ca43-9b89-4fdd-9477-deebda98468a-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d74ck\" (UID: \"63b1ca43-9b89-4fdd-9477-deebda98468a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:44.169461 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:44.169436    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/63b1ca43-9b89-4fdd-9477-deebda98468a-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d74ck\" (UID: \"63b1ca43-9b89-4fdd-9477-deebda98468a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:44.169510 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:44.169463    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/63b1ca43-9b89-4fdd-9477-deebda98468a-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d74ck\" (UID: \"63b1ca43-9b89-4fdd-9477-deebda98468a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:44.171235 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:44.171215    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/63b1ca43-9b89-4fdd-9477-deebda98468a-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d74ck\" (UID: \"63b1ca43-9b89-4fdd-9477-deebda98468a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:44.171617 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:44.171597    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/63b1ca43-9b89-4fdd-9477-deebda98468a-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d74ck\" (UID: \"63b1ca43-9b89-4fdd-9477-deebda98468a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:44.177387 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:44.177367    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krb8m\" (UniqueName: \"kubernetes.io/projected/63b1ca43-9b89-4fdd-9477-deebda98468a-kube-api-access-krb8m\") pod \"e2e-distinct-simulated-kserve-59975d69f9-d74ck\" (UID: \"63b1ca43-9b89-4fdd-9477-deebda98468a\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:44.298766 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:44.298681    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:44.424955 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:44.424933    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"]
Jul 15 21:12:44.426593 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:12:44.426563    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63b1ca43_9b89_4fdd_9477_deebda98468a.slice/crio-5ce9bf573434d753b9c40cb5fcd9e62eb31e9b32e49b1ed222be1f105c3e43f9 WatchSource:0}: Error finding container 5ce9bf573434d753b9c40cb5fcd9e62eb31e9b32e49b1ed222be1f105c3e43f9: Status 404 returned error can't find the container with id 5ce9bf573434d753b9c40cb5fcd9e62eb31e9b32e49b1ed222be1f105c3e43f9
Jul 15 21:12:45.037290 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:45.037249    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck" event={"ID":"63b1ca43-9b89-4fdd-9477-deebda98468a","Type":"ContainerStarted","Data":"4afaa7a30862c16c63f3c6e2bc3377c2695c64652006ac5cafc5954e4e93781a"}
Jul 15 21:12:45.037663 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:45.037310    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck" event={"ID":"63b1ca43-9b89-4fdd-9477-deebda98468a","Type":"ContainerStarted","Data":"5ce9bf573434d753b9c40cb5fcd9e62eb31e9b32e49b1ed222be1f105c3e43f9"}
Jul 15 21:12:45.056663 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:45.056614    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck" podStartSLOduration=1.840294605 podStartE2EDuration="2.056595277s" totalImagesPullingTime="216.300672ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:12:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:12:45.056504804 +0000 UTC m=+666.484464440" watchObservedRunningTime="2026-07-15 21:12:45.056595277 +0000 UTC m=+666.484554912"
Jul 15 21:12:48.638303 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:48.638257    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:48.638755 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:48.638327    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:48.650721 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:48.650694    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:49.065753 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:49.065720    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2"
Jul 15 21:12:54.299610 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:54.299572    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:54.300025 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:54.299637    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:54.312072 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:54.312047    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:12:55.089109 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:12:55.089078    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-d74ck"
Jul 15 21:13:09.132196 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.132161    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"]
Jul 15 21:13:09.135472 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.135452    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:09.139636 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.139616    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 15 21:13:09.156907 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.156877    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"]
Jul 15 21:13:09.296973 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.296925    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f479714-2682-4487-8f6b-a27d6b381633-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7\" (UID: \"6f479714-2682-4487-8f6b-a27d6b381633\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:09.296973 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.296974    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f479714-2682-4487-8f6b-a27d6b381633-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7\" (UID: \"6f479714-2682-4487-8f6b-a27d6b381633\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:09.297192 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.297066    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f479714-2682-4487-8f6b-a27d6b381633-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7\" (UID: \"6f479714-2682-4487-8f6b-a27d6b381633\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:09.297192 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.297103    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f479714-2682-4487-8f6b-a27d6b381633-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7\" (UID: \"6f479714-2682-4487-8f6b-a27d6b381633\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:09.297192 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.297125    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f479714-2682-4487-8f6b-a27d6b381633-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7\" (UID: \"6f479714-2682-4487-8f6b-a27d6b381633\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:09.297192 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.297179    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s9q8\" (UniqueName: \"kubernetes.io/projected/6f479714-2682-4487-8f6b-a27d6b381633-kube-api-access-6s9q8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7\" (UID: \"6f479714-2682-4487-8f6b-a27d6b381633\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:09.398600 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.398501    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s9q8\" (UniqueName: \"kubernetes.io/projected/6f479714-2682-4487-8f6b-a27d6b381633-kube-api-access-6s9q8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7\" (UID: \"6f479714-2682-4487-8f6b-a27d6b381633\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:09.398600 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.398562    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f479714-2682-4487-8f6b-a27d6b381633-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7\" (UID: \"6f479714-2682-4487-8f6b-a27d6b381633\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:09.398600 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.398582    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f479714-2682-4487-8f6b-a27d6b381633-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7\" (UID: \"6f479714-2682-4487-8f6b-a27d6b381633\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:09.398924 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.398632    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f479714-2682-4487-8f6b-a27d6b381633-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7\" (UID: \"6f479714-2682-4487-8f6b-a27d6b381633\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:09.398924 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.398769    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f479714-2682-4487-8f6b-a27d6b381633-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7\" (UID: \"6f479714-2682-4487-8f6b-a27d6b381633\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:09.398924 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.398815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f479714-2682-4487-8f6b-a27d6b381633-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7\" (UID: \"6f479714-2682-4487-8f6b-a27d6b381633\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:09.399088 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.399058    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f479714-2682-4487-8f6b-a27d6b381633-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7\" (UID: \"6f479714-2682-4487-8f6b-a27d6b381633\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:09.399088 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.399071    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6f479714-2682-4487-8f6b-a27d6b381633-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7\" (UID: \"6f479714-2682-4487-8f6b-a27d6b381633\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:09.399213 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.399189    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6f479714-2682-4487-8f6b-a27d6b381633-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7\" (UID: \"6f479714-2682-4487-8f6b-a27d6b381633\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:09.400878 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.400835    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6f479714-2682-4487-8f6b-a27d6b381633-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7\" (UID: \"6f479714-2682-4487-8f6b-a27d6b381633\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:09.401271 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.401251    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6f479714-2682-4487-8f6b-a27d6b381633-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7\" (UID: \"6f479714-2682-4487-8f6b-a27d6b381633\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:09.416800 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.416772    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s9q8\" (UniqueName: \"kubernetes.io/projected/6f479714-2682-4487-8f6b-a27d6b381633-kube-api-access-6s9q8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7\" (UID: \"6f479714-2682-4487-8f6b-a27d6b381633\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:09.446199 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.446169    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:09.583909 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.583883    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"]
Jul 15 21:13:09.585328 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:13:09.585302    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f479714_2682_4487_8f6b_a27d6b381633.slice/crio-3a0dfc0d00ee6b11654283f6ee445fa979425fe20b34c12753312700043b98f4 WatchSource:0}: Error finding container 3a0dfc0d00ee6b11654283f6ee445fa979425fe20b34c12753312700043b98f4: Status 404 returned error can't find the container with id 3a0dfc0d00ee6b11654283f6ee445fa979425fe20b34c12753312700043b98f4
Jul 15 21:13:09.586665 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:09.586645    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 21:13:10.143600 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:10.143504    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7" event={"ID":"6f479714-2682-4487-8f6b-a27d6b381633","Type":"ContainerStarted","Data":"b67f1b94548dbdae2eb80edb00dc334fe5044f38a756dd5884ef54dc367f08ef"}
Jul 15 21:13:10.143600 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:10.143566    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7" event={"ID":"6f479714-2682-4487-8f6b-a27d6b381633","Type":"ContainerStarted","Data":"3a0dfc0d00ee6b11654283f6ee445fa979425fe20b34c12753312700043b98f4"}
Jul 15 21:13:10.164396 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:10.164351    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7" podStartSLOduration=0.904226065 podStartE2EDuration="1.164336922s" totalImagesPullingTime="260.110857ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:13:10.162461642 +0000 UTC m=+691.590421278" watchObservedRunningTime="2026-07-15 21:13:10.164336922 +0000 UTC m=+691.592296557"
Jul 15 21:13:19.446654 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:19.446601    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:19.447107 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:19.446697    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:19.459193 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:19.459162    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:20.199949 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:20.199918    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7"
Jul 15 21:13:40.594933 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.594833    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"]
Jul 15 21:13:40.598638 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.598619    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:40.600894 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.600878    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 15 21:13:40.608326 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.608306    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"]
Jul 15 21:13:40.690165 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.690138    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htbsp\" (UniqueName: \"kubernetes.io/projected/6acd9a9a-2161-4b88-a9de-552ff05dc66f-kube-api-access-htbsp\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4\" (UID: \"6acd9a9a-2161-4b88-a9de-552ff05dc66f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:40.690386 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.690183    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6acd9a9a-2161-4b88-a9de-552ff05dc66f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4\" (UID: \"6acd9a9a-2161-4b88-a9de-552ff05dc66f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:40.690386 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.690208    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6acd9a9a-2161-4b88-a9de-552ff05dc66f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4\" (UID: \"6acd9a9a-2161-4b88-a9de-552ff05dc66f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:40.690386 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.690283    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6acd9a9a-2161-4b88-a9de-552ff05dc66f-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4\" (UID: \"6acd9a9a-2161-4b88-a9de-552ff05dc66f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:40.690386 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.690326    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6acd9a9a-2161-4b88-a9de-552ff05dc66f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4\" (UID: \"6acd9a9a-2161-4b88-a9de-552ff05dc66f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:40.690575 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.690397    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6acd9a9a-2161-4b88-a9de-552ff05dc66f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4\" (UID: \"6acd9a9a-2161-4b88-a9de-552ff05dc66f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:40.791541 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.791501    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6acd9a9a-2161-4b88-a9de-552ff05dc66f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4\" (UID: \"6acd9a9a-2161-4b88-a9de-552ff05dc66f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:40.791541 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.791548    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6acd9a9a-2161-4b88-a9de-552ff05dc66f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4\" (UID: \"6acd9a9a-2161-4b88-a9de-552ff05dc66f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:40.791807 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.791584    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6acd9a9a-2161-4b88-a9de-552ff05dc66f-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4\" (UID: \"6acd9a9a-2161-4b88-a9de-552ff05dc66f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:40.791807 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.791602    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6acd9a9a-2161-4b88-a9de-552ff05dc66f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4\" (UID: \"6acd9a9a-2161-4b88-a9de-552ff05dc66f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:40.791807 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.791629    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6acd9a9a-2161-4b88-a9de-552ff05dc66f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4\" (UID: \"6acd9a9a-2161-4b88-a9de-552ff05dc66f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:40.791807 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.791686    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htbsp\" (UniqueName: \"kubernetes.io/projected/6acd9a9a-2161-4b88-a9de-552ff05dc66f-kube-api-access-htbsp\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4\" (UID: \"6acd9a9a-2161-4b88-a9de-552ff05dc66f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:40.792076 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.792005    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6acd9a9a-2161-4b88-a9de-552ff05dc66f-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4\" (UID: \"6acd9a9a-2161-4b88-a9de-552ff05dc66f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:40.792129 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.792083    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6acd9a9a-2161-4b88-a9de-552ff05dc66f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4\" (UID: \"6acd9a9a-2161-4b88-a9de-552ff05dc66f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:40.792129 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.792114    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6acd9a9a-2161-4b88-a9de-552ff05dc66f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4\" (UID: \"6acd9a9a-2161-4b88-a9de-552ff05dc66f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:40.793969 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.793950    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6acd9a9a-2161-4b88-a9de-552ff05dc66f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4\" (UID: \"6acd9a9a-2161-4b88-a9de-552ff05dc66f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:40.794143 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.794126    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6acd9a9a-2161-4b88-a9de-552ff05dc66f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4\" (UID: \"6acd9a9a-2161-4b88-a9de-552ff05dc66f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:40.803812 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.803788    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htbsp\" (UniqueName: \"kubernetes.io/projected/6acd9a9a-2161-4b88-a9de-552ff05dc66f-kube-api-access-htbsp\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4\" (UID: \"6acd9a9a-2161-4b88-a9de-552ff05dc66f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:40.908903 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:40.908772    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:41.040535 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:41.040497    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"]
Jul 15 21:13:41.043833 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:13:41.043803    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6acd9a9a_2161_4b88_a9de_552ff05dc66f.slice/crio-86a2b573cb28936156fec0207392faaa10dc5c14c33bd7e6b246a7ac40c21d26 WatchSource:0}: Error finding container 86a2b573cb28936156fec0207392faaa10dc5c14c33bd7e6b246a7ac40c21d26: Status 404 returned error can't find the container with id 86a2b573cb28936156fec0207392faaa10dc5c14c33bd7e6b246a7ac40c21d26
Jul 15 21:13:41.278493 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:41.278465    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4" event={"ID":"6acd9a9a-2161-4b88-a9de-552ff05dc66f","Type":"ContainerStarted","Data":"86a2b573cb28936156fec0207392faaa10dc5c14c33bd7e6b246a7ac40c21d26"}
Jul 15 21:13:42.284434 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:42.284402    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4" event={"ID":"6acd9a9a-2161-4b88-a9de-552ff05dc66f","Type":"ContainerStarted","Data":"83d12bd26563dbd5a692f9eb98ca6be8973642cf9a4cc71fc600a4f69535e389"}
Jul 15 21:13:42.301946 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:42.301889    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4" podStartSLOduration=2.112087357 podStartE2EDuration="2.301873652s" totalImagesPullingTime="189.786295ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:13:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:13:42.301465183 +0000 UTC m=+723.729424819" watchObservedRunningTime="2026-07-15 21:13:42.301873652 +0000 UTC m=+723.729833287"
Jul 15 21:13:50.909660 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:50.909622    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:50.910178 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:50.909965    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:50.922136 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:50.922111    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:13:51.336467 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:13:51.336440    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4"
Jul 15 21:16:39.067546 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:16:39.067456    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:16:39.069027 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:16:39.068970    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:21:39.103159 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:21:39.103129    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:21:39.105038 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:21:39.105017    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:25:03.454001 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:25:03.453966    2580 generic.go:356] "Generic (PLEG): container finished" podID="7f5e9da4-a3dc-40b0-8865-bdc244ec7035" containerID="84b2316a05e63da4e1480323ee86f90f07fc9ebcc109176f41ffa8f631245d7e" exitCode=1
Jul 15 21:25:03.454400 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:25:03.454041    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw" event={"ID":"7f5e9da4-a3dc-40b0-8865-bdc244ec7035","Type":"ContainerDied","Data":"84b2316a05e63da4e1480323ee86f90f07fc9ebcc109176f41ffa8f631245d7e"}
Jul 15 21:25:03.454446 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:25:03.454414    2580 scope.go:117] "RemoveContainer" containerID="84b2316a05e63da4e1480323ee86f90f07fc9ebcc109176f41ffa8f631245d7e"
Jul 15 21:25:04.461999 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:25:04.461964    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw" event={"ID":"7f5e9da4-a3dc-40b0-8865-bdc244ec7035","Type":"ContainerStarted","Data":"dd5a24225834c849cf4259d6424ad5bbc03f871c4863380f5ded243e1c2d8884"}
Jul 15 21:25:04.462389 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:25:04.462176    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw"
Jul 15 21:25:06.754027 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:25:06.753983    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-15T21:24:56Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-15T21:24:56Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-15T21:24:56Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-15T21:24:56Z\\\",\\\"type\\\":\\\"Ready\\\"}],\\\"runtimeHandlers\\\":[{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"runc\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"crun\\\"},{\\\"features\\\":{\\\"recursiveReadOnlyMounts\\\":true,\\\"userNamespaces\\\":true},\\\"name\\\":\\\"\\\"}]}}\" for node \"ip-10-0-130-35.ec2.internal\": Patch \"https://a9c0189c76ffa414bbe64782f22ffef9-e324037f91a3c3d1.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-130-35.ec2.internal/status?timeout=10s\": context deadline exceeded"
Jul 15 21:25:07.496197 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:25:07.496156    2580 controller.go:195] "Failed to update lease" err="Put \"https://a9c0189c76ffa414bbe64782f22ffef9-e324037f91a3c3d1.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-130-35.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Jul 15 21:25:15.469077 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:25:15.469049    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5ccd478559-sq9fw"
Jul 15 21:25:16.754765 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:25:16.754721    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-35.ec2.internal\": Get \"https://a9c0189c76ffa414bbe64782f22ffef9-e324037f91a3c3d1.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-130-35.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 15 21:25:17.496988 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:25:17.496950    2580 controller.go:195] "Failed to update lease" err="Put \"https://a9c0189c76ffa414bbe64782f22ffef9-e324037f91a3c3d1.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-130-35.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 15 21:25:17.588412 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:25:17.588377    2580 controller.go:195] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"ip-10-0-130-35.ec2.internal\": the object has been modified; please apply your changes to the latest version and try again"
Jul 15 21:25:27.591339 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:25:27.591297    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="failed to patch status \"{\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"type\\\":\\\"DiskPressure\\\"},{\\\"type\\\":\\\"PIDPressure\\\"},{\\\"type\\\":\\\"Ready\\\"}],\\\"conditions\\\":[{\\\"lastHeartbeatTime\\\":\\\"2026-07-15T21:25:17Z\\\",\\\"type\\\":\\\"MemoryPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-15T21:25:17Z\\\",\\\"type\\\":\\\"DiskPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-15T21:25:17Z\\\",\\\"type\\\":\\\"PIDPressure\\\"},{\\\"lastHeartbeatTime\\\":\\\"2026-07-15T21:25:17Z\\\",\\\"type\\\":\\\"Ready\\\"}]}}\" for node \"ip-10-0-130-35.ec2.internal\": Patch \"https://a9c0189c76ffa414bbe64782f22ffef9-e324037f91a3c3d1.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-130-35.ec2.internal/status?timeout=10s\": context deadline exceeded"
Jul 15 21:25:37.592464 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:25:37.592369    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-35.ec2.internal\": Get \"https://a9c0189c76ffa414bbe64782f22ffef9-e324037f91a3c3d1.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-130-35.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Jul 15 21:25:39.083911 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:25:39.083864    2580 controller.go:195] "Failed to update lease" err="Put \"https://a9c0189c76ffa414bbe64782f22ffef9-e324037f91a3c3d1.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-130-35.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 15 21:25:47.593054 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:25:47.593017    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-35.ec2.internal\": Get \"https://a9c0189c76ffa414bbe64782f22ffef9-e324037f91a3c3d1.elb.us-east-1.amazonaws.com:6443/api/v1/nodes/ip-10-0-130-35.ec2.internal?timeout=10s\": context deadline exceeded"
Jul 15 21:25:47.593054 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:25:47.593049    2580 kubelet_node_status.go:523] "Unable to update node status" err="update node status exceeds retry count"
Jul 15 21:25:49.085012 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:25:49.084966    2580 controller.go:195] "Failed to update lease" err="Put \"https://a9c0189c76ffa414bbe64782f22ffef9-e324037f91a3c3d1.elb.us-east-1.amazonaws.com:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/ip-10-0-130-35.ec2.internal?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Jul 15 21:25:49.306757 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:25:49.306714    2580 controller.go:195] "Failed to update lease" err="Operation cannot be fulfilled on leases.coordination.k8s.io \"ip-10-0-130-35.ec2.internal\": the object has been modified; please apply your changes to the latest version and try again"
Jul 15 21:26:39.133058 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:26:39.133027    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:26:39.136151 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:26:39.136130    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:31:39.161690 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:31:39.161657    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:31:39.166200 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:31:39.166179    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:36:39.189759 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:36:39.189723    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:36:39.195312 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:36:39.195292    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:38:14.783081 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.783050    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"]
Jul 15 21:38:14.786349 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.786333    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:14.788307 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.788288    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-42fd7c24\"/\"e2e-lifecycle-model-42fd7c24-kserve-self-signed-certs\""
Jul 15 21:38:14.789067 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.789049    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-42fd7c24\"/\"kube-root-ca.crt\""
Jul 15 21:38:14.789344 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.789325    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-42fd7c24\"/\"openshift-service-ca.crt\""
Jul 15 21:38:14.789804 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.789788    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-42fd7c24\"/\"default-dockercfg-gkzsk\""
Jul 15 21:38:14.796422 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.796401    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"]
Jul 15 21:38:14.881317 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.881286    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-model-cache\") pod \"e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") " pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:14.881503 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.881322    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28613609-65d6-4ac7-8813-e5a8bed4bc03-tls-certs\") pod \"e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") " pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:14.881503 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.881368    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-dshm\") pod \"e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") " pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:14.881503 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.881399    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-tmp-dir\") pod \"e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") " pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:14.881503 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.881442    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6z9r\" (UniqueName: \"kubernetes.io/projected/28613609-65d6-4ac7-8813-e5a8bed4bc03-kube-api-access-q6z9r\") pod \"e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") " pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:14.881671 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.881503    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-home\") pod \"e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") " pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:14.982751 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.982713    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-dshm\") pod \"e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") " pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:14.982954 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.982765    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-tmp-dir\") pod \"e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") " pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:14.982954 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.982814    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6z9r\" (UniqueName: \"kubernetes.io/projected/28613609-65d6-4ac7-8813-e5a8bed4bc03-kube-api-access-q6z9r\") pod \"e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") " pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:14.982954 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.982891    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-home\") pod \"e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") " pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:14.982954 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.982944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-model-cache\") pod \"e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") " pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:14.983168 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.982967    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28613609-65d6-4ac7-8813-e5a8bed4bc03-tls-certs\") pod \"e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") " pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:14.985880 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.983735    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-tmp-dir\") pod \"e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") " pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:14.985880 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.983742    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-home\") pod \"e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") " pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:14.985880 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.983817    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-model-cache\") pod \"e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") " pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:14.986982 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.986371    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28613609-65d6-4ac7-8813-e5a8bed4bc03-tls-certs\") pod \"e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") " pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:14.990126 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.990098    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-dshm\") pod \"e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") " pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:14.992031 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:14.992012    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6z9r\" (UniqueName: \"kubernetes.io/projected/28613609-65d6-4ac7-8813-e5a8bed4bc03-kube-api-access-q6z9r\") pod \"e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") " pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:15.096320 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:15.096239    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:15.247162 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:15.247129    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"]
Jul 15 21:38:15.250858 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:38:15.250809    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28613609_65d6_4ac7_8813_e5a8bed4bc03.slice/crio-18e4dc0b349de1d563793ccb959ee44a3735b7f7066f669f87466194bf6a9310 WatchSource:0}: Error finding container 18e4dc0b349de1d563793ccb959ee44a3735b7f7066f669f87466194bf6a9310: Status 404 returned error can't find the container with id 18e4dc0b349de1d563793ccb959ee44a3735b7f7066f669f87466194bf6a9310
Jul 15 21:38:16.068279 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:16.068244    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl" event={"ID":"28613609-65d6-4ac7-8813-e5a8bed4bc03","Type":"ContainerStarted","Data":"33ab9e98976b79a4e2ace91660b59ac70de5b5aae837ae8068b9ca4198bcf92b"}
Jul 15 21:38:16.068656 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:16.068289    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl" event={"ID":"28613609-65d6-4ac7-8813-e5a8bed4bc03","Type":"ContainerStarted","Data":"18e4dc0b349de1d563793ccb959ee44a3735b7f7066f669f87466194bf6a9310"}
Jul 15 21:38:16.086015 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:16.085966    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl" podStartSLOduration=2.085951195 podStartE2EDuration="2.085951195s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:38:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:38:16.084470402 +0000 UTC m=+2197.512430037" watchObservedRunningTime="2026-07-15 21:38:16.085951195 +0000 UTC m=+2197.513910831"
Jul 15 21:38:25.097143 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:25.097107    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:25.097143 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:25.097151    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:25.109313 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:25.109284    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:25.120334 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:25.120309    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:38:53.914704 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:38:53.914671    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"]
Jul 15 21:39:08.934797 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:08.934737    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl" podUID="28613609-65d6-4ac7-8813-e5a8bed4bc03" containerName="main" containerID="cri-o://33ab9e98976b79a4e2ace91660b59ac70de5b5aae837ae8068b9ca4198bcf92b" gracePeriod=45
Jul 15 21:39:09.185070 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.185017    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:39:09.293374 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.293339    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-home\") pod \"28613609-65d6-4ac7-8813-e5a8bed4bc03\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") "
Jul 15 21:39:09.293540 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.293395    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-dshm\") pod \"28613609-65d6-4ac7-8813-e5a8bed4bc03\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") "
Jul 15 21:39:09.293540 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.293465    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-tmp-dir\") pod \"28613609-65d6-4ac7-8813-e5a8bed4bc03\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") "
Jul 15 21:39:09.293540 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.293495    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6z9r\" (UniqueName: \"kubernetes.io/projected/28613609-65d6-4ac7-8813-e5a8bed4bc03-kube-api-access-q6z9r\") pod \"28613609-65d6-4ac7-8813-e5a8bed4bc03\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") "
Jul 15 21:39:09.293705 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.293555    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28613609-65d6-4ac7-8813-e5a8bed4bc03-tls-certs\") pod \"28613609-65d6-4ac7-8813-e5a8bed4bc03\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") "
Jul 15 21:39:09.293705 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.293604    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-model-cache\") pod \"28613609-65d6-4ac7-8813-e5a8bed4bc03\" (UID: \"28613609-65d6-4ac7-8813-e5a8bed4bc03\") "
Jul 15 21:39:09.293705 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.293626    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-home" (OuterVolumeSpecName: "home") pod "28613609-65d6-4ac7-8813-e5a8bed4bc03" (UID: "28613609-65d6-4ac7-8813-e5a8bed4bc03"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:39:09.293875 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.293703    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "28613609-65d6-4ac7-8813-e5a8bed4bc03" (UID: "28613609-65d6-4ac7-8813-e5a8bed4bc03"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:39:09.293944 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.293912    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-model-cache" (OuterVolumeSpecName: "model-cache") pod "28613609-65d6-4ac7-8813-e5a8bed4bc03" (UID: "28613609-65d6-4ac7-8813-e5a8bed4bc03"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:39:09.293995 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.293979    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-tmp-dir\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:39:09.294045 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.293994    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-model-cache\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:39:09.294045 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.294004    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-home\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:39:09.295678 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.295645    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28613609-65d6-4ac7-8813-e5a8bed4bc03-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "28613609-65d6-4ac7-8813-e5a8bed4bc03" (UID: "28613609-65d6-4ac7-8813-e5a8bed4bc03"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:39:09.295678 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.295666    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-dshm" (OuterVolumeSpecName: "dshm") pod "28613609-65d6-4ac7-8813-e5a8bed4bc03" (UID: "28613609-65d6-4ac7-8813-e5a8bed4bc03"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:39:09.295813 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.295693    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28613609-65d6-4ac7-8813-e5a8bed4bc03-kube-api-access-q6z9r" (OuterVolumeSpecName: "kube-api-access-q6z9r") pod "28613609-65d6-4ac7-8813-e5a8bed4bc03" (UID: "28613609-65d6-4ac7-8813-e5a8bed4bc03"). InnerVolumeSpecName "kube-api-access-q6z9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:39:09.318128 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.318098    2580 generic.go:356] "Generic (PLEG): container finished" podID="28613609-65d6-4ac7-8813-e5a8bed4bc03" containerID="33ab9e98976b79a4e2ace91660b59ac70de5b5aae837ae8068b9ca4198bcf92b" exitCode=0
Jul 15 21:39:09.318236 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.318132    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"
Jul 15 21:39:09.318236 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.318173    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl" event={"ID":"28613609-65d6-4ac7-8813-e5a8bed4bc03","Type":"ContainerDied","Data":"33ab9e98976b79a4e2ace91660b59ac70de5b5aae837ae8068b9ca4198bcf92b"}
Jul 15 21:39:09.318236 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.318216    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl" event={"ID":"28613609-65d6-4ac7-8813-e5a8bed4bc03","Type":"ContainerDied","Data":"18e4dc0b349de1d563793ccb959ee44a3735b7f7066f669f87466194bf6a9310"}
Jul 15 21:39:09.318236 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.318233    2580 scope.go:117] "RemoveContainer" containerID="33ab9e98976b79a4e2ace91660b59ac70de5b5aae837ae8068b9ca4198bcf92b"
Jul 15 21:39:09.326668 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.326653    2580 scope.go:117] "RemoveContainer" containerID="33ab9e98976b79a4e2ace91660b59ac70de5b5aae837ae8068b9ca4198bcf92b"
Jul 15 21:39:09.326938 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:39:09.326917    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33ab9e98976b79a4e2ace91660b59ac70de5b5aae837ae8068b9ca4198bcf92b\": container with ID starting with 33ab9e98976b79a4e2ace91660b59ac70de5b5aae837ae8068b9ca4198bcf92b not found: ID does not exist" containerID="33ab9e98976b79a4e2ace91660b59ac70de5b5aae837ae8068b9ca4198bcf92b"
Jul 15 21:39:09.327018 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.326944    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33ab9e98976b79a4e2ace91660b59ac70de5b5aae837ae8068b9ca4198bcf92b"} err="failed to get container status \"33ab9e98976b79a4e2ace91660b59ac70de5b5aae837ae8068b9ca4198bcf92b\": rpc error: code = NotFound desc = could not find container \"33ab9e98976b79a4e2ace91660b59ac70de5b5aae837ae8068b9ca4198bcf92b\": container with ID starting with 33ab9e98976b79a4e2ace91660b59ac70de5b5aae837ae8068b9ca4198bcf92b not found: ID does not exist"
Jul 15 21:39:09.366030 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.366001    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"]
Jul 15 21:39:09.370284 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.370261    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-42fd7c24/e2e-lifecycle-model-42fd7c24-kserve-77b6469995-wqngl"]
Jul 15 21:39:09.394481 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.394459    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28613609-65d6-4ac7-8813-e5a8bed4bc03-dshm\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:39:09.394481 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.394481    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6z9r\" (UniqueName: \"kubernetes.io/projected/28613609-65d6-4ac7-8813-e5a8bed4bc03-kube-api-access-q6z9r\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:39:09.394608 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:09.394491    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28613609-65d6-4ac7-8813-e5a8bed4bc03-tls-certs\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:39:11.063671 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:39:11.063639    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28613609-65d6-4ac7-8813-e5a8bed4bc03" path="/var/lib/kubelet/pods/28613609-65d6-4ac7-8813-e5a8bed4bc03/volumes"
Jul 15 21:41:03.989946 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:03.989875    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"]
Jul 15 21:41:03.990503 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:03.990228    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28613609-65d6-4ac7-8813-e5a8bed4bc03" containerName="main"
Jul 15 21:41:03.990503 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:03.990239    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="28613609-65d6-4ac7-8813-e5a8bed4bc03" containerName="main"
Jul 15 21:41:03.990503 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:03.990300    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="28613609-65d6-4ac7-8813-e5a8bed4bc03" containerName="main"
Jul 15 21:41:03.993568 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:03.993551    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:03.995601 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:03.995579    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-7c4663\"/\"openshift-service-ca.crt\""
Jul 15 21:41:03.996161 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:03.996144    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-7c4663\"/\"test-model-7c4663-kserve-self-signed-certs\""
Jul 15 21:41:03.996161 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:03.996154    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-7c4663\"/\"kube-root-ca.crt\""
Jul 15 21:41:03.996241 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:03.996152    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-7c4663\"/\"default-dockercfg-lp5gx\""
Jul 15 21:41:04.001616 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.001592    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"]
Jul 15 21:41:04.129133 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.129096    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-tls-certs\") pod \"test-model-7c4663-kserve-5945c577d7-ccvbk\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") " pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:04.129298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.129144    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-model-cache\") pod \"test-model-7c4663-kserve-5945c577d7-ccvbk\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") " pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:04.129298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.129207    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-tmp-dir\") pod \"test-model-7c4663-kserve-5945c577d7-ccvbk\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") " pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:04.129298 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.129226    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-home\") pod \"test-model-7c4663-kserve-5945c577d7-ccvbk\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") " pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:04.129403 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.129343    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfjnf\" (UniqueName: \"kubernetes.io/projected/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-kube-api-access-gfjnf\") pod \"test-model-7c4663-kserve-5945c577d7-ccvbk\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") " pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:04.129403 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.129383    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-dshm\") pod \"test-model-7c4663-kserve-5945c577d7-ccvbk\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") " pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:04.230361 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.230328    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-tmp-dir\") pod \"test-model-7c4663-kserve-5945c577d7-ccvbk\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") " pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:04.230361 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.230363    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-home\") pod \"test-model-7c4663-kserve-5945c577d7-ccvbk\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") " pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:04.230622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.230404    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfjnf\" (UniqueName: \"kubernetes.io/projected/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-kube-api-access-gfjnf\") pod \"test-model-7c4663-kserve-5945c577d7-ccvbk\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") " pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:04.230622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.230441    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-dshm\") pod \"test-model-7c4663-kserve-5945c577d7-ccvbk\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") " pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:04.230622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.230499    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-tls-certs\") pod \"test-model-7c4663-kserve-5945c577d7-ccvbk\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") " pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:04.230622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.230533    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-model-cache\") pod \"test-model-7c4663-kserve-5945c577d7-ccvbk\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") " pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:04.230858 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.230822    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-tmp-dir\") pod \"test-model-7c4663-kserve-5945c577d7-ccvbk\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") " pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:04.230932 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.230865    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-home\") pod \"test-model-7c4663-kserve-5945c577d7-ccvbk\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") " pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:04.230999 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.230970    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-model-cache\") pod \"test-model-7c4663-kserve-5945c577d7-ccvbk\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") " pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:04.232769 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.232743    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-dshm\") pod \"test-model-7c4663-kserve-5945c577d7-ccvbk\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") " pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:04.233112 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.233095    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-tls-certs\") pod \"test-model-7c4663-kserve-5945c577d7-ccvbk\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") " pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:04.241132 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.241065    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfjnf\" (UniqueName: \"kubernetes.io/projected/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-kube-api-access-gfjnf\") pod \"test-model-7c4663-kserve-5945c577d7-ccvbk\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") " pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:04.303090 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.303059    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:04.435473 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.435435    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"]
Jul 15 21:41:04.437014 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:41:04.436992    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod397b32fa_ebaf_4e00_bb3a_a2495c8fc7b5.slice/crio-bdadcc5e9e1396372f965976132aaa39a4e0a693e95d94eacfe99bf6ba621440 WatchSource:0}: Error finding container bdadcc5e9e1396372f965976132aaa39a4e0a693e95d94eacfe99bf6ba621440: Status 404 returned error can't find the container with id bdadcc5e9e1396372f965976132aaa39a4e0a693e95d94eacfe99bf6ba621440
Jul 15 21:41:04.867254 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.867216    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk" event={"ID":"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5","Type":"ContainerStarted","Data":"dd7d71e6c640bef8ad1075a3319d7c1b8b11df079e4bb9d84f10ea96fdc6df00"}
Jul 15 21:41:04.867450 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.867264    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk" event={"ID":"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5","Type":"ContainerStarted","Data":"bdadcc5e9e1396372f965976132aaa39a4e0a693e95d94eacfe99bf6ba621440"}
Jul 15 21:41:04.885211 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:04.885164    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk" podStartSLOduration=1.885151252 podStartE2EDuration="1.885151252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:41:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:41:04.88308969 +0000 UTC m=+2366.311049340" watchObservedRunningTime="2026-07-15 21:41:04.885151252 +0000 UTC m=+2366.313110888"
Jul 15 21:41:14.303874 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:14.303810    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:14.303874 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:14.303889    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:14.315773 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:14.315749    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:14.925126 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:14.925098    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:23.904260 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:23.904227    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"]
Jul 15 21:41:23.907472 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:23.907456    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:23.910017 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:23.909993    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c419c9\"/\"kube-root-ca.crt\""
Jul 15 21:41:23.910474 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:23.910436    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c419c9\"/\"openshift-service-ca.crt\""
Jul 15 21:41:23.910750 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:23.910733    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c419c9\"/\"test-model-c419c9-kserve-self-signed-certs\""
Jul 15 21:41:23.910813 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:23.910764    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c419c9\"/\"default-dockercfg-th65k\""
Jul 15 21:41:23.920161 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:23.920140    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-model-cache\") pod \"test-model-c419c9-kserve-549cfdc68c-wn7gs\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") " pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:23.920234 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:23.920183    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-tls-certs\") pod \"test-model-c419c9-kserve-549cfdc68c-wn7gs\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") " pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:23.920352 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:23.920276    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-dshm\") pod \"test-model-c419c9-kserve-549cfdc68c-wn7gs\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") " pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:23.920352 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:23.920325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-home\") pod \"test-model-c419c9-kserve-549cfdc68c-wn7gs\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") " pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:23.920459 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:23.920356    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-tmp-dir\") pod \"test-model-c419c9-kserve-549cfdc68c-wn7gs\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") " pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:23.920459 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:23.920379    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btvxs\" (UniqueName: \"kubernetes.io/projected/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-kube-api-access-btvxs\") pod \"test-model-c419c9-kserve-549cfdc68c-wn7gs\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") " pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:23.922575 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:23.922555    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"]
Jul 15 21:41:24.021008 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:24.020972    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-dshm\") pod \"test-model-c419c9-kserve-549cfdc68c-wn7gs\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") " pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:24.021208 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:24.021018    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-home\") pod \"test-model-c419c9-kserve-549cfdc68c-wn7gs\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") " pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:24.021208 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:24.021038    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-tmp-dir\") pod \"test-model-c419c9-kserve-549cfdc68c-wn7gs\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") " pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:24.021208 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:24.021054    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btvxs\" (UniqueName: \"kubernetes.io/projected/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-kube-api-access-btvxs\") pod \"test-model-c419c9-kserve-549cfdc68c-wn7gs\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") " pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:24.021208 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:24.021097    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-model-cache\") pod \"test-model-c419c9-kserve-549cfdc68c-wn7gs\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") " pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:24.021208 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:24.021121    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-tls-certs\") pod \"test-model-c419c9-kserve-549cfdc68c-wn7gs\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") " pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:24.021487 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:24.021465    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-tmp-dir\") pod \"test-model-c419c9-kserve-549cfdc68c-wn7gs\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") " pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:24.021560 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:24.021540    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-home\") pod \"test-model-c419c9-kserve-549cfdc68c-wn7gs\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") " pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:24.021560 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:24.021554    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-model-cache\") pod \"test-model-c419c9-kserve-549cfdc68c-wn7gs\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") " pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:24.023249 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:24.023232    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-dshm\") pod \"test-model-c419c9-kserve-549cfdc68c-wn7gs\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") " pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:24.023514 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:24.023498    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-tls-certs\") pod \"test-model-c419c9-kserve-549cfdc68c-wn7gs\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") " pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:24.029984 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:24.029955    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btvxs\" (UniqueName: \"kubernetes.io/projected/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-kube-api-access-btvxs\") pod \"test-model-c419c9-kserve-549cfdc68c-wn7gs\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") " pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:24.217231 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:24.217199    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:24.359075 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:24.359054    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"]
Jul 15 21:41:24.361632 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:41:24.361605    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e70ae5c_ffed_4aae_8045_2c8b3dee5d11.slice/crio-272779f12d56e824d51d5cebef2d75a107951ec77cc1398cde5578b63a11b767 WatchSource:0}: Error finding container 272779f12d56e824d51d5cebef2d75a107951ec77cc1398cde5578b63a11b767: Status 404 returned error can't find the container with id 272779f12d56e824d51d5cebef2d75a107951ec77cc1398cde5578b63a11b767
Jul 15 21:41:24.962950 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:24.962916    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs" event={"ID":"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11","Type":"ContainerStarted","Data":"48eb05e05c46145c625fa68eb0beeb598731ce8c739c53649e3653b27af7fec6"}
Jul 15 21:41:24.962950 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:24.962956    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs" event={"ID":"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11","Type":"ContainerStarted","Data":"272779f12d56e824d51d5cebef2d75a107951ec77cc1398cde5578b63a11b767"}
Jul 15 21:41:24.980547 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:24.980495    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs" podStartSLOduration=1.980481464 podStartE2EDuration="1.980481464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:41:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:41:24.978781273 +0000 UTC m=+2386.406740909" watchObservedRunningTime="2026-07-15 21:41:24.980481464 +0000 UTC m=+2386.408441099"
Jul 15 21:41:34.217498 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:34.217453    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:34.217498 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:34.217509    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:34.229554 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:34.229527    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:35.018666 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:35.018638    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:39.218418 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:39.218378    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:41:39.224267 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:39.224246    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:41:42.103494 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:42.103460    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"]
Jul 15 21:41:42.995484 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:42.995445    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"]
Jul 15 21:41:57.123666 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:57.123608    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk" podUID="397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5" containerName="main" containerID="cri-o://dd7d71e6c640bef8ad1075a3319d7c1b8b11df079e4bb9d84f10ea96fdc6df00" gracePeriod=45
Jul 15 21:41:57.378818 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:57.378755    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:57.438914 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:57.438877    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfjnf\" (UniqueName: \"kubernetes.io/projected/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-kube-api-access-gfjnf\") pod \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") "
Jul 15 21:41:57.439100 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:57.438939    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-tls-certs\") pod \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") "
Jul 15 21:41:57.439100 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:57.438964    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-model-cache\") pod \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") "
Jul 15 21:41:57.439100 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:57.439019    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-dshm\") pod \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") "
Jul 15 21:41:57.439100 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:57.439056    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-tmp-dir\") pod \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") "
Jul 15 21:41:57.439312 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:57.439108    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-home\") pod \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\" (UID: \"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5\") "
Jul 15 21:41:57.439312 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:57.439289    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-model-cache" (OuterVolumeSpecName: "model-cache") pod "397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5" (UID: "397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:41:57.439421 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:57.439349    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5" (UID: "397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:41:57.439471 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:57.439418    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-model-cache\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:41:57.439471 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:57.439454    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-home" (OuterVolumeSpecName: "home") pod "397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5" (UID: "397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:41:57.441203 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:57.441176    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-kube-api-access-gfjnf" (OuterVolumeSpecName: "kube-api-access-gfjnf") pod "397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5" (UID: "397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5"). InnerVolumeSpecName "kube-api-access-gfjnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:41:57.441307 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:57.441211    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-dshm" (OuterVolumeSpecName: "dshm") pod "397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5" (UID: "397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:41:57.441307 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:57.441259    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5" (UID: "397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:41:57.539906 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:57.539872    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-dshm\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:41:57.539906 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:57.539900    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-tmp-dir\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:41:57.539906 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:57.539908    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-home\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:41:57.539906 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:57.539917    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfjnf\" (UniqueName: \"kubernetes.io/projected/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-kube-api-access-gfjnf\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:41:57.540165 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:57.539926    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5-tls-certs\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:41:58.015636 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.015587    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs" podUID="0e70ae5c-ffed-4aae-8045-2c8b3dee5d11" containerName="main" containerID="cri-o://48eb05e05c46145c625fa68eb0beeb598731ce8c739c53649e3653b27af7fec6" gracePeriod=45
Jul 15 21:41:58.112708 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.112675    2580 generic.go:356] "Generic (PLEG): container finished" podID="397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5" containerID="dd7d71e6c640bef8ad1075a3319d7c1b8b11df079e4bb9d84f10ea96fdc6df00" exitCode=0
Jul 15 21:41:58.112889 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.112715    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"
Jul 15 21:41:58.112889 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.112762    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk" event={"ID":"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5","Type":"ContainerDied","Data":"dd7d71e6c640bef8ad1075a3319d7c1b8b11df079e4bb9d84f10ea96fdc6df00"}
Jul 15 21:41:58.112889 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.112812    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk" event={"ID":"397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5","Type":"ContainerDied","Data":"bdadcc5e9e1396372f965976132aaa39a4e0a693e95d94eacfe99bf6ba621440"}
Jul 15 21:41:58.112889 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.112855    2580 scope.go:117] "RemoveContainer" containerID="dd7d71e6c640bef8ad1075a3319d7c1b8b11df079e4bb9d84f10ea96fdc6df00"
Jul 15 21:41:58.127184 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.127009    2580 scope.go:117] "RemoveContainer" containerID="dd7d71e6c640bef8ad1075a3319d7c1b8b11df079e4bb9d84f10ea96fdc6df00"
Jul 15 21:41:58.127422 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:41:58.127287    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd7d71e6c640bef8ad1075a3319d7c1b8b11df079e4bb9d84f10ea96fdc6df00\": container with ID starting with dd7d71e6c640bef8ad1075a3319d7c1b8b11df079e4bb9d84f10ea96fdc6df00 not found: ID does not exist" containerID="dd7d71e6c640bef8ad1075a3319d7c1b8b11df079e4bb9d84f10ea96fdc6df00"
Jul 15 21:41:58.127422 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.127313    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd7d71e6c640bef8ad1075a3319d7c1b8b11df079e4bb9d84f10ea96fdc6df00"} err="failed to get container status \"dd7d71e6c640bef8ad1075a3319d7c1b8b11df079e4bb9d84f10ea96fdc6df00\": rpc error: code = NotFound desc = could not find container \"dd7d71e6c640bef8ad1075a3319d7c1b8b11df079e4bb9d84f10ea96fdc6df00\": container with ID starting with dd7d71e6c640bef8ad1075a3319d7c1b8b11df079e4bb9d84f10ea96fdc6df00 not found: ID does not exist"
Jul 15 21:41:58.135286 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.135268    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"]
Jul 15 21:41:58.140406 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.140384    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-7c4663/test-model-7c4663-kserve-5945c577d7-ccvbk"]
Jul 15 21:41:58.270789 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.270729    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:58.348878 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.348851    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-home\") pod \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") "
Jul 15 21:41:58.349075 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.348886    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btvxs\" (UniqueName: \"kubernetes.io/projected/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-kube-api-access-btvxs\") pod \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") "
Jul 15 21:41:58.349075 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.348909    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-dshm\") pod \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") "
Jul 15 21:41:58.349075 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.348931    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-tmp-dir\") pod \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") "
Jul 15 21:41:58.349075 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.348991    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-model-cache\") pod \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") "
Jul 15 21:41:58.349075 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.349030    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-tls-certs\") pod \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\" (UID: \"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11\") "
Jul 15 21:41:58.349350 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.349156    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-home" (OuterVolumeSpecName: "home") pod "0e70ae5c-ffed-4aae-8045-2c8b3dee5d11" (UID: "0e70ae5c-ffed-4aae-8045-2c8b3dee5d11"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:41:58.349350 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.349192    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0e70ae5c-ffed-4aae-8045-2c8b3dee5d11" (UID: "0e70ae5c-ffed-4aae-8045-2c8b3dee5d11"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:41:58.349350 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.349307    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-model-cache" (OuterVolumeSpecName: "model-cache") pod "0e70ae5c-ffed-4aae-8045-2c8b3dee5d11" (UID: "0e70ae5c-ffed-4aae-8045-2c8b3dee5d11"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:41:58.349350 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.349325    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-home\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:41:58.349350 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.349338    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-tmp-dir\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:41:58.351274 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.351254    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-dshm" (OuterVolumeSpecName: "dshm") pod "0e70ae5c-ffed-4aae-8045-2c8b3dee5d11" (UID: "0e70ae5c-ffed-4aae-8045-2c8b3dee5d11"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:41:58.351356 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.351277    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-kube-api-access-btvxs" (OuterVolumeSpecName: "kube-api-access-btvxs") pod "0e70ae5c-ffed-4aae-8045-2c8b3dee5d11" (UID: "0e70ae5c-ffed-4aae-8045-2c8b3dee5d11"). InnerVolumeSpecName "kube-api-access-btvxs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:41:58.351460 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.351439    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0e70ae5c-ffed-4aae-8045-2c8b3dee5d11" (UID: "0e70ae5c-ffed-4aae-8045-2c8b3dee5d11"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:41:58.450004 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.449967    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btvxs\" (UniqueName: \"kubernetes.io/projected/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-kube-api-access-btvxs\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:41:58.450004 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.449997    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-dshm\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:41:58.450004 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.450010    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-model-cache\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:41:58.450239 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:58.450023    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11-tls-certs\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:41:59.063232 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:59.063199    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5" path="/var/lib/kubelet/pods/397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5/volumes"
Jul 15 21:41:59.119033 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:59.119000    2580 generic.go:356] "Generic (PLEG): container finished" podID="0e70ae5c-ffed-4aae-8045-2c8b3dee5d11" containerID="48eb05e05c46145c625fa68eb0beeb598731ce8c739c53649e3653b27af7fec6" exitCode=0
Jul 15 21:41:59.119202 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:59.119043    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"
Jul 15 21:41:59.119202 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:59.119091    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs" event={"ID":"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11","Type":"ContainerDied","Data":"48eb05e05c46145c625fa68eb0beeb598731ce8c739c53649e3653b27af7fec6"}
Jul 15 21:41:59.119202 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:59.119135    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs" event={"ID":"0e70ae5c-ffed-4aae-8045-2c8b3dee5d11","Type":"ContainerDied","Data":"272779f12d56e824d51d5cebef2d75a107951ec77cc1398cde5578b63a11b767"}
Jul 15 21:41:59.119202 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:59.119159    2580 scope.go:117] "RemoveContainer" containerID="48eb05e05c46145c625fa68eb0beeb598731ce8c739c53649e3653b27af7fec6"
Jul 15 21:41:59.127615 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:59.127443    2580 scope.go:117] "RemoveContainer" containerID="48eb05e05c46145c625fa68eb0beeb598731ce8c739c53649e3653b27af7fec6"
Jul 15 21:41:59.127829 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:41:59.127684    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48eb05e05c46145c625fa68eb0beeb598731ce8c739c53649e3653b27af7fec6\": container with ID starting with 48eb05e05c46145c625fa68eb0beeb598731ce8c739c53649e3653b27af7fec6 not found: ID does not exist" containerID="48eb05e05c46145c625fa68eb0beeb598731ce8c739c53649e3653b27af7fec6"
Jul 15 21:41:59.127829 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:59.127707    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48eb05e05c46145c625fa68eb0beeb598731ce8c739c53649e3653b27af7fec6"} err="failed to get container status \"48eb05e05c46145c625fa68eb0beeb598731ce8c739c53649e3653b27af7fec6\": rpc error: code = NotFound desc = could not find container \"48eb05e05c46145c625fa68eb0beeb598731ce8c739c53649e3653b27af7fec6\": container with ID starting with 48eb05e05c46145c625fa68eb0beeb598731ce8c739c53649e3653b27af7fec6 not found: ID does not exist"
Jul 15 21:41:59.135253 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:59.135231    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"]
Jul 15 21:41:59.139168 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:41:59.139149    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-c419c9/test-model-c419c9-kserve-549cfdc68c-wn7gs"]
Jul 15 21:42:01.063272 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:42:01.063237    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e70ae5c-ffed-4aae-8045-2c8b3dee5d11" path="/var/lib/kubelet/pods/0e70ae5c-ffed-4aae-8045-2c8b3dee5d11/volumes"
Jul 15 21:44:45.272089 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.272052    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"]
Jul 15 21:44:45.272546 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.272417    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5" containerName="main"
Jul 15 21:44:45.272546 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.272429    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5" containerName="main"
Jul 15 21:44:45.272546 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.272436    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e70ae5c-ffed-4aae-8045-2c8b3dee5d11" containerName="main"
Jul 15 21:44:45.272546 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.272446    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e70ae5c-ffed-4aae-8045-2c8b3dee5d11" containerName="main"
Jul 15 21:44:45.272546 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.272531    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="397b32fa-ebaf-4e00-bb3a-a2495c8fc7b5" containerName="main"
Jul 15 21:44:45.272546 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.272542    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e70ae5c-ffed-4aae-8045-2c8b3dee5d11" containerName="main"
Jul 15 21:44:45.275798 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.275780    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:45.277710 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.277687    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-31dfa2\"/\"default-dockercfg-822ck\""
Jul 15 21:44:45.278377 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.278358    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-31dfa2\"/\"auth-test-model-31dfa2-kserve-self-signed-certs\""
Jul 15 21:44:45.278465 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.278381    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-31dfa2\"/\"openshift-service-ca.crt\""
Jul 15 21:44:45.278465 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.278422    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-31dfa2\"/\"kube-root-ca.crt\""
Jul 15 21:44:45.285998 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.285976    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"]
Jul 15 21:44:45.385976 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.385945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-dshm\") pod \"auth-test-model-31dfa2-kserve-67496fc695-hjx4j\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") " pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:45.385976 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.385980    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-tmp-dir\") pod \"auth-test-model-31dfa2-kserve-67496fc695-hjx4j\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") " pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:45.386217 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.386085    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-model-cache\") pod \"auth-test-model-31dfa2-kserve-67496fc695-hjx4j\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") " pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:45.386217 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.386105    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-home\") pod \"auth-test-model-31dfa2-kserve-67496fc695-hjx4j\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") " pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:45.386217 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.386165    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-tls-certs\") pod \"auth-test-model-31dfa2-kserve-67496fc695-hjx4j\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") " pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:45.386217 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.386201    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx7sv\" (UniqueName: \"kubernetes.io/projected/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-kube-api-access-nx7sv\") pod \"auth-test-model-31dfa2-kserve-67496fc695-hjx4j\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") " pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:45.487027 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.486992    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-model-cache\") pod \"auth-test-model-31dfa2-kserve-67496fc695-hjx4j\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") " pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:45.487027 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.487030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-home\") pod \"auth-test-model-31dfa2-kserve-67496fc695-hjx4j\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") " pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:45.487249 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.487086    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-tls-certs\") pod \"auth-test-model-31dfa2-kserve-67496fc695-hjx4j\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") " pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:45.487249 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.487115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx7sv\" (UniqueName: \"kubernetes.io/projected/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-kube-api-access-nx7sv\") pod \"auth-test-model-31dfa2-kserve-67496fc695-hjx4j\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") " pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:45.487249 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.487164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-dshm\") pod \"auth-test-model-31dfa2-kserve-67496fc695-hjx4j\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") " pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:45.487249 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.487191    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-tmp-dir\") pod \"auth-test-model-31dfa2-kserve-67496fc695-hjx4j\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") " pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:45.487475 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.487457    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-model-cache\") pod \"auth-test-model-31dfa2-kserve-67496fc695-hjx4j\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") " pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:45.487529 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.487507    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-home\") pod \"auth-test-model-31dfa2-kserve-67496fc695-hjx4j\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") " pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:45.487596 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.487583    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-tmp-dir\") pod \"auth-test-model-31dfa2-kserve-67496fc695-hjx4j\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") " pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:45.489479 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.489454    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-dshm\") pod \"auth-test-model-31dfa2-kserve-67496fc695-hjx4j\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") " pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:45.489658 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.489641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-tls-certs\") pod \"auth-test-model-31dfa2-kserve-67496fc695-hjx4j\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") " pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:45.496477 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.496449    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx7sv\" (UniqueName: \"kubernetes.io/projected/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-kube-api-access-nx7sv\") pod \"auth-test-model-31dfa2-kserve-67496fc695-hjx4j\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") " pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:45.585668 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.585580    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:45.720924 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.720895    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"]
Jul 15 21:44:45.723049 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:44:45.723016    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod37ad1d6f_92fb_40cf_94a8_4cc98aca74e6.slice/crio-465aa97bea66a453ba5e219b88bbacaba487c8d03c14982a30d9696310b37965 WatchSource:0}: Error finding container 465aa97bea66a453ba5e219b88bbacaba487c8d03c14982a30d9696310b37965: Status 404 returned error can't find the container with id 465aa97bea66a453ba5e219b88bbacaba487c8d03c14982a30d9696310b37965
Jul 15 21:44:45.901490 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.901402    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j" event={"ID":"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6","Type":"ContainerStarted","Data":"0d6672fcc6485cfe52ed0a672aa5f38bdb05e757f6676f92a3a5c14ad708dacd"}
Jul 15 21:44:45.901490 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.901444    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j" event={"ID":"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6","Type":"ContainerStarted","Data":"465aa97bea66a453ba5e219b88bbacaba487c8d03c14982a30d9696310b37965"}
Jul 15 21:44:45.921488 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:45.921382    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j" podStartSLOduration=0.921362762 podStartE2EDuration="921.362762ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:44:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:44:45.920657839 +0000 UTC m=+2587.348617476" watchObservedRunningTime="2026-07-15 21:44:45.921362762 +0000 UTC m=+2587.349322404"
Jul 15 21:44:55.586454 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:55.586411    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:55.586454 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:55.586465    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:55.599195 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:55.599170    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:44:55.958622 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:44:55.958588    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:45:10.883288 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:10.883246    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"]
Jul 15 21:45:10.886549 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:10.886533    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:10.890444 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:10.890422    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b7f88c\"/\"kube-root-ca.crt\""
Jul 15 21:45:10.890444 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:10.890427    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b7f88c\"/\"auth-test-model-b7f88c-kserve-self-signed-certs\""
Jul 15 21:45:10.890656 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:10.890453    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b7f88c\"/\"openshift-service-ca.crt\""
Jul 15 21:45:10.890656 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:10.890427    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b7f88c\"/\"default-dockercfg-88hsc\""
Jul 15 21:45:10.906537 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:10.906512    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"]
Jul 15 21:45:11.036894 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:11.036864    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-dshm\") pod \"auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") " pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:11.036894 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:11.036897    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13d7a93f-fec5-4401-93be-ea7b37f1bd11-tls-certs\") pod \"auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") " pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:11.037131 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:11.036950    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-model-cache\") pod \"auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") " pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:11.037131 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:11.036966    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcpf5\" (UniqueName: \"kubernetes.io/projected/13d7a93f-fec5-4401-93be-ea7b37f1bd11-kube-api-access-vcpf5\") pod \"auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") " pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:11.037131 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:11.037051    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-home\") pod \"auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") " pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:11.037131 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:11.037101    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-tmp-dir\") pod \"auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") " pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:11.138099 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:11.138001    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-dshm\") pod \"auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") " pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:11.138099 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:11.138037    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13d7a93f-fec5-4401-93be-ea7b37f1bd11-tls-certs\") pod \"auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") " pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:11.138099 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:11.138059    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-model-cache\") pod \"auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") " pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:11.138099 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:11.138076    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcpf5\" (UniqueName: \"kubernetes.io/projected/13d7a93f-fec5-4401-93be-ea7b37f1bd11-kube-api-access-vcpf5\") pod \"auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") " pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:11.138430 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:11.138128    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-home\") pod \"auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") " pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:11.138430 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:11.138153    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-tmp-dir\") pod \"auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") " pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:11.138552 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:11.138459    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-model-cache\") pod \"auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") " pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:11.138597 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:11.138579    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-tmp-dir\") pod \"auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") " pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:11.138658 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:11.138636    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-home\") pod \"auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") " pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:11.140612 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:11.140586    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-dshm\") pod \"auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") " pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:11.140720 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:11.140668    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13d7a93f-fec5-4401-93be-ea7b37f1bd11-tls-certs\") pod \"auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") " pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:11.150293 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:11.150268    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcpf5\" (UniqueName: \"kubernetes.io/projected/13d7a93f-fec5-4401-93be-ea7b37f1bd11-kube-api-access-vcpf5\") pod \"auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") " pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:11.196749 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:11.196706    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:11.359150 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:11.359070    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"]
Jul 15 21:45:11.362834 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:45:11.362813    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13d7a93f_fec5_4401_93be_ea7b37f1bd11.slice/crio-81103c1594076e2ee0b622be89adf2dc74c8f892ec5199964680b9ea2e64a36f WatchSource:0}: Error finding container 81103c1594076e2ee0b622be89adf2dc74c8f892ec5199964680b9ea2e64a36f: Status 404 returned error can't find the container with id 81103c1594076e2ee0b622be89adf2dc74c8f892ec5199964680b9ea2e64a36f
Jul 15 21:45:12.029480 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:12.029443    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd" event={"ID":"13d7a93f-fec5-4401-93be-ea7b37f1bd11","Type":"ContainerStarted","Data":"a667bce1f16cb5c6bd08f0f909dd7d00f9d89ca571f0c26b174d29cc4ec4b6b7"}
Jul 15 21:45:12.029480 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:12.029485    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd" event={"ID":"13d7a93f-fec5-4401-93be-ea7b37f1bd11","Type":"ContainerStarted","Data":"81103c1594076e2ee0b622be89adf2dc74c8f892ec5199964680b9ea2e64a36f"}
Jul 15 21:45:12.050222 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:12.050062    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd" podStartSLOduration=2.050047027 podStartE2EDuration="2.050047027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:12.049249586 +0000 UTC m=+2613.477209248" watchObservedRunningTime="2026-07-15 21:45:12.050047027 +0000 UTC m=+2613.478006664"
Jul 15 21:45:21.196857 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:21.196815    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:21.197307 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:21.196900    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:21.209439 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:21.209409    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:45:22.088105 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:45:22.088071    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:46:39.248381 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:46:39.248294    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:46:39.254744 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:46:39.254722    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:47:23.800902 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:23.800864    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"]
Jul 15 21:47:24.676306 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:24.676269    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"]
Jul 15 21:47:38.820793 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:38.820726    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j" podUID="37ad1d6f-92fb-40cf-94a8-4cc98aca74e6" containerName="main" containerID="cri-o://0d6672fcc6485cfe52ed0a672aa5f38bdb05e757f6676f92a3a5c14ad708dacd" gracePeriod=45
Jul 15 21:47:39.074174 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.074113    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:47:39.159328 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.159292    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-home\") pod \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") "
Jul 15 21:47:39.159497 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.159347    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-dshm\") pod \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") "
Jul 15 21:47:39.159497 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.159384    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-tls-certs\") pod \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") "
Jul 15 21:47:39.159497 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.159432    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-tmp-dir\") pod \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") "
Jul 15 21:47:39.159497 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.159480    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nx7sv\" (UniqueName: \"kubernetes.io/projected/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-kube-api-access-nx7sv\") pod \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") "
Jul 15 21:47:39.159721 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.159506    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-model-cache\") pod \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\" (UID: \"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6\") "
Jul 15 21:47:39.159721 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.159576    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-home" (OuterVolumeSpecName: "home") pod "37ad1d6f-92fb-40cf-94a8-4cc98aca74e6" (UID: "37ad1d6f-92fb-40cf-94a8-4cc98aca74e6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:47:39.159872 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.159755    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "37ad1d6f-92fb-40cf-94a8-4cc98aca74e6" (UID: "37ad1d6f-92fb-40cf-94a8-4cc98aca74e6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:47:39.159943 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.159883    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-model-cache" (OuterVolumeSpecName: "model-cache") pod "37ad1d6f-92fb-40cf-94a8-4cc98aca74e6" (UID: "37ad1d6f-92fb-40cf-94a8-4cc98aca74e6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:47:39.160007 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.159956    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-tmp-dir\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:47:39.160007 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.159972    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-model-cache\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:47:39.160007 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.159985    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-home\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:47:39.161814 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.161786    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "37ad1d6f-92fb-40cf-94a8-4cc98aca74e6" (UID: "37ad1d6f-92fb-40cf-94a8-4cc98aca74e6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:47:39.161975 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.161932    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-kube-api-access-nx7sv" (OuterVolumeSpecName: "kube-api-access-nx7sv") pod "37ad1d6f-92fb-40cf-94a8-4cc98aca74e6" (UID: "37ad1d6f-92fb-40cf-94a8-4cc98aca74e6"). InnerVolumeSpecName "kube-api-access-nx7sv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:47:39.161975 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.161946    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-dshm" (OuterVolumeSpecName: "dshm") pod "37ad1d6f-92fb-40cf-94a8-4cc98aca74e6" (UID: "37ad1d6f-92fb-40cf-94a8-4cc98aca74e6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:47:39.260631 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.260597    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nx7sv\" (UniqueName: \"kubernetes.io/projected/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-kube-api-access-nx7sv\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:47:39.260631 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.260624    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-dshm\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:47:39.260631 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.260633    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6-tls-certs\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:47:39.695866 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.695802    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd" podUID="13d7a93f-fec5-4401-93be-ea7b37f1bd11" containerName="main" containerID="cri-o://a667bce1f16cb5c6bd08f0f909dd7d00f9d89ca571f0c26b174d29cc4ec4b6b7" gracePeriod=45
Jul 15 21:47:39.733520 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.733494    2580 generic.go:356] "Generic (PLEG): container finished" podID="37ad1d6f-92fb-40cf-94a8-4cc98aca74e6" containerID="0d6672fcc6485cfe52ed0a672aa5f38bdb05e757f6676f92a3a5c14ad708dacd" exitCode=0
Jul 15 21:47:39.733657 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.733537    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"
Jul 15 21:47:39.733657 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.733580    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j" event={"ID":"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6","Type":"ContainerDied","Data":"0d6672fcc6485cfe52ed0a672aa5f38bdb05e757f6676f92a3a5c14ad708dacd"}
Jul 15 21:47:39.733657 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.733623    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j" event={"ID":"37ad1d6f-92fb-40cf-94a8-4cc98aca74e6","Type":"ContainerDied","Data":"465aa97bea66a453ba5e219b88bbacaba487c8d03c14982a30d9696310b37965"}
Jul 15 21:47:39.733657 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.733644    2580 scope.go:117] "RemoveContainer" containerID="0d6672fcc6485cfe52ed0a672aa5f38bdb05e757f6676f92a3a5c14ad708dacd"
Jul 15 21:47:39.773362 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.773334    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"]
Jul 15 21:47:39.777528 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.777500    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-31dfa2/auth-test-model-31dfa2-kserve-67496fc695-hjx4j"]
Jul 15 21:47:39.806561 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.806544    2580 scope.go:117] "RemoveContainer" containerID="0d6672fcc6485cfe52ed0a672aa5f38bdb05e757f6676f92a3a5c14ad708dacd"
Jul 15 21:47:39.806930 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:47:39.806912    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d6672fcc6485cfe52ed0a672aa5f38bdb05e757f6676f92a3a5c14ad708dacd\": container with ID starting with 0d6672fcc6485cfe52ed0a672aa5f38bdb05e757f6676f92a3a5c14ad708dacd not found: ID does not exist" containerID="0d6672fcc6485cfe52ed0a672aa5f38bdb05e757f6676f92a3a5c14ad708dacd"
Jul 15 21:47:39.807010 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.806939    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d6672fcc6485cfe52ed0a672aa5f38bdb05e757f6676f92a3a5c14ad708dacd"} err="failed to get container status \"0d6672fcc6485cfe52ed0a672aa5f38bdb05e757f6676f92a3a5c14ad708dacd\": rpc error: code = NotFound desc = could not find container \"0d6672fcc6485cfe52ed0a672aa5f38bdb05e757f6676f92a3a5c14ad708dacd\": container with ID starting with 0d6672fcc6485cfe52ed0a672aa5f38bdb05e757f6676f92a3a5c14ad708dacd not found: ID does not exist"
Jul 15 21:47:39.946460 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:39.946381    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:47:40.066871 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.066828    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-model-cache\") pod \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") "
Jul 15 21:47:40.067064 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.066894    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-home\") pod \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") "
Jul 15 21:47:40.067064 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.066933    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-dshm\") pod \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") "
Jul 15 21:47:40.067064 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.066982    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcpf5\" (UniqueName: \"kubernetes.io/projected/13d7a93f-fec5-4401-93be-ea7b37f1bd11-kube-api-access-vcpf5\") pod \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") "
Jul 15 21:47:40.067064 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.067006    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13d7a93f-fec5-4401-93be-ea7b37f1bd11-tls-certs\") pod \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") "
Jul 15 21:47:40.067064 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.067024    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-tmp-dir\") pod \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\" (UID: \"13d7a93f-fec5-4401-93be-ea7b37f1bd11\") "
Jul 15 21:47:40.067349 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.067123    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-model-cache" (OuterVolumeSpecName: "model-cache") pod "13d7a93f-fec5-4401-93be-ea7b37f1bd11" (UID: "13d7a93f-fec5-4401-93be-ea7b37f1bd11"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:47:40.067349 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.067185    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-home" (OuterVolumeSpecName: "home") pod "13d7a93f-fec5-4401-93be-ea7b37f1bd11" (UID: "13d7a93f-fec5-4401-93be-ea7b37f1bd11"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:47:40.067458 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.067346    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "13d7a93f-fec5-4401-93be-ea7b37f1bd11" (UID: "13d7a93f-fec5-4401-93be-ea7b37f1bd11"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:47:40.067458 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.067353    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-model-cache\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:47:40.067458 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.067371    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-home\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:47:40.069352 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.069324    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-dshm" (OuterVolumeSpecName: "dshm") pod "13d7a93f-fec5-4401-93be-ea7b37f1bd11" (UID: "13d7a93f-fec5-4401-93be-ea7b37f1bd11"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:47:40.069352 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.069335    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13d7a93f-fec5-4401-93be-ea7b37f1bd11-kube-api-access-vcpf5" (OuterVolumeSpecName: "kube-api-access-vcpf5") pod "13d7a93f-fec5-4401-93be-ea7b37f1bd11" (UID: "13d7a93f-fec5-4401-93be-ea7b37f1bd11"). InnerVolumeSpecName "kube-api-access-vcpf5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:47:40.069529 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.069374    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/13d7a93f-fec5-4401-93be-ea7b37f1bd11-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "13d7a93f-fec5-4401-93be-ea7b37f1bd11" (UID: "13d7a93f-fec5-4401-93be-ea7b37f1bd11"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:47:40.168068 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.168026    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-dshm\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:47:40.168068 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.168063    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcpf5\" (UniqueName: \"kubernetes.io/projected/13d7a93f-fec5-4401-93be-ea7b37f1bd11-kube-api-access-vcpf5\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:47:40.168068 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.168074    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13d7a93f-fec5-4401-93be-ea7b37f1bd11-tls-certs\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:47:40.168068 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.168084    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/13d7a93f-fec5-4401-93be-ea7b37f1bd11-tmp-dir\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:47:40.739527 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.739489    2580 generic.go:356] "Generic (PLEG): container finished" podID="13d7a93f-fec5-4401-93be-ea7b37f1bd11" containerID="a667bce1f16cb5c6bd08f0f909dd7d00f9d89ca571f0c26b174d29cc4ec4b6b7" exitCode=0
Jul 15 21:47:40.739713 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.739530    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd" event={"ID":"13d7a93f-fec5-4401-93be-ea7b37f1bd11","Type":"ContainerDied","Data":"a667bce1f16cb5c6bd08f0f909dd7d00f9d89ca571f0c26b174d29cc4ec4b6b7"}
Jul 15 21:47:40.739713 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.739574    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd" event={"ID":"13d7a93f-fec5-4401-93be-ea7b37f1bd11","Type":"ContainerDied","Data":"81103c1594076e2ee0b622be89adf2dc74c8f892ec5199964680b9ea2e64a36f"}
Jul 15 21:47:40.739713 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.739539    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"
Jul 15 21:47:40.739713 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.739586    2580 scope.go:117] "RemoveContainer" containerID="a667bce1f16cb5c6bd08f0f909dd7d00f9d89ca571f0c26b174d29cc4ec4b6b7"
Jul 15 21:47:40.757430 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.757409    2580 scope.go:117] "RemoveContainer" containerID="a667bce1f16cb5c6bd08f0f909dd7d00f9d89ca571f0c26b174d29cc4ec4b6b7"
Jul 15 21:47:40.757669 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:47:40.757650    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a667bce1f16cb5c6bd08f0f909dd7d00f9d89ca571f0c26b174d29cc4ec4b6b7\": container with ID starting with a667bce1f16cb5c6bd08f0f909dd7d00f9d89ca571f0c26b174d29cc4ec4b6b7 not found: ID does not exist" containerID="a667bce1f16cb5c6bd08f0f909dd7d00f9d89ca571f0c26b174d29cc4ec4b6b7"
Jul 15 21:47:40.757745 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.757681    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a667bce1f16cb5c6bd08f0f909dd7d00f9d89ca571f0c26b174d29cc4ec4b6b7"} err="failed to get container status \"a667bce1f16cb5c6bd08f0f909dd7d00f9d89ca571f0c26b174d29cc4ec4b6b7\": rpc error: code = NotFound desc = could not find container \"a667bce1f16cb5c6bd08f0f909dd7d00f9d89ca571f0c26b174d29cc4ec4b6b7\": container with ID starting with a667bce1f16cb5c6bd08f0f909dd7d00f9d89ca571f0c26b174d29cc4ec4b6b7 not found: ID does not exist"
Jul 15 21:47:40.762993 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.762973    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"]
Jul 15 21:47:40.766752 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:40.766732    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b7f88c/auth-test-model-b7f88c-kserve-74cc9589f5-fpbjd"]
Jul 15 21:47:41.063532 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:41.063446    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13d7a93f-fec5-4401-93be-ea7b37f1bd11" path="/var/lib/kubelet/pods/13d7a93f-fec5-4401-93be-ea7b37f1bd11/volumes"
Jul 15 21:47:41.064088 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:41.064068    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37ad1d6f-92fb-40cf-94a8-4cc98aca74e6" path="/var/lib/kubelet/pods/37ad1d6f-92fb-40cf-94a8-4cc98aca74e6/volumes"
Jul 15 21:47:55.689656 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.689623    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"]
Jul 15 21:47:55.690267 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.690246    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37ad1d6f-92fb-40cf-94a8-4cc98aca74e6" containerName="main"
Jul 15 21:47:55.690348 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.690269    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="37ad1d6f-92fb-40cf-94a8-4cc98aca74e6" containerName="main"
Jul 15 21:47:55.690348 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.690284    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13d7a93f-fec5-4401-93be-ea7b37f1bd11" containerName="main"
Jul 15 21:47:55.690348 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.690291    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="13d7a93f-fec5-4401-93be-ea7b37f1bd11" containerName="main"
Jul 15 21:47:55.690504 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.690396    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="13d7a93f-fec5-4401-93be-ea7b37f1bd11" containerName="main"
Jul 15 21:47:55.690504 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.690409    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="37ad1d6f-92fb-40cf-94a8-4cc98aca74e6" containerName="main"
Jul 15 21:47:55.693186 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.693165    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:47:55.695321 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.695304    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b7f88c\"/\"kube-root-ca.crt\""
Jul 15 21:47:55.695791 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.695769    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b7f88c\"/\"openshift-service-ca.crt\""
Jul 15 21:47:55.695938 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.695922    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b7f88c\"/\"default-dockercfg-88hsc\""
Jul 15 21:47:55.695999 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.695922    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b7f88c\"/\"sub-test-model-b7f88c-kserve-self-signed-certs\""
Jul 15 21:47:55.702180 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.702160    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"]
Jul 15 21:47:55.808320 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.808291    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-tmp-dir\") pod \"sub-test-model-b7f88c-kserve-665cc48bf5-95fgl\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") " pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:47:55.808495 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.808326    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25cr5\" (UniqueName: \"kubernetes.io/projected/5f89917b-e006-4c94-9d4a-9ef557e1462a-kube-api-access-25cr5\") pod \"sub-test-model-b7f88c-kserve-665cc48bf5-95fgl\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") " pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:47:55.808495 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.808349    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f89917b-e006-4c94-9d4a-9ef557e1462a-tls-certs\") pod \"sub-test-model-b7f88c-kserve-665cc48bf5-95fgl\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") " pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:47:55.808495 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.808471    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-model-cache\") pod \"sub-test-model-b7f88c-kserve-665cc48bf5-95fgl\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") " pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:47:55.808607 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.808538    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-home\") pod \"sub-test-model-b7f88c-kserve-665cc48bf5-95fgl\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") " pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:47:55.808607 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.808566    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-dshm\") pod \"sub-test-model-b7f88c-kserve-665cc48bf5-95fgl\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") " pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:47:55.909875 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.909831    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-tmp-dir\") pod \"sub-test-model-b7f88c-kserve-665cc48bf5-95fgl\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") " pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:47:55.910033 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.909881    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25cr5\" (UniqueName: \"kubernetes.io/projected/5f89917b-e006-4c94-9d4a-9ef557e1462a-kube-api-access-25cr5\") pod \"sub-test-model-b7f88c-kserve-665cc48bf5-95fgl\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") " pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:47:55.910033 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.909904    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f89917b-e006-4c94-9d4a-9ef557e1462a-tls-certs\") pod \"sub-test-model-b7f88c-kserve-665cc48bf5-95fgl\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") " pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:47:55.910033 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.909958    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-model-cache\") pod \"sub-test-model-b7f88c-kserve-665cc48bf5-95fgl\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") " pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:47:55.910033 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.910001    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-home\") pod \"sub-test-model-b7f88c-kserve-665cc48bf5-95fgl\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") " pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:47:55.910225 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.910084    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-dshm\") pod \"sub-test-model-b7f88c-kserve-665cc48bf5-95fgl\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") " pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:47:55.910458 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.910428    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-tmp-dir\") pod \"sub-test-model-b7f88c-kserve-665cc48bf5-95fgl\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") " pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:47:55.910570 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.910478    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-model-cache\") pod \"sub-test-model-b7f88c-kserve-665cc48bf5-95fgl\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") " pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:47:55.910570 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.910494    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-home\") pod \"sub-test-model-b7f88c-kserve-665cc48bf5-95fgl\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") " pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:47:55.912290 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.912271    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-dshm\") pod \"sub-test-model-b7f88c-kserve-665cc48bf5-95fgl\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") " pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:47:55.912415 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.912400    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f89917b-e006-4c94-9d4a-9ef557e1462a-tls-certs\") pod \"sub-test-model-b7f88c-kserve-665cc48bf5-95fgl\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") " pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:47:55.917804 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:55.917783    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25cr5\" (UniqueName: \"kubernetes.io/projected/5f89917b-e006-4c94-9d4a-9ef557e1462a-kube-api-access-25cr5\") pod \"sub-test-model-b7f88c-kserve-665cc48bf5-95fgl\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") " pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:47:56.002663 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:56.002583    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:47:56.134119 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:56.134093    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"]
Jul 15 21:47:56.136247 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:47:56.136220    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f89917b_e006_4c94_9d4a_9ef557e1462a.slice/crio-23c910b2fa3359acf560192bdbe2a9d9b635d6d77fe0a5c5b1c477c905cef7c2 WatchSource:0}: Error finding container 23c910b2fa3359acf560192bdbe2a9d9b635d6d77fe0a5c5b1c477c905cef7c2: Status 404 returned error can't find the container with id 23c910b2fa3359acf560192bdbe2a9d9b635d6d77fe0a5c5b1c477c905cef7c2
Jul 15 21:47:56.815417 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:56.815383    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl" event={"ID":"5f89917b-e006-4c94-9d4a-9ef557e1462a","Type":"ContainerStarted","Data":"989e68b66fa67fc8a43404706753f99fde7b798d9f10c5feb3beb711986c2696"}
Jul 15 21:47:56.815417 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:56.815424    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl" event={"ID":"5f89917b-e006-4c94-9d4a-9ef557e1462a","Type":"ContainerStarted","Data":"23c910b2fa3359acf560192bdbe2a9d9b635d6d77fe0a5c5b1c477c905cef7c2"}
Jul 15 21:47:56.833700 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:47:56.833654    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl" podStartSLOduration=1.833639813 podStartE2EDuration="1.833639813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:47:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:47:56.832771627 +0000 UTC m=+2778.260731262" watchObservedRunningTime="2026-07-15 21:47:56.833639813 +0000 UTC m=+2778.261599455"
Jul 15 21:48:06.002995 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:06.002910    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:48:06.002995 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:06.002959    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:48:06.015655 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:06.015628    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:48:06.879601 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:06.879570    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:48:48.905956 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:48.905924    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"]
Jul 15 21:48:58.487347 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.487312    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"]
Jul 15 21:48:58.491413 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.491388    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:48:58.494109 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.494084    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-31dfa2\"/\"openshift-service-ca.crt\""
Jul 15 21:48:58.494109 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.494102    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-31dfa2\"/\"kube-root-ca.crt\""
Jul 15 21:48:58.494336 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.494092    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-31dfa2\"/\"rate-test-model-31dfa2-kserve-self-signed-certs\""
Jul 15 21:48:58.494336 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.494155    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-31dfa2\"/\"default-dockercfg-822ck\""
Jul 15 21:48:58.502254 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.502232    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"]
Jul 15 21:48:58.657475 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.657441    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-model-cache\") pod \"rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") " pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:48:58.657475 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.657479    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ffk2\" (UniqueName: \"kubernetes.io/projected/cbc73350-7bd2-4733-8efb-527cf22f2b6d-kube-api-access-7ffk2\") pod \"rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") " pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:48:58.657691 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.657520    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-dshm\") pod \"rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") " pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:48:58.657691 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.657566    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-home\") pod \"rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") " pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:48:58.657691 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.657648    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbc73350-7bd2-4733-8efb-527cf22f2b6d-tls-certs\") pod \"rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") " pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:48:58.657691 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.657667    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-tmp-dir\") pod \"rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") " pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:48:58.758968 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.758883    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-model-cache\") pod \"rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") " pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:48:58.758968 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.758920    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ffk2\" (UniqueName: \"kubernetes.io/projected/cbc73350-7bd2-4733-8efb-527cf22f2b6d-kube-api-access-7ffk2\") pod \"rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") " pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:48:58.758968 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.758945    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-dshm\") pod \"rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") " pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:48:58.758968 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.758966    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-home\") pod \"rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") " pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:48:58.759239 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.759030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbc73350-7bd2-4733-8efb-527cf22f2b6d-tls-certs\") pod \"rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") " pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:48:58.759239 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.759047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-tmp-dir\") pod \"rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") " pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:48:58.759381 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.759349    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-model-cache\") pod \"rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") " pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:48:58.759496 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.759408    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-home\") pod \"rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") " pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:48:58.759496 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.759446    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-tmp-dir\") pod \"rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") " pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:48:58.761219 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.761201    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-dshm\") pod \"rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") " pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:48:58.761569 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.761552    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbc73350-7bd2-4733-8efb-527cf22f2b6d-tls-certs\") pod \"rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") " pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:48:58.767023 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.767003    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ffk2\" (UniqueName: \"kubernetes.io/projected/cbc73350-7bd2-4733-8efb-527cf22f2b6d-kube-api-access-7ffk2\") pod \"rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") " pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:48:58.801179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.801154    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:48:58.934106 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:58.934081    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"]
Jul 15 21:48:58.935944 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:48:58.935919    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbc73350_7bd2_4733_8efb_527cf22f2b6d.slice/crio-b64312acb67308fbb04eadbc5099a9da600cd9af7cbf1a55a663a8a8e9b7eec1 WatchSource:0}: Error finding container b64312acb67308fbb04eadbc5099a9da600cd9af7cbf1a55a663a8a8e9b7eec1: Status 404 returned error can't find the container with id b64312acb67308fbb04eadbc5099a9da600cd9af7cbf1a55a663a8a8e9b7eec1
Jul 15 21:48:59.113016 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:59.112936    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf" event={"ID":"cbc73350-7bd2-4733-8efb-527cf22f2b6d","Type":"ContainerStarted","Data":"0d242413c3e8fcfbc831a2d7501161154fbf55be87f5c898826902eeac531ab7"}
Jul 15 21:48:59.113016 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:59.112976    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf" event={"ID":"cbc73350-7bd2-4733-8efb-527cf22f2b6d","Type":"ContainerStarted","Data":"b64312acb67308fbb04eadbc5099a9da600cd9af7cbf1a55a663a8a8e9b7eec1"}
Jul 15 21:48:59.131647 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:48:59.131593    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf" podStartSLOduration=1.131576114 podStartE2EDuration="1.131576114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:48:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:48:59.130672164 +0000 UTC m=+2840.558631802" watchObservedRunningTime="2026-07-15 21:48:59.131576114 +0000 UTC m=+2840.559535752"
Jul 15 21:49:03.926290 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:03.926252    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl" podUID="5f89917b-e006-4c94-9d4a-9ef557e1462a" containerName="main" containerID="cri-o://989e68b66fa67fc8a43404706753f99fde7b798d9f10c5feb3beb711986c2696" gracePeriod=45
Jul 15 21:49:04.141185 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:04.141153    2580 generic.go:356] "Generic (PLEG): container finished" podID="5f89917b-e006-4c94-9d4a-9ef557e1462a" containerID="989e68b66fa67fc8a43404706753f99fde7b798d9f10c5feb3beb711986c2696" exitCode=0
Jul 15 21:49:04.141339 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:04.141228    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl" event={"ID":"5f89917b-e006-4c94-9d4a-9ef557e1462a","Type":"ContainerDied","Data":"989e68b66fa67fc8a43404706753f99fde7b798d9f10c5feb3beb711986c2696"}
Jul 15 21:49:04.185671 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:04.185647    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:49:04.206259 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:04.206231    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-tmp-dir\") pod \"5f89917b-e006-4c94-9d4a-9ef557e1462a\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") "
Jul 15 21:49:04.206394 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:04.206288    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-home\") pod \"5f89917b-e006-4c94-9d4a-9ef557e1462a\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") "
Jul 15 21:49:04.206394 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:04.206324    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-dshm\") pod \"5f89917b-e006-4c94-9d4a-9ef557e1462a\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") "
Jul 15 21:49:04.206394 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:04.206378    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f89917b-e006-4c94-9d4a-9ef557e1462a-tls-certs\") pod \"5f89917b-e006-4c94-9d4a-9ef557e1462a\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") "
Jul 15 21:49:04.206566 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:04.206444    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25cr5\" (UniqueName: \"kubernetes.io/projected/5f89917b-e006-4c94-9d4a-9ef557e1462a-kube-api-access-25cr5\") pod \"5f89917b-e006-4c94-9d4a-9ef557e1462a\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") "
Jul 15 21:49:04.206566 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:04.206479    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-model-cache\") pod \"5f89917b-e006-4c94-9d4a-9ef557e1462a\" (UID: \"5f89917b-e006-4c94-9d4a-9ef557e1462a\") "
Jul 15 21:49:04.206566 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:04.206504    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5f89917b-e006-4c94-9d4a-9ef557e1462a" (UID: "5f89917b-e006-4c94-9d4a-9ef557e1462a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:49:04.206566 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:04.206521    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-home" (OuterVolumeSpecName: "home") pod "5f89917b-e006-4c94-9d4a-9ef557e1462a" (UID: "5f89917b-e006-4c94-9d4a-9ef557e1462a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:49:04.206818 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:04.206800    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-tmp-dir\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:49:04.206898 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:04.206827    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-home\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:49:04.206898 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:04.206800    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-model-cache" (OuterVolumeSpecName: "model-cache") pod "5f89917b-e006-4c94-9d4a-9ef557e1462a" (UID: "5f89917b-e006-4c94-9d4a-9ef557e1462a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:49:04.208614 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:04.208589    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f89917b-e006-4c94-9d4a-9ef557e1462a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5f89917b-e006-4c94-9d4a-9ef557e1462a" (UID: "5f89917b-e006-4c94-9d4a-9ef557e1462a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:49:04.208614 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:04.208598    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-dshm" (OuterVolumeSpecName: "dshm") pod "5f89917b-e006-4c94-9d4a-9ef557e1462a" (UID: "5f89917b-e006-4c94-9d4a-9ef557e1462a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:49:04.208758 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:04.208602    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f89917b-e006-4c94-9d4a-9ef557e1462a-kube-api-access-25cr5" (OuterVolumeSpecName: "kube-api-access-25cr5") pod "5f89917b-e006-4c94-9d4a-9ef557e1462a" (UID: "5f89917b-e006-4c94-9d4a-9ef557e1462a"). InnerVolumeSpecName "kube-api-access-25cr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:49:04.307778 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:04.307744    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-dshm\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:49:04.307778 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:04.307774    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5f89917b-e006-4c94-9d4a-9ef557e1462a-tls-certs\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:49:04.307984 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:04.307790    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25cr5\" (UniqueName: \"kubernetes.io/projected/5f89917b-e006-4c94-9d4a-9ef557e1462a-kube-api-access-25cr5\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:49:04.307984 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:04.307803    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5f89917b-e006-4c94-9d4a-9ef557e1462a-model-cache\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:49:05.147018 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:05.146993    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"
Jul 15 21:49:05.147462 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:05.147016    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl" event={"ID":"5f89917b-e006-4c94-9d4a-9ef557e1462a","Type":"ContainerDied","Data":"23c910b2fa3359acf560192bdbe2a9d9b635d6d77fe0a5c5b1c477c905cef7c2"}
Jul 15 21:49:05.147462 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:05.147065    2580 scope.go:117] "RemoveContainer" containerID="989e68b66fa67fc8a43404706753f99fde7b798d9f10c5feb3beb711986c2696"
Jul 15 21:49:05.162467 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:05.162447    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"]
Jul 15 21:49:05.166335 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:05.166314    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b7f88c/sub-test-model-b7f88c-kserve-665cc48bf5-95fgl"]
Jul 15 21:49:07.062933 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:07.062900    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f89917b-e006-4c94-9d4a-9ef557e1462a" path="/var/lib/kubelet/pods/5f89917b-e006-4c94-9d4a-9ef557e1462a/volumes"
Jul 15 21:49:08.801890 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:08.801855    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:49:08.802372 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:08.801902    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:49:08.814135 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:08.814109    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:49:09.177457 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:09.177437    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:49:20.766930 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.766893    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"]
Jul 15 21:49:20.767393 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.767268    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f89917b-e006-4c94-9d4a-9ef557e1462a" containerName="main"
Jul 15 21:49:20.767393 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.767278    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f89917b-e006-4c94-9d4a-9ef557e1462a" containerName="main"
Jul 15 21:49:20.767393 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.767337    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f89917b-e006-4c94-9d4a-9ef557e1462a" containerName="main"
Jul 15 21:49:20.770256 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.770236    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:20.773194 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.773169    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b7f88c\"/\"kube-root-ca.crt\""
Jul 15 21:49:20.773301 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.773169    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b7f88c\"/\"rate-test-model-b7f88c-kserve-self-signed-certs\""
Jul 15 21:49:20.773301 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.773250    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b7f88c\"/\"default-dockercfg-88hsc\""
Jul 15 21:49:20.773301 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.773194    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b7f88c\"/\"openshift-service-ca.crt\""
Jul 15 21:49:20.780596 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.780575    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"]
Jul 15 21:49:20.853018 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.852985    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdwfl\" (UniqueName: \"kubernetes.io/projected/0945b2e7-5de7-47f2-b219-adb8df357e61-kube-api-access-tdwfl\") pod \"rate-test-model-b7f88c-kserve-664bb74479-jfz7h\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") " pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:20.853187 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.853046    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-home\") pod \"rate-test-model-b7f88c-kserve-664bb74479-jfz7h\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") " pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:20.853187 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.853067    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-model-cache\") pod \"rate-test-model-b7f88c-kserve-664bb74479-jfz7h\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") " pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:20.853187 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.853086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-dshm\") pod \"rate-test-model-b7f88c-kserve-664bb74479-jfz7h\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") " pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:20.853294 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.853240    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0945b2e7-5de7-47f2-b219-adb8df357e61-tls-certs\") pod \"rate-test-model-b7f88c-kserve-664bb74479-jfz7h\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") " pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:20.853294 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.853283    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-tmp-dir\") pod \"rate-test-model-b7f88c-kserve-664bb74479-jfz7h\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") " pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:20.953750 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.953718    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0945b2e7-5de7-47f2-b219-adb8df357e61-tls-certs\") pod \"rate-test-model-b7f88c-kserve-664bb74479-jfz7h\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") " pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:20.953750 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.953753    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-tmp-dir\") pod \"rate-test-model-b7f88c-kserve-664bb74479-jfz7h\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") " pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:20.953997 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.953783    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdwfl\" (UniqueName: \"kubernetes.io/projected/0945b2e7-5de7-47f2-b219-adb8df357e61-kube-api-access-tdwfl\") pod \"rate-test-model-b7f88c-kserve-664bb74479-jfz7h\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") " pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:20.953997 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.953876    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-home\") pod \"rate-test-model-b7f88c-kserve-664bb74479-jfz7h\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") " pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:20.953997 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.953910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-model-cache\") pod \"rate-test-model-b7f88c-kserve-664bb74479-jfz7h\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") " pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:20.953997 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.953936    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-dshm\") pod \"rate-test-model-b7f88c-kserve-664bb74479-jfz7h\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") " pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:20.954221 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.954180    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-tmp-dir\") pod \"rate-test-model-b7f88c-kserve-664bb74479-jfz7h\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") " pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:20.954293 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.954271    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-model-cache\") pod \"rate-test-model-b7f88c-kserve-664bb74479-jfz7h\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") " pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:20.954367 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.954316    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-home\") pod \"rate-test-model-b7f88c-kserve-664bb74479-jfz7h\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") " pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:20.956102 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.956081    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-dshm\") pod \"rate-test-model-b7f88c-kserve-664bb74479-jfz7h\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") " pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:20.956220 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.956205    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0945b2e7-5de7-47f2-b219-adb8df357e61-tls-certs\") pod \"rate-test-model-b7f88c-kserve-664bb74479-jfz7h\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") " pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:20.961215 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:20.961197    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdwfl\" (UniqueName: \"kubernetes.io/projected/0945b2e7-5de7-47f2-b219-adb8df357e61-kube-api-access-tdwfl\") pod \"rate-test-model-b7f88c-kserve-664bb74479-jfz7h\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") " pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:21.080322 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:21.080248    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:21.212488 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:21.212464    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"]
Jul 15 21:49:21.214450 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:49:21.214422    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0945b2e7_5de7_47f2_b219_adb8df357e61.slice/crio-43680c6ee558ee185579e9b1d5a210f1bfc0e78ed112bf3742140280b9eb83be WatchSource:0}: Error finding container 43680c6ee558ee185579e9b1d5a210f1bfc0e78ed112bf3742140280b9eb83be: Status 404 returned error can't find the container with id 43680c6ee558ee185579e9b1d5a210f1bfc0e78ed112bf3742140280b9eb83be
Jul 15 21:49:21.226254 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:21.226219    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h" event={"ID":"0945b2e7-5de7-47f2-b219-adb8df357e61","Type":"ContainerStarted","Data":"43680c6ee558ee185579e9b1d5a210f1bfc0e78ed112bf3742140280b9eb83be"}
Jul 15 21:49:22.233525 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:22.233490    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h" event={"ID":"0945b2e7-5de7-47f2-b219-adb8df357e61","Type":"ContainerStarted","Data":"1a4af821ed920f41ab90e643333e481ff497f7ac4fa5af15163f1c32ba26e495"}
Jul 15 21:49:22.249493 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:22.249448    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h" podStartSLOduration=2.249434492 podStartE2EDuration="2.249434492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:49:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:49:22.248427835 +0000 UTC m=+2863.676387463" watchObservedRunningTime="2026-07-15 21:49:22.249434492 +0000 UTC m=+2863.677394128"
Jul 15 21:49:31.081173 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:31.081139    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:31.081526 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:31.081197    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:31.093365 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:31.093343    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:49:31.287098 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:49:31.287022    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:50:05.065499 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:05.065465    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"]
Jul 15 21:50:05.918315 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:05.918284    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"]
Jul 15 21:50:20.085914 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.085866    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf" podUID="cbc73350-7bd2-4733-8efb-527cf22f2b6d" containerName="main" containerID="cri-o://0d242413c3e8fcfbc831a2d7501161154fbf55be87f5c898826902eeac531ab7" gracePeriod=45
Jul 15 21:50:20.339908 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.339852    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:50:20.510002 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.509968    2580 generic.go:356] "Generic (PLEG): container finished" podID="cbc73350-7bd2-4733-8efb-527cf22f2b6d" containerID="0d242413c3e8fcfbc831a2d7501161154fbf55be87f5c898826902eeac531ab7" exitCode=0
Jul 15 21:50:20.510178 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.510012    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"
Jul 15 21:50:20.510178 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.510053    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf" event={"ID":"cbc73350-7bd2-4733-8efb-527cf22f2b6d","Type":"ContainerDied","Data":"0d242413c3e8fcfbc831a2d7501161154fbf55be87f5c898826902eeac531ab7"}
Jul 15 21:50:20.510178 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.510099    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf" event={"ID":"cbc73350-7bd2-4733-8efb-527cf22f2b6d","Type":"ContainerDied","Data":"b64312acb67308fbb04eadbc5099a9da600cd9af7cbf1a55a663a8a8e9b7eec1"}
Jul 15 21:50:20.510178 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.510121    2580 scope.go:117] "RemoveContainer" containerID="0d242413c3e8fcfbc831a2d7501161154fbf55be87f5c898826902eeac531ab7"
Jul 15 21:50:20.518599 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.518580    2580 scope.go:117] "RemoveContainer" containerID="0d242413c3e8fcfbc831a2d7501161154fbf55be87f5c898826902eeac531ab7"
Jul 15 21:50:20.518862 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:50:20.518828    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d242413c3e8fcfbc831a2d7501161154fbf55be87f5c898826902eeac531ab7\": container with ID starting with 0d242413c3e8fcfbc831a2d7501161154fbf55be87f5c898826902eeac531ab7 not found: ID does not exist" containerID="0d242413c3e8fcfbc831a2d7501161154fbf55be87f5c898826902eeac531ab7"
Jul 15 21:50:20.518930 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.518876    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d242413c3e8fcfbc831a2d7501161154fbf55be87f5c898826902eeac531ab7"} err="failed to get container status \"0d242413c3e8fcfbc831a2d7501161154fbf55be87f5c898826902eeac531ab7\": rpc error: code = NotFound desc = could not find container \"0d242413c3e8fcfbc831a2d7501161154fbf55be87f5c898826902eeac531ab7\": container with ID starting with 0d242413c3e8fcfbc831a2d7501161154fbf55be87f5c898826902eeac531ab7 not found: ID does not exist"
Jul 15 21:50:20.520097 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.520080    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7ffk2\" (UniqueName: \"kubernetes.io/projected/cbc73350-7bd2-4733-8efb-527cf22f2b6d-kube-api-access-7ffk2\") pod \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") "
Jul 15 21:50:20.520150 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.520121    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbc73350-7bd2-4733-8efb-527cf22f2b6d-tls-certs\") pod \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") "
Jul 15 21:50:20.520150 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.520139    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-home\") pod \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") "
Jul 15 21:50:20.520218 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.520167    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-model-cache\") pod \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") "
Jul 15 21:50:20.520370 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.520352    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-tmp-dir\") pod \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") "
Jul 15 21:50:20.520424 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.520388    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-model-cache" (OuterVolumeSpecName: "model-cache") pod "cbc73350-7bd2-4733-8efb-527cf22f2b6d" (UID: "cbc73350-7bd2-4733-8efb-527cf22f2b6d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:50:20.520479 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.520424    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-dshm\") pod \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\" (UID: \"cbc73350-7bd2-4733-8efb-527cf22f2b6d\") "
Jul 15 21:50:20.520479 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.520454    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-home" (OuterVolumeSpecName: "home") pod "cbc73350-7bd2-4733-8efb-527cf22f2b6d" (UID: "cbc73350-7bd2-4733-8efb-527cf22f2b6d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:50:20.520646 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.520592    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cbc73350-7bd2-4733-8efb-527cf22f2b6d" (UID: "cbc73350-7bd2-4733-8efb-527cf22f2b6d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:50:20.520818 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.520800    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-home\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:50:20.520910 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.520826    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-model-cache\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:50:20.520910 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.520886    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-tmp-dir\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:50:20.522197 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.522172    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbc73350-7bd2-4733-8efb-527cf22f2b6d-kube-api-access-7ffk2" (OuterVolumeSpecName: "kube-api-access-7ffk2") pod "cbc73350-7bd2-4733-8efb-527cf22f2b6d" (UID: "cbc73350-7bd2-4733-8efb-527cf22f2b6d"). InnerVolumeSpecName "kube-api-access-7ffk2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:50:20.522281 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.522211    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cbc73350-7bd2-4733-8efb-527cf22f2b6d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cbc73350-7bd2-4733-8efb-527cf22f2b6d" (UID: "cbc73350-7bd2-4733-8efb-527cf22f2b6d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:50:20.522338 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.522321    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-dshm" (OuterVolumeSpecName: "dshm") pod "cbc73350-7bd2-4733-8efb-527cf22f2b6d" (UID: "cbc73350-7bd2-4733-8efb-527cf22f2b6d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:50:20.622384 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.622304    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7ffk2\" (UniqueName: \"kubernetes.io/projected/cbc73350-7bd2-4733-8efb-527cf22f2b6d-kube-api-access-7ffk2\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:50:20.622384 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.622330    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cbc73350-7bd2-4733-8efb-527cf22f2b6d-tls-certs\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:50:20.622384 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.622340    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cbc73350-7bd2-4733-8efb-527cf22f2b6d-dshm\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:50:20.831007 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.830977    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"]
Jul 15 21:50:20.834523 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.834500    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-31dfa2/rate-test-model-31dfa2-kserve-6dc4f7c8c9-5bpmf"]
Jul 15 21:50:20.938209 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:20.938169    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h" podUID="0945b2e7-5de7-47f2-b219-adb8df357e61" containerName="main" containerID="cri-o://1a4af821ed920f41ab90e643333e481ff497f7ac4fa5af15163f1c32ba26e495" gracePeriod=45
Jul 15 21:50:21.062655 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.062627    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbc73350-7bd2-4733-8efb-527cf22f2b6d" path="/var/lib/kubelet/pods/cbc73350-7bd2-4733-8efb-527cf22f2b6d/volumes"
Jul 15 21:50:21.188678 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.188627    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:50:21.327687 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.327662    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-model-cache\") pod \"0945b2e7-5de7-47f2-b219-adb8df357e61\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") "
Jul 15 21:50:21.327894 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.327711    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-dshm\") pod \"0945b2e7-5de7-47f2-b219-adb8df357e61\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") "
Jul 15 21:50:21.327894 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.327742    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdwfl\" (UniqueName: \"kubernetes.io/projected/0945b2e7-5de7-47f2-b219-adb8df357e61-kube-api-access-tdwfl\") pod \"0945b2e7-5de7-47f2-b219-adb8df357e61\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") "
Jul 15 21:50:21.327894 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.327805    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-home\") pod \"0945b2e7-5de7-47f2-b219-adb8df357e61\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") "
Jul 15 21:50:21.327894 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.327885    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-tmp-dir\") pod \"0945b2e7-5de7-47f2-b219-adb8df357e61\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") "
Jul 15 21:50:21.328167 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.327915    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0945b2e7-5de7-47f2-b219-adb8df357e61-tls-certs\") pod \"0945b2e7-5de7-47f2-b219-adb8df357e61\" (UID: \"0945b2e7-5de7-47f2-b219-adb8df357e61\") "
Jul 15 21:50:21.328167 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.327989    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-model-cache" (OuterVolumeSpecName: "model-cache") pod "0945b2e7-5de7-47f2-b219-adb8df357e61" (UID: "0945b2e7-5de7-47f2-b219-adb8df357e61"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:50:21.328283 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.328171    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-home" (OuterVolumeSpecName: "home") pod "0945b2e7-5de7-47f2-b219-adb8df357e61" (UID: "0945b2e7-5de7-47f2-b219-adb8df357e61"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:50:21.328283 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.328224    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-model-cache\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:50:21.328283 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.328234    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0945b2e7-5de7-47f2-b219-adb8df357e61" (UID: "0945b2e7-5de7-47f2-b219-adb8df357e61"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:50:21.330063 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.330035    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0945b2e7-5de7-47f2-b219-adb8df357e61-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0945b2e7-5de7-47f2-b219-adb8df357e61" (UID: "0945b2e7-5de7-47f2-b219-adb8df357e61"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 21:50:21.330063 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.330055    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0945b2e7-5de7-47f2-b219-adb8df357e61-kube-api-access-tdwfl" (OuterVolumeSpecName: "kube-api-access-tdwfl") pod "0945b2e7-5de7-47f2-b219-adb8df357e61" (UID: "0945b2e7-5de7-47f2-b219-adb8df357e61"). InnerVolumeSpecName "kube-api-access-tdwfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 21:50:21.330240 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.330059    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-dshm" (OuterVolumeSpecName: "dshm") pod "0945b2e7-5de7-47f2-b219-adb8df357e61" (UID: "0945b2e7-5de7-47f2-b219-adb8df357e61"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 21:50:21.429301 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.429273    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-tmp-dir\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:50:21.429301 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.429295    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0945b2e7-5de7-47f2-b219-adb8df357e61-tls-certs\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:50:21.429301 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.429305    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-dshm\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:50:21.429515 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.429314    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdwfl\" (UniqueName: \"kubernetes.io/projected/0945b2e7-5de7-47f2-b219-adb8df357e61-kube-api-access-tdwfl\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:50:21.429515 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.429322    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0945b2e7-5de7-47f2-b219-adb8df357e61-home\") on node \"ip-10-0-130-35.ec2.internal\" DevicePath \"\""
Jul 15 21:50:21.516723 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.516643    2580 generic.go:356] "Generic (PLEG): container finished" podID="0945b2e7-5de7-47f2-b219-adb8df357e61" containerID="1a4af821ed920f41ab90e643333e481ff497f7ac4fa5af15163f1c32ba26e495" exitCode=0
Jul 15 21:50:21.516723 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.516680    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"
Jul 15 21:50:21.516916 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.516729    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h" event={"ID":"0945b2e7-5de7-47f2-b219-adb8df357e61","Type":"ContainerDied","Data":"1a4af821ed920f41ab90e643333e481ff497f7ac4fa5af15163f1c32ba26e495"}
Jul 15 21:50:21.516916 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.516767    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h" event={"ID":"0945b2e7-5de7-47f2-b219-adb8df357e61","Type":"ContainerDied","Data":"43680c6ee558ee185579e9b1d5a210f1bfc0e78ed112bf3742140280b9eb83be"}
Jul 15 21:50:21.516916 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.516786    2580 scope.go:117] "RemoveContainer" containerID="1a4af821ed920f41ab90e643333e481ff497f7ac4fa5af15163f1c32ba26e495"
Jul 15 21:50:21.525939 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.525913    2580 scope.go:117] "RemoveContainer" containerID="1a4af821ed920f41ab90e643333e481ff497f7ac4fa5af15163f1c32ba26e495"
Jul 15 21:50:21.526158 ip-10-0-130-35 kubenswrapper[2580]: E0715 21:50:21.526142    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a4af821ed920f41ab90e643333e481ff497f7ac4fa5af15163f1c32ba26e495\": container with ID starting with 1a4af821ed920f41ab90e643333e481ff497f7ac4fa5af15163f1c32ba26e495 not found: ID does not exist" containerID="1a4af821ed920f41ab90e643333e481ff497f7ac4fa5af15163f1c32ba26e495"
Jul 15 21:50:21.526215 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.526166    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a4af821ed920f41ab90e643333e481ff497f7ac4fa5af15163f1c32ba26e495"} err="failed to get container status \"1a4af821ed920f41ab90e643333e481ff497f7ac4fa5af15163f1c32ba26e495\": rpc error: code = NotFound desc = could not find container \"1a4af821ed920f41ab90e643333e481ff497f7ac4fa5af15163f1c32ba26e495\": container with ID starting with 1a4af821ed920f41ab90e643333e481ff497f7ac4fa5af15163f1c32ba26e495 not found: ID does not exist"
Jul 15 21:50:21.536581 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.536557    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"]
Jul 15 21:50:21.538629 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:21.538605    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b7f88c/rate-test-model-b7f88c-kserve-664bb74479-jfz7h"]
Jul 15 21:50:23.063293 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:50:23.063258    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0945b2e7-5de7-47f2-b219-adb8df357e61" path="/var/lib/kubelet/pods/0945b2e7-5de7-47f2-b219-adb8df357e61/volumes"
Jul 15 21:51:24.782253 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:24.782227    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65c67f598f-76ms4_51f20288-4267-45e2-b596-2ec3f89d5ca6/copy-manifests/0.log"
Jul 15 21:51:24.789084 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:24.789061    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65c67f598f-76ms4_51f20288-4267-45e2-b596-2ec3f89d5ca6/manager/0.log"
Jul 15 21:51:27.616552 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:27.616523    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-qhpgd_ab5f8941-98d4-4aca-9d76-206271a0b20b/postgres/0.log"
Jul 15 21:51:29.510066 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:29.510041    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9wvtn_e9178c21-45d2-4537-85ad-2ae9fd1e84a6/kuadrant-console-plugin/0.log"
Jul 15 21:51:30.892233 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:30.892206    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f6cc69c87-ls8nd_2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7/kube-auth-proxy/0.log"
Jul 15 21:51:31.443925 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:31.443897    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74d5dc7b48-vx9t7_0c3324df-13f7-41ea-9145-aee63d6bc31c/router/0.log"
Jul 15 21:51:31.849944 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:31.849870    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-vmxk2_3e1f92c1-228a-4ad4-9603-01b2bf070468/main/0.log"
Jul 15 21:51:31.995898 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:31.995868    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-d74ck_63b1ca43-9b89-4fdd-9477-deebda98468a/main/0.log"
Jul 15 21:51:32.263490 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:32.263466    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbff8w7_6f479714-2682-4487-8f6b-a27d6b381633/main/0.log"
Jul 15 21:51:32.535090 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:32.535013    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-d2ld4_6acd9a9a-2161-4b88-a9de-552ff05dc66f/main/0.log"
Jul 15 21:51:39.276059 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:39.276030    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:51:39.283351 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:39.283332    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dhz54_0b444f82-3531-4cf8-8bbd-f36aeb5b6c29/ovn-acl-logging/0.log"
Jul 15 21:51:42.107789 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:42.107756    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bctvr_1a69c601-b5b2-4177-8781-16090abbd7f6/global-pull-secret-syncer/0.log"
Jul 15 21:51:42.228779 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:42.228751    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pw62m_394a0fde-3d6c-48e7-9d13-0325ad6ae285/konnectivity-agent/0.log"
Jul 15 21:51:42.277081 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:42.277053    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-35.ec2.internal_9093750e6d24bbef1ba3b0def477f9fe/haproxy/0.log"
Jul 15 21:51:48.298213 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:48.298187    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9wvtn_e9178c21-45d2-4537-85ad-2ae9fd1e84a6/kuadrant-console-plugin/0.log"
Jul 15 21:51:50.175265 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:50.175188    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_51c2f071-9922-43a0-9c39-4f6cb653bb69/alertmanager/0.log"
Jul 15 21:51:50.199619 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:50.199596    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_51c2f071-9922-43a0-9c39-4f6cb653bb69/config-reloader/0.log"
Jul 15 21:51:50.225509 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:50.225483    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_51c2f071-9922-43a0-9c39-4f6cb653bb69/kube-rbac-proxy-web/0.log"
Jul 15 21:51:50.252041 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:50.252019    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_51c2f071-9922-43a0-9c39-4f6cb653bb69/kube-rbac-proxy/0.log"
Jul 15 21:51:50.284910 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:50.284888    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_51c2f071-9922-43a0-9c39-4f6cb653bb69/kube-rbac-proxy-metric/0.log"
Jul 15 21:51:50.320004 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:50.319982    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_51c2f071-9922-43a0-9c39-4f6cb653bb69/prom-label-proxy/0.log"
Jul 15 21:51:50.349012 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:50.348989    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_51c2f071-9922-43a0-9c39-4f6cb653bb69/init-config-reloader/0.log"
Jul 15 21:51:50.395380 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:50.395357    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-vwjr6_95680620-6e1c-4356-b790-949697705f91/cluster-monitoring-operator/0.log"
Jul 15 21:51:50.551330 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:50.551302    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-5pl7s_4cf114db-5f8f-41c1-8b84-3ea18ec8b69d/monitoring-plugin/0.log"
Jul 15 21:51:50.758524 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:50.758495    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-thv55_58533952-e1cd-482a-919c-be6f0d5440d2/node-exporter/0.log"
Jul 15 21:51:50.783509 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:50.783482    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-thv55_58533952-e1cd-482a-919c-be6f0d5440d2/kube-rbac-proxy/0.log"
Jul 15 21:51:50.818078 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:50.818019    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-thv55_58533952-e1cd-482a-919c-be6f0d5440d2/init-textfile/0.log"
Jul 15 21:51:50.847778 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:50.847753    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-4xx52_ccde4391-22cf-430f-a8b6-d919aeec3c96/kube-rbac-proxy-main/0.log"
Jul 15 21:51:50.872215 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:50.872197    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-4xx52_ccde4391-22cf-430f-a8b6-d919aeec3c96/kube-rbac-proxy-self/0.log"
Jul 15 21:51:50.905454 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:50.905434    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-4xx52_ccde4391-22cf-430f-a8b6-d919aeec3c96/openshift-state-metrics/0.log"
Jul 15 21:51:50.950024 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:50.950002    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_408d8984-44d2-4b58-8546-dcdb7a8ee6a5/prometheus/0.log"
Jul 15 21:51:50.976612 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:50.976592    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_408d8984-44d2-4b58-8546-dcdb7a8ee6a5/config-reloader/0.log"
Jul 15 21:51:50.998575 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:50.998543    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_408d8984-44d2-4b58-8546-dcdb7a8ee6a5/thanos-sidecar/0.log"
Jul 15 21:51:51.020891 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:51.020868    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_408d8984-44d2-4b58-8546-dcdb7a8ee6a5/kube-rbac-proxy-web/0.log"
Jul 15 21:51:51.054536 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:51.054517    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_408d8984-44d2-4b58-8546-dcdb7a8ee6a5/kube-rbac-proxy/0.log"
Jul 15 21:51:51.086079 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:51.086022    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_408d8984-44d2-4b58-8546-dcdb7a8ee6a5/kube-rbac-proxy-thanos/0.log"
Jul 15 21:51:51.112179 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:51.112160    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_408d8984-44d2-4b58-8546-dcdb7a8ee6a5/init-config-reloader/0.log"
Jul 15 21:51:51.137977 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:51.137959    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-m4gz8_85d654e3-d853-4286-afc1-415e945349a9/prometheus-operator/0.log"
Jul 15 21:51:51.158599 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:51.158579    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-m4gz8_85d654e3-d853-4286-afc1-415e945349a9/kube-rbac-proxy/0.log"
Jul 15 21:51:51.183856 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:51.183821    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-9f225_bb3c0559-7c33-4c2e-80db-64c85ce44dbb/prometheus-operator-admission-webhook/0.log"
Jul 15 21:51:52.364679 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.364641    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v"]
Jul 15 21:51:52.365181 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.365012    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbc73350-7bd2-4733-8efb-527cf22f2b6d" containerName="main"
Jul 15 21:51:52.365181 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.365023    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbc73350-7bd2-4733-8efb-527cf22f2b6d" containerName="main"
Jul 15 21:51:52.365181 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.365048    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0945b2e7-5de7-47f2-b219-adb8df357e61" containerName="main"
Jul 15 21:51:52.365181 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.365053    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0945b2e7-5de7-47f2-b219-adb8df357e61" containerName="main"
Jul 15 21:51:52.365181 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.365112    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbc73350-7bd2-4733-8efb-527cf22f2b6d" containerName="main"
Jul 15 21:51:52.365181 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.365121    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0945b2e7-5de7-47f2-b219-adb8df357e61" containerName="main"
Jul 15 21:51:52.368265 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.368246    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v"
Jul 15 21:51:52.370081 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.370061    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pqvxt\"/\"kube-root-ca.crt\""
Jul 15 21:51:52.370552 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.370534    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pqvxt\"/\"openshift-service-ca.crt\""
Jul 15 21:51:52.370634 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.370600    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pqvxt\"/\"default-dockercfg-c2jrj\""
Jul 15 21:51:52.375654 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.375634    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v"]
Jul 15 21:51:52.447615 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.447575    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1424bf4-5c51-4174-9381-f2e4a229fe8b-lib-modules\") pod \"perf-node-gather-daemonset-qkz6v\" (UID: \"d1424bf4-5c51-4174-9381-f2e4a229fe8b\") " pod="openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v"
Jul 15 21:51:52.447615 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.447621    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d1424bf4-5c51-4174-9381-f2e4a229fe8b-proc\") pod \"perf-node-gather-daemonset-qkz6v\" (UID: \"d1424bf4-5c51-4174-9381-f2e4a229fe8b\") " pod="openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v"
Jul 15 21:51:52.447807 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.447684    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1424bf4-5c51-4174-9381-f2e4a229fe8b-sys\") pod \"perf-node-gather-daemonset-qkz6v\" (UID: \"d1424bf4-5c51-4174-9381-f2e4a229fe8b\") " pod="openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v"
Jul 15 21:51:52.447807 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.447768    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d1424bf4-5c51-4174-9381-f2e4a229fe8b-podres\") pod \"perf-node-gather-daemonset-qkz6v\" (UID: \"d1424bf4-5c51-4174-9381-f2e4a229fe8b\") " pod="openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v"
Jul 15 21:51:52.447807 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.447800    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dshcn\" (UniqueName: \"kubernetes.io/projected/d1424bf4-5c51-4174-9381-f2e4a229fe8b-kube-api-access-dshcn\") pod \"perf-node-gather-daemonset-qkz6v\" (UID: \"d1424bf4-5c51-4174-9381-f2e4a229fe8b\") " pod="openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v"
Jul 15 21:51:52.548578 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.548551    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1424bf4-5c51-4174-9381-f2e4a229fe8b-sys\") pod \"perf-node-gather-daemonset-qkz6v\" (UID: \"d1424bf4-5c51-4174-9381-f2e4a229fe8b\") " pod="openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v"
Jul 15 21:51:52.548705 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.548610    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d1424bf4-5c51-4174-9381-f2e4a229fe8b-podres\") pod \"perf-node-gather-daemonset-qkz6v\" (UID: \"d1424bf4-5c51-4174-9381-f2e4a229fe8b\") " pod="openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v"
Jul 15 21:51:52.548705 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.548631    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dshcn\" (UniqueName: \"kubernetes.io/projected/d1424bf4-5c51-4174-9381-f2e4a229fe8b-kube-api-access-dshcn\") pod \"perf-node-gather-daemonset-qkz6v\" (UID: \"d1424bf4-5c51-4174-9381-f2e4a229fe8b\") " pod="openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v"
Jul 15 21:51:52.548705 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.548667    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d1424bf4-5c51-4174-9381-f2e4a229fe8b-sys\") pod \"perf-node-gather-daemonset-qkz6v\" (UID: \"d1424bf4-5c51-4174-9381-f2e4a229fe8b\") " pod="openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v"
Jul 15 21:51:52.548705 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.548671    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1424bf4-5c51-4174-9381-f2e4a229fe8b-lib-modules\") pod \"perf-node-gather-daemonset-qkz6v\" (UID: \"d1424bf4-5c51-4174-9381-f2e4a229fe8b\") " pod="openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v"
Jul 15 21:51:52.548864 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.548721    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d1424bf4-5c51-4174-9381-f2e4a229fe8b-proc\") pod \"perf-node-gather-daemonset-qkz6v\" (UID: \"d1424bf4-5c51-4174-9381-f2e4a229fe8b\") " pod="openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v"
Jul 15 21:51:52.548864 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.548764    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d1424bf4-5c51-4174-9381-f2e4a229fe8b-lib-modules\") pod \"perf-node-gather-daemonset-qkz6v\" (UID: \"d1424bf4-5c51-4174-9381-f2e4a229fe8b\") " pod="openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v"
Jul 15 21:51:52.548864 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.548784    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d1424bf4-5c51-4174-9381-f2e4a229fe8b-podres\") pod \"perf-node-gather-daemonset-qkz6v\" (UID: \"d1424bf4-5c51-4174-9381-f2e4a229fe8b\") " pod="openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v"
Jul 15 21:51:52.548864 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.548792    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d1424bf4-5c51-4174-9381-f2e4a229fe8b-proc\") pod \"perf-node-gather-daemonset-qkz6v\" (UID: \"d1424bf4-5c51-4174-9381-f2e4a229fe8b\") " pod="openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v"
Jul 15 21:51:52.556965 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.556943    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dshcn\" (UniqueName: \"kubernetes.io/projected/d1424bf4-5c51-4174-9381-f2e4a229fe8b-kube-api-access-dshcn\") pod \"perf-node-gather-daemonset-qkz6v\" (UID: \"d1424bf4-5c51-4174-9381-f2e4a229fe8b\") " pod="openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v"
Jul 15 21:51:52.679033 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.679013    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v"
Jul 15 21:51:52.806264 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.806197    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v"]
Jul 15 21:51:52.808692 ip-10-0-130-35 kubenswrapper[2580]: W0715 21:51:52.808666    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd1424bf4_5c51_4174_9381_f2e4a229fe8b.slice/crio-8231d0ceec5390d8818f9eed6f7d6a18efa5a427db99c87dc1393e5e0bf264f9 WatchSource:0}: Error finding container 8231d0ceec5390d8818f9eed6f7d6a18efa5a427db99c87dc1393e5e0bf264f9: Status 404 returned error can't find the container with id 8231d0ceec5390d8818f9eed6f7d6a18efa5a427db99c87dc1393e5e0bf264f9
Jul 15 21:51:52.947547 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.947519    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v" event={"ID":"d1424bf4-5c51-4174-9381-f2e4a229fe8b","Type":"ContainerStarted","Data":"9e512279948ab08e2f9862b53975e2e3430ee4d906d3707167afd75273e0c5a7"}
Jul 15 21:51:52.947657 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.947571    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v" event={"ID":"d1424bf4-5c51-4174-9381-f2e4a229fe8b","Type":"ContainerStarted","Data":"8231d0ceec5390d8818f9eed6f7d6a18efa5a427db99c87dc1393e5e0bf264f9"}
Jul 15 21:51:52.947657 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.947600    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v"
Jul 15 21:51:52.961434 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:52.961396    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v" podStartSLOduration=0.961382467 podStartE2EDuration="961.382467ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:51:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:51:52.960786621 +0000 UTC m=+3014.388746260" watchObservedRunningTime="2026-07-15 21:51:52.961382467 +0000 UTC m=+3014.389342103"
Jul 15 21:51:53.654574 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:53.654529    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-zxqkh_3098d13b-e3aa-49c7-9118-c70ba055523d/download-server/0.log"
Jul 15 21:51:54.231486 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:54.231451    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-kl8w7_9a87abc1-b350-47cc-8e22-3e947ede13ea/volume-data-source-validator/0.log"
Jul 15 21:51:55.324149 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:55.324120    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f7694_d1fb00d7-6201-4dfb-b60f-9364a0230149/dns/0.log"
Jul 15 21:51:55.344862 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:55.344822    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f7694_d1fb00d7-6201-4dfb-b60f-9364a0230149/kube-rbac-proxy/0.log"
Jul 15 21:51:55.453592 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:55.453567    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pj9tk_1a806e68-abc4-414a-96ac-843e728e77b9/dns-node-resolver/0.log"
Jul 15 21:51:56.040593 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:56.040567    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9hqht_3f3f398c-10c8-43f7-ba9f-1049f774d568/node-ca/0.log"
Jul 15 21:51:57.244534 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:57.244507    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f6cc69c87-ls8nd_2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7/kube-auth-proxy/0.log"
Jul 15 21:51:57.416116 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:57.416089    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74d5dc7b48-vx9t7_0c3324df-13f7-41ea-9145-aee63d6bc31c/router/0.log"
Jul 15 21:51:58.138417 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:58.138393    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dlmz6_8bce08f0-aff4-4d40-ab8d-7b9223412b0b/serve-healthcheck-canary/0.log"
Jul 15 21:51:58.655977 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:58.655948    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-7dmjx_95389d21-5271-4dda-bcf4-147a2f14832a/insights-operator/0.log"
Jul 15 21:51:58.656475 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:58.656459    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-7dmjx_95389d21-5271-4dda-bcf4-147a2f14832a/insights-operator/1.log"
Jul 15 21:51:58.812325 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:58.812300    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v9sgz_b3fa2ce3-fc47-44d8-b72e-228967dfde6d/kube-rbac-proxy/0.log"
Jul 15 21:51:58.833711 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:58.833695    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v9sgz_b3fa2ce3-fc47-44d8-b72e-228967dfde6d/exporter/0.log"
Jul 15 21:51:58.855472 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:58.855456    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-v9sgz_b3fa2ce3-fc47-44d8-b72e-228967dfde6d/extractor/0.log"
Jul 15 21:51:58.961702 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:51:58.961681    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pqvxt/perf-node-gather-daemonset-qkz6v"
Jul 15 21:52:02.292931 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:52:02.292900    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65c67f598f-76ms4_51f20288-4267-45e2-b596-2ec3f89d5ca6/manager/0.log"
Jul 15 21:52:02.353026 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:52:02.353000    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-65c67f598f-76ms4_51f20288-4267-45e2-b596-2ec3f89d5ca6/copy-manifests/0.log"
Jul 15 21:52:03.053151 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:52:03.053122    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f6cc69c87-ls8nd_2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7/kube-auth-proxy/0.log"
Jul 15 21:52:03.210732 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:52:03.210703    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74d5dc7b48-vx9t7_0c3324df-13f7-41ea-9145-aee63d6bc31c/router/0.log"
Jul 15 21:52:04.007116 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:52:04.007088    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5ccd478559-sq9fw_7f5e9da4-a3dc-40b0-8865-bdc244ec7035/manager/1.log"
Jul 15 21:52:04.007540 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:52:04.007420    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5ccd478559-sq9fw_7f5e9da4-a3dc-40b0-8865-bdc244ec7035/manager/0.log"
Jul 15 21:52:04.607813 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:52:04.607786    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6f6cc69c87-ls8nd_2ce63cb9-b5dc-4c15-81b8-8500fbf0d7b7/kube-auth-proxy/0.log"
Jul 15 21:52:04.768466 ip-10-0-130-35 kubenswrapper[2580]: I0715 21:52:04.768436    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-74d5dc7b48-vx9t7_0c3324df-13f7-41ea-9145-aee63d6bc31c/router/0.log"