Jul 18 11:18:11.510887 ip-10-0-130-110 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 18 11:18:11.510904 ip-10-0-130-110 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 18 11:18:11.510915 ip-10-0-130-110 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 18 11:18:11.511344 ip-10-0-130-110 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 18 11:18:21.759928 ip-10-0-130-110 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 18 11:18:21.759948 ip-10-0-130-110 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot bcafca2b55924a94976c7bc980cb181b --
Jul 18 11:19:56.670187 ip-10-0-130-110 systemd[1]: Starting Kubernetes Kubelet...
Jul 18 11:19:57.102182 ip-10-0-130-110 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 11:19:57.102182 ip-10-0-130-110 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 18 11:19:57.102182 ip-10-0-130-110 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 11:19:57.102182 ip-10-0-130-110 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 18 11:19:57.102182 ip-10-0-130-110 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 18 11:19:57.103313 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.103207    2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 18 11:19:57.111433 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111413    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 11:19:57.111433 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111431    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 11:19:57.111433 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111435    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 11:19:57.111433 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111440    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 11:19:57.111613 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111444    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 11:19:57.111613 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111447    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 11:19:57.111613 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111450    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 11:19:57.111613 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111454    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 11:19:57.111613 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111456    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 11:19:57.111613 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111459    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 11:19:57.111613 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111463    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 11:19:57.111613 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111465    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 11:19:57.111613 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111468    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 11:19:57.111613 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111471    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 11:19:57.111613 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111474    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 11:19:57.111613 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111477    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 11:19:57.111613 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111480    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 11:19:57.111613 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111482    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 11:19:57.111613 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111485    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 11:19:57.111613 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111488    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 11:19:57.111613 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111490    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 11:19:57.111613 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111493    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 11:19:57.111613 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111495    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 11:19:57.111613 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111498    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 11:19:57.112105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111500    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 11:19:57.112105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111503    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 11:19:57.112105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111505    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 11:19:57.112105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111510    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 11:19:57.112105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111513    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 11:19:57.112105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111516    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 11:19:57.112105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111519    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 11:19:57.112105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111522    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 11:19:57.112105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111525    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 11:19:57.112105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111527    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 11:19:57.112105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111532    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 11:19:57.112105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111536    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 11:19:57.112105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111539    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 11:19:57.112105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111543    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 11:19:57.112105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111546    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 11:19:57.112105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111549    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 11:19:57.112105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111552    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 11:19:57.112105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111556    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 11:19:57.112105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111558    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 11:19:57.112563 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111562    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 11:19:57.112563 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111565    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 11:19:57.112563 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111567    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 11:19:57.112563 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111570    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 11:19:57.112563 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111572    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 11:19:57.112563 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111575    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 11:19:57.112563 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111577    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 11:19:57.112563 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111580    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 11:19:57.112563 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111582    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 11:19:57.112563 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111585    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 11:19:57.112563 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111587    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 11:19:57.112563 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111591    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 11:19:57.112563 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111593    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 11:19:57.112563 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111596    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 11:19:57.112563 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111598    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 11:19:57.112563 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111601    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 11:19:57.112563 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111603    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 11:19:57.112563 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111606    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 11:19:57.112563 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111609    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 11:19:57.112563 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111611    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 11:19:57.113105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111614    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 11:19:57.113105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111616    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 11:19:57.113105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111619    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 11:19:57.113105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111622    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 11:19:57.113105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111625    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 11:19:57.113105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111629    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 11:19:57.113105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111633    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 11:19:57.113105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111636    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 11:19:57.113105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111640    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 11:19:57.113105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111643    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 11:19:57.113105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111646    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 11:19:57.113105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111648    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 11:19:57.113105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111651    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 11:19:57.113105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111653    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 11:19:57.113105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111656    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 11:19:57.113105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111659    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 11:19:57.113105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111661    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 11:19:57.113105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111664    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 11:19:57.113105 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111666    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 11:19:57.113558 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111669    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 11:19:57.113558 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111672    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 11:19:57.113558 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111674    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 11:19:57.113558 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111677    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 11:19:57.113558 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111680    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 11:19:57.113558 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111682    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 11:19:57.113558 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111684    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 11:19:57.113558 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111687    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 11:19:57.113558 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111689    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 11:19:57.113558 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111692    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 11:19:57.113558 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111694    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 11:19:57.113558 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111697    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 11:19:57.113558 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111699    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 11:19:57.113558 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111701    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 11:19:57.113558 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111704    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 11:19:57.113558 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111706    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 11:19:57.113558 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.111709    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 11:19:57.114226 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114213    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 11:19:57.114257 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114227    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 11:19:57.114257 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114231    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 11:19:57.114257 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114234    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 11:19:57.114257 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114237    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 11:19:57.114257 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114240    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 11:19:57.114257 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114243    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 11:19:57.114257 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114246    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 11:19:57.114257 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114248    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 11:19:57.114257 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114252    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 11:19:57.114257 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114255    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 11:19:57.114257 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114259    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 11:19:57.114520 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114263    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 11:19:57.114520 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114266    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 11:19:57.114520 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114270    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 11:19:57.114520 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114273    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 11:19:57.114520 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114275    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 11:19:57.114520 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114279    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 11:19:57.114520 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114281    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 11:19:57.114520 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114284    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 11:19:57.114520 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114287    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 11:19:57.114520 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114289    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 11:19:57.114520 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114293    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 11:19:57.114520 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114295    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 11:19:57.114520 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114298    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 11:19:57.114520 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114300    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 11:19:57.114520 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114303    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 11:19:57.114520 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114305    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 11:19:57.114520 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114308    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 11:19:57.114520 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114310    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 11:19:57.114520 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114313    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 11:19:57.114520 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114315    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 11:19:57.115028 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114318    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 11:19:57.115028 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114321    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 11:19:57.115028 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114323    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 11:19:57.115028 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114326    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 11:19:57.115028 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114328    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 11:19:57.115028 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114330    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 11:19:57.115028 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114333    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 11:19:57.115028 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114335    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 11:19:57.115028 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114338    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 11:19:57.115028 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114340    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 11:19:57.115028 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114343    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 11:19:57.115028 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114345    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 11:19:57.115028 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114348    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 11:19:57.115028 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114352    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 11:19:57.115028 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114354    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 11:19:57.115028 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114357    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 11:19:57.115028 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114360    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 11:19:57.115028 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114363    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 11:19:57.115028 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114366    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 11:19:57.115028 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114368    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 11:19:57.115519 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114371    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 11:19:57.115519 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114375    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 11:19:57.115519 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114378    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 11:19:57.115519 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114381    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 11:19:57.115519 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114383    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 11:19:57.115519 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114386    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 11:19:57.115519 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114388    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 11:19:57.115519 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114391    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 11:19:57.115519 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114394    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 11:19:57.115519 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114396    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 11:19:57.115519 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114399    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 11:19:57.115519 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114401    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 11:19:57.115519 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114404    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 11:19:57.115519 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114406    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 11:19:57.115519 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114409    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 11:19:57.115519 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114411    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 11:19:57.115519 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114414    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 11:19:57.115519 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114416    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 11:19:57.115519 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114419    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 11:19:57.115519 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114421    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 11:19:57.116006 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114424    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 11:19:57.116006 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114426    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 11:19:57.116006 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114429    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 11:19:57.116006 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114431    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 11:19:57.116006 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114434    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 11:19:57.116006 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114437    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 11:19:57.116006 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114440    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 11:19:57.116006 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114442    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 11:19:57.116006 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114445    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 11:19:57.116006 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114448    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 11:19:57.116006 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114450    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 11:19:57.116006 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114454    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 11:19:57.116006 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114457    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 11:19:57.116006 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114459    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 11:19:57.116006 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114462    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 11:19:57.116006 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114465    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 11:19:57.116006 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114467    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 11:19:57.116006 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114470    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 11:19:57.116006 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114473    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 11:19:57.116006 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114475    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 11:19:57.116490 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114478    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 11:19:57.116490 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114480    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 11:19:57.116490 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114483    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 11:19:57.116490 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114485    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 11:19:57.116490 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114488    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 11:19:57.116490 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114490    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 11:19:57.116490 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114493    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 11:19:57.116490 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114872    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 11:19:57.116490 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114876    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 11:19:57.116490 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114879    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 11:19:57.116490 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114882    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 11:19:57.116490 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114884    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 11:19:57.116490 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114887    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 11:19:57.116490 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114890    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 11:19:57.116490 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114893    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 11:19:57.116490 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114895    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 11:19:57.116490 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114898    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 11:19:57.116490 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114902    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 11:19:57.116490 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114905    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 11:19:57.116490 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114907    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 11:19:57.117002 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114911    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 11:19:57.117002 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114932    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 11:19:57.117002 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114936    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 11:19:57.117002 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114940    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 11:19:57.117002 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114942    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 11:19:57.117002 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114945    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 11:19:57.117002 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114948    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 11:19:57.117002 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114951    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 11:19:57.117002 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114953    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 11:19:57.117002 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114956    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 11:19:57.117002 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114958    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 11:19:57.117002 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114961    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 11:19:57.117002 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114964    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 11:19:57.117002 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114966    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 11:19:57.117002 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114969    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 11:19:57.117002 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114971    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 11:19:57.117002 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114974    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 11:19:57.117002 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114976    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 11:19:57.117002 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114979    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 11:19:57.117002 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114981    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 11:19:57.117475 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114984    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 11:19:57.117475 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114986    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 11:19:57.117475 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114989    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 11:19:57.117475 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114991    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 11:19:57.117475 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114994    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 11:19:57.117475 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114997    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 11:19:57.117475 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.114999    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 11:19:57.117475 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115001    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 11:19:57.117475 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115004    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 11:19:57.117475 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115007    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 11:19:57.117475 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115010    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 11:19:57.117475 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115012    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 11:19:57.117475 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115015    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 11:19:57.117475 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115019    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 11:19:57.117475 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115022    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 11:19:57.117475 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115025    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 11:19:57.117475 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115029    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 11:19:57.117475 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115033    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 11:19:57.117475 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115036    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 11:19:57.117948 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115039    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 11:19:57.117948 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115042    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 11:19:57.117948 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115045    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 11:19:57.117948 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115047    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 11:19:57.117948 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115050    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 11:19:57.117948 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115052    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 11:19:57.117948 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115055    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 11:19:57.117948 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115057    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 11:19:57.117948 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115060    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 11:19:57.117948 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115062    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 11:19:57.117948 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115064    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 11:19:57.117948 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115067    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 11:19:57.117948 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115069    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 11:19:57.117948 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115072    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 11:19:57.117948 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115074    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 11:19:57.117948 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115077    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 11:19:57.117948 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115079    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 11:19:57.117948 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115081    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 11:19:57.117948 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115084    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 11:19:57.117948 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115086    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 11:19:57.118459 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115089    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 11:19:57.118459 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115091    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 11:19:57.118459 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115095    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 11:19:57.118459 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115098    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 11:19:57.118459 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115100    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 11:19:57.118459 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115105    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 11:19:57.118459 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115108    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 11:19:57.118459 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115111    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 11:19:57.118459 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115113    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 11:19:57.118459 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115116    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 11:19:57.118459 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115119    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 11:19:57.118459 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115122    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 11:19:57.118459 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115124    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 11:19:57.118459 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115127    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 11:19:57.118459 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115129    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 11:19:57.118459 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115133    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 11:19:57.118459 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115136    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 11:19:57.118459 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115138    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 11:19:57.118459 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115141    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 11:19:57.118933 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115143    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 11:19:57.118933 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115146    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 11:19:57.118933 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115148    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 11:19:57.118933 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115151    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 11:19:57.118933 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115154    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 11:19:57.118933 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115157    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 11:19:57.118933 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115159    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 11:19:57.118933 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115162    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 11:19:57.118933 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115231    2554 flags.go:64] FLAG: --address="0.0.0.0"
Jul 18 11:19:57.118933 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115248    2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 18 11:19:57.118933 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115255    2554 flags.go:64] FLAG: --anonymous-auth="true"
Jul 18 11:19:57.118933 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115260    2554 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 18 11:19:57.118933 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115263    2554 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 18 11:19:57.118933 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115267    2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 18 11:19:57.118933 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115272    2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 18 11:19:57.118933 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115276    2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 18 11:19:57.118933 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115279    2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 18 11:19:57.118933 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115282    2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 18 11:19:57.118933 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115285    2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 18 11:19:57.118933 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115289    2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 18 11:19:57.118933 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115292    2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 18 11:19:57.118933 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115295    2554 flags.go:64] FLAG: --cgroup-root=""
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115298    2554 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115301    2554 flags.go:64] FLAG: --client-ca-file=""
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115304    2554 flags.go:64] FLAG: --cloud-provider="external"
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115308    2554 flags.go:64] FLAG: --cluster-dns="[]"
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115312    2554 flags.go:64] FLAG: --cluster-domain=""
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115315    2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115318    2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115320    2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115324    2554 flags.go:64] FLAG: --container-log-max-files="5"
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115327    2554 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115330    2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115333    2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115337    2554 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115340    2554 flags.go:64] FLAG: --contention-profiling="false"
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115343    2554 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115345    2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115348    2554 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115352    2554 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115356    2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115359    2554 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115362    2554 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115365    2554 flags.go:64] FLAG: --enable-load-reader="false"
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115369    2554 flags.go:64] FLAG: --enable-server="true"
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115372    2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 18 11:19:57.119477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115377    2554 flags.go:64] FLAG: --event-burst="100"
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115380    2554 flags.go:64] FLAG: --event-qps="50"
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115383    2554 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115386    2554 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115389    2554 flags.go:64] FLAG: --eviction-hard=""
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115393    2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115396    2554 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115399    2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115402    2554 flags.go:64] FLAG: --eviction-soft=""
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115404    2554 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115407    2554 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115411    2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115414    2554 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115421    2554 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115424    2554 flags.go:64] FLAG: --fail-swap-on="true"
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115426    2554 flags.go:64] FLAG: --feature-gates=""
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115435    2554 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115438    2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115441    2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115444    2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115447    2554 flags.go:64] FLAG: --healthz-port="10248"
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115450    2554 flags.go:64] FLAG: --help="false"
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115454    2554 flags.go:64] FLAG: --hostname-override="ip-10-0-130-110.ec2.internal"
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115457    2554 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 18 11:19:57.120133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115460    2554 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115462    2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115466    2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115469    2554 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115472    2554 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115475    2554 flags.go:64] FLAG: --image-service-endpoint=""
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115477    2554 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115480    2554 flags.go:64] FLAG: --kube-api-burst="100"
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115483    2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115486    2554 flags.go:64] FLAG: --kube-api-qps="50"
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115489    2554 flags.go:64] FLAG: --kube-reserved=""
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115491    2554 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115494    2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115497    2554 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115500    2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115503    2554 flags.go:64] FLAG: --lock-file=""
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115505    2554 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115508    2554 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115511    2554 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115516    2554 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115519    2554 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115523    2554 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115526    2554 flags.go:64] FLAG: --logging-format="text"
Jul 18 11:19:57.120725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115529    2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115532    2554 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115535    2554 flags.go:64] FLAG: --manifest-url=""
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115538    2554 flags.go:64] FLAG: --manifest-url-header=""
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115542    2554 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115545    2554 flags.go:64] FLAG: --max-open-files="1000000"
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115549    2554 flags.go:64] FLAG: --max-pods="110"
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115552    2554 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115555    2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115557    2554 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115560    2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115563    2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115566    2554 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115569    2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115576    2554 flags.go:64] FLAG: --node-status-max-images="50"
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115579    2554 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115582    2554 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115585    2554 flags.go:64] FLAG: --pod-cidr=""
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115587    2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115592    2554 flags.go:64] FLAG: --pod-manifest-path=""
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115595    2554 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115598    2554 flags.go:64] FLAG: --pods-per-core="0"
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115601    2554 flags.go:64] FLAG: --port="10250"
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115604    2554 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 18 11:19:57.121300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115607    2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06768be7249c4552d"
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115610    2554 flags.go:64] FLAG: --qos-reserved=""
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115613    2554 flags.go:64] FLAG: --read-only-port="10255"
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115615    2554 flags.go:64] FLAG: --register-node="true"
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115618    2554 flags.go:64] FLAG: --register-with-taints=""
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115622    2554 flags.go:64] FLAG: --registry-burst="10"
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115625    2554 flags.go:64] FLAG: --registry-qps="5"
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115629    2554 flags.go:64] FLAG: --reserved-cpus=""
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115632    2554 flags.go:64] FLAG: --reserved-memory=""
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115636    2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115639    2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115642    2554 flags.go:64] FLAG: --rotate-certificates="false"
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115645    2554 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115647    2554 flags.go:64] FLAG: --runonce="false"
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115650    2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115653    2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115656    2554 flags.go:64] FLAG: --seccomp-default="false"
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115659    2554 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115662    2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115665    2554 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115668    2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115671    2554 flags.go:64] FLAG: --storage-driver-password="root"
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115674    2554 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115677    2554 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115680    2554 flags.go:64] FLAG: --storage-driver-user="root"
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115682    2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 18 11:19:57.122088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115685    2554 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115688    2554 flags.go:64] FLAG: --system-cgroups=""
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115691    2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115696    2554 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115699    2554 flags.go:64] FLAG: --tls-cert-file=""
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115702    2554 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115706    2554 flags.go:64] FLAG: --tls-min-version=""
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115708    2554 flags.go:64] FLAG: --tls-private-key-file=""
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115711    2554 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115714    2554 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115717    2554 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115720    2554 flags.go:64] FLAG: --v="2"
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115724    2554 flags.go:64] FLAG: --version="false"
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115729    2554 flags.go:64] FLAG: --vmodule=""
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115733    2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.115737    2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115861    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115865    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115868    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115871    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115874    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115877    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115879    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 11:19:57.123210 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115882    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 11:19:57.124165 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115885    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 11:19:57.124165 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115888    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 11:19:57.124165 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115891    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 11:19:57.124165 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115894    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 11:19:57.124165 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115896    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 11:19:57.124165 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115899    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 11:19:57.124165 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115902    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 11:19:57.124165 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115905    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 11:19:57.124165 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115908    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 11:19:57.124165 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115910    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 11:19:57.124165 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115913    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 11:19:57.124165 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115931    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 11:19:57.124165 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115935    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 11:19:57.124165 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115937    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 11:19:57.124165 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115940    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 11:19:57.124165 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115943    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 11:19:57.124165 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115945    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 11:19:57.124165 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115948    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 11:19:57.124165 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115951    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 11:19:57.124165 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115954    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 11:19:57.124692 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115956    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 11:19:57.124692 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115961    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 11:19:57.124692 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115965    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 11:19:57.124692 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115968    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 11:19:57.124692 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115971    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 11:19:57.124692 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115973    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 11:19:57.124692 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115976    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 11:19:57.124692 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115979    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 11:19:57.124692 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115983    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 11:19:57.124692 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115986    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 11:19:57.124692 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115989    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 11:19:57.124692 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115992    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 11:19:57.124692 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115995    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 11:19:57.124692 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.115997    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 11:19:57.124692 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116000    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 11:19:57.124692 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116003    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 11:19:57.124692 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116007    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 11:19:57.124692 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116010    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 11:19:57.124692 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116012    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 11:19:57.125451 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116015    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 11:19:57.125451 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116017    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 11:19:57.125451 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116020    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 11:19:57.125451 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116023    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 11:19:57.125451 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116025    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 11:19:57.125451 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116028    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 11:19:57.125451 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116030    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 11:19:57.125451 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116033    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 11:19:57.125451 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116035    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 11:19:57.125451 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116038    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 11:19:57.125451 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116041    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 11:19:57.125451 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116045    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 11:19:57.125451 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116048    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 11:19:57.125451 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116052    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 11:19:57.125451 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116056    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 11:19:57.125451 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116061    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 11:19:57.125451 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116064    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 11:19:57.125451 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116067    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 11:19:57.125451 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116069    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 11:19:57.126279 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116072    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 11:19:57.126279 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116074    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 11:19:57.126279 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116077    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 11:19:57.126279 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116080    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 11:19:57.126279 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116082    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 11:19:57.126279 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116085    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 11:19:57.126279 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116087    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 11:19:57.126279 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116090    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 11:19:57.126279 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116092    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 11:19:57.126279 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116095    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 11:19:57.126279 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116097    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 11:19:57.126279 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116100    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 11:19:57.126279 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116103    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 11:19:57.126279 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116105    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 11:19:57.126279 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116108    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 11:19:57.126279 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116111    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 11:19:57.126279 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116113    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 11:19:57.126279 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116116    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 11:19:57.126279 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116118    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 11:19:57.126763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116121    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 11:19:57.126763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116123    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 11:19:57.126763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116126    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 11:19:57.126763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116128    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 11:19:57.126763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116131    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 11:19:57.126763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116133    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 11:19:57.126763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116136    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 11:19:57.126763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116138    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 11:19:57.126763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116143    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 11:19:57.126763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116146    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 11:19:57.126763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116149    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 11:19:57.126763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116152    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 11:19:57.126763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116154    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 11:19:57.126763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.116157    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 11:19:57.126763 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.116162    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 11:19:57.127321 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.123858    2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 18 11:19:57.127321 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.123878    2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 18 11:19:57.127321 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.124814    2554 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 18 11:19:57.127321 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.124828    2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 18 11:19:57.127321 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.124932    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 11:19:57.127321 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.124941    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 11:19:57.127321 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.124946    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 11:19:57.127321 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.124950    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 11:19:57.127321 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.124955    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 11:19:57.127321 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.124959    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 11:19:57.127321 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.124964    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 11:19:57.127321 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.124968    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 11:19:57.127321 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.124973    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 11:19:57.127321 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.124977    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 11:19:57.127321 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.124981    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 11:19:57.127321 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.124985    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 11:19:57.127321 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.124989    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 11:19:57.127321 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.124993    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 11:19:57.127321 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.124998    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 11:19:57.127321 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125003    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 11:19:57.128168 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125007    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 11:19:57.128168 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125011    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 11:19:57.128168 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125015    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 11:19:57.128168 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125020    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 11:19:57.128168 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125024    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 11:19:57.128168 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125028    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 11:19:57.128168 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125032    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 11:19:57.128168 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125037    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 11:19:57.128168 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125043    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 11:19:57.128168 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125047    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 11:19:57.128168 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125051    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 11:19:57.128168 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125055    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 11:19:57.128168 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125059    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 11:19:57.128168 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125064    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 11:19:57.128168 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125068    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 11:19:57.128168 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125072    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 11:19:57.128168 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125077    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 11:19:57.128168 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125081    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 11:19:57.128168 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125085    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 11:19:57.128168 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125089    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 11:19:57.128766 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125094    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 11:19:57.128766 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125098    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 11:19:57.128766 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125103    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 11:19:57.128766 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125107    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 11:19:57.128766 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125111    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 11:19:57.128766 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125115    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 11:19:57.128766 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125119    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 11:19:57.128766 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125123    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 11:19:57.128766 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125127    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 11:19:57.128766 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125131    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 11:19:57.128766 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125136    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 11:19:57.128766 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125140    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 11:19:57.128766 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125144    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 11:19:57.128766 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125148    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 11:19:57.128766 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125152    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 11:19:57.128766 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125156    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 11:19:57.128766 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125161    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 11:19:57.128766 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125167    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 11:19:57.128766 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125174    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 11:19:57.128766 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125179    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 11:19:57.129375 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125183    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 11:19:57.129375 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125188    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 11:19:57.129375 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125193    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 11:19:57.129375 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125197    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 11:19:57.129375 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125201    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 11:19:57.129375 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125208    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 11:19:57.129375 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125214    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 11:19:57.129375 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125218    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 11:19:57.129375 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125223    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 11:19:57.129375 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125227    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 11:19:57.129375 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125232    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 11:19:57.129375 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125236    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 11:19:57.129375 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125241    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 11:19:57.129375 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125245    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 11:19:57.129375 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125250    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 11:19:57.129375 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125254    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 11:19:57.129375 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125258    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 11:19:57.129375 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125263    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 11:19:57.129375 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125267    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 11:19:57.129375 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125271    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 11:19:57.129860 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125276    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 11:19:57.129860 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125280    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 11:19:57.129860 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125284    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 11:19:57.129860 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125288    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 11:19:57.129860 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125294    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 11:19:57.129860 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125300    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 11:19:57.129860 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125305    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 11:19:57.129860 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125309    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 11:19:57.129860 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125313    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 11:19:57.129860 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125318    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 11:19:57.129860 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125322    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 11:19:57.129860 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125326    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 11:19:57.129860 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125330    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 11:19:57.129860 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125334    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 11:19:57.129860 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125339    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 11:19:57.129860 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125343    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 11:19:57.129860 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125347    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 11:19:57.129860 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125352    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 11:19:57.129860 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125356    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 11:19:57.130360 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125360    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 11:19:57.130360 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125364    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 11:19:57.130360 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125368    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 11:19:57.130360 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125372    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 11:19:57.130360 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.125380    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 11:19:57.130360 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125551    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 18 11:19:57.130360 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125562    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 18 11:19:57.130360 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125568    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 18 11:19:57.130360 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125573    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 18 11:19:57.130360 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125578    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 18 11:19:57.130360 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125583    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 18 11:19:57.130360 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125587    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 18 11:19:57.130360 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125591    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 18 11:19:57.130360 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125595    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 18 11:19:57.130705 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125601    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 18 11:19:57.130705 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125607    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 18 11:19:57.130705 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125611    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 18 11:19:57.130705 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125616    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 18 11:19:57.130705 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125620    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 18 11:19:57.130705 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125624    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 18 11:19:57.130705 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125628    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 18 11:19:57.130705 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125632    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 18 11:19:57.130705 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125636    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 18 11:19:57.130705 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125641    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 18 11:19:57.130705 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125645    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 18 11:19:57.130705 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125649    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 18 11:19:57.130705 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125653    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 18 11:19:57.130705 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125657    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 18 11:19:57.130705 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125663    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 18 11:19:57.130705 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125667    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 18 11:19:57.130705 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125671    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 18 11:19:57.130705 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125676    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 18 11:19:57.130705 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125680    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 18 11:19:57.130705 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125684    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 18 11:19:57.131281 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125688    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 18 11:19:57.131281 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125692    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 18 11:19:57.131281 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125696    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 18 11:19:57.131281 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125700    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 18 11:19:57.131281 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125704    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 18 11:19:57.131281 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125709    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 18 11:19:57.131281 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125713    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 18 11:19:57.131281 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125716    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 18 11:19:57.131281 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125721    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 18 11:19:57.131281 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125725    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 18 11:19:57.131281 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125729    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 18 11:19:57.131281 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125733    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 18 11:19:57.131281 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125737    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 18 11:19:57.131281 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125741    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 18 11:19:57.131281 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125745    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 18 11:19:57.131281 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125749    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 18 11:19:57.131281 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125753    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 18 11:19:57.131281 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125757    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 18 11:19:57.131281 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125761    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 18 11:19:57.131281 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125766    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 18 11:19:57.131763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125770    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 18 11:19:57.131763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125774    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 18 11:19:57.131763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125778    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 18 11:19:57.131763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125782    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 18 11:19:57.131763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125786    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 18 11:19:57.131763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125790    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 18 11:19:57.131763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125794    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 18 11:19:57.131763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125801    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 18 11:19:57.131763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125805    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 18 11:19:57.131763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125809    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 18 11:19:57.131763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125814    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 18 11:19:57.131763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125818    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 18 11:19:57.131763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125822    2554 feature_gate.go:328] unrecognized feature gate: Example2
Jul 18 11:19:57.131763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125826    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 18 11:19:57.131763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125830    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 18 11:19:57.131763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125834    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 18 11:19:57.131763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125838    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 18 11:19:57.131763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125842    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 18 11:19:57.131763 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125847    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 18 11:19:57.132362 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125850    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 18 11:19:57.132362 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125854    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 18 11:19:57.132362 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125859    2554 feature_gate.go:328] unrecognized feature gate: Example
Jul 18 11:19:57.132362 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125865    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 18 11:19:57.132362 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125870    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 18 11:19:57.132362 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125874    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 18 11:19:57.132362 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125879    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 18 11:19:57.132362 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125883    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 18 11:19:57.132362 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125887    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 18 11:19:57.132362 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125892    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 18 11:19:57.132362 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125895    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 18 11:19:57.132362 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125899    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 18 11:19:57.132362 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125904    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 18 11:19:57.132362 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125908    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 18 11:19:57.132362 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125912    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 18 11:19:57.132362 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125932    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 18 11:19:57.132362 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125936    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 18 11:19:57.132362 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125940    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 18 11:19:57.132362 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125944    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 18 11:19:57.132362 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125948    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 18 11:19:57.132855 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125952    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 18 11:19:57.132855 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125957    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 18 11:19:57.132855 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125962    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 18 11:19:57.132855 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125966    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 18 11:19:57.132855 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125970    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 18 11:19:57.132855 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125974    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 18 11:19:57.132855 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125978    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 18 11:19:57.132855 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125982    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 18 11:19:57.132855 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125986    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 18 11:19:57.132855 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125990    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 18 11:19:57.132855 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:57.125994    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 18 11:19:57.132855 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.126002    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 18 11:19:57.132855 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.126155    2554 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 18 11:19:57.132855 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.129156    2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 18 11:19:57.133230 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.131032    2554 server.go:1019] "Starting client certificate rotation"
Jul 18 11:19:57.133230 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.131133    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 18 11:19:57.133230 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.131175    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 18 11:19:57.134082 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.134068    2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 18 11:19:57.137861 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.137782    2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 18 11:19:57.151460 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.151442    2554 log.go:25] "Validated CRI v1 runtime API"
Jul 18 11:19:57.153965 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.153948    2554 log.go:25] "Validated CRI v1 image API"
Jul 18 11:19:57.154690 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.154674    2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 18 11:19:57.157338 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.157318    2554 fs.go:135] Filesystem UUIDs: map[394ef116-9703-4609-a8c6-b8ecc9f304b5:/dev/nvme0n1p3 73b9c80c-59ae-4e9e-bafa-4541d8b9d071:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 18 11:19:57.157407 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.157337    2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 18 11:19:57.159971 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.159949    2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 18 11:19:57.161458 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.161358    2554 manager.go:216] Machine: {Timestamp:2026-07-18 11:19:57.160878068 +0000 UTC m=+0.374185044 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3034678 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26ded8a2a4ad44be4211829a13b3ff SystemUUID:ec26ded8-a2a4-ad44-be42-11829a13b3ff BootID:bcafca2b-5592-4a94-976c-7bc980cb181b Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:61:78:71:0d:83 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:61:78:71:0d:83 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:a5:ec:ac:db:4d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 18 11:19:57.161458 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.161455    2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 18 11:19:57.161568 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.161547    2554 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 18 11:19:57.165256 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.165236    2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 18 11:19:57.165384 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.165258    2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-110.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 18 11:19:57.166065 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.166055    2554 topology_manager.go:138] "Creating topology manager with none policy"
Jul 18 11:19:57.166096 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.166068    2554 container_manager_linux.go:309] "Creating device plugin manager"
Jul 18 11:19:57.166096 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.166075    2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 18 11:19:57.167878 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.167867    2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 18 11:19:57.169851 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.169841    2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 18 11:19:57.174291 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.174279    2554 state_mem.go:36] "Initialized new in-memory state store"
Jul 18 11:19:57.174393 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.174384    2554 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 18 11:19:57.174431 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.174412    2554 kubelet.go:486] "Attempting to sync node with API server"
Jul 18 11:19:57.174431 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.174421    2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 18 11:19:57.174524 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.174437    2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 18 11:19:57.174524 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.174445    2554 kubelet.go:398] "Adding apiserver pod source"
Jul 18 11:19:57.174524 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.174454    2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 18 11:19:57.174750 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.174740    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 18 11:19:57.174780 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.174758    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 18 11:19:57.176949 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.176934    2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 18 11:19:57.178741 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.178728    2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 18 11:19:57.178801 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.178758    2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 18 11:19:57.179433 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.179422    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 18 11:19:57.179480 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.179438    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 18 11:19:57.179824 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.179815    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 18 11:19:57.179856 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.179826    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 18 11:19:57.179856 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.179836    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 18 11:19:57.179856 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.179842    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 18 11:19:57.179856 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.179851    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 18 11:19:57.179856 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.179856    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 18 11:19:57.180002 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.179862    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 18 11:19:57.180002 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.179867    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 18 11:19:57.180002 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.179883    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 18 11:19:57.180002 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.179888    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 18 11:19:57.180788 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.180778    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 18 11:19:57.180788 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.180788    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 18 11:19:57.182381 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.182360    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gnw27"
Jul 18 11:19:57.183739 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.183722    2554 server.go:1268] "Started kubelet"
Jul 18 11:19:57.183855 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.183827    2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 18 11:19:57.183855 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.183816    2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 18 11:19:57.183980 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.183873    2554 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 18 11:19:57.184431 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:57.184409    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 18 11:19:57.184431 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:57.184416    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 18 11:19:57.184581 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.184493    2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-110.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 18 11:19:57.184591 ip-10-0-130-110 systemd[1]: Started Kubernetes Kubelet.
Jul 18 11:19:57.189405 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.189380    2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 18 11:19:57.190815 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.190793    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gnw27"
Jul 18 11:19:57.191040 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.191020    2554 server.go:310] "Adding debug handlers to kubelet server"
Jul 18 11:19:57.191424 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:57.191402    2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 18 11:19:57.193193 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:57.192032    2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-110.ec2.internal.18c35e5526b8606a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-110.ec2.internal,UID:ip-10-0-130-110.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-110.ec2.internal,},FirstTimestamp:2026-07-18 11:19:57.183697002 +0000 UTC m=+0.397003977,LastTimestamp:2026-07-18 11:19:57.183697002 +0000 UTC m=+0.397003977,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-110.ec2.internal,}"
Jul 18 11:19:57.201245 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.201064    2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 18 11:19:57.201245 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.201075    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 18 11:19:57.201245 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:57.201158    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found"
Jul 18 11:19:57.201988 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.201904    2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 18 11:19:57.201988 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.201907    2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 18 11:19:57.201988 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.201943    2554 factory.go:55] Registering systemd factory
Jul 18 11:19:57.201988 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.201953    2554 factory.go:223] Registration of the systemd container factory successfully
Jul 18 11:19:57.202160 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.201905    2554 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 18 11:19:57.202160 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.202042    2554 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 18 11:19:57.202255 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.202160    2554 reconstruct.go:97] "Volume reconstruction finished"
Jul 18 11:19:57.202255 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.202169    2554 reconciler.go:29] "Reconciler: start to sync state"
Jul 18 11:19:57.202255 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.202179    2554 factory.go:153] Registering CRI-O factory
Jul 18 11:19:57.202255 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.202189    2554 factory.go:223] Registration of the crio container factory successfully
Jul 18 11:19:57.202255 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.202208    2554 factory.go:103] Registering Raw factory
Jul 18 11:19:57.202255 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.202224    2554 manager.go:1196] Started watching for new ooms in manager
Jul 18 11:19:57.202872 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:57.202851    2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-110.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 18 11:19:57.202872 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:57.202856    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 18 11:19:57.203302 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.203288    2554 manager.go:349] Starting recovery of all containers
Jul 18 11:19:57.212085 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.212071    2554 manager.go:354] Recovery completed
Jul 18 11:19:57.215760 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.215747    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 11:19:57.217324 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.217309    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 11:19:57.217405 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.217335    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 11:19:57.217405 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.217348    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientPID"
Jul 18 11:19:57.217828 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.217813    2554 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 18 11:19:57.217828 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.217827    2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 18 11:19:57.217952 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.217832    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 11:19:57.217952 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.217843    2554 state_mem.go:36] "Initialized new in-memory state store"
Jul 18 11:19:57.218514 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.218499    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 11:19:57.218574 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.218523    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 11:19:57.218574 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.218532    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientPID"
Jul 18 11:19:57.219013 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.218999    2554 policy_none.go:49] "None policy: Start"
Jul 18 11:19:57.219013 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.219014    2554 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 18 11:19:57.219102 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.219024    2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 18 11:19:57.220039 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.220029    2554 policy_none.go:47] "Start"
Jul 18 11:19:57.260610 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.260444    2554 manager.go:337] "Starting Device Plugin manager"
Jul 18 11:19:57.266638 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:57.260632    2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 18 11:19:57.266638 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.260646    2554 server.go:87] "Starting device plugin registration server"
Jul 18 11:19:57.266638 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.260901    2554 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 18 11:19:57.266638 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.260912    2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 18 11:19:57.266638 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.261036    2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 18 11:19:57.266638 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.261117    2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 18 11:19:57.266638 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.261124    2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 18 11:19:57.266638 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:57.262233    2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 18 11:19:57.266638 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:57.262275    2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-110.ec2.internal\" not found"
Jul 18 11:19:57.330856 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.330821    2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 18 11:19:57.332041 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.332027    2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 18 11:19:57.332118 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.332062    2554 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 18 11:19:57.332118 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.332083    2554 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 18 11:19:57.332216 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:57.332120    2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 18 11:19:57.334536 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.334514    2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 11:19:57.361644 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.361605    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 11:19:57.363059 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.363045    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 11:19:57.363129 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.363075    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 11:19:57.363129 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.363089    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientPID"
Jul 18 11:19:57.363129 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.363118    2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-110.ec2.internal"
Jul 18 11:19:57.373806 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.373789    2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-110.ec2.internal"
Jul 18 11:19:57.373866 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:57.373809    2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-110.ec2.internal\": node \"ip-10-0-130-110.ec2.internal\" not found"
Jul 18 11:19:57.390952 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:57.390933    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found"
Jul 18 11:19:57.432859 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.432831    2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-110.ec2.internal"]
Jul 18 11:19:57.432951 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.432940    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 11:19:57.433711 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.433699    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 11:19:57.433765 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.433725    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 11:19:57.433765 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.433738    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientPID"
Jul 18 11:19:57.435179 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.435167    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 11:19:57.435307 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.435284    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal"
Jul 18 11:19:57.435352 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.435321    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 11:19:57.435851 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.435836    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 11:19:57.435968 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.435856    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 11:19:57.435968 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.435873    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 11:19:57.435968 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.435859    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 11:19:57.435968 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.435882    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientPID"
Jul 18 11:19:57.435968 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.435885    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientPID"
Jul 18 11:19:57.437023 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.437008    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-110.ec2.internal"
Jul 18 11:19:57.437076 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.437033    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 18 11:19:57.437663 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.437646    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientMemory"
Jul 18 11:19:57.437741 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.437678    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasNoDiskPressure"
Jul 18 11:19:57.437741 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.437692    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeHasSufficientPID"
Jul 18 11:19:57.466606 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:57.466589    2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-110.ec2.internal\" not found" node="ip-10-0-130-110.ec2.internal"
Jul 18 11:19:57.470791 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:57.470774    2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-110.ec2.internal\" not found" node="ip-10-0-130-110.ec2.internal"
Jul 18 11:19:57.491228 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:57.491211    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found"
Jul 18 11:19:57.503486 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.503467    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d67cf298a38ae64f8f437221596a16f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal\" (UID: \"1d67cf298a38ae64f8f437221596a16f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal"
Jul 18 11:19:57.503539 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.503493    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d67cf298a38ae64f8f437221596a16f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal\" (UID: \"1d67cf298a38ae64f8f437221596a16f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal"
Jul 18 11:19:57.503539 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.503509    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/97c5a81044e47f299dcb090782306fa8-config\") pod \"kube-apiserver-proxy-ip-10-0-130-110.ec2.internal\" (UID: \"97c5a81044e47f299dcb090782306fa8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-110.ec2.internal"
Jul 18 11:19:57.591830 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:57.591808    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found"
Jul 18 11:19:57.604573 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.604554    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d67cf298a38ae64f8f437221596a16f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal\" (UID: \"1d67cf298a38ae64f8f437221596a16f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal"
Jul 18 11:19:57.604639 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.604583    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d67cf298a38ae64f8f437221596a16f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal\" (UID: \"1d67cf298a38ae64f8f437221596a16f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal"
Jul 18 11:19:57.604639 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.604602    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/97c5a81044e47f299dcb090782306fa8-config\") pod \"kube-apiserver-proxy-ip-10-0-130-110.ec2.internal\" (UID: \"97c5a81044e47f299dcb090782306fa8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-110.ec2.internal"
Jul 18 11:19:57.604701 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.604662    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d67cf298a38ae64f8f437221596a16f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal\" (UID: \"1d67cf298a38ae64f8f437221596a16f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal"
Jul 18 11:19:57.604748 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.604730    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/97c5a81044e47f299dcb090782306fa8-config\") pod \"kube-apiserver-proxy-ip-10-0-130-110.ec2.internal\" (UID: \"97c5a81044e47f299dcb090782306fa8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-110.ec2.internal"
Jul 18 11:19:57.604787 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:57.604776    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d67cf298a38ae64f8f437221596a16f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal\" (UID: \"1d67cf298a38ae64f8f437221596a16f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal"
Jul 18 11:19:59.303204 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:59.303182    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found"
Jul 18 11:19:59.379714 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:59.379677    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal"
Jul 18 11:19:59.385520 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:59.385495    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-110.ec2.internal"
Jul 18 11:19:59.404283 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:59.404260    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found"
Jul 18 11:19:59.504809 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:59.504771    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found"
Jul 18 11:19:59.605384 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:59.605317    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found"
Jul 18 11:19:59.635858 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:59.635840    2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 11:19:59.705589 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:59.705562    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found"
Jul 18 11:19:59.741071 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:59.741049    2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 18 11:19:59.741464 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:59.741183    2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 18 11:19:59.741464 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:59.741215    2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 18 11:19:59.805952 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:59.805925    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found"
Jul 18 11:19:59.808967 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:59.808934    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-17 11:14:58 +0000 UTC" deadline="2028-04-19 23:15:37.409835012 +0000 UTC"
Jul 18 11:19:59.808967 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:59.808964    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15395h55m37.600873625s"
Jul 18 11:19:59.827524 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:59.827507    2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 11:19:59.906558 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:19:59.906498    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found"
Jul 18 11:19:59.949798 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:59.949767    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d67cf298a38ae64f8f437221596a16f.slice/crio-6c11dfe24504a847e76d5e3a468f1679522ba2bc1775335feeb5ec927c0599a7 WatchSource:0}: Error finding container 6c11dfe24504a847e76d5e3a468f1679522ba2bc1775335feeb5ec927c0599a7: Status 404 returned error can't find the container with id 6c11dfe24504a847e76d5e3a468f1679522ba2bc1775335feeb5ec927c0599a7
Jul 18 11:19:59.950649 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:19:59.950634    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c5a81044e47f299dcb090782306fa8.slice/crio-01da61314b41d2461391ee2151381366fa0b625665e2f2c3bc6ceab02b610112 WatchSource:0}: Error finding container 01da61314b41d2461391ee2151381366fa0b625665e2f2c3bc6ceab02b610112: Status 404 returned error can't find the container with id 01da61314b41d2461391ee2151381366fa0b625665e2f2c3bc6ceab02b610112
Jul 18 11:19:59.955688 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:19:59.955674    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 11:20:00.007451 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:00.007413    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found"
Jul 18 11:20:00.107980 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:00.107949    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-110.ec2.internal\" not found"
Jul 18 11:20:00.141626 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.141599    2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 11:20:00.212588 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.212525    2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-110.ec2.internal"
Jul 18 11:20:00.221738 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.221715    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 18 11:20:00.222680 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.222665    2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal"
Jul 18 11:20:00.232135 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.232115    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 18 11:20:00.786457 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.786423    2554 apiserver.go:52] "Watching apiserver"
Jul 18 11:20:00.792744 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.792719    2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 18 11:20:00.794727 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.794272    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-5kkzl","kube-system/global-pull-secret-syncer-tj4vh","kube-system/konnectivity-agent-wqfc9","kube-system/kube-apiserver-proxy-ip-10-0-130-110.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s","openshift-dns/node-resolver-p6t6n","openshift-multus/multus-2gphw","openshift-multus/multus-additional-cni-plugins-lbhg8","openshift-network-diagnostics/network-check-target-z9cdq","openshift-cluster-node-tuning-operator/tuned-zdbnc","openshift-image-registry/node-ca-np9kp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal","openshift-multus/network-metrics-daemon-wd67v","openshift-network-operator/iptables-alerter-6qdq9"]
Jul 18 11:20:00.796995 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.796972    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wqfc9"
Jul 18 11:20:00.799314 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.799270    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 18 11:20:00.799314 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.799275    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 18 11:20:00.799482 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.799412    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rgcdx\""
Jul 18 11:20:00.799668 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.799648    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-np9kp"
Jul 18 11:20:00.801986 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.801785    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 18 11:20:00.801986 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.801828    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 18 11:20:00.801986 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.801857    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vxztn\""
Jul 18 11:20:00.802214 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.801806    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 18 11:20:00.802214 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.802000    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.804177 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.804140    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 18 11:20:00.804177 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.804170    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 18 11:20:00.804327 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.804239    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6j56s\""
Jul 18 11:20:00.804327 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.804172    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:00.806576 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.806296    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p6t6n"
Jul 18 11:20:00.806576 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.806314    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-krv7n\""
Jul 18 11:20:00.806576 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.806377    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 18 11:20:00.806576 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.806401    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 18 11:20:00.806796 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.806780    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 18 11:20:00.808682 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.808544    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ztfqj\""
Jul 18 11:20:00.808682 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.808594    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 18 11:20:00.808682 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.808602    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 18 11:20:00.808682 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.808674    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.810647 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.810625    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 18 11:20:00.810949 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.810889    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 18 11:20:00.810949 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.810912    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 18 11:20:00.811166 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.811123    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-km8qn\""
Jul 18 11:20:00.811236 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.811170    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 18 11:20:00.811441 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.811423    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.812666 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.812646    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 18 11:20:00.813156 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.813138    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:00.813300 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:00.813248    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:00.813370 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.813325    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p985n\""
Jul 18 11:20:00.813611 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.813594    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 18 11:20:00.813691 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.813633    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 18 11:20:00.815828 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.815807    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.817789 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.817772    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 18 11:20:00.817881 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.817772    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6wgth\""
Jul 18 11:20:00.818160 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.818070    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 18 11:20:00.818160 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.818072    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 18 11:20:00.818305 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.818244    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 18 11:20:00.818361 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.818348    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 18 11:20:00.818409 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.818354    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:00.818493 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:00.818430    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:00.818493 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.818443    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 18 11:20:00.820631 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.820611    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:00.820715 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:00.820688    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:00.823516 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.823498    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6qdq9"
Jul 18 11:20:00.825772 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.825750    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 18 11:20:00.826727 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.826632    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-host-cni-bin\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.826822 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.826718    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-etc-sysconfig\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.826822 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.826780    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-host\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.826929 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.826917    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-system-cni-dir\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.826984 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.826951    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-var-lib-openvswitch\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.826984 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.826976    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-host-var-lib-cni-bin\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.827078 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.827005    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-etc-sysctl-d\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.827154 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.827081    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2b5c3f17-2f4d-4c49-a797-ddc010d48e96-socket-dir\") pod \"aws-ebs-csi-driver-node-lsh2s\" (UID: \"2b5c3f17-2f4d-4c49-a797-ddc010d48e96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:00.827205 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.827159    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2b5c3f17-2f4d-4c49-a797-ddc010d48e96-etc-selinux\") pod \"aws-ebs-csi-driver-node-lsh2s\" (UID: \"2b5c3f17-2f4d-4c49-a797-ddc010d48e96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:00.827257 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.827221    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-cnibin\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.827257 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.827250    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hd8fs\""
Jul 18 11:20:00.827762 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.827350    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 18 11:20:00.827762 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.827406    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.827762 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.827496    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 18 11:20:00.827762 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.827525    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.827762 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.827560    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-host-cni-netd\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.827762 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.827588    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-host-run-netns\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.827762 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.827619    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2b5c3f17-2f4d-4c49-a797-ddc010d48e96-registration-dir\") pod \"aws-ebs-csi-driver-node-lsh2s\" (UID: \"2b5c3f17-2f4d-4c49-a797-ddc010d48e96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:00.828133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.827781    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-etc-kubernetes\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.828133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.827833    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-etc-modprobe-d\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.828133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.827899    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdfnr\" (UniqueName: \"kubernetes.io/projected/2b5c3f17-2f4d-4c49-a797-ddc010d48e96-kube-api-access-zdfnr\") pod \"aws-ebs-csi-driver-node-lsh2s\" (UID: \"2b5c3f17-2f4d-4c49-a797-ddc010d48e96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:00.828133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.827942    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-host-kubelet\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.828133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.827974    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e953581-6e11-46ad-92e3-0d63df589850-env-overrides\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.828133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828004    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-multus-cni-dir\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.828133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828031    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-os-release\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.828133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828062    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq9jb\" (UniqueName: \"kubernetes.io/projected/630ceb00-9a31-46a7-8976-1f33f56025d7-kube-api-access-kq9jb\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.828133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828104    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e232d4ab-f385-4027-b5ae-89821bb14026-cni-binary-copy\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.828543 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828160    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpdd2\" (UniqueName: \"kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2\") pod \"network-check-target-z9cdq\" (UID: \"ac841995-3c3f-4f12-a8da-9467f87a401b\") " pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:00.828543 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828185    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d89ecbee-c2b4-417a-a54f-1a03ac0bbc1c-host\") pod \"node-ca-np9kp\" (UID: \"d89ecbee-c2b4-417a-a54f-1a03ac0bbc1c\") " pod="openshift-image-registry/node-ca-np9kp"
Jul 18 11:20:00.828543 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828215    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-etc-sysctl-conf\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.828543 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828245    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e6d4988d-0ad4-4bbd-a75a-5da0d1c25749-hosts-file\") pod \"node-resolver-p6t6n\" (UID: \"e6d4988d-0ad4-4bbd-a75a-5da0d1c25749\") " pod="openshift-dns/node-resolver-p6t6n"
Jul 18 11:20:00.828543 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828275    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6d4988d-0ad4-4bbd-a75a-5da0d1c25749-tmp-dir\") pod \"node-resolver-p6t6n\" (UID: \"e6d4988d-0ad4-4bbd-a75a-5da0d1c25749\") " pod="openshift-dns/node-resolver-p6t6n"
Jul 18 11:20:00.828543 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828315    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e953581-6e11-46ad-92e3-0d63df589850-ovn-node-metrics-cert\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.828543 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828346    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e953581-6e11-46ad-92e3-0d63df589850-ovnkube-script-lib\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.828543 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828362    2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 18 11:20:00.828543 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828372    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c2065968-1eb2-40a6-bac5-af5e502f89af-agent-certs\") pod \"konnectivity-agent-wqfc9\" (UID: \"c2065968-1eb2-40a6-bac5-af5e502f89af\") " pod="kube-system/konnectivity-agent-wqfc9"
Jul 18 11:20:00.828543 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828402    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkrjw\" (UniqueName: \"kubernetes.io/projected/d89ecbee-c2b4-417a-a54f-1a03ac0bbc1c-kube-api-access-gkrjw\") pod \"node-ca-np9kp\" (UID: \"d89ecbee-c2b4-417a-a54f-1a03ac0bbc1c\") " pod="openshift-image-registry/node-ca-np9kp"
Jul 18 11:20:00.828543 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828432    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2b5c3f17-2f4d-4c49-a797-ddc010d48e96-device-dir\") pod \"aws-ebs-csi-driver-node-lsh2s\" (UID: \"2b5c3f17-2f4d-4c49-a797-ddc010d48e96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:00.828543 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828461    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-systemd-units\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.828543 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828494    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-hostroot\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.828543 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828534    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-multus-conf-dir\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.829243 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828589    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-run-openvswitch\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.829243 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828636    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-run\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.829243 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828676    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-sys\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.829243 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828721    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wg29q\" (UniqueName: \"kubernetes.io/projected/e6d4988d-0ad4-4bbd-a75a-5da0d1c25749-kube-api-access-wg29q\") pod \"node-resolver-p6t6n\" (UID: \"e6d4988d-0ad4-4bbd-a75a-5da0d1c25749\") " pod="openshift-dns/node-resolver-p6t6n"
Jul 18 11:20:00.829243 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828773    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmr49\" (UniqueName: \"kubernetes.io/projected/2e953581-6e11-46ad-92e3-0d63df589850-kube-api-access-hmr49\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.829243 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828806    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-host-var-lib-kubelet\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.829243 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828841    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-host-run-multus-certs\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.829243 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828872    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctgtv\" (UniqueName: \"kubernetes.io/projected/e232d4ab-f385-4027-b5ae-89821bb14026-kube-api-access-ctgtv\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.829243 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828910    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d89ecbee-c2b4-417a-a54f-1a03ac0bbc1c-serviceca\") pod \"node-ca-np9kp\" (UID: \"d89ecbee-c2b4-417a-a54f-1a03ac0bbc1c\") " pod="openshift-image-registry/node-ca-np9kp"
Jul 18 11:20:00.829243 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.828952    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-host-slash\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.829243 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.829003    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-node-log\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.829243 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.829060    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-host-run-ovn-kubernetes\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.829243 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.829189    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e953581-6e11-46ad-92e3-0d63df589850-ovnkube-config\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.829243 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.829244    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-system-cni-dir\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.829883 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.829292    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-os-release\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.829883 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.829369    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-host-run-netns\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.829883 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.829403    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-etc-openvswitch\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.829883 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.829449    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-host-var-lib-cni-multus\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.829883 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.829493    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-var-lib-kubelet\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.829883 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.829533    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/630ceb00-9a31-46a7-8976-1f33f56025d7-etc-tuned\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.829883 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.829569    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-log-socket\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.830617 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.829632    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-host-run-k8s-cni-cncf-io\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.830617 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.830214    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-lib-modules\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.830617 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.830271    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2b5c3f17-2f4d-4c49-a797-ddc010d48e96-sys-fs\") pod \"aws-ebs-csi-driver-node-lsh2s\" (UID: \"2b5c3f17-2f4d-4c49-a797-ddc010d48e96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:00.830617 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.830334    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c2065968-1eb2-40a6-bac5-af5e502f89af-konnectivity-ca\") pod \"konnectivity-agent-wqfc9\" (UID: \"c2065968-1eb2-40a6-bac5-af5e502f89af\") " pod="kube-system/konnectivity-agent-wqfc9"
Jul 18 11:20:00.830617 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.830370    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-etc-kubernetes\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.830617 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.830400    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.830617 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.830475    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-run-ovn\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.830617 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.830536    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-multus-socket-dir-parent\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.830617 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.830588    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.831040 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.830630    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-etc-systemd\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.831040 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.830661    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/630ceb00-9a31-46a7-8976-1f33f56025d7-tmp\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.831040 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.830690    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2b5c3f17-2f4d-4c49-a797-ddc010d48e96-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lsh2s\" (UID: \"2b5c3f17-2f4d-4c49-a797-ddc010d48e96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:00.831040 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.830737    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.831040 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.830809    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4kg9\" (UniqueName: \"kubernetes.io/projected/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-kube-api-access-p4kg9\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.831319 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.831292    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-run-systemd\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.831375 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.831348    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-cnibin\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.831375 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.831369    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e232d4ab-f385-4027-b5ae-89821bb14026-multus-daemon-config\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.846817 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.846795    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2nskv"
Jul 18 11:20:00.856149 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.856127    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2nskv"
Jul 18 11:20:00.914732 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.914703    2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 18 11:20:00.931966 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.931938    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2b5c3f17-2f4d-4c49-a797-ddc010d48e96-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lsh2s\" (UID: \"2b5c3f17-2f4d-4c49-a797-ddc010d48e96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:00.932142 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.931973    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.932142 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.931992    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4kg9\" (UniqueName: \"kubernetes.io/projected/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-kube-api-access-p4kg9\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.932142 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932074    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2b5c3f17-2f4d-4c49-a797-ddc010d48e96-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lsh2s\" (UID: \"2b5c3f17-2f4d-4c49-a797-ddc010d48e96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:00.932308 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932150    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-run-systemd\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.932308 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932197    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-cnibin\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.932308 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932225    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e232d4ab-f385-4027-b5ae-89821bb14026-multus-daemon-config\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.932308 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932248    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-host-cni-bin\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.932308 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932272    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-etc-sysconfig\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.932308 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932295    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-host\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.932569 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932308    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-cnibin\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.932569 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932317    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-system-cni-dir\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.932569 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932354    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-var-lib-openvswitch\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.932569 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932382    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-host-var-lib-cni-bin\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.932569 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932413    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-dbus\") pod \"global-pull-secret-syncer-tj4vh\" (UID: \"6a7e7704-fd0c-4d89-935e-ddf63f7082e1\") " pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:00.932569 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932439    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-etc-sysctl-d\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.932569 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932476    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2b5c3f17-2f4d-4c49-a797-ddc010d48e96-socket-dir\") pod \"aws-ebs-csi-driver-node-lsh2s\" (UID: \"2b5c3f17-2f4d-4c49-a797-ddc010d48e96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:00.932569 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932487    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-host-cni-bin\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.932569 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932483    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-host\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.932569 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932512    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-system-cni-dir\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.932569 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932522    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-host-var-lib-cni-bin\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.932569 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932537    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-run-systemd\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.932569 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932570    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-var-lib-openvswitch\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.933198 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932583    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2b5c3f17-2f4d-4c49-a797-ddc010d48e96-etc-selinux\") pod \"aws-ebs-csi-driver-node-lsh2s\" (UID: \"2b5c3f17-2f4d-4c49-a797-ddc010d48e96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:00.933198 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932581    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.933198 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932599    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-etc-sysctl-d\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.933198 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932611    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-etc-sysconfig\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.933198 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932616    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-cnibin\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.933198 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932621    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2b5c3f17-2f4d-4c49-a797-ddc010d48e96-socket-dir\") pod \"aws-ebs-csi-driver-node-lsh2s\" (UID: \"2b5c3f17-2f4d-4c49-a797-ddc010d48e96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:00.933198 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932643    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.933198 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932668    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-cnibin\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.933198 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932697    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2b5c3f17-2f4d-4c49-a797-ddc010d48e96-etc-selinux\") pod \"aws-ebs-csi-driver-node-lsh2s\" (UID: \"2b5c3f17-2f4d-4c49-a797-ddc010d48e96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:00.933198 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932708    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.933198 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932735    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-host-cni-netd\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.933198 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932761    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-host-run-netns\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.933198 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932833    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2b5c3f17-2f4d-4c49-a797-ddc010d48e96-registration-dir\") pod \"aws-ebs-csi-driver-node-lsh2s\" (UID: \"2b5c3f17-2f4d-4c49-a797-ddc010d48e96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:00.933198 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932816    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e232d4ab-f385-4027-b5ae-89821bb14026-multus-daemon-config\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.933198 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932846    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-host-cni-netd\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.933198 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932860    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-host-run-netns\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.933198 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932863    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-etc-kubernetes\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.933950 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932897    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-etc-kubernetes\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.933950 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932899    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret\") pod \"global-pull-secret-syncer-tj4vh\" (UID: \"6a7e7704-fd0c-4d89-935e-ddf63f7082e1\") " pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:00.933950 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932897    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2b5c3f17-2f4d-4c49-a797-ddc010d48e96-registration-dir\") pod \"aws-ebs-csi-driver-node-lsh2s\" (UID: \"2b5c3f17-2f4d-4c49-a797-ddc010d48e96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:00.933950 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932933    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl4fs\" (UniqueName: \"kubernetes.io/projected/f390acc5-cb52-4b39-a4fe-362b2b543fbf-kube-api-access-fl4fs\") pod \"network-metrics-daemon-wd67v\" (UID: \"f390acc5-cb52-4b39-a4fe-362b2b543fbf\") " pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:00.933950 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932964    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f08b2c6c-0b5d-4e0f-ab18-e8ff3bf894e2-host-slash\") pod \"iptables-alerter-6qdq9\" (UID: \"f08b2c6c-0b5d-4e0f-ab18-e8ff3bf894e2\") " pod="openshift-network-operator/iptables-alerter-6qdq9"
Jul 18 11:20:00.933950 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.932991    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-etc-modprobe-d\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.933950 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933017    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdfnr\" (UniqueName: \"kubernetes.io/projected/2b5c3f17-2f4d-4c49-a797-ddc010d48e96-kube-api-access-zdfnr\") pod \"aws-ebs-csi-driver-node-lsh2s\" (UID: \"2b5c3f17-2f4d-4c49-a797-ddc010d48e96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:00.933950 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933078    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-host-kubelet\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.933950 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933125    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-etc-modprobe-d\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.933950 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933167    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-host-kubelet\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.933950 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933123    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e953581-6e11-46ad-92e3-0d63df589850-env-overrides\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.933950 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933169    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.933950 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933205    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-multus-cni-dir\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.933950 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933229    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.933950 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933250    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-os-release\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.933950 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933275    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq9jb\" (UniqueName: \"kubernetes.io/projected/630ceb00-9a31-46a7-8976-1f33f56025d7-kube-api-access-kq9jb\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.933950 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933298    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e232d4ab-f385-4027-b5ae-89821bb14026-cni-binary-copy\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.934774 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933357    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpdd2\" (UniqueName: \"kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2\") pod \"network-check-target-z9cdq\" (UID: \"ac841995-3c3f-4f12-a8da-9467f87a401b\") " pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:00.934774 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933364    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-os-release\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.934774 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933417    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-multus-cni-dir\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.934774 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933468    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d89ecbee-c2b4-417a-a54f-1a03ac0bbc1c-host\") pod \"node-ca-np9kp\" (UID: \"d89ecbee-c2b4-417a-a54f-1a03ac0bbc1c\") " pod="openshift-image-registry/node-ca-np9kp"
Jul 18 11:20:00.934774 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933498    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-etc-sysctl-conf\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.934774 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933511    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e953581-6e11-46ad-92e3-0d63df589850-env-overrides\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.934774 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933527    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e6d4988d-0ad4-4bbd-a75a-5da0d1c25749-hosts-file\") pod \"node-resolver-p6t6n\" (UID: \"e6d4988d-0ad4-4bbd-a75a-5da0d1c25749\") " pod="openshift-dns/node-resolver-p6t6n"
Jul 18 11:20:00.934774 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933541    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d89ecbee-c2b4-417a-a54f-1a03ac0bbc1c-host\") pod \"node-ca-np9kp\" (UID: \"d89ecbee-c2b4-417a-a54f-1a03ac0bbc1c\") " pod="openshift-image-registry/node-ca-np9kp"
Jul 18 11:20:00.934774 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933551    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6d4988d-0ad4-4bbd-a75a-5da0d1c25749-tmp-dir\") pod \"node-resolver-p6t6n\" (UID: \"e6d4988d-0ad4-4bbd-a75a-5da0d1c25749\") " pod="openshift-dns/node-resolver-p6t6n"
Jul 18 11:20:00.934774 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933577    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e953581-6e11-46ad-92e3-0d63df589850-ovn-node-metrics-cert\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.934774 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933598    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e6d4988d-0ad4-4bbd-a75a-5da0d1c25749-hosts-file\") pod \"node-resolver-p6t6n\" (UID: \"e6d4988d-0ad4-4bbd-a75a-5da0d1c25749\") " pod="openshift-dns/node-resolver-p6t6n"
Jul 18 11:20:00.934774 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933601    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e953581-6e11-46ad-92e3-0d63df589850-ovnkube-script-lib\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.934774 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933644    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-etc-sysctl-conf\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.934774 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933649    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6df6\" (UniqueName: \"kubernetes.io/projected/f08b2c6c-0b5d-4e0f-ab18-e8ff3bf894e2-kube-api-access-m6df6\") pod \"iptables-alerter-6qdq9\" (UID: \"f08b2c6c-0b5d-4e0f-ab18-e8ff3bf894e2\") " pod="openshift-network-operator/iptables-alerter-6qdq9"
Jul 18 11:20:00.934774 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933676    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c2065968-1eb2-40a6-bac5-af5e502f89af-agent-certs\") pod \"konnectivity-agent-wqfc9\" (UID: \"c2065968-1eb2-40a6-bac5-af5e502f89af\") " pod="kube-system/konnectivity-agent-wqfc9"
Jul 18 11:20:00.934774 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933725    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkrjw\" (UniqueName: \"kubernetes.io/projected/d89ecbee-c2b4-417a-a54f-1a03ac0bbc1c-kube-api-access-gkrjw\") pod \"node-ca-np9kp\" (UID: \"d89ecbee-c2b4-417a-a54f-1a03ac0bbc1c\") " pod="openshift-image-registry/node-ca-np9kp"
Jul 18 11:20:00.934774 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933755    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2b5c3f17-2f4d-4c49-a797-ddc010d48e96-device-dir\") pod \"aws-ebs-csi-driver-node-lsh2s\" (UID: \"2b5c3f17-2f4d-4c49-a797-ddc010d48e96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:00.934774 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933780    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-systemd-units\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.935652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933805    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-hostroot\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.935652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933810    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e232d4ab-f385-4027-b5ae-89821bb14026-cni-binary-copy\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.935652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933828    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-multus-conf-dir\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.935652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933853    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-run-openvswitch\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.935652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933860    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-systemd-units\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.935652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933866    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e6d4988d-0ad4-4bbd-a75a-5da0d1c25749-tmp-dir\") pod \"node-resolver-p6t6n\" (UID: \"e6d4988d-0ad4-4bbd-a75a-5da0d1c25749\") " pod="openshift-dns/node-resolver-p6t6n"
Jul 18 11:20:00.935652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933877    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-run\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.935652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933902    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-sys\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.935652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933918    2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 18 11:20:00.935652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933941    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-multus-conf-dir\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.935652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933910    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2b5c3f17-2f4d-4c49-a797-ddc010d48e96-device-dir\") pod \"aws-ebs-csi-driver-node-lsh2s\" (UID: \"2b5c3f17-2f4d-4c49-a797-ddc010d48e96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:00.935652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933961    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-sys\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.935652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933967    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-hostroot\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.935652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933976    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-run-openvswitch\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.935652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933984    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wg29q\" (UniqueName: \"kubernetes.io/projected/e6d4988d-0ad4-4bbd-a75a-5da0d1c25749-kube-api-access-wg29q\") pod \"node-resolver-p6t6n\" (UID: \"e6d4988d-0ad4-4bbd-a75a-5da0d1c25749\") " pod="openshift-dns/node-resolver-p6t6n"
Jul 18 11:20:00.935652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.933988    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-run\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.935652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934012    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmr49\" (UniqueName: \"kubernetes.io/projected/2e953581-6e11-46ad-92e3-0d63df589850-kube-api-access-hmr49\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.935652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934036    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-host-var-lib-kubelet\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.936419 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934060    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-host-run-multus-certs\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.936419 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934084    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctgtv\" (UniqueName: \"kubernetes.io/projected/e232d4ab-f385-4027-b5ae-89821bb14026-kube-api-access-ctgtv\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.936419 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934129    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d89ecbee-c2b4-417a-a54f-1a03ac0bbc1c-serviceca\") pod \"node-ca-np9kp\" (UID: \"d89ecbee-c2b4-417a-a54f-1a03ac0bbc1c\") " pod="openshift-image-registry/node-ca-np9kp"
Jul 18 11:20:00.936419 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934145    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-host-var-lib-kubelet\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.936419 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934154    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-host-slash\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.936419 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934189    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e953581-6e11-46ad-92e3-0d63df589850-ovnkube-script-lib\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.936419 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934229    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-host-run-multus-certs\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.936419 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934255    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-node-log\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.936419 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934304    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-host-run-ovn-kubernetes\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.936419 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934267    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-host-slash\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.936419 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934328    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e953581-6e11-46ad-92e3-0d63df589850-ovnkube-config\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.936419 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934317    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-node-log\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.936419 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934349    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-system-cni-dir\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.936419 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934351    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-host-run-ovn-kubernetes\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.936419 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934411    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-system-cni-dir\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.936419 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934459    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-os-release\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.936419 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934492    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-host-run-netns\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.936419 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934515    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-etc-openvswitch\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.937207 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934534    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-os-release\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.937207 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934540    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-host-var-lib-cni-multus\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.937207 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934573    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f08b2c6c-0b5d-4e0f-ab18-e8ff3bf894e2-iptables-alerter-script\") pod \"iptables-alerter-6qdq9\" (UID: \"f08b2c6c-0b5d-4e0f-ab18-e8ff3bf894e2\") " pod="openshift-network-operator/iptables-alerter-6qdq9"
Jul 18 11:20:00.937207 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934600    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-var-lib-kubelet\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.937207 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934608    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d89ecbee-c2b4-417a-a54f-1a03ac0bbc1c-serviceca\") pod \"node-ca-np9kp\" (UID: \"d89ecbee-c2b4-417a-a54f-1a03ac0bbc1c\") " pod="openshift-image-registry/node-ca-np9kp"
Jul 18 11:20:00.937207 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934616    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-etc-openvswitch\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.937207 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934623    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/630ceb00-9a31-46a7-8976-1f33f56025d7-etc-tuned\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.937207 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934576    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-host-var-lib-cni-multus\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.937207 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934655    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-log-socket\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.937207 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934678    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-var-lib-kubelet\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.937207 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934728    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-log-socket\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.937207 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934757    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-host-run-netns\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.937207 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934782    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e953581-6e11-46ad-92e3-0d63df589850-ovnkube-config\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.937207 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934794    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-host-run-k8s-cni-cncf-io\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.937207 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934826    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-kubelet-config\") pod \"global-pull-secret-syncer-tj4vh\" (UID: \"6a7e7704-fd0c-4d89-935e-ddf63f7082e1\") " pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:00.937207 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934846    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs\") pod \"network-metrics-daemon-wd67v\" (UID: \"f390acc5-cb52-4b39-a4fe-362b2b543fbf\") " pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:00.937207 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934863    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-lib-modules\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.937880 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934866    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-host-run-k8s-cni-cncf-io\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.937880 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934897    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2b5c3f17-2f4d-4c49-a797-ddc010d48e96-sys-fs\") pod \"aws-ebs-csi-driver-node-lsh2s\" (UID: \"2b5c3f17-2f4d-4c49-a797-ddc010d48e96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:00.937880 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934923    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c2065968-1eb2-40a6-bac5-af5e502f89af-konnectivity-ca\") pod \"konnectivity-agent-wqfc9\" (UID: \"c2065968-1eb2-40a6-bac5-af5e502f89af\") " pod="kube-system/konnectivity-agent-wqfc9"
Jul 18 11:20:00.937880 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934945    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-etc-kubernetes\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.937880 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934970    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2b5c3f17-2f4d-4c49-a797-ddc010d48e96-sys-fs\") pod \"aws-ebs-csi-driver-node-lsh2s\" (UID: \"2b5c3f17-2f4d-4c49-a797-ddc010d48e96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:00.937880 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934973    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-lib-modules\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.937880 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.934969    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.937880 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.935041    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-run-ovn\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.937880 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.935049    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-etc-kubernetes\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.937880 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.935067    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-multus-socket-dir-parent\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.937880 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.935085    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-run-ovn\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.937880 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.935113    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.937880 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.935134    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.937880 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.935140    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-etc-systemd\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.937880 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.935151    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e232d4ab-f385-4027-b5ae-89821bb14026-multus-socket-dir-parent\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.937880 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.935161    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/630ceb00-9a31-46a7-8976-1f33f56025d7-tmp\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.937880 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.935192    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/630ceb00-9a31-46a7-8976-1f33f56025d7-etc-systemd\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.938531 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.935193    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e953581-6e11-46ad-92e3-0d63df589850-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.938531 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.935481    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c2065968-1eb2-40a6-bac5-af5e502f89af-konnectivity-ca\") pod \"konnectivity-agent-wqfc9\" (UID: \"c2065968-1eb2-40a6-bac5-af5e502f89af\") " pod="kube-system/konnectivity-agent-wqfc9"
Jul 18 11:20:00.938531 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.937536    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/630ceb00-9a31-46a7-8976-1f33f56025d7-etc-tuned\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.938531 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.937626    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e953581-6e11-46ad-92e3-0d63df589850-ovn-node-metrics-cert\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.938531 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.937779    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c2065968-1eb2-40a6-bac5-af5e502f89af-agent-certs\") pod \"konnectivity-agent-wqfc9\" (UID: \"c2065968-1eb2-40a6-bac5-af5e502f89af\") " pod="kube-system/konnectivity-agent-wqfc9"
Jul 18 11:20:00.938531 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.937790    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/630ceb00-9a31-46a7-8976-1f33f56025d7-tmp\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.945418 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:00.945390    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 11:20:00.945418 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:00.945417    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 11:20:00.945600 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:00.945431    2554 projected.go:196] Error preparing data for projected volume kube-api-access-zpdd2 for pod openshift-network-diagnostics/network-check-target-z9cdq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:20:00.945600 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:00.945502    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2 podName:ac841995-3c3f-4f12-a8da-9467f87a401b nodeName:}" failed. No retries permitted until 2026-07-18 11:20:01.445470529 +0000 UTC m=+3.047600250 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zpdd2" (UniqueName: "kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2") pod "network-check-target-z9cdq" (UID: "ac841995-3c3f-4f12-a8da-9467f87a401b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:20:00.949430 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.949083    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdfnr\" (UniqueName: \"kubernetes.io/projected/2b5c3f17-2f4d-4c49-a797-ddc010d48e96-kube-api-access-zdfnr\") pod \"aws-ebs-csi-driver-node-lsh2s\" (UID: \"2b5c3f17-2f4d-4c49-a797-ddc010d48e96\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:00.949430 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.949361    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctgtv\" (UniqueName: \"kubernetes.io/projected/e232d4ab-f385-4027-b5ae-89821bb14026-kube-api-access-ctgtv\") pod \"multus-2gphw\" (UID: \"e232d4ab-f385-4027-b5ae-89821bb14026\") " pod="openshift-multus/multus-2gphw"
Jul 18 11:20:00.949430 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.949400    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4kg9\" (UniqueName: \"kubernetes.io/projected/7a5e4326-d7b2-44c7-9404-2ada70d7ad0b-kube-api-access-p4kg9\") pod \"multus-additional-cni-plugins-lbhg8\" (UID: \"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b\") " pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:00.949805 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.949781    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wg29q\" (UniqueName: \"kubernetes.io/projected/e6d4988d-0ad4-4bbd-a75a-5da0d1c25749-kube-api-access-wg29q\") pod \"node-resolver-p6t6n\" (UID: \"e6d4988d-0ad4-4bbd-a75a-5da0d1c25749\") " pod="openshift-dns/node-resolver-p6t6n"
Jul 18 11:20:00.950187 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.950168    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq9jb\" (UniqueName: \"kubernetes.io/projected/630ceb00-9a31-46a7-8976-1f33f56025d7-kube-api-access-kq9jb\") pod \"tuned-zdbnc\" (UID: \"630ceb00-9a31-46a7-8976-1f33f56025d7\") " pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:00.952308 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.952176    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmr49\" (UniqueName: \"kubernetes.io/projected/2e953581-6e11-46ad-92e3-0d63df589850-kube-api-access-hmr49\") pod \"ovnkube-node-5kkzl\" (UID: \"2e953581-6e11-46ad-92e3-0d63df589850\") " pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:00.953313 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.953291    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkrjw\" (UniqueName: \"kubernetes.io/projected/d89ecbee-c2b4-417a-a54f-1a03ac0bbc1c-kube-api-access-gkrjw\") pod \"node-ca-np9kp\" (UID: \"d89ecbee-c2b4-417a-a54f-1a03ac0bbc1c\") " pod="openshift-image-registry/node-ca-np9kp"
Jul 18 11:20:00.953445 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.953403    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-110.ec2.internal" event={"ID":"97c5a81044e47f299dcb090782306fa8","Type":"ContainerStarted","Data":"01da61314b41d2461391ee2151381366fa0b625665e2f2c3bc6ceab02b610112"}
Jul 18 11:20:00.954684 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:00.954660    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal" event={"ID":"1d67cf298a38ae64f8f437221596a16f","Type":"ContainerStarted","Data":"6c11dfe24504a847e76d5e3a468f1679522ba2bc1775335feeb5ec927c0599a7"}
Jul 18 11:20:01.035936 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.035906    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6df6\" (UniqueName: \"kubernetes.io/projected/f08b2c6c-0b5d-4e0f-ab18-e8ff3bf894e2-kube-api-access-m6df6\") pod \"iptables-alerter-6qdq9\" (UID: \"f08b2c6c-0b5d-4e0f-ab18-e8ff3bf894e2\") " pod="openshift-network-operator/iptables-alerter-6qdq9"
Jul 18 11:20:01.036123 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.035953    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f08b2c6c-0b5d-4e0f-ab18-e8ff3bf894e2-iptables-alerter-script\") pod \"iptables-alerter-6qdq9\" (UID: \"f08b2c6c-0b5d-4e0f-ab18-e8ff3bf894e2\") " pod="openshift-network-operator/iptables-alerter-6qdq9"
Jul 18 11:20:01.036123 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.035977    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-kubelet-config\") pod \"global-pull-secret-syncer-tj4vh\" (UID: \"6a7e7704-fd0c-4d89-935e-ddf63f7082e1\") " pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:01.036123 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.035997    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs\") pod \"network-metrics-daemon-wd67v\" (UID: \"f390acc5-cb52-4b39-a4fe-362b2b543fbf\") " pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:01.036123 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.036033    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-dbus\") pod \"global-pull-secret-syncer-tj4vh\" (UID: \"6a7e7704-fd0c-4d89-935e-ddf63f7082e1\") " pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:01.036123 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.036062    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret\") pod \"global-pull-secret-syncer-tj4vh\" (UID: \"6a7e7704-fd0c-4d89-935e-ddf63f7082e1\") " pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:01.036123 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.036083    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl4fs\" (UniqueName: \"kubernetes.io/projected/f390acc5-cb52-4b39-a4fe-362b2b543fbf-kube-api-access-fl4fs\") pod \"network-metrics-daemon-wd67v\" (UID: \"f390acc5-cb52-4b39-a4fe-362b2b543fbf\") " pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:01.036123 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.036115    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-kubelet-config\") pod \"global-pull-secret-syncer-tj4vh\" (UID: \"6a7e7704-fd0c-4d89-935e-ddf63f7082e1\") " pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:01.036455 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.036154    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-dbus\") pod \"global-pull-secret-syncer-tj4vh\" (UID: \"6a7e7704-fd0c-4d89-935e-ddf63f7082e1\") " pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:01.036455 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:01.036169    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:20:01.036455 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:01.036193    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 11:20:01.036455 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.036245    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f08b2c6c-0b5d-4e0f-ab18-e8ff3bf894e2-host-slash\") pod \"iptables-alerter-6qdq9\" (UID: \"f08b2c6c-0b5d-4e0f-ab18-e8ff3bf894e2\") " pod="openshift-network-operator/iptables-alerter-6qdq9"
Jul 18 11:20:01.036455 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:01.036257    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs podName:f390acc5-cb52-4b39-a4fe-362b2b543fbf nodeName:}" failed. No retries permitted until 2026-07-18 11:20:01.536238105 +0000 UTC m=+3.138367838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs") pod "network-metrics-daemon-wd67v" (UID: "f390acc5-cb52-4b39-a4fe-362b2b543fbf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:20:01.036455 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:01.036279    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret podName:6a7e7704-fd0c-4d89-935e-ddf63f7082e1 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:01.536269319 +0000 UTC m=+3.138399043 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret") pod "global-pull-secret-syncer-tj4vh" (UID: "6a7e7704-fd0c-4d89-935e-ddf63f7082e1") : object "kube-system"/"original-pull-secret" not registered
Jul 18 11:20:01.036455 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.036302    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f08b2c6c-0b5d-4e0f-ab18-e8ff3bf894e2-host-slash\") pod \"iptables-alerter-6qdq9\" (UID: \"f08b2c6c-0b5d-4e0f-ab18-e8ff3bf894e2\") " pod="openshift-network-operator/iptables-alerter-6qdq9"
Jul 18 11:20:01.036679 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.036644    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f08b2c6c-0b5d-4e0f-ab18-e8ff3bf894e2-iptables-alerter-script\") pod \"iptables-alerter-6qdq9\" (UID: \"f08b2c6c-0b5d-4e0f-ab18-e8ff3bf894e2\") " pod="openshift-network-operator/iptables-alerter-6qdq9"
Jul 18 11:20:01.044230 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.044205    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl4fs\" (UniqueName: \"kubernetes.io/projected/f390acc5-cb52-4b39-a4fe-362b2b543fbf-kube-api-access-fl4fs\") pod \"network-metrics-daemon-wd67v\" (UID: \"f390acc5-cb52-4b39-a4fe-362b2b543fbf\") " pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:01.044343 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.044320    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6df6\" (UniqueName: \"kubernetes.io/projected/f08b2c6c-0b5d-4e0f-ab18-e8ff3bf894e2-kube-api-access-m6df6\") pod \"iptables-alerter-6qdq9\" (UID: \"f08b2c6c-0b5d-4e0f-ab18-e8ff3bf894e2\") " pod="openshift-network-operator/iptables-alerter-6qdq9"
Jul 18 11:20:01.108195 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.108163    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wqfc9"
Jul 18 11:20:01.114884 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.114858    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-np9kp"
Jul 18 11:20:01.123141 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.123123    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-zdbnc"
Jul 18 11:20:01.131996 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.131973    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s"
Jul 18 11:20:01.138704 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.138688    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p6t6n"
Jul 18 11:20:01.144470 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.144454    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2gphw"
Jul 18 11:20:01.149932 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.149914    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lbhg8"
Jul 18 11:20:01.155599 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.155583    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:01.162167 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.162151    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-6qdq9"
Jul 18 11:20:01.327534 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.327467    2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 11:20:01.538348 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.538313    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpdd2\" (UniqueName: \"kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2\") pod \"network-check-target-z9cdq\" (UID: \"ac841995-3c3f-4f12-a8da-9467f87a401b\") " pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:01.538513 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.538374    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs\") pod \"network-metrics-daemon-wd67v\" (UID: \"f390acc5-cb52-4b39-a4fe-362b2b543fbf\") " pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:01.538513 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.538421    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret\") pod \"global-pull-secret-syncer-tj4vh\" (UID: \"6a7e7704-fd0c-4d89-935e-ddf63f7082e1\") " pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:01.538513 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:01.538503    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 11:20:01.538687 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:01.538529    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 11:20:01.538687 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:01.538539    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:20:01.538687 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:01.538599    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs podName:f390acc5-cb52-4b39-a4fe-362b2b543fbf nodeName:}" failed. No retries permitted until 2026-07-18 11:20:02.538583782 +0000 UTC m=+4.140713499 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs") pod "network-metrics-daemon-wd67v" (UID: "f390acc5-cb52-4b39-a4fe-362b2b543fbf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:20:01.538687 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:01.538601    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 11:20:01.538687 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:01.538544    2554 projected.go:196] Error preparing data for projected volume kube-api-access-zpdd2 for pod openshift-network-diagnostics/network-check-target-z9cdq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:20:01.538687 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:01.538673    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret podName:6a7e7704-fd0c-4d89-935e-ddf63f7082e1 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:02.538656267 +0000 UTC m=+4.140785985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret") pod "global-pull-secret-syncer-tj4vh" (UID: "6a7e7704-fd0c-4d89-935e-ddf63f7082e1") : object "kube-system"/"original-pull-secret" not registered
Jul 18 11:20:01.538939 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:01.538692    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2 podName:ac841995-3c3f-4f12-a8da-9467f87a401b nodeName:}" failed. No retries permitted until 2026-07-18 11:20:02.538683187 +0000 UTC m=+4.140812909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zpdd2" (UniqueName: "kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2") pod "network-check-target-z9cdq" (UID: "ac841995-3c3f-4f12-a8da-9467f87a401b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:20:01.712642 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:20:01.712616    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2065968_1eb2_40a6_bac5_af5e502f89af.slice/crio-d6f254418c94f4ced23e2c4ae65878b54b52f3730863fb55c57803959ecdcb1a WatchSource:0}: Error finding container d6f254418c94f4ced23e2c4ae65878b54b52f3730863fb55c57803959ecdcb1a: Status 404 returned error can't find the container with id d6f254418c94f4ced23e2c4ae65878b54b52f3730863fb55c57803959ecdcb1a
Jul 18 11:20:01.713973 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:20:01.713952    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e953581_6e11_46ad_92e3_0d63df589850.slice/crio-a37ffc3c17fa09a24f0569e1ced164fa8f108f9a898989d073c292d5b5fffdcb WatchSource:0}: Error finding container a37ffc3c17fa09a24f0569e1ced164fa8f108f9a898989d073c292d5b5fffdcb: Status 404 returned error can't find the container with id a37ffc3c17fa09a24f0569e1ced164fa8f108f9a898989d073c292d5b5fffdcb
Jul 18 11:20:01.714758 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:20:01.714730    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf08b2c6c_0b5d_4e0f_ab18_e8ff3bf894e2.slice/crio-f81c4dc5c70f5b6bd8f46aff4eaaa08a83f2623f7f9b44e3616b96d93b473764 WatchSource:0}: Error finding container f81c4dc5c70f5b6bd8f46aff4eaaa08a83f2623f7f9b44e3616b96d93b473764: Status 404 returned error can't find the container with id f81c4dc5c70f5b6bd8f46aff4eaaa08a83f2623f7f9b44e3616b96d93b473764
Jul 18 11:20:01.715784 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:20:01.715637    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode232d4ab_f385_4027_b5ae_89821bb14026.slice/crio-24ce6aff3b335fcbfbcfff80cf50ce1b5a8a798055fd374dd3590c9fa8a47488 WatchSource:0}: Error finding container 24ce6aff3b335fcbfbcfff80cf50ce1b5a8a798055fd374dd3590c9fa8a47488: Status 404 returned error can't find the container with id 24ce6aff3b335fcbfbcfff80cf50ce1b5a8a798055fd374dd3590c9fa8a47488
Jul 18 11:20:01.717395 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:20:01.717296    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b5c3f17_2f4d_4c49_a797_ddc010d48e96.slice/crio-85d0a576c68e6dfff5aa5b7af495e31fe0bb3e5be7054aa88ffead13ed4c2deb WatchSource:0}: Error finding container 85d0a576c68e6dfff5aa5b7af495e31fe0bb3e5be7054aa88ffead13ed4c2deb: Status 404 returned error can't find the container with id 85d0a576c68e6dfff5aa5b7af495e31fe0bb3e5be7054aa88ffead13ed4c2deb
Jul 18 11:20:01.718812 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:20:01.718602    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6d4988d_0ad4_4bbd_a75a_5da0d1c25749.slice/crio-19904c629369c005af74bacf61c84afca03a998015ae5fd09c19bebfdae093db WatchSource:0}: Error finding container 19904c629369c005af74bacf61c84afca03a998015ae5fd09c19bebfdae093db: Status 404 returned error can't find the container with id 19904c629369c005af74bacf61c84afca03a998015ae5fd09c19bebfdae093db
Jul 18 11:20:01.720588 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:20:01.720549    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod630ceb00_9a31_46a7_8976_1f33f56025d7.slice/crio-91864bf78164d06099813b49ba0766e3c21813dba9755ab5558953d9ba6c6559 WatchSource:0}: Error finding container 91864bf78164d06099813b49ba0766e3c21813dba9755ab5558953d9ba6c6559: Status 404 returned error can't find the container with id 91864bf78164d06099813b49ba0766e3c21813dba9755ab5558953d9ba6c6559
Jul 18 11:20:01.721445 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:20:01.721426    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a5e4326_d7b2_44c7_9404_2ada70d7ad0b.slice/crio-ffdd91bc357ea8cce11810b2503e3b2c482d562febc67e6f6f2e4094f4eea6db WatchSource:0}: Error finding container ffdd91bc357ea8cce11810b2503e3b2c482d562febc67e6f6f2e4094f4eea6db: Status 404 returned error can't find the container with id ffdd91bc357ea8cce11810b2503e3b2c482d562febc67e6f6f2e4094f4eea6db
Jul 18 11:20:01.722873 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:20:01.722843    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd89ecbee_c2b4_417a_a54f_1a03ac0bbc1c.slice/crio-ae58e6a13c7aa68b64a5d51e2e8778476ed38eb1a9537c4d6a08f8809480a875 WatchSource:0}: Error finding container ae58e6a13c7aa68b64a5d51e2e8778476ed38eb1a9537c4d6a08f8809480a875: Status 404 returned error can't find the container with id ae58e6a13c7aa68b64a5d51e2e8778476ed38eb1a9537c4d6a08f8809480a875
Jul 18 11:20:01.859703 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.859649    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 11:15:00 +0000 UTC" deadline="2028-02-05 08:42:23.102090834 +0000 UTC"
Jul 18 11:20:01.859703 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.859700    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13605h22m21.242395979s"
Jul 18 11:20:01.944346 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.944207    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:01.944428 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:01.944414    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:01.958162 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.958133    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-110.ec2.internal" event={"ID":"97c5a81044e47f299dcb090782306fa8","Type":"ContainerStarted","Data":"4b05bb37cb187843a1d721922b1bb80c2f5f14b9bcba3ab8b6a336f9c37c39f5"}
Jul 18 11:20:01.959183 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.959161    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-np9kp" event={"ID":"d89ecbee-c2b4-417a-a54f-1a03ac0bbc1c","Type":"ContainerStarted","Data":"ae58e6a13c7aa68b64a5d51e2e8778476ed38eb1a9537c4d6a08f8809480a875"}
Jul 18 11:20:01.960254 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.960229    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lbhg8" event={"ID":"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b","Type":"ContainerStarted","Data":"ffdd91bc357ea8cce11810b2503e3b2c482d562febc67e6f6f2e4094f4eea6db"}
Jul 18 11:20:01.961241 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.961221    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zdbnc" event={"ID":"630ceb00-9a31-46a7-8976-1f33f56025d7","Type":"ContainerStarted","Data":"91864bf78164d06099813b49ba0766e3c21813dba9755ab5558953d9ba6c6559"}
Jul 18 11:20:01.962313 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.962287    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6qdq9" event={"ID":"f08b2c6c-0b5d-4e0f-ab18-e8ff3bf894e2","Type":"ContainerStarted","Data":"f81c4dc5c70f5b6bd8f46aff4eaaa08a83f2623f7f9b44e3616b96d93b473764"}
Jul 18 11:20:01.963314 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.963294    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wqfc9" event={"ID":"c2065968-1eb2-40a6-bac5-af5e502f89af","Type":"ContainerStarted","Data":"d6f254418c94f4ced23e2c4ae65878b54b52f3730863fb55c57803959ecdcb1a"}
Jul 18 11:20:01.964632 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.964611    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal" event={"ID":"1d67cf298a38ae64f8f437221596a16f","Type":"ContainerStarted","Data":"0806ecc3f63492ab4b90a5ee4090f957cf9efbc3c5c7390c545f0cd640b2ec63"}
Jul 18 11:20:01.965614 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.965595    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p6t6n" event={"ID":"e6d4988d-0ad4-4bbd-a75a-5da0d1c25749","Type":"ContainerStarted","Data":"19904c629369c005af74bacf61c84afca03a998015ae5fd09c19bebfdae093db"}
Jul 18 11:20:01.966704 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.966663    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s" event={"ID":"2b5c3f17-2f4d-4c49-a797-ddc010d48e96","Type":"ContainerStarted","Data":"85d0a576c68e6dfff5aa5b7af495e31fe0bb3e5be7054aa88ffead13ed4c2deb"}
Jul 18 11:20:01.967838 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.967819    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2gphw" event={"ID":"e232d4ab-f385-4027-b5ae-89821bb14026","Type":"ContainerStarted","Data":"24ce6aff3b335fcbfbcfff80cf50ce1b5a8a798055fd374dd3590c9fa8a47488"}
Jul 18 11:20:01.968771 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.968753    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl" event={"ID":"2e953581-6e11-46ad-92e3-0d63df589850","Type":"ContainerStarted","Data":"a37ffc3c17fa09a24f0569e1ced164fa8f108f9a898989d073c292d5b5fffdcb"}
Jul 18 11:20:01.984306 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:01.984266    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-110.ec2.internal" podStartSLOduration=1.984252152 podStartE2EDuration="1.984252152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:20:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:01.971309926 +0000 UTC m=+3.573439680" watchObservedRunningTime="2026-07-18 11:20:01.984252152 +0000 UTC m=+3.586381891"
Jul 18 11:20:02.548176 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:02.547224    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs\") pod \"network-metrics-daemon-wd67v\" (UID: \"f390acc5-cb52-4b39-a4fe-362b2b543fbf\") " pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:02.548176 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:02.547301    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret\") pod \"global-pull-secret-syncer-tj4vh\" (UID: \"6a7e7704-fd0c-4d89-935e-ddf63f7082e1\") " pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:02.548176 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:02.547336    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpdd2\" (UniqueName: \"kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2\") pod \"network-check-target-z9cdq\" (UID: \"ac841995-3c3f-4f12-a8da-9467f87a401b\") " pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:02.548176 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:02.547470    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 11:20:02.548176 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:02.547487    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 11:20:02.548176 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:02.547500    2554 projected.go:196] Error preparing data for projected volume kube-api-access-zpdd2 for pod openshift-network-diagnostics/network-check-target-z9cdq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:20:02.548176 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:02.547556    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2 podName:ac841995-3c3f-4f12-a8da-9467f87a401b nodeName:}" failed. No retries permitted until 2026-07-18 11:20:04.547538693 +0000 UTC m=+6.149668413 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zpdd2" (UniqueName: "kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2") pod "network-check-target-z9cdq" (UID: "ac841995-3c3f-4f12-a8da-9467f87a401b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:20:02.548176 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:02.547977    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:20:02.548176 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:02.548023    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs podName:f390acc5-cb52-4b39-a4fe-362b2b543fbf nodeName:}" failed. No retries permitted until 2026-07-18 11:20:04.548008607 +0000 UTC m=+6.150138329 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs") pod "network-metrics-daemon-wd67v" (UID: "f390acc5-cb52-4b39-a4fe-362b2b543fbf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:20:02.548176 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:02.548077    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 11:20:02.548176 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:02.548125    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret podName:6a7e7704-fd0c-4d89-935e-ddf63f7082e1 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:04.548113348 +0000 UTC m=+6.150243066 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret") pod "global-pull-secret-syncer-tj4vh" (UID: "6a7e7704-fd0c-4d89-935e-ddf63f7082e1") : object "kube-system"/"original-pull-secret" not registered
Jul 18 11:20:02.707772 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:02.707659    2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 18 11:20:02.860075 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:02.859957    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-17 11:15:00 +0000 UTC" deadline="2028-02-08 04:43:19.384231686 +0000 UTC"
Jul 18 11:20:02.860075 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:02.860018    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13673h23m16.52421808s"
Jul 18 11:20:02.944119 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:02.943957    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:02.944119 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:02.944114    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:02.944354 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:02.944132    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:02.944354 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:02.944291    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:03.004034 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:03.003983    2554 generic.go:356] "Generic (PLEG): container finished" podID="1d67cf298a38ae64f8f437221596a16f" containerID="0806ecc3f63492ab4b90a5ee4090f957cf9efbc3c5c7390c545f0cd640b2ec63" exitCode=0
Jul 18 11:20:03.005045 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:03.004885    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal" event={"ID":"1d67cf298a38ae64f8f437221596a16f","Type":"ContainerDied","Data":"0806ecc3f63492ab4b90a5ee4090f957cf9efbc3c5c7390c545f0cd640b2ec63"}
Jul 18 11:20:03.944651 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:03.944620    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:03.945143 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:03.944750    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:04.042987 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:04.042944    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal" event={"ID":"1d67cf298a38ae64f8f437221596a16f","Type":"ContainerStarted","Data":"c87c2a233e40cf0ac93dedcb7dea6afcdd75eea0806d9304a8da5894bc65bcaa"}
Jul 18 11:20:04.562240 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:04.562201    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret\") pod \"global-pull-secret-syncer-tj4vh\" (UID: \"6a7e7704-fd0c-4d89-935e-ddf63f7082e1\") " pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:04.562435 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:04.562259    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpdd2\" (UniqueName: \"kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2\") pod \"network-check-target-z9cdq\" (UID: \"ac841995-3c3f-4f12-a8da-9467f87a401b\") " pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:04.562435 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:04.562321    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs\") pod \"network-metrics-daemon-wd67v\" (UID: \"f390acc5-cb52-4b39-a4fe-362b2b543fbf\") " pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:04.562553 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:04.562475    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:20:04.562553 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:04.562540    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs podName:f390acc5-cb52-4b39-a4fe-362b2b543fbf nodeName:}" failed. No retries permitted until 2026-07-18 11:20:08.562519712 +0000 UTC m=+10.164649430 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs") pod "network-metrics-daemon-wd67v" (UID: "f390acc5-cb52-4b39-a4fe-362b2b543fbf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:20:04.562933 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:04.562913    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 11:20:04.563003 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:04.562976    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret podName:6a7e7704-fd0c-4d89-935e-ddf63f7082e1 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:08.562960012 +0000 UTC m=+10.165089733 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret") pod "global-pull-secret-syncer-tj4vh" (UID: "6a7e7704-fd0c-4d89-935e-ddf63f7082e1") : object "kube-system"/"original-pull-secret" not registered
Jul 18 11:20:04.563085 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:04.563073    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 11:20:04.563177 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:04.563111    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 11:20:04.563177 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:04.563124    2554 projected.go:196] Error preparing data for projected volume kube-api-access-zpdd2 for pod openshift-network-diagnostics/network-check-target-z9cdq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:20:04.563177 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:04.563158    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2 podName:ac841995-3c3f-4f12-a8da-9467f87a401b nodeName:}" failed. No retries permitted until 2026-07-18 11:20:08.563146862 +0000 UTC m=+10.165276594 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zpdd2" (UniqueName: "kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2") pod "network-check-target-z9cdq" (UID: "ac841995-3c3f-4f12-a8da-9467f87a401b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:20:04.944453 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:04.944376    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:04.944606 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:04.944395    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:04.944606 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:04.944542    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:04.944718 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:04.944602    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:05.943688 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:05.943651    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:05.943886 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:05.943796    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:06.944286 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:06.944200    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:06.944286 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:06.944221    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:06.944810 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:06.944336    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:06.944810 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:06.944500    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:07.944205 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:07.943821    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:07.944205 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:07.943955    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:08.596518 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:08.596468    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs\") pod \"network-metrics-daemon-wd67v\" (UID: \"f390acc5-cb52-4b39-a4fe-362b2b543fbf\") " pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:08.596697 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:08.596529    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret\") pod \"global-pull-secret-syncer-tj4vh\" (UID: \"6a7e7704-fd0c-4d89-935e-ddf63f7082e1\") " pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:08.596697 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:08.596562    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpdd2\" (UniqueName: \"kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2\") pod \"network-check-target-z9cdq\" (UID: \"ac841995-3c3f-4f12-a8da-9467f87a401b\") " pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:08.596697 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:08.596636    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:20:08.596697 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:08.596690    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 11:20:08.596919 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:08.596694    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 11:20:08.596919 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:08.596710    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 11:20:08.596919 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:08.596723    2554 projected.go:196] Error preparing data for projected volume kube-api-access-zpdd2 for pod openshift-network-diagnostics/network-check-target-z9cdq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:20:08.596919 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:08.596705    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs podName:f390acc5-cb52-4b39-a4fe-362b2b543fbf nodeName:}" failed. No retries permitted until 2026-07-18 11:20:16.596686369 +0000 UTC m=+18.198816096 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs") pod "network-metrics-daemon-wd67v" (UID: "f390acc5-cb52-4b39-a4fe-362b2b543fbf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:20:08.596919 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:08.596768    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret podName:6a7e7704-fd0c-4d89-935e-ddf63f7082e1 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:16.596750637 +0000 UTC m=+18.198880360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret") pod "global-pull-secret-syncer-tj4vh" (UID: "6a7e7704-fd0c-4d89-935e-ddf63f7082e1") : object "kube-system"/"original-pull-secret" not registered
Jul 18 11:20:08.596919 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:08.596784    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2 podName:ac841995-3c3f-4f12-a8da-9467f87a401b nodeName:}" failed. No retries permitted until 2026-07-18 11:20:16.596773695 +0000 UTC m=+18.198903414 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zpdd2" (UniqueName: "kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2") pod "network-check-target-z9cdq" (UID: "ac841995-3c3f-4f12-a8da-9467f87a401b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:20:08.944461 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:08.943672    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:08.944899 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:08.944684    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:08.944899 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:08.944765    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:08.944899 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:08.944877    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:09.945158 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:09.944546    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:09.945158 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:09.944679    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:10.943907 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:10.943874    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:10.944057 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:10.944002    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:10.944130 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:10.944053    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:10.944201 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:10.944180    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:11.943717 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:11.943689    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:11.944083 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:11.943793    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:12.943572 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:12.943542    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:12.943742 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:12.943662    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:12.943742 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:12.943689    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:12.944145 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:12.943817    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:13.944459 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:13.944424    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:13.944907 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:13.944599    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:14.947234 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:14.947209    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:14.947630 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:14.947209    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:14.947630 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:14.947305    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:14.947630 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:14.947428    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:15.944459 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:15.944417    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:15.944704 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:15.944545    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:16.653682 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:16.653593    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret\") pod \"global-pull-secret-syncer-tj4vh\" (UID: \"6a7e7704-fd0c-4d89-935e-ddf63f7082e1\") " pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:16.653682 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:16.653644    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpdd2\" (UniqueName: \"kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2\") pod \"network-check-target-z9cdq\" (UID: \"ac841995-3c3f-4f12-a8da-9467f87a401b\") " pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:16.654180 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:16.653693    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs\") pod \"network-metrics-daemon-wd67v\" (UID: \"f390acc5-cb52-4b39-a4fe-362b2b543fbf\") " pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:16.654180 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:16.653754    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 11:20:16.654180 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:16.653795    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:20:16.654180 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:16.653801    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 11:20:16.654180 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:16.653824    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 11:20:16.654180 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:16.653841    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret podName:6a7e7704-fd0c-4d89-935e-ddf63f7082e1 nodeName:}" failed. No retries permitted until 2026-07-18 11:20:32.653817457 +0000 UTC m=+34.255947200 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret") pod "global-pull-secret-syncer-tj4vh" (UID: "6a7e7704-fd0c-4d89-935e-ddf63f7082e1") : object "kube-system"/"original-pull-secret" not registered
Jul 18 11:20:16.654180 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:16.653862    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs podName:f390acc5-cb52-4b39-a4fe-362b2b543fbf nodeName:}" failed. No retries permitted until 2026-07-18 11:20:32.65385143 +0000 UTC m=+34.255981155 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs") pod "network-metrics-daemon-wd67v" (UID: "f390acc5-cb52-4b39-a4fe-362b2b543fbf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:20:16.654180 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:16.653841    2554 projected.go:196] Error preparing data for projected volume kube-api-access-zpdd2 for pod openshift-network-diagnostics/network-check-target-z9cdq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:20:16.654180 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:16.653938    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2 podName:ac841995-3c3f-4f12-a8da-9467f87a401b nodeName:}" failed. No retries permitted until 2026-07-18 11:20:32.653917589 +0000 UTC m=+34.256047325 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zpdd2" (UniqueName: "kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2") pod "network-check-target-z9cdq" (UID: "ac841995-3c3f-4f12-a8da-9467f87a401b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:20:16.944313 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:16.944240    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:16.944483 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:16.944240    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:16.944483 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:16.944359    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:16.944483 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:16.944446    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:17.943693 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:17.943659    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:17.944178 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:17.943767    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:18.944607 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:18.944570    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:18.945048 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:18.944654    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:18.945048 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:18.944673    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:18.945048 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:18.944819    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:19.943645 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:19.943616    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:19.943808 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:19.943730    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:20.944192 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:20.943769    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:20.944957 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:20.944323    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:20.944957 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:20.943769    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:20.944957 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:20.944711    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:21.076477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.076439    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wqfc9" event={"ID":"c2065968-1eb2-40a6-bac5-af5e502f89af","Type":"ContainerStarted","Data":"fa7ba0d0eab2fa8e09b18eded85a5982a3915bc92e2d26669f1e8de22b5d5193"}
Jul 18 11:20:21.077909 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.077871    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p6t6n" event={"ID":"e6d4988d-0ad4-4bbd-a75a-5da0d1c25749","Type":"ContainerStarted","Data":"99b8ca501c4fd167f7c3106167d7b0afe674aab4ed9178a254af27ddfce73bfd"}
Jul 18 11:20:21.079394 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.079365    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s" event={"ID":"2b5c3f17-2f4d-4c49-a797-ddc010d48e96","Type":"ContainerStarted","Data":"b6c05dcfa5d39942aede29d2bbd2d96e142bc70d9ebd35f9b2f976318250578f"}
Jul 18 11:20:21.080883 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.080863    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2gphw" event={"ID":"e232d4ab-f385-4027-b5ae-89821bb14026","Type":"ContainerStarted","Data":"4fb7311b16cc87f7f31ccb311fec1f6c0b2c3af1d3bb1ee00dcf21f16a2fe2b3"}
Jul 18 11:20:21.086372 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.086346    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5kkzl_2e953581-6e11-46ad-92e3-0d63df589850/ovn-acl-logging/0.log"
Jul 18 11:20:21.086804 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.086778    2554 generic.go:356] "Generic (PLEG): container finished" podID="2e953581-6e11-46ad-92e3-0d63df589850" containerID="48c21365d9c7c185d8e5fd3237f3bea5f9eaa7ed9ecbbc1ea894637f9f4ce3a6" exitCode=1
Jul 18 11:20:21.086875 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.086842    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl" event={"ID":"2e953581-6e11-46ad-92e3-0d63df589850","Type":"ContainerStarted","Data":"b3a714c7a9d351adea8774b757f1e7bfc002595bc42f994bb9deb0d609b82c6e"}
Jul 18 11:20:21.086945 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.086925    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl" event={"ID":"2e953581-6e11-46ad-92e3-0d63df589850","Type":"ContainerStarted","Data":"14797fa63ec82ee095fec1ae99077eb415c0594965688c6ae1227814586b5366"}
Jul 18 11:20:21.087064 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.086977    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl" event={"ID":"2e953581-6e11-46ad-92e3-0d63df589850","Type":"ContainerStarted","Data":"3a4dbaac7af5e039ac679b78057e702e28c781f8bb4d966c9364048cbb8eea29"}
Jul 18 11:20:21.087064 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.087042    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl" event={"ID":"2e953581-6e11-46ad-92e3-0d63df589850","Type":"ContainerStarted","Data":"9bbfa76575791e65bb94b17ac726ebe4d686fd22b82a043f2db17d75247b1449"}
Jul 18 11:20:21.087200 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.087089    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl" event={"ID":"2e953581-6e11-46ad-92e3-0d63df589850","Type":"ContainerDied","Data":"48c21365d9c7c185d8e5fd3237f3bea5f9eaa7ed9ecbbc1ea894637f9f4ce3a6"}
Jul 18 11:20:21.087200 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.087157    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl" event={"ID":"2e953581-6e11-46ad-92e3-0d63df589850","Type":"ContainerStarted","Data":"e27e7c2a4a48479da4cbf5376f4cf17103cbb369561fa0e02ad5b6b01a77697d"}
Jul 18 11:20:21.088257 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.088234    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-np9kp" event={"ID":"d89ecbee-c2b4-417a-a54f-1a03ac0bbc1c","Type":"ContainerStarted","Data":"0f2669021005ac78581d5b27bef5adc42332d17a4642cb77d0ed606461f055a8"}
Jul 18 11:20:21.089614 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.089593    2554 generic.go:356] "Generic (PLEG): container finished" podID="7a5e4326-d7b2-44c7-9404-2ada70d7ad0b" containerID="ed4e89feb20383b13d575bf43f2c5a1699599c692891bd11d4857e00763f4c55" exitCode=0
Jul 18 11:20:21.089698 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.089655    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lbhg8" event={"ID":"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b","Type":"ContainerDied","Data":"ed4e89feb20383b13d575bf43f2c5a1699599c692891bd11d4857e00763f4c55"}
Jul 18 11:20:21.090923 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.090847    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-110.ec2.internal" podStartSLOduration=21.090835473 podStartE2EDuration="21.090835473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:20:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:04.058712868 +0000 UTC m=+5.660842625" watchObservedRunningTime="2026-07-18 11:20:21.090835473 +0000 UTC m=+22.692965212"
Jul 18 11:20:21.091124 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.091088    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-zdbnc" event={"ID":"630ceb00-9a31-46a7-8976-1f33f56025d7","Type":"ContainerStarted","Data":"1822c7a0ae99ee887d315cee24bc9855d017eb2320dcdb8802dfe45db55153ff"}
Jul 18 11:20:21.091275 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.091180    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wqfc9" podStartSLOduration=8.364712971 podStartE2EDuration="23.091173863s" totalImagesPullingTime="14.726460892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:21.09061033 +0000 UTC m=+22.692740072" watchObservedRunningTime="2026-07-18 11:20:21.091173863 +0000 UTC m=+22.693303601"
Jul 18 11:20:21.103617 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.103580    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p6t6n" podStartSLOduration=3.600689762 podStartE2EDuration="22.103568314s" totalImagesPullingTime="18.502878552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:19:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:21.10346066 +0000 UTC m=+22.705590412" watchObservedRunningTime="2026-07-18 11:20:21.103568314 +0000 UTC m=+22.705698047"
Jul 18 11:20:21.116347 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.116311    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-np9kp" podStartSLOduration=4.620110009 podStartE2EDuration="23.116298583s" totalImagesPullingTime="18.496188574s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:19:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:21.115954719 +0000 UTC m=+22.718084457" watchObservedRunningTime="2026-07-18 11:20:21.116298583 +0000 UTC m=+22.718428322"
Jul 18 11:20:21.134041 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.133985    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2gphw" podStartSLOduration=3.05672888 podStartE2EDuration="22.133963688s" totalImagesPullingTime="19.077234808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:19:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:21.133085467 +0000 UTC m=+22.735215207" watchObservedRunningTime="2026-07-18 11:20:21.133963688 +0000 UTC m=+22.736093429"
Jul 18 11:20:21.178213 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.178164    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-zdbnc" podStartSLOduration=3.677070613 podStartE2EDuration="22.178142917s" totalImagesPullingTime="18.501072304s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:19:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:21.177747885 +0000 UTC m=+22.779877641" watchObservedRunningTime="2026-07-18 11:20:21.178142917 +0000 UTC m=+22.780272658"
Jul 18 11:20:21.744374 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.744339    2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 18 11:20:21.887604 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.887452    2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-18T11:20:21.744370986Z","UUID":"fffcc933-d444-4aca-94f8-73a3717691f9","Handler":null,"Name":"","Endpoint":""}
Jul 18 11:20:21.889248 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.889227    2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 18 11:20:21.889361 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.889271    2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 18 11:20:21.944125 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:21.944085    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:21.944291 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:21.944209    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:22.095753 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:22.095704    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s" event={"ID":"2b5c3f17-2f4d-4c49-a797-ddc010d48e96","Type":"ContainerStarted","Data":"cafab5f6ce58b55245578dd47d120680354dccae13935116643d60fe947b8e70"}
Jul 18 11:20:22.097390 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:22.097365    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-6qdq9" event={"ID":"f08b2c6c-0b5d-4e0f-ab18-e8ff3bf894e2","Type":"ContainerStarted","Data":"20551ef730123004924d0b6a023a273b3a8c24f468df55858cc3926979d72fe5"}
Jul 18 11:20:22.111390 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:22.111349    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-6qdq9" podStartSLOduration=4.687268155 podStartE2EDuration="23.111321128s" totalImagesPullingTime="18.424052973s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:19:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:22.111063923 +0000 UTC m=+23.713193661" watchObservedRunningTime="2026-07-18 11:20:22.111321128 +0000 UTC m=+23.713450867"
Jul 18 11:20:22.696226 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:22.696196    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wqfc9"
Jul 18 11:20:22.696785 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:22.696770    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wqfc9"
Jul 18 11:20:22.943716 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:22.943690    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:22.943909 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:22.943825    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:22.943909 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:22.943690    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:22.944027 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:22.943924    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:23.101858 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:23.101824    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s" event={"ID":"2b5c3f17-2f4d-4c49-a797-ddc010d48e96","Type":"ContainerStarted","Data":"61eac3e47e93169fefa136e1bc9d2cd10f8b8663a574748c0e5936af36d13f29"}
Jul 18 11:20:23.102276 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:23.102264    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wqfc9"
Jul 18 11:20:23.102671 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:23.102650    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wqfc9"
Jul 18 11:20:23.117783 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:23.117743    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsh2s" podStartSLOduration=3.506403396 podStartE2EDuration="24.117727836s" totalImagesPullingTime="20.61132444s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:19:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:23.117357744 +0000 UTC m=+24.719487484" watchObservedRunningTime="2026-07-18 11:20:23.117727836 +0000 UTC m=+24.719857576"
Jul 18 11:20:23.944485 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:23.944314    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:23.944720 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:23.944563    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:24.108366 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:24.108337    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5kkzl_2e953581-6e11-46ad-92e3-0d63df589850/ovn-acl-logging/0.log"
Jul 18 11:20:24.108814 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:24.108791    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl" event={"ID":"2e953581-6e11-46ad-92e3-0d63df589850","Type":"ContainerStarted","Data":"a85d392bb3e59a32031aa25b56523c091742d336cf628d1180a0e4017165e0f4"}
Jul 18 11:20:24.944284 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:24.944254    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:24.944484 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:24.944391    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:24.944484 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:24.944443    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:24.944570 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:24.944522    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:25.944616 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:25.944442    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:25.945293 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:25.944681    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:26.116982 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:26.116956    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5kkzl_2e953581-6e11-46ad-92e3-0d63df589850/ovn-acl-logging/0.log"
Jul 18 11:20:26.117319 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:26.117297    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl" event={"ID":"2e953581-6e11-46ad-92e3-0d63df589850","Type":"ContainerStarted","Data":"1cd5afdff08ba09c0a508c1448175c466540d663c6079331fea4a256cbcc202c"}
Jul 18 11:20:26.117586 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:26.117553    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:26.117733 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:26.117717    2554 scope.go:117] "RemoveContainer" containerID="48c21365d9c7c185d8e5fd3237f3bea5f9eaa7ed9ecbbc1ea894637f9f4ce3a6"
Jul 18 11:20:26.119246 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:26.119220    2554 generic.go:356] "Generic (PLEG): container finished" podID="7a5e4326-d7b2-44c7-9404-2ada70d7ad0b" containerID="b0093f08110194914e1a74582a4383ad225f721bdaa138c04c34a0f25d9f760f" exitCode=0
Jul 18 11:20:26.119339 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:26.119266    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lbhg8" event={"ID":"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b","Type":"ContainerDied","Data":"b0093f08110194914e1a74582a4383ad225f721bdaa138c04c34a0f25d9f760f"}
Jul 18 11:20:26.134249 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:26.134229    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:26.943584 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:26.943559    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:26.943704 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:26.943564    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:26.943704 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:26.943657    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:26.943788 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:26.943720    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:27.129673 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:27.129650    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5kkzl_2e953581-6e11-46ad-92e3-0d63df589850/ovn-acl-logging/0.log"
Jul 18 11:20:27.130201 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:27.130051    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl" event={"ID":"2e953581-6e11-46ad-92e3-0d63df589850","Type":"ContainerStarted","Data":"1d6c7a4975913cd6aa7bf89640b719cbd425a40b572e947bce50be39ff8a1af4"}
Jul 18 11:20:27.130346 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:27.130323    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:27.130433 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:27.130406    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:27.148743 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:27.148711    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:27.158981 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:27.158938    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl" podStartSLOduration=9.373391879 podStartE2EDuration="28.158925064s" totalImagesPullingTime="18.785533185s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:19:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:27.157756023 +0000 UTC m=+28.759885783" watchObservedRunningTime="2026-07-18 11:20:27.158925064 +0000 UTC m=+28.761054803"
Jul 18 11:20:27.312848 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:27.312805    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tj4vh"]
Jul 18 11:20:27.312994 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:27.312931    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:27.313046 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:27.313013    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:27.313627 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:27.313608    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z9cdq"]
Jul 18 11:20:27.313742 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:27.313692    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:27.313801 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:27.313782    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:27.314211 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:27.314190    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wd67v"]
Jul 18 11:20:27.314301 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:27.314282    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:27.314380 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:27.314360    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:28.134405 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:28.134372    2554 generic.go:356] "Generic (PLEG): container finished" podID="7a5e4326-d7b2-44c7-9404-2ada70d7ad0b" containerID="4a2ea28d46e25915d03d803f7a21072506216cabd048a5a3448a3020edb77598" exitCode=0
Jul 18 11:20:28.134777 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:28.134455    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lbhg8" event={"ID":"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b","Type":"ContainerDied","Data":"4a2ea28d46e25915d03d803f7a21072506216cabd048a5a3448a3020edb77598"}
Jul 18 11:20:28.944620 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:28.944593    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:28.944823 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:28.944682    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:28.944823 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:28.944757    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:28.945010 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:28.944874    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:28.945010 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:28.944897    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:28.945438 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:28.944978    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:29.701360 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:29.701335    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p6t6n_e6d4988d-0ad4-4bbd-a75a-5da0d1c25749/dns-node-resolver/0.log"
Jul 18 11:20:30.141592 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:30.141562    2554 generic.go:356] "Generic (PLEG): container finished" podID="7a5e4326-d7b2-44c7-9404-2ada70d7ad0b" containerID="d02ea7809bfde9cc130c1c6a643cff7c42399aa9b4db36eebcbd7c71060b4063" exitCode=0
Jul 18 11:20:30.141737 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:30.141608    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lbhg8" event={"ID":"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b","Type":"ContainerDied","Data":"d02ea7809bfde9cc130c1c6a643cff7c42399aa9b4db36eebcbd7c71060b4063"}
Jul 18 11:20:30.676083 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:30.676052    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-np9kp_d89ecbee-c2b4-417a-a54f-1a03ac0bbc1c/node-ca/0.log"
Jul 18 11:20:30.944493 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:30.944412    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:30.945177 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:30.944545    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:30.945177 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:30.944545    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:30.945177 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:30.944664    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:30.945177 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:30.944698    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:30.945177 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:30.944772    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:32.665858 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:32.665817    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpdd2\" (UniqueName: \"kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2\") pod \"network-check-target-z9cdq\" (UID: \"ac841995-3c3f-4f12-a8da-9467f87a401b\") " pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:32.665858 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:32.665868    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs\") pod \"network-metrics-daemon-wd67v\" (UID: \"f390acc5-cb52-4b39-a4fe-362b2b543fbf\") " pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:32.666477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:32.665909    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret\") pod \"global-pull-secret-syncer-tj4vh\" (UID: \"6a7e7704-fd0c-4d89-935e-ddf63f7082e1\") " pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:32.666477 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:32.665990    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 18 11:20:32.666477 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:32.665995    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 18 11:20:32.666477 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:32.666014    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 18 11:20:32.666477 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:32.666027    2554 projected.go:196] Error preparing data for projected volume kube-api-access-zpdd2 for pod openshift-network-diagnostics/network-check-target-z9cdq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:20:32.666477 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:32.666024    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:20:32.666477 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:32.666057    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret podName:6a7e7704-fd0c-4d89-935e-ddf63f7082e1 nodeName:}" failed. No retries permitted until 2026-07-18 11:21:04.666039245 +0000 UTC m=+66.268168965 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret") pod "global-pull-secret-syncer-tj4vh" (UID: "6a7e7704-fd0c-4d89-935e-ddf63f7082e1") : object "kube-system"/"original-pull-secret" not registered
Jul 18 11:20:32.666477 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:32.666076    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2 podName:ac841995-3c3f-4f12-a8da-9467f87a401b nodeName:}" failed. No retries permitted until 2026-07-18 11:21:04.666065421 +0000 UTC m=+66.268195142 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zpdd2" (UniqueName: "kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2") pod "network-check-target-z9cdq" (UID: "ac841995-3c3f-4f12-a8da-9467f87a401b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 18 11:20:32.666477 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:32.666123    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs podName:f390acc5-cb52-4b39-a4fe-362b2b543fbf nodeName:}" failed. No retries permitted until 2026-07-18 11:21:04.666087546 +0000 UTC m=+66.268217282 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs") pod "network-metrics-daemon-wd67v" (UID: "f390acc5-cb52-4b39-a4fe-362b2b543fbf") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 18 11:20:32.947180 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:32.947089    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:32.947343 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:32.947088    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:32.947343 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:32.947230    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:32.947343 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:32.947088    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:32.947343 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:32.947276    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:32.947549 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:32.947380    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:34.943948 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:34.943916    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:34.943948 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:34.943940    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:34.944377 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:34.944052    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:34.944377 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:34.944060    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:34.944377 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:34.944135    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:34.944377 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:34.944206    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:35.156214 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:35.156180    2554 generic.go:356] "Generic (PLEG): container finished" podID="7a5e4326-d7b2-44c7-9404-2ada70d7ad0b" containerID="ea6411bffeed5049174e04e2bfb07c069ff15f902a0f012b9388588fda1a0961" exitCode=0
Jul 18 11:20:35.156367 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:35.156237    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lbhg8" event={"ID":"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b","Type":"ContainerDied","Data":"ea6411bffeed5049174e04e2bfb07c069ff15f902a0f012b9388588fda1a0961"}
Jul 18 11:20:36.164195 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:36.164150    2554 generic.go:356] "Generic (PLEG): container finished" podID="7a5e4326-d7b2-44c7-9404-2ada70d7ad0b" containerID="639d2c1ad7d8c456a1f3838d3f609f4bc8f1b358ce027c1a774c6c38866e9b50" exitCode=0
Jul 18 11:20:36.164540 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:36.164222    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lbhg8" event={"ID":"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b","Type":"ContainerDied","Data":"639d2c1ad7d8c456a1f3838d3f609f4bc8f1b358ce027c1a774c6c38866e9b50"}
Jul 18 11:20:36.947026 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:36.946997    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:36.947177 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:36.946997    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:36.947177 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:36.947109    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:36.947177 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:36.947112    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:36.947276 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:36.947175    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:36.947276 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:36.947239    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:37.169816 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:37.169741    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lbhg8" event={"ID":"7a5e4326-d7b2-44c7-9404-2ada70d7ad0b","Type":"ContainerStarted","Data":"3a721e236bb0dee63df30e4f8e202da7f2ff2bea5d1dab04e6fade2e85171361"}
Jul 18 11:20:37.190985 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:37.190937    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lbhg8" podStartSLOduration=9.603122119 podStartE2EDuration="38.190921902s" totalImagesPullingTime="28.587799783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:19:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:37.190755876 +0000 UTC m=+38.792885629" watchObservedRunningTime="2026-07-18 11:20:37.190921902 +0000 UTC m=+38.793051641"
Jul 18 11:20:38.946812 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:38.946782    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:38.947191 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:38.946780    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:38.947191 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:38.946881    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:38.947191 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:38.946782    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:38.947191 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:38.946962    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:38.947191 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:38.947033    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:40.943512 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:40.943483    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:40.943958 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:40.943590    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:40.943958 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:40.943615    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:40.943958 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:40.943589    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:40.943958 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:40.943701    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:40.943958 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:40.943774    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:42.943482 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:42.943444    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:42.943482 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:42.943469    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:42.943896 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:42.943555    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:42.943896 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:42.943580    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:42.943896 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:42.943647    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:42.943896 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:42.943708    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:44.943669 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:44.943637    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:44.943669 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:44.943653    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:44.944162 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:44.943639    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:44.944162 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:44.943736    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:44.944162 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:44.943799    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:44.944162 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:44.943859    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:46.944173 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:46.944142    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:46.944620 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:46.944150    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:46.944620 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:46.944233    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:46.944620 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:46.944333    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:46.944620 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:46.944155    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:46.944620 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:46.944404    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:48.946327 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:48.946293    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:48.946682 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:48.946387    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:48.946682 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:48.946399    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:48.946682 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:48.946488    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:48.946682 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:48.946553    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:48.946682 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:48.946633    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:50.944149 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:50.944111    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:50.944560 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:50.944117    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:50.944560 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:50.944231    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:50.944560 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:50.944123    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:50.944560 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:50.944283    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:50.944560 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:50.944413    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:52.943724 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:52.943693    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:52.944279 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:52.943704    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:52.944279 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:52.943805    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tj4vh" podUID="6a7e7704-fd0c-4d89-935e-ddf63f7082e1"
Jul 18 11:20:52.944279 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:52.943704    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:52.944279 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:52.943858    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wd67v" podUID="f390acc5-cb52-4b39-a4fe-362b2b543fbf"
Jul 18 11:20:52.944279 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:20:52.944001    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z9cdq" podUID="ac841995-3c3f-4f12-a8da-9467f87a401b"
Jul 18 11:20:53.723238 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.723165    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-110.ec2.internal" event="NodeReady"
Jul 18 11:20:53.723371 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.723284    2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 18 11:20:53.758776 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.758746    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68999d7447-txfrt"]
Jul 18 11:20:53.760649 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.760635    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.762910 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.762886    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 18 11:20:53.763029 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.762973    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 18 11:20:53.763029 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.762976    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 18 11:20:53.763029 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.763005    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hnxrg\""
Jul 18 11:20:53.767785 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.767766    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 18 11:20:53.776535 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.776508    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pv9kp"]
Jul 18 11:20:53.778315 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.778296    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68999d7447-txfrt"]
Jul 18 11:20:53.778420 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.778401    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pv9kp"
Jul 18 11:20:53.778579 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.778551    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zt4vp"]
Jul 18 11:20:53.780328 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.780309    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zt4vp"
Jul 18 11:20:53.780771 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.780753    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 18 11:20:53.780870 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.780809    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 18 11:20:53.780923 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.780908    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-72crb\""
Jul 18 11:20:53.782154 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.782138    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 18 11:20:53.782349 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.782335    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dgc9c\""
Jul 18 11:20:53.782489 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.782475    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 18 11:20:53.782658 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.782641    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 18 11:20:53.793183 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.793164    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zt4vp"]
Jul 18 11:20:53.795039 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.795018    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pv9kp"]
Jul 18 11:20:53.806761 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.806741    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9rqst"]
Jul 18 11:20:53.808440 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.808426    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9rqst"
Jul 18 11:20:53.816301 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.816282    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 18 11:20:53.816477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.816463    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 18 11:20:53.816538 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.816523    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 18 11:20:53.816607 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.816523    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 18 11:20:53.816669 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.816640    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nhs4n\""
Jul 18 11:20:53.830004 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.829984    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fced16a6-eb16-46c1-9a0e-d02dff750a17-cert\") pod \"ingress-canary-zt4vp\" (UID: \"fced16a6-eb16-46c1-9a0e-d02dff750a17\") " pod="openshift-ingress-canary/ingress-canary-zt4vp"
Jul 18 11:20:53.830073 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.830010    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39beca92-f03f-4ed9-958b-b3c2a1da17c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9rqst\" (UID: \"39beca92-f03f-4ed9-958b-b3c2a1da17c5\") " pod="openshift-insights/insights-runtime-extractor-9rqst"
Jul 18 11:20:53.830073 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.830028    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f-config-volume\") pod \"dns-default-pv9kp\" (UID: \"2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f\") " pod="openshift-dns/dns-default-pv9kp"
Jul 18 11:20:53.830073 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.830041    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f-metrics-tls\") pod \"dns-default-pv9kp\" (UID: \"2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f\") " pod="openshift-dns/dns-default-pv9kp"
Jul 18 11:20:53.830216 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.830070    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39beca92-f03f-4ed9-958b-b3c2a1da17c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9rqst\" (UID: \"39beca92-f03f-4ed9-958b-b3c2a1da17c5\") " pod="openshift-insights/insights-runtime-extractor-9rqst"
Jul 18 11:20:53.830216 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.830123    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/672368e4-16b5-470b-9b7e-973867d923e9-registry-certificates\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.830216 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.830168    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39beca92-f03f-4ed9-958b-b3c2a1da17c5-crio-socket\") pod \"insights-runtime-extractor-9rqst\" (UID: \"39beca92-f03f-4ed9-958b-b3c2a1da17c5\") " pod="openshift-insights/insights-runtime-extractor-9rqst"
Jul 18 11:20:53.830216 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.830187    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/672368e4-16b5-470b-9b7e-973867d923e9-installation-pull-secrets\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.830396 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.830222    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xftvw\" (UniqueName: \"kubernetes.io/projected/2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f-kube-api-access-xftvw\") pod \"dns-default-pv9kp\" (UID: \"2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f\") " pod="openshift-dns/dns-default-pv9kp"
Jul 18 11:20:53.830396 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.830296    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/672368e4-16b5-470b-9b7e-973867d923e9-trusted-ca\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.830396 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.830329    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39beca92-f03f-4ed9-958b-b3c2a1da17c5-data-volume\") pod \"insights-runtime-extractor-9rqst\" (UID: \"39beca92-f03f-4ed9-958b-b3c2a1da17c5\") " pod="openshift-insights/insights-runtime-extractor-9rqst"
Jul 18 11:20:53.830396 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.830354    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rx7m\" (UniqueName: \"kubernetes.io/projected/672368e4-16b5-470b-9b7e-973867d923e9-kube-api-access-9rx7m\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.830563 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.830395    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f-tmp-dir\") pod \"dns-default-pv9kp\" (UID: \"2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f\") " pod="openshift-dns/dns-default-pv9kp"
Jul 18 11:20:53.830563 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.830429    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cvfs\" (UniqueName: \"kubernetes.io/projected/39beca92-f03f-4ed9-958b-b3c2a1da17c5-kube-api-access-7cvfs\") pod \"insights-runtime-extractor-9rqst\" (UID: \"39beca92-f03f-4ed9-958b-b3c2a1da17c5\") " pod="openshift-insights/insights-runtime-extractor-9rqst"
Jul 18 11:20:53.830563 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.830467    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42mnn\" (UniqueName: \"kubernetes.io/projected/fced16a6-eb16-46c1-9a0e-d02dff750a17-kube-api-access-42mnn\") pod \"ingress-canary-zt4vp\" (UID: \"fced16a6-eb16-46c1-9a0e-d02dff750a17\") " pod="openshift-ingress-canary/ingress-canary-zt4vp"
Jul 18 11:20:53.830563 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.830492    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/672368e4-16b5-470b-9b7e-973867d923e9-image-registry-private-configuration\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.830563 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.830509    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/672368e4-16b5-470b-9b7e-973867d923e9-registry-tls\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.830563 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.830525    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/672368e4-16b5-470b-9b7e-973867d923e9-ca-trust-extracted\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.830563 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.830540    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/672368e4-16b5-470b-9b7e-973867d923e9-bound-sa-token\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.833852 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.833831    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9rqst"]
Jul 18 11:20:53.931342 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.931310    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xftvw\" (UniqueName: \"kubernetes.io/projected/2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f-kube-api-access-xftvw\") pod \"dns-default-pv9kp\" (UID: \"2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f\") " pod="openshift-dns/dns-default-pv9kp"
Jul 18 11:20:53.931501 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.931361    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/672368e4-16b5-470b-9b7e-973867d923e9-trusted-ca\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.931501 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.931389    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39beca92-f03f-4ed9-958b-b3c2a1da17c5-data-volume\") pod \"insights-runtime-extractor-9rqst\" (UID: \"39beca92-f03f-4ed9-958b-b3c2a1da17c5\") " pod="openshift-insights/insights-runtime-extractor-9rqst"
Jul 18 11:20:53.931501 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.931410    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rx7m\" (UniqueName: \"kubernetes.io/projected/672368e4-16b5-470b-9b7e-973867d923e9-kube-api-access-9rx7m\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.931501 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.931446    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f-tmp-dir\") pod \"dns-default-pv9kp\" (UID: \"2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f\") " pod="openshift-dns/dns-default-pv9kp"
Jul 18 11:20:53.931719 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.931563    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cvfs\" (UniqueName: \"kubernetes.io/projected/39beca92-f03f-4ed9-958b-b3c2a1da17c5-kube-api-access-7cvfs\") pod \"insights-runtime-extractor-9rqst\" (UID: \"39beca92-f03f-4ed9-958b-b3c2a1da17c5\") " pod="openshift-insights/insights-runtime-extractor-9rqst"
Jul 18 11:20:53.931719 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.931596    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42mnn\" (UniqueName: \"kubernetes.io/projected/fced16a6-eb16-46c1-9a0e-d02dff750a17-kube-api-access-42mnn\") pod \"ingress-canary-zt4vp\" (UID: \"fced16a6-eb16-46c1-9a0e-d02dff750a17\") " pod="openshift-ingress-canary/ingress-canary-zt4vp"
Jul 18 11:20:53.931719 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.931620    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/672368e4-16b5-470b-9b7e-973867d923e9-image-registry-private-configuration\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.931719 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.931645    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/672368e4-16b5-470b-9b7e-973867d923e9-registry-tls\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.931719 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.931668    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/672368e4-16b5-470b-9b7e-973867d923e9-ca-trust-extracted\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.931719 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.931690    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/672368e4-16b5-470b-9b7e-973867d923e9-bound-sa-token\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.932019 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.931725    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fced16a6-eb16-46c1-9a0e-d02dff750a17-cert\") pod \"ingress-canary-zt4vp\" (UID: \"fced16a6-eb16-46c1-9a0e-d02dff750a17\") " pod="openshift-ingress-canary/ingress-canary-zt4vp"
Jul 18 11:20:53.932019 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.931755    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39beca92-f03f-4ed9-958b-b3c2a1da17c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9rqst\" (UID: \"39beca92-f03f-4ed9-958b-b3c2a1da17c5\") " pod="openshift-insights/insights-runtime-extractor-9rqst"
Jul 18 11:20:53.932019 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.931778    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f-config-volume\") pod \"dns-default-pv9kp\" (UID: \"2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f\") " pod="openshift-dns/dns-default-pv9kp"
Jul 18 11:20:53.932019 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.931802    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f-metrics-tls\") pod \"dns-default-pv9kp\" (UID: \"2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f\") " pod="openshift-dns/dns-default-pv9kp"
Jul 18 11:20:53.932019 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.931832    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/39beca92-f03f-4ed9-958b-b3c2a1da17c5-data-volume\") pod \"insights-runtime-extractor-9rqst\" (UID: \"39beca92-f03f-4ed9-958b-b3c2a1da17c5\") " pod="openshift-insights/insights-runtime-extractor-9rqst"
Jul 18 11:20:53.932019 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.931842    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39beca92-f03f-4ed9-958b-b3c2a1da17c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9rqst\" (UID: \"39beca92-f03f-4ed9-958b-b3c2a1da17c5\") " pod="openshift-insights/insights-runtime-extractor-9rqst"
Jul 18 11:20:53.932019 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.931847    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f-tmp-dir\") pod \"dns-default-pv9kp\" (UID: \"2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f\") " pod="openshift-dns/dns-default-pv9kp"
Jul 18 11:20:53.932019 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.931867    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/672368e4-16b5-470b-9b7e-973867d923e9-registry-certificates\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.932427 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.932072    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/672368e4-16b5-470b-9b7e-973867d923e9-ca-trust-extracted\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.932871 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.932689    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/672368e4-16b5-470b-9b7e-973867d923e9-registry-certificates\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.932871 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.932838    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/39beca92-f03f-4ed9-958b-b3c2a1da17c5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9rqst\" (UID: \"39beca92-f03f-4ed9-958b-b3c2a1da17c5\") " pod="openshift-insights/insights-runtime-extractor-9rqst"
Jul 18 11:20:53.933033 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.932878    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f-config-volume\") pod \"dns-default-pv9kp\" (UID: \"2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f\") " pod="openshift-dns/dns-default-pv9kp"
Jul 18 11:20:53.933033 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.932985    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39beca92-f03f-4ed9-958b-b3c2a1da17c5-crio-socket\") pod \"insights-runtime-extractor-9rqst\" (UID: \"39beca92-f03f-4ed9-958b-b3c2a1da17c5\") " pod="openshift-insights/insights-runtime-extractor-9rqst"
Jul 18 11:20:53.933033 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.933011    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/672368e4-16b5-470b-9b7e-973867d923e9-installation-pull-secrets\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.933193 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.933060    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/672368e4-16b5-470b-9b7e-973867d923e9-trusted-ca\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.933245 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.933227    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/39beca92-f03f-4ed9-958b-b3c2a1da17c5-crio-socket\") pod \"insights-runtime-extractor-9rqst\" (UID: \"39beca92-f03f-4ed9-958b-b3c2a1da17c5\") " pod="openshift-insights/insights-runtime-extractor-9rqst"
Jul 18 11:20:53.936132 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.936086    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/672368e4-16b5-470b-9b7e-973867d923e9-installation-pull-secrets\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.936132 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.936118    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/39beca92-f03f-4ed9-958b-b3c2a1da17c5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9rqst\" (UID: \"39beca92-f03f-4ed9-958b-b3c2a1da17c5\") " pod="openshift-insights/insights-runtime-extractor-9rqst"
Jul 18 11:20:53.936297 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.936111    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f-metrics-tls\") pod \"dns-default-pv9kp\" (UID: \"2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f\") " pod="openshift-dns/dns-default-pv9kp"
Jul 18 11:20:53.936297 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.936216    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/672368e4-16b5-470b-9b7e-973867d923e9-registry-tls\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.936297 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.936219    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fced16a6-eb16-46c1-9a0e-d02dff750a17-cert\") pod \"ingress-canary-zt4vp\" (UID: \"fced16a6-eb16-46c1-9a0e-d02dff750a17\") " pod="openshift-ingress-canary/ingress-canary-zt4vp"
Jul 18 11:20:53.936297 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.936216    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/672368e4-16b5-470b-9b7e-973867d923e9-image-registry-private-configuration\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.947680 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.947658    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cvfs\" (UniqueName: \"kubernetes.io/projected/39beca92-f03f-4ed9-958b-b3c2a1da17c5-kube-api-access-7cvfs\") pod \"insights-runtime-extractor-9rqst\" (UID: \"39beca92-f03f-4ed9-958b-b3c2a1da17c5\") " pod="openshift-insights/insights-runtime-extractor-9rqst"
Jul 18 11:20:53.947995 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.947796    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rx7m\" (UniqueName: \"kubernetes.io/projected/672368e4-16b5-470b-9b7e-973867d923e9-kube-api-access-9rx7m\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.948088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.948073    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/672368e4-16b5-470b-9b7e-973867d923e9-bound-sa-token\") pod \"image-registry-68999d7447-txfrt\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") " pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:53.948406 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.948384    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42mnn\" (UniqueName: \"kubernetes.io/projected/fced16a6-eb16-46c1-9a0e-d02dff750a17-kube-api-access-42mnn\") pod \"ingress-canary-zt4vp\" (UID: \"fced16a6-eb16-46c1-9a0e-d02dff750a17\") " pod="openshift-ingress-canary/ingress-canary-zt4vp"
Jul 18 11:20:53.948541 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:53.948523    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xftvw\" (UniqueName: \"kubernetes.io/projected/2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f-kube-api-access-xftvw\") pod \"dns-default-pv9kp\" (UID: \"2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f\") " pod="openshift-dns/dns-default-pv9kp"
Jul 18 11:20:54.069832 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:54.069797    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:54.087407 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:54.087383    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pv9kp"
Jul 18 11:20:54.095118 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:54.095078    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zt4vp"
Jul 18 11:20:54.116991 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:54.116967    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9rqst"
Jul 18 11:20:54.264220 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:54.264144    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68999d7447-txfrt"]
Jul 18 11:20:54.266995 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:54.266779    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pv9kp"]
Jul 18 11:20:54.271752 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:20:54.271714    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2031a1ee_5208_4fd6_8faa_68fdaa8c8b1f.slice/crio-332411a93e725a7c08863f07dd2d65753fea93ceb33938700c4c0c62a35f3fb4 WatchSource:0}: Error finding container 332411a93e725a7c08863f07dd2d65753fea93ceb33938700c4c0c62a35f3fb4: Status 404 returned error can't find the container with id 332411a93e725a7c08863f07dd2d65753fea93ceb33938700c4c0c62a35f3fb4
Jul 18 11:20:54.283638 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:54.283610    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zt4vp"]
Jul 18 11:20:54.300878 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:54.300827    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9rqst"]
Jul 18 11:20:54.304602 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:20:54.304579    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39beca92_f03f_4ed9_958b_b3c2a1da17c5.slice/crio-c11cf7311d82cd8985313e43563808f8623c59141548bfc2f1adce29e25ab587 WatchSource:0}: Error finding container c11cf7311d82cd8985313e43563808f8623c59141548bfc2f1adce29e25ab587: Status 404 returned error can't find the container with id c11cf7311d82cd8985313e43563808f8623c59141548bfc2f1adce29e25ab587
Jul 18 11:20:54.946917 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:54.946330    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:20:54.946917 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:54.946473    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:20:54.946917 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:54.946514    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:20:54.949079 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:54.949015    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 18 11:20:54.950509 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:54.950489    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 18 11:20:54.950843 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:54.950825    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s78sq\""
Jul 18 11:20:54.951033 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:54.951018    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 18 11:20:54.951285 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:54.951266    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b49zp\""
Jul 18 11:20:54.951729 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:54.951457    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 18 11:20:55.211751 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:55.211604    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9rqst" event={"ID":"39beca92-f03f-4ed9-958b-b3c2a1da17c5","Type":"ContainerStarted","Data":"c11cf7311d82cd8985313e43563808f8623c59141548bfc2f1adce29e25ab587"}
Jul 18 11:20:55.213457 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:55.213409    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zt4vp" event={"ID":"fced16a6-eb16-46c1-9a0e-d02dff750a17","Type":"ContainerStarted","Data":"d6e1c44cdee738452c75911afa168840ab328a0706edd23337efe8a63326ceb4"}
Jul 18 11:20:55.215934 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:55.215865    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pv9kp" event={"ID":"2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f","Type":"ContainerStarted","Data":"332411a93e725a7c08863f07dd2d65753fea93ceb33938700c4c0c62a35f3fb4"}
Jul 18 11:20:55.218010 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:55.217987    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68999d7447-txfrt" event={"ID":"672368e4-16b5-470b-9b7e-973867d923e9","Type":"ContainerStarted","Data":"7aaaf99b766aef3374020e7d8c142d8c665ee358a9de5d39eff45ecfe90d0b8b"}
Jul 18 11:20:55.218125 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:55.218067    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68999d7447-txfrt" event={"ID":"672368e4-16b5-470b-9b7e-973867d923e9","Type":"ContainerStarted","Data":"f8b6c2c63d267d5d599adc8e82f7fcb1883f02a44fb858bcf32f24cfcd6eb67f"}
Jul 18 11:20:55.218882 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:55.218863    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:20:55.247384 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:55.247157    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68999d7447-txfrt" podStartSLOduration=73.247137975 podStartE2EDuration="1m13.247137975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:19:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:20:55.245968581 +0000 UTC m=+56.848098325" watchObservedRunningTime="2026-07-18 11:20:55.247137975 +0000 UTC m=+56.849267697"
Jul 18 11:20:57.225335 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:57.225298    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pv9kp" event={"ID":"2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f","Type":"ContainerStarted","Data":"65cd8b696af75f074b92b2eff4360feea8bd168db5b2ea69a658cb270815f646"}
Jul 18 11:20:59.152675 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:59.152651    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5kkzl"
Jul 18 11:20:59.178894 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:59.178871    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-b6qwp"]
Jul 18 11:20:59.251843 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:59.251814    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-b6qwp"]
Jul 18 11:20:59.252001 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:59.251915    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-b6qwp"
Jul 18 11:20:59.254536 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:59.254510    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 18 11:20:59.254673 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:59.254595    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-bl562\""
Jul 18 11:20:59.382804 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:59.382776    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/33be1e8c-d7a8-4fc2-b2a2-1beb6b8236d7-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-b6qwp\" (UID: \"33be1e8c-d7a8-4fc2-b2a2-1beb6b8236d7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-b6qwp"
Jul 18 11:20:59.483956 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:59.483891    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/33be1e8c-d7a8-4fc2-b2a2-1beb6b8236d7-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-b6qwp\" (UID: \"33be1e8c-d7a8-4fc2-b2a2-1beb6b8236d7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-b6qwp"
Jul 18 11:20:59.487919 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:59.487859    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/33be1e8c-d7a8-4fc2-b2a2-1beb6b8236d7-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-b6qwp\" (UID: \"33be1e8c-d7a8-4fc2-b2a2-1beb6b8236d7\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-b6qwp"
Jul 18 11:20:59.559902 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:20:59.559874    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-b6qwp"
Jul 18 11:21:00.427325 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:00.427298    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-b6qwp"]
Jul 18 11:21:01.243209 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:01.243168    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9rqst" event={"ID":"39beca92-f03f-4ed9-958b-b3c2a1da17c5","Type":"ContainerStarted","Data":"7aef7f875c35f7590223d0acdf4c66de006abf6bb9984d4c87c64e41f0edc734"}
Jul 18 11:21:01.244700 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:01.244669    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-b6qwp" event={"ID":"33be1e8c-d7a8-4fc2-b2a2-1beb6b8236d7","Type":"ContainerStarted","Data":"331fea005c429614a74fb007052ab1fa670d320e2a69c7cd815f6762f1fd128a"}
Jul 18 11:21:01.246436 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:01.246382    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zt4vp" event={"ID":"fced16a6-eb16-46c1-9a0e-d02dff750a17","Type":"ContainerStarted","Data":"55f13a94e42367bbfc00100923384a50b91350456c7205e5b4fc750131422a42"}
Jul 18 11:21:01.248792 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:01.248766    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pv9kp" event={"ID":"2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f","Type":"ContainerStarted","Data":"1fc4ae3ee3a48de2d94e29167ac9a271396a35a53624e05815f2ebd6fd5b381f"}
Jul 18 11:21:01.248925 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:01.248908    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pv9kp"
Jul 18 11:21:01.261834 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:01.261787    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zt4vp" podStartSLOduration=2.262250786 podStartE2EDuration="8.261773676s" totalImagesPullingTime="5.99952289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:21:01.260439918 +0000 UTC m=+62.862569658" watchObservedRunningTime="2026-07-18 11:21:01.261773676 +0000 UTC m=+62.863903415"
Jul 18 11:21:01.275564 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:01.275451    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pv9kp" podStartSLOduration=6.361128854 podStartE2EDuration="8.275433417s" totalImagesPullingTime="1.914304563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:20:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:21:01.275310607 +0000 UTC m=+62.877440349" watchObservedRunningTime="2026-07-18 11:21:01.275433417 +0000 UTC m=+62.877563173"
Jul 18 11:21:02.253364 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:02.253323    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-b6qwp" event={"ID":"33be1e8c-d7a8-4fc2-b2a2-1beb6b8236d7","Type":"ContainerStarted","Data":"9e74c83452ac06c9c0851907e93b3d6cc53918c8523b24de99dd9ebc462344fd"}
Jul 18 11:21:02.267752 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:02.267704    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-b6qwp" podStartSLOduration=2.184808632 podStartE2EDuration="3.267689473s" totalImagesPullingTime="1.082880841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:20:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:21:02.267128021 +0000 UTC m=+63.869257758" watchObservedRunningTime="2026-07-18 11:21:02.267689473 +0000 UTC m=+63.869819212"
Jul 18 11:21:03.257639 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:03.257603    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-b6qwp"
Jul 18 11:21:03.262998 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:03.262973    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-b6qwp"
Jul 18 11:21:04.263202 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:04.263171    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9rqst" event={"ID":"39beca92-f03f-4ed9-958b-b3c2a1da17c5","Type":"ContainerStarted","Data":"89ce23c2ec7794ce746e1ae97ab2072ade0d1e1656f330c92f7d15c4f32cd7b1"}
Jul 18 11:21:04.728357 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:04.728257    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret\") pod \"global-pull-secret-syncer-tj4vh\" (UID: \"6a7e7704-fd0c-4d89-935e-ddf63f7082e1\") " pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:21:04.728357 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:04.728319    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpdd2\" (UniqueName: \"kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2\") pod \"network-check-target-z9cdq\" (UID: \"ac841995-3c3f-4f12-a8da-9467f87a401b\") " pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:21:04.728562 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:04.728371    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs\") pod \"network-metrics-daemon-wd67v\" (UID: \"f390acc5-cb52-4b39-a4fe-362b2b543fbf\") " pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:21:04.731170 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:04.731145    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 18 11:21:04.731669 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:04.731633    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 18 11:21:04.731751 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:04.731675    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 18 11:21:04.740638 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:04.740617    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 18 11:21:04.741138 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:04.741117    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a7e7704-fd0c-4d89-935e-ddf63f7082e1-original-pull-secret\") pod \"global-pull-secret-syncer-tj4vh\" (UID: \"6a7e7704-fd0c-4d89-935e-ddf63f7082e1\") " pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:21:04.741258 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:04.741153    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f390acc5-cb52-4b39-a4fe-362b2b543fbf-metrics-certs\") pod \"network-metrics-daemon-wd67v\" (UID: \"f390acc5-cb52-4b39-a4fe-362b2b543fbf\") " pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:21:04.751950 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:04.751925    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpdd2\" (UniqueName: \"kubernetes.io/projected/ac841995-3c3f-4f12-a8da-9467f87a401b-kube-api-access-zpdd2\") pod \"network-check-target-z9cdq\" (UID: \"ac841995-3c3f-4f12-a8da-9467f87a401b\") " pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:21:04.871187 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:04.871158    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tj4vh"
Jul 18 11:21:04.885904 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:04.885876    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-s78sq\""
Jul 18 11:21:04.891008 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:04.890987    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b49zp\""
Jul 18 11:21:04.893888 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:04.893868    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:21:04.899226 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:04.899204    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wd67v"
Jul 18 11:21:05.031243 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:05.031212    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tj4vh"]
Jul 18 11:21:05.036458 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:21:05.036425    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a7e7704_fd0c_4d89_935e_ddf63f7082e1.slice/crio-5351873bdad3403277e875edc45f44864e4542da50afcdd8f38b38e8a344a988 WatchSource:0}: Error finding container 5351873bdad3403277e875edc45f44864e4542da50afcdd8f38b38e8a344a988: Status 404 returned error can't find the container with id 5351873bdad3403277e875edc45f44864e4542da50afcdd8f38b38e8a344a988
Jul 18 11:21:05.055416 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:05.055389    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wd67v"]
Jul 18 11:21:05.059454 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:21:05.059425    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf390acc5_cb52_4b39_a4fe_362b2b543fbf.slice/crio-6a356b3ba1baa488755367bebf3977783dc6732d650ac71e4a6c4f97cd90652a WatchSource:0}: Error finding container 6a356b3ba1baa488755367bebf3977783dc6732d650ac71e4a6c4f97cd90652a: Status 404 returned error can't find the container with id 6a356b3ba1baa488755367bebf3977783dc6732d650ac71e4a6c4f97cd90652a
Jul 18 11:21:05.076352 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:05.076318    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z9cdq"]
Jul 18 11:21:05.079328 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:21:05.079301    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac841995_3c3f_4f12_a8da_9467f87a401b.slice/crio-9f37fe53a13da24d419329692e08e48c7d92b0cf2b80d6273751cc22fc4cec75 WatchSource:0}: Error finding container 9f37fe53a13da24d419329692e08e48c7d92b0cf2b80d6273751cc22fc4cec75: Status 404 returned error can't find the container with id 9f37fe53a13da24d419329692e08e48c7d92b0cf2b80d6273751cc22fc4cec75
Jul 18 11:21:05.271791 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:05.271700    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wd67v" event={"ID":"f390acc5-cb52-4b39-a4fe-362b2b543fbf","Type":"ContainerStarted","Data":"6a356b3ba1baa488755367bebf3977783dc6732d650ac71e4a6c4f97cd90652a"}
Jul 18 11:21:05.273013 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:05.272986    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tj4vh" event={"ID":"6a7e7704-fd0c-4d89-935e-ddf63f7082e1","Type":"ContainerStarted","Data":"5351873bdad3403277e875edc45f44864e4542da50afcdd8f38b38e8a344a988"}
Jul 18 11:21:05.274278 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:05.274253    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z9cdq" event={"ID":"ac841995-3c3f-4f12-a8da-9467f87a401b","Type":"ContainerStarted","Data":"9f37fe53a13da24d419329692e08e48c7d92b0cf2b80d6273751cc22fc4cec75"}
Jul 18 11:21:08.256111 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:08.256074    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pv9kp"
Jul 18 11:21:09.583607 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.583574    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9zv49"]
Jul 18 11:21:09.587848 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.587825    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.590447 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.590422    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 18 11:21:09.590556 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.590422    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kw9x4\""
Jul 18 11:21:09.590556 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.590472    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 18 11:21:09.591187 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.591128    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 18 11:21:09.591285 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.591206    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 18 11:21:09.591285 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.591258    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 18 11:21:09.591490 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.591465    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 18 11:21:09.664659 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.664628    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a37b360-f039-4518-9f80-0ac803dde189-node-exporter-tls\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.664852 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.664676    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a37b360-f039-4518-9f80-0ac803dde189-root\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.664852 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.664706    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a37b360-f039-4518-9f80-0ac803dde189-node-exporter-textfile\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.664852 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.664776    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a37b360-f039-4518-9f80-0ac803dde189-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.664852 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.664833    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a37b360-f039-4518-9f80-0ac803dde189-node-exporter-wtmp\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.665031 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.664864    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtbrc\" (UniqueName: \"kubernetes.io/projected/4a37b360-f039-4518-9f80-0ac803dde189-kube-api-access-mtbrc\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.665031 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.664909    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a37b360-f039-4518-9f80-0ac803dde189-metrics-client-ca\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.665031 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.664929    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a37b360-f039-4518-9f80-0ac803dde189-node-exporter-accelerators-collector-config\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.665031 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.664962    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a37b360-f039-4518-9f80-0ac803dde189-sys\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.765598 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.765566    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a37b360-f039-4518-9f80-0ac803dde189-node-exporter-accelerators-collector-config\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.765844 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.765619    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a37b360-f039-4518-9f80-0ac803dde189-sys\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.765844 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.765645    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a37b360-f039-4518-9f80-0ac803dde189-node-exporter-tls\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.765844 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.765676    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a37b360-f039-4518-9f80-0ac803dde189-root\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.765844 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.765702    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a37b360-f039-4518-9f80-0ac803dde189-node-exporter-textfile\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.765844 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.765712    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a37b360-f039-4518-9f80-0ac803dde189-sys\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.765844 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.765744    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a37b360-f039-4518-9f80-0ac803dde189-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.765844 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.765775    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a37b360-f039-4518-9f80-0ac803dde189-node-exporter-wtmp\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.765844 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.765778    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a37b360-f039-4518-9f80-0ac803dde189-root\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.765844 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.765796    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtbrc\" (UniqueName: \"kubernetes.io/projected/4a37b360-f039-4518-9f80-0ac803dde189-kube-api-access-mtbrc\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.766330 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.765907    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a37b360-f039-4518-9f80-0ac803dde189-node-exporter-wtmp\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.766330 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.765942    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a37b360-f039-4518-9f80-0ac803dde189-metrics-client-ca\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.766330 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.766090    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a37b360-f039-4518-9f80-0ac803dde189-node-exporter-textfile\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.766330 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:21:09.766184    2554 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 18 11:21:09.766330 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.766196    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a37b360-f039-4518-9f80-0ac803dde189-node-exporter-accelerators-collector-config\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.766330 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:21:09.766245    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a37b360-f039-4518-9f80-0ac803dde189-node-exporter-tls podName:4a37b360-f039-4518-9f80-0ac803dde189 nodeName:}" failed. No retries permitted until 2026-07-18 11:21:10.266226337 +0000 UTC m=+71.868356056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4a37b360-f039-4518-9f80-0ac803dde189-node-exporter-tls") pod "node-exporter-9zv49" (UID: "4a37b360-f039-4518-9f80-0ac803dde189") : secret "node-exporter-tls" not found
Jul 18 11:21:09.766604 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.766437    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a37b360-f039-4518-9f80-0ac803dde189-metrics-client-ca\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.768590 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.768566    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a37b360-f039-4518-9f80-0ac803dde189-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:09.774786 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:09.774758    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtbrc\" (UniqueName: \"kubernetes.io/projected/4a37b360-f039-4518-9f80-0ac803dde189-kube-api-access-mtbrc\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:10.271505 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.271480    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a37b360-f039-4518-9f80-0ac803dde189-node-exporter-tls\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:10.273899 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.273853    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a37b360-f039-4518-9f80-0ac803dde189-node-exporter-tls\") pod \"node-exporter-9zv49\" (UID: \"4a37b360-f039-4518-9f80-0ac803dde189\") " pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:10.296318 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.296269    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9rqst" event={"ID":"39beca92-f03f-4ed9-958b-b3c2a1da17c5","Type":"ContainerStarted","Data":"148ae3c02bd410c69a60de6827cf0437c329d64cdbfc4c1ae30b36bd2761c05e"}
Jul 18 11:21:10.297640 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.297619    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wd67v" event={"ID":"f390acc5-cb52-4b39-a4fe-362b2b543fbf","Type":"ContainerStarted","Data":"22e85fc3719e5fb44a9fae46e9134cc23ba87fc540fc8e6b138b96d877f70044"}
Jul 18 11:21:10.299034 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.298970    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z9cdq" event={"ID":"ac841995-3c3f-4f12-a8da-9467f87a401b","Type":"ContainerStarted","Data":"e5d65352db10a4e7681fd0ec4b10682f8ebbd7288821aa7826b6cd8e9b74d4a1"}
Jul 18 11:21:10.300013 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.299158    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:21:10.316684 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.316636    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9rqst" podStartSLOduration=1.557720141 podStartE2EDuration="17.316618081s" totalImagesPullingTime="15.75889794s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:20:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:21:10.315251969 +0000 UTC m=+71.917381723" watchObservedRunningTime="2026-07-18 11:21:10.316618081 +0000 UTC m=+71.918747820"
Jul 18 11:21:10.334328 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.334279    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z9cdq" podStartSLOduration=66.215178464 podStartE2EDuration="1m11.334261334s" totalImagesPullingTime="5.11908287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:19:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:21:10.332903233 +0000 UTC m=+71.935032999" watchObservedRunningTime="2026-07-18 11:21:10.334261334 +0000 UTC m=+71.936391073"
Jul 18 11:21:10.499350 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.499311    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9zv49"
Jul 18 11:21:10.510837 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:21:10.510806    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a37b360_f039_4518_9f80_0ac803dde189.slice/crio-c9ef2005dcec1eeecca237321b538257107697a69f18b9577f2c9c50760bce24 WatchSource:0}: Error finding container c9ef2005dcec1eeecca237321b538257107697a69f18b9577f2c9c50760bce24: Status 404 returned error can't find the container with id c9ef2005dcec1eeecca237321b538257107697a69f18b9577f2c9c50760bce24
Jul 18 11:21:10.652207 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.652148    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 11:21:10.656757 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.656734    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.659183 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.659162    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 18 11:21:10.659321 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.659218    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 18 11:21:10.659598 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.659583    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 18 11:21:10.660227 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.660213    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sg7v4\""
Jul 18 11:21:10.660545 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.660495    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 18 11:21:10.660545 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.660509    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 18 11:21:10.660545 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.660511    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 18 11:21:10.660727 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.660549    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 18 11:21:10.660727 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.660513    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 18 11:21:10.660727 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.660511    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 18 11:21:10.675141 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.675115    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 11:21:10.774042 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.773971    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f181cb0-e648-434e-9cd9-989f85b8b290-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.774042 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.774015    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-config-volume\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.774221 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.774044    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.774221 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.774089    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f181cb0-e648-434e-9cd9-989f85b8b290-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.774221 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.774143    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-web-config\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.774221 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.774162    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f181cb0-e648-434e-9cd9-989f85b8b290-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.774221 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.774201    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rhcp\" (UniqueName: \"kubernetes.io/projected/9f181cb0-e648-434e-9cd9-989f85b8b290-kube-api-access-8rhcp\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.774365 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.774224    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f181cb0-e648-434e-9cd9-989f85b8b290-config-out\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.774365 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.774247    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.774365 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.774300    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.774365 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.774325    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.774365 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.774349    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.774513 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.774370    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f181cb0-e648-434e-9cd9-989f85b8b290-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.875209 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.875169    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f181cb0-e648-434e-9cd9-989f85b8b290-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.875381 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.875227    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f181cb0-e648-434e-9cd9-989f85b8b290-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.875381 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.875256    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-config-volume\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.875381 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.875288    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.875381 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.875315    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f181cb0-e648-434e-9cd9-989f85b8b290-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.875381 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:21:10.875354    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9f181cb0-e648-434e-9cd9-989f85b8b290-alertmanager-trusted-ca-bundle podName:9f181cb0-e648-434e-9cd9-989f85b8b290 nodeName:}" failed. No retries permitted until 2026-07-18 11:21:11.375329649 +0000 UTC m=+72.977459375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/9f181cb0-e648-434e-9cd9-989f85b8b290-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "9f181cb0-e648-434e-9cd9-989f85b8b290") : configmap references non-existent config key: ca-bundle.crt
Jul 18 11:21:10.875954 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.875388    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-web-config\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.875954 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.875414    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f181cb0-e648-434e-9cd9-989f85b8b290-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.875954 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.875439    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rhcp\" (UniqueName: \"kubernetes.io/projected/9f181cb0-e648-434e-9cd9-989f85b8b290-kube-api-access-8rhcp\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.875954 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.875630    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f181cb0-e648-434e-9cd9-989f85b8b290-config-out\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.875954 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.875668    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.875954 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.875697    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.875954 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.875724    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.875954 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.875759    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.875954 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.875769    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f181cb0-e648-434e-9cd9-989f85b8b290-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.876432 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:21:10.876153    2554 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 18 11:21:10.876432 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:21:10.876211    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-main-tls podName:9f181cb0-e648-434e-9cd9-989f85b8b290 nodeName:}" failed. No retries permitted until 2026-07-18 11:21:11.376194077 +0000 UTC m=+72.978323794 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "9f181cb0-e648-434e-9cd9-989f85b8b290") : secret "alertmanager-main-tls" not found
Jul 18 11:21:10.876432 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.876412    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f181cb0-e648-434e-9cd9-989f85b8b290-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.878230 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.878188    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f181cb0-e648-434e-9cd9-989f85b8b290-config-out\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.878230 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.878190    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-config-volume\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.878363 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.878244    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f181cb0-e648-434e-9cd9-989f85b8b290-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.878494 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.878450    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.878494 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.878472    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.878608 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.878554    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-web-config\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.878766 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.878746    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.879527 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.879512    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:10.882847 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:10.882828    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rhcp\" (UniqueName: \"kubernetes.io/projected/9f181cb0-e648-434e-9cd9-989f85b8b290-kube-api-access-8rhcp\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:11.304759 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:11.304707    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9zv49" event={"ID":"4a37b360-f039-4518-9f80-0ac803dde189","Type":"ContainerStarted","Data":"c9ef2005dcec1eeecca237321b538257107697a69f18b9577f2c9c50760bce24"}
Jul 18 11:21:11.306905 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:11.306842    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wd67v" event={"ID":"f390acc5-cb52-4b39-a4fe-362b2b543fbf","Type":"ContainerStarted","Data":"af6d3c86d46ee8c40b909cdb3c6aab33752e30a25698385616c7ebc3a14a6f8c"}
Jul 18 11:21:11.308542 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:11.308476    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tj4vh" event={"ID":"6a7e7704-fd0c-4d89-935e-ddf63f7082e1","Type":"ContainerStarted","Data":"d0b2d31c2c92e50d06416643086b77463642683f7a77158b2acd60cf3398cd40"}
Jul 18 11:21:11.321693 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:11.321636    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wd67v" podStartSLOduration=67.186973865 podStartE2EDuration="1m12.321616659s" totalImagesPullingTime="5.134642794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:19:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:21:11.321044616 +0000 UTC m=+72.923174346" watchObservedRunningTime="2026-07-18 11:21:11.321616659 +0000 UTC m=+72.923746400"
Jul 18 11:21:11.335506 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:11.335439    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tj4vh" podStartSLOduration=67.158665062 podStartE2EDuration="1m12.335423368s" totalImagesPullingTime="5.176758306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 11:19:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:21:11.335351272 +0000 UTC m=+72.937481035" watchObservedRunningTime="2026-07-18 11:21:11.335423368 +0000 UTC m=+72.937553106"
Jul 18 11:21:11.380955 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:11.380920    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:11.381139 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:11.380990    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f181cb0-e648-434e-9cd9-989f85b8b290-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:11.381959 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:11.381930    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f181cb0-e648-434e-9cd9-989f85b8b290-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:11.383303 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:11.383285    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:11.565920 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:11.565864    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:21:11.690034 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:11.690002    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 11:21:11.692543 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:21:11.692519    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f181cb0_e648_434e_9cd9_989f85b8b290.slice/crio-b24eb739beb1d8fac12d5da3d6ef49d86aed934a170419c466efc2b43e71bd4a WatchSource:0}: Error finding container b24eb739beb1d8fac12d5da3d6ef49d86aed934a170419c466efc2b43e71bd4a: Status 404 returned error can't find the container with id b24eb739beb1d8fac12d5da3d6ef49d86aed934a170419c466efc2b43e71bd4a
Jul 18 11:21:12.313963 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:12.313885    2554 generic.go:356] "Generic (PLEG): container finished" podID="4a37b360-f039-4518-9f80-0ac803dde189" containerID="dd2c0dfcdad224167270d9777e47ef6ff13bf701bf8598209838a63dabbcb1fd" exitCode=0
Jul 18 11:21:12.313963 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:12.313928    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9zv49" event={"ID":"4a37b360-f039-4518-9f80-0ac803dde189","Type":"ContainerDied","Data":"dd2c0dfcdad224167270d9777e47ef6ff13bf701bf8598209838a63dabbcb1fd"}
Jul 18 11:21:12.315437 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:12.315412    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f181cb0-e648-434e-9cd9-989f85b8b290","Type":"ContainerStarted","Data":"b24eb739beb1d8fac12d5da3d6ef49d86aed934a170419c466efc2b43e71bd4a"}
Jul 18 11:21:13.320398 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.320362    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9zv49" event={"ID":"4a37b360-f039-4518-9f80-0ac803dde189","Type":"ContainerStarted","Data":"a18c870bc64c7bfdde8cb57b292053037e30d0cbac0faea5d9619d8d7be1279f"}
Jul 18 11:21:13.320779 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.320419    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9zv49" event={"ID":"4a37b360-f039-4518-9f80-0ac803dde189","Type":"ContainerStarted","Data":"0f6cd8de65436f9e31141d83e894337107b5317d788829b97b0ae8235b306735"}
Jul 18 11:21:13.321707 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.321685    2554 generic.go:356] "Generic (PLEG): container finished" podID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerID="ac60f420f913640090d3fb1b09f4efadaaccf5303fda0b5582c1aa7a74a6dfd8" exitCode=0
Jul 18 11:21:13.321807 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.321717    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f181cb0-e648-434e-9cd9-989f85b8b290","Type":"ContainerDied","Data":"ac60f420f913640090d3fb1b09f4efadaaccf5303fda0b5582c1aa7a74a6dfd8"}
Jul 18 11:21:13.339255 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.339215    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9zv49" podStartSLOduration=3.377307816 podStartE2EDuration="4.339202713s" totalImagesPullingTime="902.781847ms" totalInitContainerRuntime="59.11305ms" isStatefulPod=true podCreationTimestamp="2026-07-18 11:21:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:21:13.337495316 +0000 UTC m=+74.939625053" watchObservedRunningTime="2026-07-18 11:21:13.339202713 +0000 UTC m=+74.941332452"
Jul 18 11:21:13.821143 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.821111    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77959d4b8b-mb5nn"]
Jul 18 11:21:13.824170 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.824150    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:13.832160 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.831938    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 18 11:21:13.832160 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.831938    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 18 11:21:13.832299 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.832239    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 18 11:21:13.832354 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.832333    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 18 11:21:13.832405 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.832356    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 18 11:21:13.832453 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.832418    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 18 11:21:13.832774 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.832751    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 18 11:21:13.832881 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.832755    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-t4pht\""
Jul 18 11:21:13.838046 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.838026    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77959d4b8b-mb5nn"]
Jul 18 11:21:13.898863 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.898832    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/735e7cc9-7878-4043-b723-b5a05568c723-console-config\") pod \"console-77959d4b8b-mb5nn\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") " pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:13.898863 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.898875    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng6xl\" (UniqueName: \"kubernetes.io/projected/735e7cc9-7878-4043-b723-b5a05568c723-kube-api-access-ng6xl\") pod \"console-77959d4b8b-mb5nn\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") " pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:13.899080 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.898933    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/735e7cc9-7878-4043-b723-b5a05568c723-service-ca\") pod \"console-77959d4b8b-mb5nn\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") " pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:13.899080 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.898961    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/735e7cc9-7878-4043-b723-b5a05568c723-oauth-serving-cert\") pod \"console-77959d4b8b-mb5nn\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") " pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:13.899080 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.898991    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/735e7cc9-7878-4043-b723-b5a05568c723-console-oauth-config\") pod \"console-77959d4b8b-mb5nn\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") " pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:13.899080 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.899066    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/735e7cc9-7878-4043-b723-b5a05568c723-console-serving-cert\") pod \"console-77959d4b8b-mb5nn\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") " pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:13.999516 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.999478    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/735e7cc9-7878-4043-b723-b5a05568c723-console-serving-cert\") pod \"console-77959d4b8b-mb5nn\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") " pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:13.999689 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.999533    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/735e7cc9-7878-4043-b723-b5a05568c723-console-config\") pod \"console-77959d4b8b-mb5nn\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") " pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:13.999689 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.999568    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng6xl\" (UniqueName: \"kubernetes.io/projected/735e7cc9-7878-4043-b723-b5a05568c723-kube-api-access-ng6xl\") pod \"console-77959d4b8b-mb5nn\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") " pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:13.999689 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.999627    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/735e7cc9-7878-4043-b723-b5a05568c723-service-ca\") pod \"console-77959d4b8b-mb5nn\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") " pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:13.999689 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.999667    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/735e7cc9-7878-4043-b723-b5a05568c723-oauth-serving-cert\") pod \"console-77959d4b8b-mb5nn\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") " pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:13.999888 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:13.999699    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/735e7cc9-7878-4043-b723-b5a05568c723-console-oauth-config\") pod \"console-77959d4b8b-mb5nn\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") " pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:14.000544 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:14.000497    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/735e7cc9-7878-4043-b723-b5a05568c723-console-config\") pod \"console-77959d4b8b-mb5nn\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") " pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:14.000544 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:14.000497    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/735e7cc9-7878-4043-b723-b5a05568c723-oauth-serving-cert\") pod \"console-77959d4b8b-mb5nn\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") " pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:14.000960 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:14.000933    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/735e7cc9-7878-4043-b723-b5a05568c723-service-ca\") pod \"console-77959d4b8b-mb5nn\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") " pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:14.002223 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:14.002196    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/735e7cc9-7878-4043-b723-b5a05568c723-console-oauth-config\") pod \"console-77959d4b8b-mb5nn\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") " pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:14.002412 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:14.002396    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/735e7cc9-7878-4043-b723-b5a05568c723-console-serving-cert\") pod \"console-77959d4b8b-mb5nn\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") " pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:14.007731 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:14.007712    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng6xl\" (UniqueName: \"kubernetes.io/projected/735e7cc9-7878-4043-b723-b5a05568c723-kube-api-access-ng6xl\") pod \"console-77959d4b8b-mb5nn\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") " pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:14.074835 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:14.074763    2554 patch_prober.go:28] interesting pod/image-registry-68999d7447-txfrt container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 18 11:21:14.074969 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:14.074821    2554 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-68999d7447-txfrt" podUID="672368e4-16b5-470b-9b7e-973867d923e9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 18 11:21:14.135836 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:14.135807    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:14.258308 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:14.258279    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77959d4b8b-mb5nn"]
Jul 18 11:21:14.260904 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:21:14.260877    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod735e7cc9_7878_4043_b723_b5a05568c723.slice/crio-5adda2abadac78e86fe9490153d2760d7a3e8704945956f5467fe63ef72ac8c3 WatchSource:0}: Error finding container 5adda2abadac78e86fe9490153d2760d7a3e8704945956f5467fe63ef72ac8c3: Status 404 returned error can't find the container with id 5adda2abadac78e86fe9490153d2760d7a3e8704945956f5467fe63ef72ac8c3
Jul 18 11:21:14.327338 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:14.327251    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77959d4b8b-mb5nn" event={"ID":"735e7cc9-7878-4043-b723-b5a05568c723","Type":"ContainerStarted","Data":"5adda2abadac78e86fe9490153d2760d7a3e8704945956f5467fe63ef72ac8c3"}
Jul 18 11:21:15.333813 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.333782    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f181cb0-e648-434e-9cd9-989f85b8b290","Type":"ContainerStarted","Data":"15ff2c844d21737a52cbe49bf4848156a9cee88bdaefd589c7ff72aac356767e"}
Jul 18 11:21:15.334174 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.333841    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f181cb0-e648-434e-9cd9-989f85b8b290","Type":"ContainerStarted","Data":"9b1955ab319eb076cd4d3970812fc65e1a535d69c6f8ac698eef14697b4545e9"}
Jul 18 11:21:15.334174 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.333867    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f181cb0-e648-434e-9cd9-989f85b8b290","Type":"ContainerStarted","Data":"947f83e715a93c18bf66e85f224042de5a02e5a957beabe90bd59100282759dc"}
Jul 18 11:21:15.334174 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.333889    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f181cb0-e648-434e-9cd9-989f85b8b290","Type":"ContainerStarted","Data":"ae77419c82dec4b97d09944c4d8c504dbd3f91f7189290b592b8550905e472c4"}
Jul 18 11:21:15.334174 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.333913    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f181cb0-e648-434e-9cd9-989f85b8b290","Type":"ContainerStarted","Data":"da1c54ef783cb33ee8317a1a96b13af1186c7b2f2c9661313630d48da75dd075"}
Jul 18 11:21:15.875798 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.875755    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 11:21:15.880084 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.880061    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:15.882864 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.882574    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 18 11:21:15.882864 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.882597    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 18 11:21:15.882864 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.882660    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 18 11:21:15.882864 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.882750    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 18 11:21:15.882864 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.882768    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 18 11:21:15.882864 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.882784    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 18 11:21:15.883216 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.883002    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5rsfq\""
Jul 18 11:21:15.884117 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.883920    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 18 11:21:15.884117 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.883952    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 18 11:21:15.884274 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.884232    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 18 11:21:15.884984 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.884366    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 18 11:21:15.884984 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.884485    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 18 11:21:15.884984 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.884526    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8vm6fqm5gkt1j\""
Jul 18 11:21:15.884984 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.884582    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 18 11:21:15.884984 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.884849    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 18 11:21:15.884984 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.884879    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 18 11:21:15.886080 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.885918    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 18 11:21:15.894378 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:15.894300    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 11:21:16.015830 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.015800    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.015946 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.015844    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfbb4e42-4cd9-4397-8aab-28160b4a8351-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.015946 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.015874    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.015946 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.015898    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.015946 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.015923    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.016187 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.015974    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.016187 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.016011    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.016187 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.016033    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4e42-4cd9-4397-8aab-28160b4a8351-config-out\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.016187 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.016049    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.016187 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.016078    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.016187 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.016161    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.016477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.016179    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-web-config\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.016477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.016222    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.016477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.016249    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.016477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.016267    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.016477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.016285    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.016477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.016384    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5c66\" (UniqueName: \"kubernetes.io/projected/bfbb4e42-4cd9-4397-8aab-28160b4a8351-kube-api-access-f5c66\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.016477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.016428    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.016477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.016458    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-config\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.016846 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.016498    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.117649 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.117614    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.117822 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.117661    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.117822 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.117693    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.117822 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.117739    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5c66\" (UniqueName: \"kubernetes.io/projected/bfbb4e42-4cd9-4397-8aab-28160b4a8351-kube-api-access-f5c66\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.117822 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.117764    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.117822 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.117780    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-config\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.117822 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.117802    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.118173 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.117834    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.118173 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.117857    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfbb4e42-4cd9-4397-8aab-28160b4a8351-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.118173 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.117878    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.118173 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.117902    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.118173 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.117931    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.118173 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.117969    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.118173 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.117992    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.118173 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.118022    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4e42-4cd9-4397-8aab-28160b4a8351-config-out\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.118173 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.118048    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.118173 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.118084    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.118173 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.118142    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.118173 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.118165    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-web-config\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.118173 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.118195    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.118968 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.118368    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.118968 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.118633    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.118968 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.118772    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.118968 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.118892    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.119165 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.118981    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.119619 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.119277    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.120973 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.120887    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.121351 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.121329    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.122831 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.122792    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-config\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.123059 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.123032    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.123775 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.123395    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-web-config\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.123775 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.123588    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.123775 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.123735    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.123963 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.123867    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.124654 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.124548    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfbb4e42-4cd9-4397-8aab-28160b4a8351-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.124989 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.124956    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4e42-4cd9-4397-8aab-28160b4a8351-config-out\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.125078 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.124991    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.125990 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.125935    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.126490 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.126467    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.127045 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.127024    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5c66\" (UniqueName: \"kubernetes.io/projected/bfbb4e42-4cd9-4397-8aab-28160b4a8351-kube-api-access-f5c66\") pod \"prometheus-k8s-0\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.194898 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.194857    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:16.340627 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.340595    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f181cb0-e648-434e-9cd9-989f85b8b290","Type":"ContainerStarted","Data":"c0906832a48c4b6f9c4531a0ec77f7096e876e2ac3779a94996d9ba0e098e318"}
Jul 18 11:21:16.365108 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:16.365038    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.978205106 podStartE2EDuration="6.365019402s" totalImagesPullingTime="3.369409554s" totalInitContainerRuntime="17.404742ms" isStatefulPod=false podCreationTimestamp="2026-07-18 11:21:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:21:16.364567244 +0000 UTC m=+77.966697021" watchObservedRunningTime="2026-07-18 11:21:16.365019402 +0000 UTC m=+77.967149143"
Jul 18 11:21:17.219145 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:17.219120    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 11:21:17.219695 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:21:17.219672    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfbb4e42_4cd9_4397_8aab_28160b4a8351.slice/crio-5fa8a3818ef98ad6e0e256c93bfd3d74d92d447e4c307f2796d9ab7d972683de WatchSource:0}: Error finding container 5fa8a3818ef98ad6e0e256c93bfd3d74d92d447e4c307f2796d9ab7d972683de: Status 404 returned error can't find the container with id 5fa8a3818ef98ad6e0e256c93bfd3d74d92d447e4c307f2796d9ab7d972683de
Jul 18 11:21:17.230652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:17.230635    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:21:17.347540 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:17.347483    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77959d4b8b-mb5nn" event={"ID":"735e7cc9-7878-4043-b723-b5a05568c723","Type":"ContainerStarted","Data":"eb9cd58a80f808ef5ab275ed5118829bbd17bebd0f645f6d5c7bd589fb4a1b0d"}
Jul 18 11:21:17.348828 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:17.348802    2554 generic.go:356] "Generic (PLEG): container finished" podID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerID="d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24" exitCode=0
Jul 18 11:21:17.348938 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:17.348843    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfbb4e42-4cd9-4397-8aab-28160b4a8351","Type":"ContainerDied","Data":"d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24"}
Jul 18 11:21:17.348938 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:17.348919    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfbb4e42-4cd9-4397-8aab-28160b4a8351","Type":"ContainerStarted","Data":"5fa8a3818ef98ad6e0e256c93bfd3d74d92d447e4c307f2796d9ab7d972683de"}
Jul 18 11:21:17.363139 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:17.363079    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77959d4b8b-mb5nn" podStartSLOduration=1.482953108 podStartE2EDuration="4.363063476s" totalImagesPullingTime="2.880110368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:21:17.361909557 +0000 UTC m=+78.964039295" watchObservedRunningTime="2026-07-18 11:21:17.363063476 +0000 UTC m=+78.965193214"
Jul 18 11:21:20.364969 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:20.364927    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfbb4e42-4cd9-4397-8aab-28160b4a8351","Type":"ContainerStarted","Data":"fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a"}
Jul 18 11:21:20.365416 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:20.365017    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfbb4e42-4cd9-4397-8aab-28160b4a8351","Type":"ContainerStarted","Data":"74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b"}
Jul 18 11:21:20.532391 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:20.532353    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68999d7447-txfrt"]
Jul 18 11:21:22.375845 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:22.375811    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfbb4e42-4cd9-4397-8aab-28160b4a8351","Type":"ContainerStarted","Data":"6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9"}
Jul 18 11:21:22.376232 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:22.375878    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfbb4e42-4cd9-4397-8aab-28160b4a8351","Type":"ContainerStarted","Data":"a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1"}
Jul 18 11:21:22.376232 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:22.375905    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfbb4e42-4cd9-4397-8aab-28160b4a8351","Type":"ContainerStarted","Data":"79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5"}
Jul 18 11:21:22.376232 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:22.375928    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfbb4e42-4cd9-4397-8aab-28160b4a8351","Type":"ContainerStarted","Data":"a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689"}
Jul 18 11:21:22.406472 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:22.406407    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.086041471 podStartE2EDuration="7.406386141s" totalImagesPullingTime="4.300042084s" totalInitContainerRuntime="20.302586ms" isStatefulPod=false podCreationTimestamp="2026-07-18 11:21:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:21:22.404218225 +0000 UTC m=+84.006347963" watchObservedRunningTime="2026-07-18 11:21:22.406386141 +0000 UTC m=+84.008515877"
Jul 18 11:21:24.136205 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:24.136169    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:24.136661 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:24.136232    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:24.141231 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:24.141209    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:24.390564 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:24.387212    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:26.196025 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:26.195985    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:21:34.332851 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:34.332816    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77959d4b8b-mb5nn"]
Jul 18 11:21:41.311234 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:41.311203    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z9cdq"
Jul 18 11:21:45.556279 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:45.556240    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68999d7447-txfrt" podUID="672368e4-16b5-470b-9b7e-973867d923e9" containerName="registry" containerID="cri-o://7aaaf99b766aef3374020e7d8c142d8c665ee358a9de5d39eff45ecfe90d0b8b" gracePeriod=30
Jul 18 11:21:46.323532 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.323505    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:21:46.345967 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.345939    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/672368e4-16b5-470b-9b7e-973867d923e9-installation-pull-secrets\") pod \"672368e4-16b5-470b-9b7e-973867d923e9\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") "
Jul 18 11:21:46.346159 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.345978    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/672368e4-16b5-470b-9b7e-973867d923e9-bound-sa-token\") pod \"672368e4-16b5-470b-9b7e-973867d923e9\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") "
Jul 18 11:21:46.346159 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.346003    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/672368e4-16b5-470b-9b7e-973867d923e9-image-registry-private-configuration\") pod \"672368e4-16b5-470b-9b7e-973867d923e9\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") "
Jul 18 11:21:46.346159 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.346055    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/672368e4-16b5-470b-9b7e-973867d923e9-registry-certificates\") pod \"672368e4-16b5-470b-9b7e-973867d923e9\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") "
Jul 18 11:21:46.346159 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.346111    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rx7m\" (UniqueName: \"kubernetes.io/projected/672368e4-16b5-470b-9b7e-973867d923e9-kube-api-access-9rx7m\") pod \"672368e4-16b5-470b-9b7e-973867d923e9\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") "
Jul 18 11:21:46.346358 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.346169    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/672368e4-16b5-470b-9b7e-973867d923e9-trusted-ca\") pod \"672368e4-16b5-470b-9b7e-973867d923e9\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") "
Jul 18 11:21:46.346358 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.346201    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/672368e4-16b5-470b-9b7e-973867d923e9-ca-trust-extracted\") pod \"672368e4-16b5-470b-9b7e-973867d923e9\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") "
Jul 18 11:21:46.346358 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.346235    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/672368e4-16b5-470b-9b7e-973867d923e9-registry-tls\") pod \"672368e4-16b5-470b-9b7e-973867d923e9\" (UID: \"672368e4-16b5-470b-9b7e-973867d923e9\") "
Jul 18 11:21:46.346505 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.346461    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/672368e4-16b5-470b-9b7e-973867d923e9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "672368e4-16b5-470b-9b7e-973867d923e9" (UID: "672368e4-16b5-470b-9b7e-973867d923e9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:21:46.347062 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.347018    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/672368e4-16b5-470b-9b7e-973867d923e9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "672368e4-16b5-470b-9b7e-973867d923e9" (UID: "672368e4-16b5-470b-9b7e-973867d923e9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:21:46.348615 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.348559    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/672368e4-16b5-470b-9b7e-973867d923e9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "672368e4-16b5-470b-9b7e-973867d923e9" (UID: "672368e4-16b5-470b-9b7e-973867d923e9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:21:46.348825 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.348794    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/672368e4-16b5-470b-9b7e-973867d923e9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "672368e4-16b5-470b-9b7e-973867d923e9" (UID: "672368e4-16b5-470b-9b7e-973867d923e9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:21:46.349312 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.349292    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/672368e4-16b5-470b-9b7e-973867d923e9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "672368e4-16b5-470b-9b7e-973867d923e9" (UID: "672368e4-16b5-470b-9b7e-973867d923e9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:21:46.349392 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.349346    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/672368e4-16b5-470b-9b7e-973867d923e9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "672368e4-16b5-470b-9b7e-973867d923e9" (UID: "672368e4-16b5-470b-9b7e-973867d923e9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:21:46.349800 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.349780    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/672368e4-16b5-470b-9b7e-973867d923e9-kube-api-access-9rx7m" (OuterVolumeSpecName: "kube-api-access-9rx7m") pod "672368e4-16b5-470b-9b7e-973867d923e9" (UID: "672368e4-16b5-470b-9b7e-973867d923e9"). InnerVolumeSpecName "kube-api-access-9rx7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:21:46.354973 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.354947    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/672368e4-16b5-470b-9b7e-973867d923e9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "672368e4-16b5-470b-9b7e-973867d923e9" (UID: "672368e4-16b5-470b-9b7e-973867d923e9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:21:46.446922 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.446882    2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/672368e4-16b5-470b-9b7e-973867d923e9-ca-trust-extracted\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:21:46.446922 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.446916    2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/672368e4-16b5-470b-9b7e-973867d923e9-registry-tls\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:21:46.446922 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.446925    2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/672368e4-16b5-470b-9b7e-973867d923e9-installation-pull-secrets\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:21:46.446922 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.446934    2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/672368e4-16b5-470b-9b7e-973867d923e9-bound-sa-token\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:21:46.447221 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.446944    2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/672368e4-16b5-470b-9b7e-973867d923e9-image-registry-private-configuration\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:21:46.447221 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.446953    2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/672368e4-16b5-470b-9b7e-973867d923e9-registry-certificates\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:21:46.447221 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.446961    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rx7m\" (UniqueName: \"kubernetes.io/projected/672368e4-16b5-470b-9b7e-973867d923e9-kube-api-access-9rx7m\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:21:46.447221 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.446969    2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/672368e4-16b5-470b-9b7e-973867d923e9-trusted-ca\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:21:46.459345 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.459312    2554 generic.go:356] "Generic (PLEG): container finished" podID="672368e4-16b5-470b-9b7e-973867d923e9" containerID="7aaaf99b766aef3374020e7d8c142d8c665ee358a9de5d39eff45ecfe90d0b8b" exitCode=0
Jul 18 11:21:46.459477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.459358    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68999d7447-txfrt"
Jul 18 11:21:46.459477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.459394    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68999d7447-txfrt" event={"ID":"672368e4-16b5-470b-9b7e-973867d923e9","Type":"ContainerDied","Data":"7aaaf99b766aef3374020e7d8c142d8c665ee358a9de5d39eff45ecfe90d0b8b"}
Jul 18 11:21:46.459477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.459442    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68999d7447-txfrt" event={"ID":"672368e4-16b5-470b-9b7e-973867d923e9","Type":"ContainerDied","Data":"f8b6c2c63d267d5d599adc8e82f7fcb1883f02a44fb858bcf32f24cfcd6eb67f"}
Jul 18 11:21:46.459826 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.459687    2554 scope.go:117] "RemoveContainer" containerID="7aaaf99b766aef3374020e7d8c142d8c665ee358a9de5d39eff45ecfe90d0b8b"
Jul 18 11:21:46.481614 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.481557    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68999d7447-txfrt"]
Jul 18 11:21:46.485532 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.485509    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68999d7447-txfrt"]
Jul 18 11:21:46.487574 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.487555    2554 scope.go:117] "RemoveContainer" containerID="7aaaf99b766aef3374020e7d8c142d8c665ee358a9de5d39eff45ecfe90d0b8b"
Jul 18 11:21:46.487864 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:21:46.487846    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aaaf99b766aef3374020e7d8c142d8c665ee358a9de5d39eff45ecfe90d0b8b\": container with ID starting with 7aaaf99b766aef3374020e7d8c142d8c665ee358a9de5d39eff45ecfe90d0b8b not found: ID does not exist" containerID="7aaaf99b766aef3374020e7d8c142d8c665ee358a9de5d39eff45ecfe90d0b8b"
Jul 18 11:21:46.487905 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.487871    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aaaf99b766aef3374020e7d8c142d8c665ee358a9de5d39eff45ecfe90d0b8b"} err="failed to get container status \"7aaaf99b766aef3374020e7d8c142d8c665ee358a9de5d39eff45ecfe90d0b8b\": rpc error: code = NotFound desc = could not find container \"7aaaf99b766aef3374020e7d8c142d8c665ee358a9de5d39eff45ecfe90d0b8b\": container with ID starting with 7aaaf99b766aef3374020e7d8c142d8c665ee358a9de5d39eff45ecfe90d0b8b not found: ID does not exist"
Jul 18 11:21:46.947958 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:46.947926    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="672368e4-16b5-470b-9b7e-973867d923e9" path="/var/lib/kubelet/pods/672368e4-16b5-470b-9b7e-973867d923e9/volumes"
Jul 18 11:21:59.360891 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:59.360832    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77959d4b8b-mb5nn" podUID="735e7cc9-7878-4043-b723-b5a05568c723" containerName="console" containerID="cri-o://eb9cd58a80f808ef5ab275ed5118829bbd17bebd0f645f6d5c7bd589fb4a1b0d" gracePeriod=15
Jul 18 11:21:59.506874 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:59.506839    2554 generic.go:356] "Generic (PLEG): container finished" podID="735e7cc9-7878-4043-b723-b5a05568c723" containerID="eb9cd58a80f808ef5ab275ed5118829bbd17bebd0f645f6d5c7bd589fb4a1b0d" exitCode=0
Jul 18 11:21:59.506874 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:59.506863    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77959d4b8b-mb5nn" event={"ID":"735e7cc9-7878-4043-b723-b5a05568c723","Type":"ContainerDied","Data":"eb9cd58a80f808ef5ab275ed5118829bbd17bebd0f645f6d5c7bd589fb4a1b0d"}
Jul 18 11:21:59.593134 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:59.593113    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:21:59.642920 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:59.642862    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/735e7cc9-7878-4043-b723-b5a05568c723-console-config\") pod \"735e7cc9-7878-4043-b723-b5a05568c723\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") "
Jul 18 11:21:59.642920 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:59.642907    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ng6xl\" (UniqueName: \"kubernetes.io/projected/735e7cc9-7878-4043-b723-b5a05568c723-kube-api-access-ng6xl\") pod \"735e7cc9-7878-4043-b723-b5a05568c723\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") "
Jul 18 11:21:59.643185 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:59.642957    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/735e7cc9-7878-4043-b723-b5a05568c723-oauth-serving-cert\") pod \"735e7cc9-7878-4043-b723-b5a05568c723\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") "
Jul 18 11:21:59.643185 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:59.642972    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/735e7cc9-7878-4043-b723-b5a05568c723-console-oauth-config\") pod \"735e7cc9-7878-4043-b723-b5a05568c723\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") "
Jul 18 11:21:59.643185 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:59.642989    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/735e7cc9-7878-4043-b723-b5a05568c723-console-serving-cert\") pod \"735e7cc9-7878-4043-b723-b5a05568c723\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") "
Jul 18 11:21:59.643185 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:59.643011    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/735e7cc9-7878-4043-b723-b5a05568c723-service-ca\") pod \"735e7cc9-7878-4043-b723-b5a05568c723\" (UID: \"735e7cc9-7878-4043-b723-b5a05568c723\") "
Jul 18 11:21:59.643388 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:59.643301    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/735e7cc9-7878-4043-b723-b5a05568c723-console-config" (OuterVolumeSpecName: "console-config") pod "735e7cc9-7878-4043-b723-b5a05568c723" (UID: "735e7cc9-7878-4043-b723-b5a05568c723"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:21:59.643440 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:59.643383    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/735e7cc9-7878-4043-b723-b5a05568c723-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "735e7cc9-7878-4043-b723-b5a05568c723" (UID: "735e7cc9-7878-4043-b723-b5a05568c723"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:21:59.643494 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:59.643468    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/735e7cc9-7878-4043-b723-b5a05568c723-service-ca" (OuterVolumeSpecName: "service-ca") pod "735e7cc9-7878-4043-b723-b5a05568c723" (UID: "735e7cc9-7878-4043-b723-b5a05568c723"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:21:59.645153 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:59.645125    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/735e7cc9-7878-4043-b723-b5a05568c723-kube-api-access-ng6xl" (OuterVolumeSpecName: "kube-api-access-ng6xl") pod "735e7cc9-7878-4043-b723-b5a05568c723" (UID: "735e7cc9-7878-4043-b723-b5a05568c723"). InnerVolumeSpecName "kube-api-access-ng6xl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:21:59.645153 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:59.645131    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/735e7cc9-7878-4043-b723-b5a05568c723-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "735e7cc9-7878-4043-b723-b5a05568c723" (UID: "735e7cc9-7878-4043-b723-b5a05568c723"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:21:59.645279 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:59.645241    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/735e7cc9-7878-4043-b723-b5a05568c723-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "735e7cc9-7878-4043-b723-b5a05568c723" (UID: "735e7cc9-7878-4043-b723-b5a05568c723"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:21:59.743747 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:59.743700    2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/735e7cc9-7878-4043-b723-b5a05568c723-oauth-serving-cert\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:21:59.743747 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:59.743742    2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/735e7cc9-7878-4043-b723-b5a05568c723-console-oauth-config\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:21:59.743747 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:59.743752    2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/735e7cc9-7878-4043-b723-b5a05568c723-console-serving-cert\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:21:59.743747 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:59.743762    2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/735e7cc9-7878-4043-b723-b5a05568c723-service-ca\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:21:59.743998 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:59.743770    2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/735e7cc9-7878-4043-b723-b5a05568c723-console-config\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:21:59.743998 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:21:59.743778    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ng6xl\" (UniqueName: \"kubernetes.io/projected/735e7cc9-7878-4043-b723-b5a05568c723-kube-api-access-ng6xl\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:00.511862 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:00.511828    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77959d4b8b-mb5nn" event={"ID":"735e7cc9-7878-4043-b723-b5a05568c723","Type":"ContainerDied","Data":"5adda2abadac78e86fe9490153d2760d7a3e8704945956f5467fe63ef72ac8c3"}
Jul 18 11:22:00.512298 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:00.511880    2554 scope.go:117] "RemoveContainer" containerID="eb9cd58a80f808ef5ab275ed5118829bbd17bebd0f645f6d5c7bd589fb4a1b0d"
Jul 18 11:22:00.512298 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:00.511841    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77959d4b8b-mb5nn"
Jul 18 11:22:00.532190 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:00.532163    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77959d4b8b-mb5nn"]
Jul 18 11:22:00.539344 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:00.539324    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77959d4b8b-mb5nn"]
Jul 18 11:22:00.948148 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:00.948062    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="735e7cc9-7878-4043-b723-b5a05568c723" path="/var/lib/kubelet/pods/735e7cc9-7878-4043-b723-b5a05568c723/volumes"
Jul 18 11:22:16.195357 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:16.195321    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:16.212793 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:16.212763    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:16.582970 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:16.582942    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:29.860055 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:29.860020    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 11:22:29.860606 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:29.860366    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="alertmanager" containerID="cri-o://da1c54ef783cb33ee8317a1a96b13af1186c7b2f2c9661313630d48da75dd075" gracePeriod=120
Jul 18 11:22:29.860606 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:29.860386    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="kube-rbac-proxy-metric" containerID="cri-o://15ff2c844d21737a52cbe49bf4848156a9cee88bdaefd589c7ff72aac356767e" gracePeriod=120
Jul 18 11:22:29.860606 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:29.860462    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="kube-rbac-proxy" containerID="cri-o://9b1955ab319eb076cd4d3970812fc65e1a535d69c6f8ac698eef14697b4545e9" gracePeriod=120
Jul 18 11:22:29.860606 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:29.860498    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="prom-label-proxy" containerID="cri-o://c0906832a48c4b6f9c4531a0ec77f7096e876e2ac3779a94996d9ba0e098e318" gracePeriod=120
Jul 18 11:22:29.860606 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:29.860452    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="kube-rbac-proxy-web" containerID="cri-o://947f83e715a93c18bf66e85f224042de5a02e5a957beabe90bd59100282759dc" gracePeriod=120
Jul 18 11:22:29.860606 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:29.860471    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="config-reloader" containerID="cri-o://ae77419c82dec4b97d09944c4d8c504dbd3f91f7189290b592b8550905e472c4" gracePeriod=120
Jul 18 11:22:30.617463 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:30.617430    2554 generic.go:356] "Generic (PLEG): container finished" podID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerID="c0906832a48c4b6f9c4531a0ec77f7096e876e2ac3779a94996d9ba0e098e318" exitCode=0
Jul 18 11:22:30.617463 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:30.617453    2554 generic.go:356] "Generic (PLEG): container finished" podID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerID="9b1955ab319eb076cd4d3970812fc65e1a535d69c6f8ac698eef14697b4545e9" exitCode=0
Jul 18 11:22:30.617463 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:30.617460    2554 generic.go:356] "Generic (PLEG): container finished" podID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerID="ae77419c82dec4b97d09944c4d8c504dbd3f91f7189290b592b8550905e472c4" exitCode=0
Jul 18 11:22:30.617463 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:30.617465    2554 generic.go:356] "Generic (PLEG): container finished" podID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerID="da1c54ef783cb33ee8317a1a96b13af1186c7b2f2c9661313630d48da75dd075" exitCode=0
Jul 18 11:22:30.617764 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:30.617504    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f181cb0-e648-434e-9cd9-989f85b8b290","Type":"ContainerDied","Data":"c0906832a48c4b6f9c4531a0ec77f7096e876e2ac3779a94996d9ba0e098e318"}
Jul 18 11:22:30.617764 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:30.617580    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f181cb0-e648-434e-9cd9-989f85b8b290","Type":"ContainerDied","Data":"9b1955ab319eb076cd4d3970812fc65e1a535d69c6f8ac698eef14697b4545e9"}
Jul 18 11:22:30.617764 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:30.617620    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f181cb0-e648-434e-9cd9-989f85b8b290","Type":"ContainerDied","Data":"ae77419c82dec4b97d09944c4d8c504dbd3f91f7189290b592b8550905e472c4"}
Jul 18 11:22:30.617764 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:30.617653    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f181cb0-e648-434e-9cd9-989f85b8b290","Type":"ContainerDied","Data":"da1c54ef783cb33ee8317a1a96b13af1186c7b2f2c9661313630d48da75dd075"}
Jul 18 11:22:31.198609 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.198580    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.272504 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.272478    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-main-tls\") pod \"9f181cb0-e648-434e-9cd9-989f85b8b290\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") "
Jul 18 11:22:31.272504 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.272512    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rhcp\" (UniqueName: \"kubernetes.io/projected/9f181cb0-e648-434e-9cd9-989f85b8b290-kube-api-access-8rhcp\") pod \"9f181cb0-e648-434e-9cd9-989f85b8b290\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") "
Jul 18 11:22:31.272692 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.272532    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f181cb0-e648-434e-9cd9-989f85b8b290-alertmanager-trusted-ca-bundle\") pod \"9f181cb0-e648-434e-9cd9-989f85b8b290\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") "
Jul 18 11:22:31.272692 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.272582    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-cluster-tls-config\") pod \"9f181cb0-e648-434e-9cd9-989f85b8b290\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") "
Jul 18 11:22:31.272777 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.272724    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f181cb0-e648-434e-9cd9-989f85b8b290-alertmanager-main-db\") pod \"9f181cb0-e648-434e-9cd9-989f85b8b290\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") "
Jul 18 11:22:31.272833 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.272781    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f181cb0-e648-434e-9cd9-989f85b8b290-metrics-client-ca\") pod \"9f181cb0-e648-434e-9cd9-989f85b8b290\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") "
Jul 18 11:22:31.272833 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.272811    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-web-config\") pod \"9f181cb0-e648-434e-9cd9-989f85b8b290\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") "
Jul 18 11:22:31.272935 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.272840    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f181cb0-e648-434e-9cd9-989f85b8b290-tls-assets\") pod \"9f181cb0-e648-434e-9cd9-989f85b8b290\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") "
Jul 18 11:22:31.272935 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.272856    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f181cb0-e648-434e-9cd9-989f85b8b290-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "9f181cb0-e648-434e-9cd9-989f85b8b290" (UID: "9f181cb0-e648-434e-9cd9-989f85b8b290"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:22:31.272935 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.272867    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-kube-rbac-proxy\") pod \"9f181cb0-e648-434e-9cd9-989f85b8b290\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") "
Jul 18 11:22:31.272935 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.272905    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-config-volume\") pod \"9f181cb0-e648-434e-9cd9-989f85b8b290\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") "
Jul 18 11:22:31.272935 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.272927    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f181cb0-e648-434e-9cd9-989f85b8b290-config-out\") pod \"9f181cb0-e648-434e-9cd9-989f85b8b290\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") "
Jul 18 11:22:31.273208 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.272951    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-kube-rbac-proxy-metric\") pod \"9f181cb0-e648-434e-9cd9-989f85b8b290\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") "
Jul 18 11:22:31.273208 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.272981    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-kube-rbac-proxy-web\") pod \"9f181cb0-e648-434e-9cd9-989f85b8b290\" (UID: \"9f181cb0-e648-434e-9cd9-989f85b8b290\") "
Jul 18 11:22:31.273306 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.273214    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f181cb0-e648-434e-9cd9-989f85b8b290-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "9f181cb0-e648-434e-9cd9-989f85b8b290" (UID: "9f181cb0-e648-434e-9cd9-989f85b8b290"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:22:31.273306 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.273221    2554 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9f181cb0-e648-434e-9cd9-989f85b8b290-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:31.273410 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.273378    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f181cb0-e648-434e-9cd9-989f85b8b290-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "9f181cb0-e648-434e-9cd9-989f85b8b290" (UID: "9f181cb0-e648-434e-9cd9-989f85b8b290"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:22:31.275545 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.275508    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "9f181cb0-e648-434e-9cd9-989f85b8b290" (UID: "9f181cb0-e648-434e-9cd9-989f85b8b290"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:22:31.275881 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.275854    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "9f181cb0-e648-434e-9cd9-989f85b8b290" (UID: "9f181cb0-e648-434e-9cd9-989f85b8b290"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:22:31.275976 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.275912    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "9f181cb0-e648-434e-9cd9-989f85b8b290" (UID: "9f181cb0-e648-434e-9cd9-989f85b8b290"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:22:31.276168 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.276136    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f181cb0-e648-434e-9cd9-989f85b8b290-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9f181cb0-e648-434e-9cd9-989f85b8b290" (UID: "9f181cb0-e648-434e-9cd9-989f85b8b290"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:22:31.276168 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.276146    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-config-volume" (OuterVolumeSpecName: "config-volume") pod "9f181cb0-e648-434e-9cd9-989f85b8b290" (UID: "9f181cb0-e648-434e-9cd9-989f85b8b290"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:22:31.276949 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.276921    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f181cb0-e648-434e-9cd9-989f85b8b290-kube-api-access-8rhcp" (OuterVolumeSpecName: "kube-api-access-8rhcp") pod "9f181cb0-e648-434e-9cd9-989f85b8b290" (UID: "9f181cb0-e648-434e-9cd9-989f85b8b290"). InnerVolumeSpecName "kube-api-access-8rhcp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:22:31.277130 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.277087    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f181cb0-e648-434e-9cd9-989f85b8b290-config-out" (OuterVolumeSpecName: "config-out") pod "9f181cb0-e648-434e-9cd9-989f85b8b290" (UID: "9f181cb0-e648-434e-9cd9-989f85b8b290"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:22:31.277590 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.277563    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "9f181cb0-e648-434e-9cd9-989f85b8b290" (UID: "9f181cb0-e648-434e-9cd9-989f85b8b290"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:22:31.279526 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.279382    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "9f181cb0-e648-434e-9cd9-989f85b8b290" (UID: "9f181cb0-e648-434e-9cd9-989f85b8b290"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:22:31.285087 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.285066    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-web-config" (OuterVolumeSpecName: "web-config") pod "9f181cb0-e648-434e-9cd9-989f85b8b290" (UID: "9f181cb0-e648-434e-9cd9-989f85b8b290"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:22:31.374403 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.374375    2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-main-tls\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:31.374403 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.374400    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rhcp\" (UniqueName: \"kubernetes.io/projected/9f181cb0-e648-434e-9cd9-989f85b8b290-kube-api-access-8rhcp\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:31.374403 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.374409    2554 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-cluster-tls-config\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:31.374607 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.374417    2554 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9f181cb0-e648-434e-9cd9-989f85b8b290-alertmanager-main-db\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:31.374607 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.374425    2554 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f181cb0-e648-434e-9cd9-989f85b8b290-metrics-client-ca\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:31.374607 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.374454    2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-web-config\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:31.374607 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.374462    2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9f181cb0-e648-434e-9cd9-989f85b8b290-tls-assets\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:31.374607 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.374471    2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:31.374607 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.374480    2554 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-config-volume\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:31.374607 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.374487    2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9f181cb0-e648-434e-9cd9-989f85b8b290-config-out\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:31.374607 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.374494    2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:31.374607 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.374503    2554 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9f181cb0-e648-434e-9cd9-989f85b8b290-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:31.623472 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.623440    2554 generic.go:356] "Generic (PLEG): container finished" podID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerID="15ff2c844d21737a52cbe49bf4848156a9cee88bdaefd589c7ff72aac356767e" exitCode=0
Jul 18 11:22:31.623472 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.623464    2554 generic.go:356] "Generic (PLEG): container finished" podID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerID="947f83e715a93c18bf66e85f224042de5a02e5a957beabe90bd59100282759dc" exitCode=0
Jul 18 11:22:31.623714 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.623500    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f181cb0-e648-434e-9cd9-989f85b8b290","Type":"ContainerDied","Data":"15ff2c844d21737a52cbe49bf4848156a9cee88bdaefd589c7ff72aac356767e"}
Jul 18 11:22:31.623714 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.623521    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.623714 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.623558    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f181cb0-e648-434e-9cd9-989f85b8b290","Type":"ContainerDied","Data":"947f83e715a93c18bf66e85f224042de5a02e5a957beabe90bd59100282759dc"}
Jul 18 11:22:31.623714 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.623592    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9f181cb0-e648-434e-9cd9-989f85b8b290","Type":"ContainerDied","Data":"b24eb739beb1d8fac12d5da3d6ef49d86aed934a170419c466efc2b43e71bd4a"}
Jul 18 11:22:31.623714 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.623632    2554 scope.go:117] "RemoveContainer" containerID="c0906832a48c4b6f9c4531a0ec77f7096e876e2ac3779a94996d9ba0e098e318"
Jul 18 11:22:31.630922 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.630908    2554 scope.go:117] "RemoveContainer" containerID="15ff2c844d21737a52cbe49bf4848156a9cee88bdaefd589c7ff72aac356767e"
Jul 18 11:22:31.637426 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.637411    2554 scope.go:117] "RemoveContainer" containerID="9b1955ab319eb076cd4d3970812fc65e1a535d69c6f8ac698eef14697b4545e9"
Jul 18 11:22:31.643326 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.643306    2554 scope.go:117] "RemoveContainer" containerID="947f83e715a93c18bf66e85f224042de5a02e5a957beabe90bd59100282759dc"
Jul 18 11:22:31.644982 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.644948    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 11:22:31.649599 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.649578    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 11:22:31.650397 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.650382    2554 scope.go:117] "RemoveContainer" containerID="ae77419c82dec4b97d09944c4d8c504dbd3f91f7189290b592b8550905e472c4"
Jul 18 11:22:31.656791 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.656774    2554 scope.go:117] "RemoveContainer" containerID="da1c54ef783cb33ee8317a1a96b13af1186c7b2f2c9661313630d48da75dd075"
Jul 18 11:22:31.663072 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.663054    2554 scope.go:117] "RemoveContainer" containerID="ac60f420f913640090d3fb1b09f4efadaaccf5303fda0b5582c1aa7a74a6dfd8"
Jul 18 11:22:31.669450 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.669427    2554 scope.go:117] "RemoveContainer" containerID="c0906832a48c4b6f9c4531a0ec77f7096e876e2ac3779a94996d9ba0e098e318"
Jul 18 11:22:31.669710 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:22:31.669690    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c0906832a48c4b6f9c4531a0ec77f7096e876e2ac3779a94996d9ba0e098e318\": container with ID starting with c0906832a48c4b6f9c4531a0ec77f7096e876e2ac3779a94996d9ba0e098e318 not found: ID does not exist" containerID="c0906832a48c4b6f9c4531a0ec77f7096e876e2ac3779a94996d9ba0e098e318"
Jul 18 11:22:31.669780 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.669720    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0906832a48c4b6f9c4531a0ec77f7096e876e2ac3779a94996d9ba0e098e318"} err="failed to get container status \"c0906832a48c4b6f9c4531a0ec77f7096e876e2ac3779a94996d9ba0e098e318\": rpc error: code = NotFound desc = could not find container \"c0906832a48c4b6f9c4531a0ec77f7096e876e2ac3779a94996d9ba0e098e318\": container with ID starting with c0906832a48c4b6f9c4531a0ec77f7096e876e2ac3779a94996d9ba0e098e318 not found: ID does not exist"
Jul 18 11:22:31.669780 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.669738    2554 scope.go:117] "RemoveContainer" containerID="15ff2c844d21737a52cbe49bf4848156a9cee88bdaefd589c7ff72aac356767e"
Jul 18 11:22:31.670000 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:22:31.669984    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15ff2c844d21737a52cbe49bf4848156a9cee88bdaefd589c7ff72aac356767e\": container with ID starting with 15ff2c844d21737a52cbe49bf4848156a9cee88bdaefd589c7ff72aac356767e not found: ID does not exist" containerID="15ff2c844d21737a52cbe49bf4848156a9cee88bdaefd589c7ff72aac356767e"
Jul 18 11:22:31.670054 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.670005    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15ff2c844d21737a52cbe49bf4848156a9cee88bdaefd589c7ff72aac356767e"} err="failed to get container status \"15ff2c844d21737a52cbe49bf4848156a9cee88bdaefd589c7ff72aac356767e\": rpc error: code = NotFound desc = could not find container \"15ff2c844d21737a52cbe49bf4848156a9cee88bdaefd589c7ff72aac356767e\": container with ID starting with 15ff2c844d21737a52cbe49bf4848156a9cee88bdaefd589c7ff72aac356767e not found: ID does not exist"
Jul 18 11:22:31.670054 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.670020    2554 scope.go:117] "RemoveContainer" containerID="9b1955ab319eb076cd4d3970812fc65e1a535d69c6f8ac698eef14697b4545e9"
Jul 18 11:22:31.670265 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:22:31.670247    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b1955ab319eb076cd4d3970812fc65e1a535d69c6f8ac698eef14697b4545e9\": container with ID starting with 9b1955ab319eb076cd4d3970812fc65e1a535d69c6f8ac698eef14697b4545e9 not found: ID does not exist" containerID="9b1955ab319eb076cd4d3970812fc65e1a535d69c6f8ac698eef14697b4545e9"
Jul 18 11:22:31.670305 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.670268    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b1955ab319eb076cd4d3970812fc65e1a535d69c6f8ac698eef14697b4545e9"} err="failed to get container status \"9b1955ab319eb076cd4d3970812fc65e1a535d69c6f8ac698eef14697b4545e9\": rpc error: code = NotFound desc = could not find container \"9b1955ab319eb076cd4d3970812fc65e1a535d69c6f8ac698eef14697b4545e9\": container with ID starting with 9b1955ab319eb076cd4d3970812fc65e1a535d69c6f8ac698eef14697b4545e9 not found: ID does not exist"
Jul 18 11:22:31.670305 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.670281    2554 scope.go:117] "RemoveContainer" containerID="947f83e715a93c18bf66e85f224042de5a02e5a957beabe90bd59100282759dc"
Jul 18 11:22:31.670520 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:22:31.670495    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"947f83e715a93c18bf66e85f224042de5a02e5a957beabe90bd59100282759dc\": container with ID starting with 947f83e715a93c18bf66e85f224042de5a02e5a957beabe90bd59100282759dc not found: ID does not exist" containerID="947f83e715a93c18bf66e85f224042de5a02e5a957beabe90bd59100282759dc"
Jul 18 11:22:31.670566 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.670524    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"947f83e715a93c18bf66e85f224042de5a02e5a957beabe90bd59100282759dc"} err="failed to get container status \"947f83e715a93c18bf66e85f224042de5a02e5a957beabe90bd59100282759dc\": rpc error: code = NotFound desc = could not find container \"947f83e715a93c18bf66e85f224042de5a02e5a957beabe90bd59100282759dc\": container with ID starting with 947f83e715a93c18bf66e85f224042de5a02e5a957beabe90bd59100282759dc not found: ID does not exist"
Jul 18 11:22:31.670566 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.670540    2554 scope.go:117] "RemoveContainer" containerID="ae77419c82dec4b97d09944c4d8c504dbd3f91f7189290b592b8550905e472c4"
Jul 18 11:22:31.670727 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:22:31.670714    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae77419c82dec4b97d09944c4d8c504dbd3f91f7189290b592b8550905e472c4\": container with ID starting with ae77419c82dec4b97d09944c4d8c504dbd3f91f7189290b592b8550905e472c4 not found: ID does not exist" containerID="ae77419c82dec4b97d09944c4d8c504dbd3f91f7189290b592b8550905e472c4"
Jul 18 11:22:31.670766 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.670728    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae77419c82dec4b97d09944c4d8c504dbd3f91f7189290b592b8550905e472c4"} err="failed to get container status \"ae77419c82dec4b97d09944c4d8c504dbd3f91f7189290b592b8550905e472c4\": rpc error: code = NotFound desc = could not find container \"ae77419c82dec4b97d09944c4d8c504dbd3f91f7189290b592b8550905e472c4\": container with ID starting with ae77419c82dec4b97d09944c4d8c504dbd3f91f7189290b592b8550905e472c4 not found: ID does not exist"
Jul 18 11:22:31.670766 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.670739    2554 scope.go:117] "RemoveContainer" containerID="da1c54ef783cb33ee8317a1a96b13af1186c7b2f2c9661313630d48da75dd075"
Jul 18 11:22:31.670958 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:22:31.670940    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da1c54ef783cb33ee8317a1a96b13af1186c7b2f2c9661313630d48da75dd075\": container with ID starting with da1c54ef783cb33ee8317a1a96b13af1186c7b2f2c9661313630d48da75dd075 not found: ID does not exist" containerID="da1c54ef783cb33ee8317a1a96b13af1186c7b2f2c9661313630d48da75dd075"
Jul 18 11:22:31.671014 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.670977    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da1c54ef783cb33ee8317a1a96b13af1186c7b2f2c9661313630d48da75dd075"} err="failed to get container status \"da1c54ef783cb33ee8317a1a96b13af1186c7b2f2c9661313630d48da75dd075\": rpc error: code = NotFound desc = could not find container \"da1c54ef783cb33ee8317a1a96b13af1186c7b2f2c9661313630d48da75dd075\": container with ID starting with da1c54ef783cb33ee8317a1a96b13af1186c7b2f2c9661313630d48da75dd075 not found: ID does not exist"
Jul 18 11:22:31.671014 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.670999    2554 scope.go:117] "RemoveContainer" containerID="ac60f420f913640090d3fb1b09f4efadaaccf5303fda0b5582c1aa7a74a6dfd8"
Jul 18 11:22:31.671213 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:22:31.671200    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac60f420f913640090d3fb1b09f4efadaaccf5303fda0b5582c1aa7a74a6dfd8\": container with ID starting with ac60f420f913640090d3fb1b09f4efadaaccf5303fda0b5582c1aa7a74a6dfd8 not found: ID does not exist" containerID="ac60f420f913640090d3fb1b09f4efadaaccf5303fda0b5582c1aa7a74a6dfd8"
Jul 18 11:22:31.671257 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.671215    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac60f420f913640090d3fb1b09f4efadaaccf5303fda0b5582c1aa7a74a6dfd8"} err="failed to get container status \"ac60f420f913640090d3fb1b09f4efadaaccf5303fda0b5582c1aa7a74a6dfd8\": rpc error: code = NotFound desc = could not find container \"ac60f420f913640090d3fb1b09f4efadaaccf5303fda0b5582c1aa7a74a6dfd8\": container with ID starting with ac60f420f913640090d3fb1b09f4efadaaccf5303fda0b5582c1aa7a74a6dfd8 not found: ID does not exist"
Jul 18 11:22:31.671257 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.671227    2554 scope.go:117] "RemoveContainer" containerID="c0906832a48c4b6f9c4531a0ec77f7096e876e2ac3779a94996d9ba0e098e318"
Jul 18 11:22:31.671397 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.671377    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c0906832a48c4b6f9c4531a0ec77f7096e876e2ac3779a94996d9ba0e098e318"} err="failed to get container status \"c0906832a48c4b6f9c4531a0ec77f7096e876e2ac3779a94996d9ba0e098e318\": rpc error: code = NotFound desc = could not find container \"c0906832a48c4b6f9c4531a0ec77f7096e876e2ac3779a94996d9ba0e098e318\": container with ID starting with c0906832a48c4b6f9c4531a0ec77f7096e876e2ac3779a94996d9ba0e098e318 not found: ID does not exist"
Jul 18 11:22:31.671461 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.671400    2554 scope.go:117] "RemoveContainer" containerID="15ff2c844d21737a52cbe49bf4848156a9cee88bdaefd589c7ff72aac356767e"
Jul 18 11:22:31.671598 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.671581    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15ff2c844d21737a52cbe49bf4848156a9cee88bdaefd589c7ff72aac356767e"} err="failed to get container status \"15ff2c844d21737a52cbe49bf4848156a9cee88bdaefd589c7ff72aac356767e\": rpc error: code = NotFound desc = could not find container \"15ff2c844d21737a52cbe49bf4848156a9cee88bdaefd589c7ff72aac356767e\": container with ID starting with 15ff2c844d21737a52cbe49bf4848156a9cee88bdaefd589c7ff72aac356767e not found: ID does not exist"
Jul 18 11:22:31.671634 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.671600    2554 scope.go:117] "RemoveContainer" containerID="9b1955ab319eb076cd4d3970812fc65e1a535d69c6f8ac698eef14697b4545e9"
Jul 18 11:22:31.671777 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.671759    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b1955ab319eb076cd4d3970812fc65e1a535d69c6f8ac698eef14697b4545e9"} err="failed to get container status \"9b1955ab319eb076cd4d3970812fc65e1a535d69c6f8ac698eef14697b4545e9\": rpc error: code = NotFound desc = could not find container \"9b1955ab319eb076cd4d3970812fc65e1a535d69c6f8ac698eef14697b4545e9\": container with ID starting with 9b1955ab319eb076cd4d3970812fc65e1a535d69c6f8ac698eef14697b4545e9 not found: ID does not exist"
Jul 18 11:22:31.671817 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.671778    2554 scope.go:117] "RemoveContainer" containerID="947f83e715a93c18bf66e85f224042de5a02e5a957beabe90bd59100282759dc"
Jul 18 11:22:31.671988 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.671971    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"947f83e715a93c18bf66e85f224042de5a02e5a957beabe90bd59100282759dc"} err="failed to get container status \"947f83e715a93c18bf66e85f224042de5a02e5a957beabe90bd59100282759dc\": rpc error: code = NotFound desc = could not find container \"947f83e715a93c18bf66e85f224042de5a02e5a957beabe90bd59100282759dc\": container with ID starting with 947f83e715a93c18bf66e85f224042de5a02e5a957beabe90bd59100282759dc not found: ID does not exist"
Jul 18 11:22:31.672027 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.671989    2554 scope.go:117] "RemoveContainer" containerID="ae77419c82dec4b97d09944c4d8c504dbd3f91f7189290b592b8550905e472c4"
Jul 18 11:22:31.672179 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.672159    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae77419c82dec4b97d09944c4d8c504dbd3f91f7189290b592b8550905e472c4"} err="failed to get container status \"ae77419c82dec4b97d09944c4d8c504dbd3f91f7189290b592b8550905e472c4\": rpc error: code = NotFound desc = could not find container \"ae77419c82dec4b97d09944c4d8c504dbd3f91f7189290b592b8550905e472c4\": container with ID starting with ae77419c82dec4b97d09944c4d8c504dbd3f91f7189290b592b8550905e472c4 not found: ID does not exist"
Jul 18 11:22:31.672251 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.672179    2554 scope.go:117] "RemoveContainer" containerID="da1c54ef783cb33ee8317a1a96b13af1186c7b2f2c9661313630d48da75dd075"
Jul 18 11:22:31.672380 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.672363    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da1c54ef783cb33ee8317a1a96b13af1186c7b2f2c9661313630d48da75dd075"} err="failed to get container status \"da1c54ef783cb33ee8317a1a96b13af1186c7b2f2c9661313630d48da75dd075\": rpc error: code = NotFound desc = could not find container \"da1c54ef783cb33ee8317a1a96b13af1186c7b2f2c9661313630d48da75dd075\": container with ID starting with da1c54ef783cb33ee8317a1a96b13af1186c7b2f2c9661313630d48da75dd075 not found: ID does not exist"
Jul 18 11:22:31.672442 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.672380    2554 scope.go:117] "RemoveContainer" containerID="ac60f420f913640090d3fb1b09f4efadaaccf5303fda0b5582c1aa7a74a6dfd8"
Jul 18 11:22:31.672650 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.672629    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac60f420f913640090d3fb1b09f4efadaaccf5303fda0b5582c1aa7a74a6dfd8"} err="failed to get container status \"ac60f420f913640090d3fb1b09f4efadaaccf5303fda0b5582c1aa7a74a6dfd8\": rpc error: code = NotFound desc = could not find container \"ac60f420f913640090d3fb1b09f4efadaaccf5303fda0b5582c1aa7a74a6dfd8\": container with ID starting with ac60f420f913640090d3fb1b09f4efadaaccf5303fda0b5582c1aa7a74a6dfd8 not found: ID does not exist"
Jul 18 11:22:31.673952 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.673934    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 11:22:31.674193 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674180    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672368e4-16b5-470b-9b7e-973867d923e9" containerName="registry"
Jul 18 11:22:31.674251 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674197    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="672368e4-16b5-470b-9b7e-973867d923e9" containerName="registry"
Jul 18 11:22:31.674251 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674209    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="config-reloader"
Jul 18 11:22:31.674251 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674214    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="config-reloader"
Jul 18 11:22:31.674251 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674222    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="alertmanager"
Jul 18 11:22:31.674251 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674227    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="alertmanager"
Jul 18 11:22:31.674251 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674235    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="kube-rbac-proxy-web"
Jul 18 11:22:31.674251 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674240    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="kube-rbac-proxy-web"
Jul 18 11:22:31.674251 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674245    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="kube-rbac-proxy-metric"
Jul 18 11:22:31.674251 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674251    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="kube-rbac-proxy-metric"
Jul 18 11:22:31.674497 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674257    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="735e7cc9-7878-4043-b723-b5a05568c723" containerName="console"
Jul 18 11:22:31.674497 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674261    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="735e7cc9-7878-4043-b723-b5a05568c723" containerName="console"
Jul 18 11:22:31.674497 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674268    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="init-config-reloader"
Jul 18 11:22:31.674497 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674273    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="init-config-reloader"
Jul 18 11:22:31.674497 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674279    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="kube-rbac-proxy"
Jul 18 11:22:31.674497 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674284    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="kube-rbac-proxy"
Jul 18 11:22:31.674497 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674290    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="prom-label-proxy"
Jul 18 11:22:31.674497 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674294    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="prom-label-proxy"
Jul 18 11:22:31.674497 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674331    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="kube-rbac-proxy"
Jul 18 11:22:31.674497 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674337    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="735e7cc9-7878-4043-b723-b5a05568c723" containerName="console"
Jul 18 11:22:31.674497 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674343    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="config-reloader"
Jul 18 11:22:31.674497 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674349    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="kube-rbac-proxy-web"
Jul 18 11:22:31.674497 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674354    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="alertmanager"
Jul 18 11:22:31.674497 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674360    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="672368e4-16b5-470b-9b7e-973867d923e9" containerName="registry"
Jul 18 11:22:31.674497 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674365    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="kube-rbac-proxy-metric"
Jul 18 11:22:31.674497 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.674369    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" containerName="prom-label-proxy"
Jul 18 11:22:31.678168 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.678154    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.680603 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.680587    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 18 11:22:31.680682 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.680606    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 18 11:22:31.680729 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.680682    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 18 11:22:31.680777 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.680743    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 18 11:22:31.680777 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.680752    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sg7v4\""
Jul 18 11:22:31.680777 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.680752    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 18 11:22:31.680777 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.680755    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 18 11:22:31.681076 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.681060    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 18 11:22:31.681157 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.681136    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 18 11:22:31.685656 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.685636    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 18 11:22:31.690528 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.690500    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 11:22:31.777941 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.777909    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/447a6bee-9a81-4569-bccc-4a7b62c6fa59-web-config\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.777941 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.777951    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/447a6bee-9a81-4569-bccc-4a7b62c6fa59-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.778194 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.777989    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/447a6bee-9a81-4569-bccc-4a7b62c6fa59-config-out\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.778194 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.778020    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/447a6bee-9a81-4569-bccc-4a7b62c6fa59-config-volume\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.778194 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.778048    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/447a6bee-9a81-4569-bccc-4a7b62c6fa59-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.778194 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.778138    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/447a6bee-9a81-4569-bccc-4a7b62c6fa59-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.778194 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.778171    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/447a6bee-9a81-4569-bccc-4a7b62c6fa59-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.778384 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.778205    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/447a6bee-9a81-4569-bccc-4a7b62c6fa59-tls-assets\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.778384 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.778231    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/447a6bee-9a81-4569-bccc-4a7b62c6fa59-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.778384 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.778247    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/447a6bee-9a81-4569-bccc-4a7b62c6fa59-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.778384 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.778264    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447a6bee-9a81-4569-bccc-4a7b62c6fa59-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.778384 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.778321    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/447a6bee-9a81-4569-bccc-4a7b62c6fa59-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.778384 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.778346    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k78sb\" (UniqueName: \"kubernetes.io/projected/447a6bee-9a81-4569-bccc-4a7b62c6fa59-kube-api-access-k78sb\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.879458 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.879368    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/447a6bee-9a81-4569-bccc-4a7b62c6fa59-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.879458 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.879409    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/447a6bee-9a81-4569-bccc-4a7b62c6fa59-tls-assets\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.879458 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.879441    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/447a6bee-9a81-4569-bccc-4a7b62c6fa59-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.879723 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.879463    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/447a6bee-9a81-4569-bccc-4a7b62c6fa59-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.879723 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.879484    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447a6bee-9a81-4569-bccc-4a7b62c6fa59-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.879723 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.879511    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/447a6bee-9a81-4569-bccc-4a7b62c6fa59-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.879723 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.879530    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k78sb\" (UniqueName: \"kubernetes.io/projected/447a6bee-9a81-4569-bccc-4a7b62c6fa59-kube-api-access-k78sb\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.879723 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.879565    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/447a6bee-9a81-4569-bccc-4a7b62c6fa59-web-config\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.879723 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.879594    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/447a6bee-9a81-4569-bccc-4a7b62c6fa59-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.879723 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.879627    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/447a6bee-9a81-4569-bccc-4a7b62c6fa59-config-out\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.879723 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.879658    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/447a6bee-9a81-4569-bccc-4a7b62c6fa59-config-volume\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.879723 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.879687    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/447a6bee-9a81-4569-bccc-4a7b62c6fa59-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.879723 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.879711    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/447a6bee-9a81-4569-bccc-4a7b62c6fa59-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.880301 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.880276    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/447a6bee-9a81-4569-bccc-4a7b62c6fa59-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.880482 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.880460    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/447a6bee-9a81-4569-bccc-4a7b62c6fa59-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.880984 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.880594    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/447a6bee-9a81-4569-bccc-4a7b62c6fa59-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.882422 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.882383    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/447a6bee-9a81-4569-bccc-4a7b62c6fa59-tls-assets\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.882675 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.882630    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/447a6bee-9a81-4569-bccc-4a7b62c6fa59-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.882675 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.882654    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/447a6bee-9a81-4569-bccc-4a7b62c6fa59-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.882827 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.882689    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/447a6bee-9a81-4569-bccc-4a7b62c6fa59-config-out\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.882959 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.882940    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/447a6bee-9a81-4569-bccc-4a7b62c6fa59-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.883172 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.883152    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/447a6bee-9a81-4569-bccc-4a7b62c6fa59-web-config\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.883276 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.883259    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/447a6bee-9a81-4569-bccc-4a7b62c6fa59-config-volume\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.883749 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.883730    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/447a6bee-9a81-4569-bccc-4a7b62c6fa59-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.883822 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.883809    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/447a6bee-9a81-4569-bccc-4a7b62c6fa59-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.891737 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.891719    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k78sb\" (UniqueName: \"kubernetes.io/projected/447a6bee-9a81-4569-bccc-4a7b62c6fa59-kube-api-access-k78sb\") pod \"alertmanager-main-0\" (UID: \"447a6bee-9a81-4569-bccc-4a7b62c6fa59\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:31.988618 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:31.988592    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 18 11:22:32.119583 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:32.119411    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 18 11:22:32.122164 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:22:32.122137    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod447a6bee_9a81_4569_bccc_4a7b62c6fa59.slice/crio-7eed01317b18b2cd37ffa36bcd9543979ae2730ba82f94d236eea794651fe22b WatchSource:0}: Error finding container 7eed01317b18b2cd37ffa36bcd9543979ae2730ba82f94d236eea794651fe22b: Status 404 returned error can't find the container with id 7eed01317b18b2cd37ffa36bcd9543979ae2730ba82f94d236eea794651fe22b
Jul 18 11:22:32.629030 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:32.628990    2554 generic.go:356] "Generic (PLEG): container finished" podID="447a6bee-9a81-4569-bccc-4a7b62c6fa59" containerID="f7c05cacd1009b7f3cedd7770290a25fd1a068b527016b6999a468b96478935c" exitCode=0
Jul 18 11:22:32.629030 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:32.629030    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"447a6bee-9a81-4569-bccc-4a7b62c6fa59","Type":"ContainerDied","Data":"f7c05cacd1009b7f3cedd7770290a25fd1a068b527016b6999a468b96478935c"}
Jul 18 11:22:32.629440 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:32.629141    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"447a6bee-9a81-4569-bccc-4a7b62c6fa59","Type":"ContainerStarted","Data":"7eed01317b18b2cd37ffa36bcd9543979ae2730ba82f94d236eea794651fe22b"}
Jul 18 11:22:32.948973 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:32.948945    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f181cb0-e648-434e-9cd9-989f85b8b290" path="/var/lib/kubelet/pods/9f181cb0-e648-434e-9cd9-989f85b8b290/volumes"
Jul 18 11:22:33.636611 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:33.636575    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"447a6bee-9a81-4569-bccc-4a7b62c6fa59","Type":"ContainerStarted","Data":"40ff9b41369cbc675c72cc304babb482cd212a64eec8655bf4f71f2766ec008d"}
Jul 18 11:22:33.636965 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:33.636655    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"447a6bee-9a81-4569-bccc-4a7b62c6fa59","Type":"ContainerStarted","Data":"d0cc8568373b429435417790220bfa41f5c2c6872d9cd902a94c87845ac21d45"}
Jul 18 11:22:33.636965 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:33.636696    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"447a6bee-9a81-4569-bccc-4a7b62c6fa59","Type":"ContainerStarted","Data":"f82549519c965258b1bc842e3b9f67232c12872a638ee7cb34464c538be12894"}
Jul 18 11:22:33.636965 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:33.636732    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"447a6bee-9a81-4569-bccc-4a7b62c6fa59","Type":"ContainerStarted","Data":"e0e9010ce0b562d7bd19267409325d8be7918157377ca1b524552afe80963556"}
Jul 18 11:22:33.636965 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:33.636767    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"447a6bee-9a81-4569-bccc-4a7b62c6fa59","Type":"ContainerStarted","Data":"7c9ea7a7b7a1082936bbb2405533f3ca4a44f52af76d188750c4247c7e545806"}
Jul 18 11:22:33.636965 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:33.636802    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"447a6bee-9a81-4569-bccc-4a7b62c6fa59","Type":"ContainerStarted","Data":"c2880e8c6030a1e58c49768fae96709ecc4c3be76dc2ca65f155c4b6ff1e8599"}
Jul 18 11:22:33.664813 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:33.664761    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.649270132 podStartE2EDuration="2.664740974s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.470842ms" isStatefulPod=false podCreationTimestamp="2026-07-18 11:22:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:22:33.663909287 +0000 UTC m=+155.266039018" watchObservedRunningTime="2026-07-18 11:22:33.664740974 +0000 UTC m=+155.266870713"
Jul 18 11:22:34.224968 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.224934    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 11:22:34.225279 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.225239    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="kube-rbac-proxy" containerID="cri-o://a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1" gracePeriod=600
Jul 18 11:22:34.225279 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.225232    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="prometheus" containerID="cri-o://74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b" gracePeriod=600
Jul 18 11:22:34.225472 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.225260    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="thanos-sidecar" containerID="cri-o://a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689" gracePeriod=600
Jul 18 11:22:34.225472 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.225292    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="config-reloader" containerID="cri-o://fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a" gracePeriod=600
Jul 18 11:22:34.225472 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.225302    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="kube-rbac-proxy-web" containerID="cri-o://79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5" gracePeriod=600
Jul 18 11:22:34.225472 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.225289    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="kube-rbac-proxy-thanos" containerID="cri-o://6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9" gracePeriod=600
Jul 18 11:22:34.480035 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.479972    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.600734 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.600686    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-configmap-serving-certs-ca-bundle\") pod \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") "
Jul 18 11:22:34.600734 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.600732    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-grpc-tls\") pod \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") "
Jul 18 11:22:34.600972 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.600761    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-config\") pod \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") "
Jul 18 11:22:34.600972 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.600796    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-rulefiles-2\") pod \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") "
Jul 18 11:22:34.600972 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.600821    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-db\") pod \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") "
Jul 18 11:22:34.600972 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.600845    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-web-config\") pod \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") "
Jul 18 11:22:34.600972 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.600865    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-rulefiles-1\") pod \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") "
Jul 18 11:22:34.600972 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.600894    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-metrics-client-certs\") pod \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") "
Jul 18 11:22:34.600972 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.600924    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-configmap-kubelet-serving-ca-bundle\") pod \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") "
Jul 18 11:22:34.600972 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.600958    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-kube-rbac-proxy\") pod \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") "
Jul 18 11:22:34.601354 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.600982    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-thanos-prometheus-http-client-file\") pod \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") "
Jul 18 11:22:34.601354 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.601020    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfbb4e42-4cd9-4397-8aab-28160b4a8351-tls-assets\") pod \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") "
Jul 18 11:22:34.601354 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.601046    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-trusted-ca-bundle\") pod \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") "
Jul 18 11:22:34.601354 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.601079    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4e42-4cd9-4397-8aab-28160b4a8351-config-out\") pod \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") "
Jul 18 11:22:34.601354 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.601132    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") "
Jul 18 11:22:34.601354 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.601167    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") "
Jul 18 11:22:34.601354 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.601214    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-prometheus-k8s-tls\") pod \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") "
Jul 18 11:22:34.601354 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.601208    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "bfbb4e42-4cd9-4397-8aab-28160b4a8351" (UID: "bfbb4e42-4cd9-4397-8aab-28160b4a8351"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:22:34.601354 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.601238    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-configmap-metrics-client-ca\") pod \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") "
Jul 18 11:22:34.601354 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.601271    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-rulefiles-0\") pod \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") "
Jul 18 11:22:34.601354 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.601304    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5c66\" (UniqueName: \"kubernetes.io/projected/bfbb4e42-4cd9-4397-8aab-28160b4a8351-kube-api-access-f5c66\") pod \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\" (UID: \"bfbb4e42-4cd9-4397-8aab-28160b4a8351\") "
Jul 18 11:22:34.601839 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.601393    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "bfbb4e42-4cd9-4397-8aab-28160b4a8351" (UID: "bfbb4e42-4cd9-4397-8aab-28160b4a8351"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:22:34.601839 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.601532    2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:34.601839 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.601552    2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:34.601839 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.601719    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "bfbb4e42-4cd9-4397-8aab-28160b4a8351" (UID: "bfbb4e42-4cd9-4397-8aab-28160b4a8351"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:22:34.602023 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.601876    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "bfbb4e42-4cd9-4397-8aab-28160b4a8351" (UID: "bfbb4e42-4cd9-4397-8aab-28160b4a8351"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:22:34.602761 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.602295    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "bfbb4e42-4cd9-4397-8aab-28160b4a8351" (UID: "bfbb4e42-4cd9-4397-8aab-28160b4a8351"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:22:34.602904 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.602779    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "bfbb4e42-4cd9-4397-8aab-28160b4a8351" (UID: "bfbb4e42-4cd9-4397-8aab-28160b4a8351"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:22:34.603395 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.603354    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "bfbb4e42-4cd9-4397-8aab-28160b4a8351" (UID: "bfbb4e42-4cd9-4397-8aab-28160b4a8351"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:22:34.603966 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.603940    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "bfbb4e42-4cd9-4397-8aab-28160b4a8351" (UID: "bfbb4e42-4cd9-4397-8aab-28160b4a8351"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:22:34.604196 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.604010    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "bfbb4e42-4cd9-4397-8aab-28160b4a8351" (UID: "bfbb4e42-4cd9-4397-8aab-28160b4a8351"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:22:34.605217 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.605186    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "bfbb4e42-4cd9-4397-8aab-28160b4a8351" (UID: "bfbb4e42-4cd9-4397-8aab-28160b4a8351"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:22:34.605296 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.605189    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfbb4e42-4cd9-4397-8aab-28160b4a8351-kube-api-access-f5c66" (OuterVolumeSpecName: "kube-api-access-f5c66") pod "bfbb4e42-4cd9-4397-8aab-28160b4a8351" (UID: "bfbb4e42-4cd9-4397-8aab-28160b4a8351"). InnerVolumeSpecName "kube-api-access-f5c66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:22:34.605296 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.605246    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-config" (OuterVolumeSpecName: "config") pod "bfbb4e42-4cd9-4397-8aab-28160b4a8351" (UID: "bfbb4e42-4cd9-4397-8aab-28160b4a8351"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:22:34.605451 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.605410    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfbb4e42-4cd9-4397-8aab-28160b4a8351-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "bfbb4e42-4cd9-4397-8aab-28160b4a8351" (UID: "bfbb4e42-4cd9-4397-8aab-28160b4a8351"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:22:34.605607 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.605587    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "bfbb4e42-4cd9-4397-8aab-28160b4a8351" (UID: "bfbb4e42-4cd9-4397-8aab-28160b4a8351"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:22:34.605681 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.605629    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfbb4e42-4cd9-4397-8aab-28160b4a8351-config-out" (OuterVolumeSpecName: "config-out") pod "bfbb4e42-4cd9-4397-8aab-28160b4a8351" (UID: "bfbb4e42-4cd9-4397-8aab-28160b4a8351"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:22:34.605737 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.605689    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "bfbb4e42-4cd9-4397-8aab-28160b4a8351" (UID: "bfbb4e42-4cd9-4397-8aab-28160b4a8351"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:22:34.605983 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.605970    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "bfbb4e42-4cd9-4397-8aab-28160b4a8351" (UID: "bfbb4e42-4cd9-4397-8aab-28160b4a8351"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:22:34.606146 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.606121    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "bfbb4e42-4cd9-4397-8aab-28160b4a8351" (UID: "bfbb4e42-4cd9-4397-8aab-28160b4a8351"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:22:34.606280 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.606264    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "bfbb4e42-4cd9-4397-8aab-28160b4a8351" (UID: "bfbb4e42-4cd9-4397-8aab-28160b4a8351"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:22:34.612914 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.612896    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-web-config" (OuterVolumeSpecName: "web-config") pod "bfbb4e42-4cd9-4397-8aab-28160b4a8351" (UID: "bfbb4e42-4cd9-4397-8aab-28160b4a8351"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:22:34.642856 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.642826    2554 generic.go:356] "Generic (PLEG): container finished" podID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerID="6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9" exitCode=0
Jul 18 11:22:34.642856 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.642847    2554 generic.go:356] "Generic (PLEG): container finished" podID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerID="a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1" exitCode=0
Jul 18 11:22:34.642856 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.642852    2554 generic.go:356] "Generic (PLEG): container finished" podID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerID="79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5" exitCode=0
Jul 18 11:22:34.642856 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.642858    2554 generic.go:356] "Generic (PLEG): container finished" podID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerID="a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689" exitCode=0
Jul 18 11:22:34.642856 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.642863    2554 generic.go:356] "Generic (PLEG): container finished" podID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerID="fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a" exitCode=0
Jul 18 11:22:34.643481 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.642868    2554 generic.go:356] "Generic (PLEG): container finished" podID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerID="74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b" exitCode=0
Jul 18 11:22:34.643481 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.642916    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.643481 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.642912    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfbb4e42-4cd9-4397-8aab-28160b4a8351","Type":"ContainerDied","Data":"6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9"}
Jul 18 11:22:34.643481 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.643084    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfbb4e42-4cd9-4397-8aab-28160b4a8351","Type":"ContainerDied","Data":"a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1"}
Jul 18 11:22:34.643481 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.643117    2554 scope.go:117] "RemoveContainer" containerID="6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9"
Jul 18 11:22:34.643481 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.643125    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfbb4e42-4cd9-4397-8aab-28160b4a8351","Type":"ContainerDied","Data":"79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5"}
Jul 18 11:22:34.643481 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.643151    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfbb4e42-4cd9-4397-8aab-28160b4a8351","Type":"ContainerDied","Data":"a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689"}
Jul 18 11:22:34.643481 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.643174    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfbb4e42-4cd9-4397-8aab-28160b4a8351","Type":"ContainerDied","Data":"fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a"}
Jul 18 11:22:34.643481 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.643199    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfbb4e42-4cd9-4397-8aab-28160b4a8351","Type":"ContainerDied","Data":"74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b"}
Jul 18 11:22:34.643481 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.643223    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"bfbb4e42-4cd9-4397-8aab-28160b4a8351","Type":"ContainerDied","Data":"5fa8a3818ef98ad6e0e256c93bfd3d74d92d447e4c307f2796d9ab7d972683de"}
Jul 18 11:22:34.651042 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.651013    2554 scope.go:117] "RemoveContainer" containerID="a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1"
Jul 18 11:22:34.657795 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.657778    2554 scope.go:117] "RemoveContainer" containerID="79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5"
Jul 18 11:22:34.663954 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.663939    2554 scope.go:117] "RemoveContainer" containerID="a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689"
Jul 18 11:22:34.667615 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.667594    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 11:22:34.670613 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.670508    2554 scope.go:117] "RemoveContainer" containerID="fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a"
Jul 18 11:22:34.671700 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.671678    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 11:22:34.676805 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.676790    2554 scope.go:117] "RemoveContainer" containerID="74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b"
Jul 18 11:22:34.683315 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.683299    2554 scope.go:117] "RemoveContainer" containerID="d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24"
Jul 18 11:22:34.689555 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.689540    2554 scope.go:117] "RemoveContainer" containerID="6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9"
Jul 18 11:22:34.689809 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:22:34.689790    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9\": container with ID starting with 6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9 not found: ID does not exist" containerID="6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9"
Jul 18 11:22:34.689873 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.689822    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9"} err="failed to get container status \"6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9\": rpc error: code = NotFound desc = could not find container \"6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9\": container with ID starting with 6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9 not found: ID does not exist"
Jul 18 11:22:34.689873 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.689849    2554 scope.go:117] "RemoveContainer" containerID="a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1"
Jul 18 11:22:34.690076 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:22:34.690061    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1\": container with ID starting with a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1 not found: ID does not exist" containerID="a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1"
Jul 18 11:22:34.690165 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.690082    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1"} err="failed to get container status \"a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1\": rpc error: code = NotFound desc = could not find container \"a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1\": container with ID starting with a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1 not found: ID does not exist"
Jul 18 11:22:34.690165 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.690116    2554 scope.go:117] "RemoveContainer" containerID="79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5"
Jul 18 11:22:34.690364 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:22:34.690347    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5\": container with ID starting with 79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5 not found: ID does not exist" containerID="79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5"
Jul 18 11:22:34.690431 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.690370    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5"} err="failed to get container status \"79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5\": rpc error: code = NotFound desc = could not find container \"79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5\": container with ID starting with 79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5 not found: ID does not exist"
Jul 18 11:22:34.690431 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.690389    2554 scope.go:117] "RemoveContainer" containerID="a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689"
Jul 18 11:22:34.690650 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:22:34.690636    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689\": container with ID starting with a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689 not found: ID does not exist" containerID="a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689"
Jul 18 11:22:34.690710 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.690655    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689"} err="failed to get container status \"a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689\": rpc error: code = NotFound desc = could not find container \"a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689\": container with ID starting with a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689 not found: ID does not exist"
Jul 18 11:22:34.690710 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.690674    2554 scope.go:117] "RemoveContainer" containerID="fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a"
Jul 18 11:22:34.690878 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:22:34.690863    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a\": container with ID starting with fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a not found: ID does not exist" containerID="fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a"
Jul 18 11:22:34.690932 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.690884    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a"} err="failed to get container status \"fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a\": rpc error: code = NotFound desc = could not find container \"fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a\": container with ID starting with fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a not found: ID does not exist"
Jul 18 11:22:34.690932 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.690906    2554 scope.go:117] "RemoveContainer" containerID="74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b"
Jul 18 11:22:34.691138 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:22:34.691085    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b\": container with ID starting with 74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b not found: ID does not exist" containerID="74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b"
Jul 18 11:22:34.691213 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.691145    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b"} err="failed to get container status \"74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b\": rpc error: code = NotFound desc = could not find container \"74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b\": container with ID starting with 74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b not found: ID does not exist"
Jul 18 11:22:34.691213 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.691163    2554 scope.go:117] "RemoveContainer" containerID="d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24"
Jul 18 11:22:34.691428 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:22:34.691408    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24\": container with ID starting with d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24 not found: ID does not exist" containerID="d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24"
Jul 18 11:22:34.691468 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.691434    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24"} err="failed to get container status \"d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24\": rpc error: code = NotFound desc = could not find container \"d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24\": container with ID starting with d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24 not found: ID does not exist"
Jul 18 11:22:34.691468 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.691448    2554 scope.go:117] "RemoveContainer" containerID="6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9"
Jul 18 11:22:34.691665 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.691649    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9"} err="failed to get container status \"6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9\": rpc error: code = NotFound desc = could not find container \"6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9\": container with ID starting with 6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9 not found: ID does not exist"
Jul 18 11:22:34.691729 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.691667    2554 scope.go:117] "RemoveContainer" containerID="a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1"
Jul 18 11:22:34.691917 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.691901    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1"} err="failed to get container status \"a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1\": rpc error: code = NotFound desc = could not find container \"a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1\": container with ID starting with a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1 not found: ID does not exist"
Jul 18 11:22:34.691956 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.691919    2554 scope.go:117] "RemoveContainer" containerID="79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5"
Jul 18 11:22:34.692089 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.692072    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5"} err="failed to get container status \"79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5\": rpc error: code = NotFound desc = could not find container \"79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5\": container with ID starting with 79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5 not found: ID does not exist"
Jul 18 11:22:34.692174 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.692108    2554 scope.go:117] "RemoveContainer" containerID="a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689"
Jul 18 11:22:34.692272 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.692255    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689"} err="failed to get container status \"a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689\": rpc error: code = NotFound desc = could not find container \"a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689\": container with ID starting with a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689 not found: ID does not exist"
Jul 18 11:22:34.692329 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.692274    2554 scope.go:117] "RemoveContainer" containerID="fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a"
Jul 18 11:22:34.692430 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.692414    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a"} err="failed to get container status \"fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a\": rpc error: code = NotFound desc = could not find container \"fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a\": container with ID starting with fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a not found: ID does not exist"
Jul 18 11:22:34.692491 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.692432    2554 scope.go:117] "RemoveContainer" containerID="74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b"
Jul 18 11:22:34.692604 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.692587    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b"} err="failed to get container status \"74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b\": rpc error: code = NotFound desc = could not find container \"74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b\": container with ID starting with 74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b not found: ID does not exist"
Jul 18 11:22:34.692645 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.692605    2554 scope.go:117] "RemoveContainer" containerID="d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24"
Jul 18 11:22:34.692788 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.692771    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24"} err="failed to get container status \"d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24\": rpc error: code = NotFound desc = could not find container \"d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24\": container with ID starting with d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24 not found: ID does not exist"
Jul 18 11:22:34.692835 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.692789    2554 scope.go:117] "RemoveContainer" containerID="6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9"
Jul 18 11:22:34.692946 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.692931    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9"} err="failed to get container status \"6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9\": rpc error: code = NotFound desc = could not find container \"6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9\": container with ID starting with 6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9 not found: ID does not exist"
Jul 18 11:22:34.692986 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.692947    2554 scope.go:117] "RemoveContainer" containerID="a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1"
Jul 18 11:22:34.693083 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.693069    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1"} err="failed to get container status \"a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1\": rpc error: code = NotFound desc = could not find container \"a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1\": container with ID starting with a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1 not found: ID does not exist"
Jul 18 11:22:34.693134 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.693084    2554 scope.go:117] "RemoveContainer" containerID="79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5"
Jul 18 11:22:34.693351 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.693337    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5"} err="failed to get container status \"79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5\": rpc error: code = NotFound desc = could not find container \"79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5\": container with ID starting with 79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5 not found: ID does not exist"
Jul 18 11:22:34.693389 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.693351    2554 scope.go:117] "RemoveContainer" containerID="a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689"
Jul 18 11:22:34.693560 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.693541    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689"} err="failed to get container status \"a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689\": rpc error: code = NotFound desc = could not find container \"a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689\": container with ID starting with a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689 not found: ID does not exist"
Jul 18 11:22:34.693609 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.693560    2554 scope.go:117] "RemoveContainer" containerID="fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a"
Jul 18 11:22:34.693748 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.693733    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a"} err="failed to get container status \"fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a\": rpc error: code = NotFound desc = could not find container \"fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a\": container with ID starting with fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a not found: ID does not exist"
Jul 18 11:22:34.693785 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.693748    2554 scope.go:117] "RemoveContainer" containerID="74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b"
Jul 18 11:22:34.693945 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.693928    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b"} err="failed to get container status \"74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b\": rpc error: code = NotFound desc = could not find container \"74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b\": container with ID starting with 74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b not found: ID does not exist"
Jul 18 11:22:34.693984 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.693946    2554 scope.go:117] "RemoveContainer" containerID="d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24"
Jul 18 11:22:34.694176 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.694159    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24"} err="failed to get container status \"d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24\": rpc error: code = NotFound desc = could not find container \"d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24\": container with ID starting with d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24 not found: ID does not exist"
Jul 18 11:22:34.694223 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.694176    2554 scope.go:117] "RemoveContainer" containerID="6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9"
Jul 18 11:22:34.694367 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.694348    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9"} err="failed to get container status \"6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9\": rpc error: code = NotFound desc = could not find container \"6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9\": container with ID starting with 6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9 not found: ID does not exist"
Jul 18 11:22:34.694413 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.694368    2554 scope.go:117] "RemoveContainer" containerID="a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1"
Jul 18 11:22:34.694609 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.694592    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1"} err="failed to get container status \"a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1\": rpc error: code = NotFound desc = could not find container \"a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1\": container with ID starting with a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1 not found: ID does not exist"
Jul 18 11:22:34.694662 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.694608    2554 scope.go:117] "RemoveContainer" containerID="79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5"
Jul 18 11:22:34.694801 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.694785    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5"} err="failed to get container status \"79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5\": rpc error: code = NotFound desc = could not find container \"79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5\": container with ID starting with 79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5 not found: ID does not exist"
Jul 18 11:22:34.694841 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.694801    2554 scope.go:117] "RemoveContainer" containerID="a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689"
Jul 18 11:22:34.694991 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.694971    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689"} err="failed to get container status \"a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689\": rpc error: code = NotFound desc = could not find container \"a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689\": container with ID starting with a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689 not found: ID does not exist"
Jul 18 11:22:34.695038 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.694992    2554 scope.go:117] "RemoveContainer" containerID="fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a"
Jul 18 11:22:34.695258 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.695241    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a"} err="failed to get container status \"fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a\": rpc error: code = NotFound desc = could not find container \"fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a\": container with ID starting with fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a not found: ID does not exist"
Jul 18 11:22:34.695258 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.695257    2554 scope.go:117] "RemoveContainer" containerID="74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b"
Jul 18 11:22:34.695477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.695461    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b"} err="failed to get container status \"74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b\": rpc error: code = NotFound desc = could not find container \"74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b\": container with ID starting with 74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b not found: ID does not exist"
Jul 18 11:22:34.695514 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.695477    2554 scope.go:117] "RemoveContainer" containerID="d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24"
Jul 18 11:22:34.695703 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.695688    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24"} err="failed to get container status \"d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24\": rpc error: code = NotFound desc = could not find container \"d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24\": container with ID starting with d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24 not found: ID does not exist"
Jul 18 11:22:34.695757 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.695703    2554 scope.go:117] "RemoveContainer" containerID="6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9"
Jul 18 11:22:34.695960 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.695940    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9"} err="failed to get container status \"6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9\": rpc error: code = NotFound desc = could not find container \"6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9\": container with ID starting with 6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9 not found: ID does not exist"
Jul 18 11:22:34.696026 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.695962    2554 scope.go:117] "RemoveContainer" containerID="a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1"
Jul 18 11:22:34.696266 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.696217    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1"} err="failed to get container status \"a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1\": rpc error: code = NotFound desc = could not find container \"a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1\": container with ID starting with a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1 not found: ID does not exist"
Jul 18 11:22:34.696266 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.696247    2554 scope.go:117] "RemoveContainer" containerID="79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5"
Jul 18 11:22:34.696538 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.696516    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5"} err="failed to get container status \"79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5\": rpc error: code = NotFound desc = could not find container \"79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5\": container with ID starting with 79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5 not found: ID does not exist"
Jul 18 11:22:34.696631 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.696539    2554 scope.go:117] "RemoveContainer" containerID="a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689"
Jul 18 11:22:34.696824 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.696799    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689"} err="failed to get container status \"a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689\": rpc error: code = NotFound desc = could not find container \"a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689\": container with ID starting with a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689 not found: ID does not exist"
Jul 18 11:22:34.696915 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.696825    2554 scope.go:117] "RemoveContainer" containerID="fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a"
Jul 18 11:22:34.697077 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.697045    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a"} err="failed to get container status \"fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a\": rpc error: code = NotFound desc = could not find container \"fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a\": container with ID starting with fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a not found: ID does not exist"
Jul 18 11:22:34.697077 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.697068    2554 scope.go:117] "RemoveContainer" containerID="74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b"
Jul 18 11:22:34.697342 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.697319    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b"} err="failed to get container status \"74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b\": rpc error: code = NotFound desc = could not find container \"74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b\": container with ID starting with 74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b not found: ID does not exist"
Jul 18 11:22:34.697411 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.697343    2554 scope.go:117] "RemoveContainer" containerID="d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24"
Jul 18 11:22:34.697901 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.697663    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24"} err="failed to get container status \"d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24\": rpc error: code = NotFound desc = could not find container \"d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24\": container with ID starting with d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24 not found: ID does not exist"
Jul 18 11:22:34.697901 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.697688    2554 scope.go:117] "RemoveContainer" containerID="6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9"
Jul 18 11:22:34.697901 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.697780    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 11:22:34.698065 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.697985    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9"} err="failed to get container status \"6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9\": rpc error: code = NotFound desc = could not find container \"6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9\": container with ID starting with 6d2227037365976877f3d7ac07416c26542578e9c4a1af9267f268acb6fffff9 not found: ID does not exist"
Jul 18 11:22:34.698065 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698006    2554 scope.go:117] "RemoveContainer" containerID="a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1"
Jul 18 11:22:34.698224 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698083    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="config-reloader"
Jul 18 11:22:34.698224 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698122    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="config-reloader"
Jul 18 11:22:34.698224 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698134    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="thanos-sidecar"
Jul 18 11:22:34.698224 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698141    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="thanos-sidecar"
Jul 18 11:22:34.698224 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698156    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="kube-rbac-proxy"
Jul 18 11:22:34.698224 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698164    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="kube-rbac-proxy"
Jul 18 11:22:34.698224 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698189    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="init-config-reloader"
Jul 18 11:22:34.698224 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698197    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="init-config-reloader"
Jul 18 11:22:34.698224 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698210    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="kube-rbac-proxy-thanos"
Jul 18 11:22:34.698224 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698219    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="kube-rbac-proxy-thanos"
Jul 18 11:22:34.698686 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698230    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="kube-rbac-proxy-web"
Jul 18 11:22:34.698686 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698239    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="kube-rbac-proxy-web"
Jul 18 11:22:34.698686 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698249    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="prometheus"
Jul 18 11:22:34.698686 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698264    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="prometheus"
Jul 18 11:22:34.698686 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698329    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="prometheus"
Jul 18 11:22:34.698686 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698340    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="kube-rbac-proxy-web"
Jul 18 11:22:34.698686 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698351    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="kube-rbac-proxy"
Jul 18 11:22:34.698686 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698359    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="config-reloader"
Jul 18 11:22:34.698686 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698366    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="thanos-sidecar"
Jul 18 11:22:34.698686 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698375    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" containerName="kube-rbac-proxy-thanos"
Jul 18 11:22:34.698686 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698246    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1"} err="failed to get container status \"a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1\": rpc error: code = NotFound desc = could not find container \"a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1\": container with ID starting with a36fd2a9a80c2ed1a3e8565114c64e17b666c216274077d43595ad4e41784aa1 not found: ID does not exist"
Jul 18 11:22:34.698686 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698442    2554 scope.go:117] "RemoveContainer" containerID="79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5"
Jul 18 11:22:34.699230 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698728    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5"} err="failed to get container status \"79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5\": rpc error: code = NotFound desc = could not find container \"79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5\": container with ID starting with 79c6fc6908146dea985d2150ea1c30d1b4b97c9d70fa363a7cfc928223c9f9d5 not found: ID does not exist"
Jul 18 11:22:34.699230 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698748    2554 scope.go:117] "RemoveContainer" containerID="a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689"
Jul 18 11:22:34.699230 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698965    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689"} err="failed to get container status \"a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689\": rpc error: code = NotFound desc = could not find container \"a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689\": container with ID starting with a7f9d8a1832afb82a05fef495d74485669581ae2e53417d1bc7fb858a1503689 not found: ID does not exist"
Jul 18 11:22:34.699230 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.698982    2554 scope.go:117] "RemoveContainer" containerID="fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a"
Jul 18 11:22:34.699230 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.699197    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a"} err="failed to get container status \"fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a\": rpc error: code = NotFound desc = could not find container \"fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a\": container with ID starting with fe947bea8dcfc0f894304957f80006bf4e4a3ec022c76d86bd1fac0f327ba30a not found: ID does not exist"
Jul 18 11:22:34.699230 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.699212    2554 scope.go:117] "RemoveContainer" containerID="74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b"
Jul 18 11:22:34.699505 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.699451    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b"} err="failed to get container status \"74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b\": rpc error: code = NotFound desc = could not find container \"74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b\": container with ID starting with 74bb30573405379e1f64881bd56bcbe6f4b410a7dea820d074e2d210456a095b not found: ID does not exist"
Jul 18 11:22:34.699505 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.699468    2554 scope.go:117] "RemoveContainer" containerID="d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24"
Jul 18 11:22:34.699677 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.699656    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24"} err="failed to get container status \"d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24\": rpc error: code = NotFound desc = could not find container \"d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24\": container with ID starting with d78b7673aa2ac812fc7b04859710b48e71cd2979d70b3b191a169fe5b0a93c24 not found: ID does not exist"
Jul 18 11:22:34.701887 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.701870    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.701990 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.701976    2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-db\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:34.702040 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.702017    2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-web-config\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:34.702040 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.702031    2554 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-metrics-client-certs\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:34.702147 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.702048    2554 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:34.702147 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.702062    2554 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-kube-rbac-proxy\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:34.702147 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.702074    2554 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:34.702147 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.702087    2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/bfbb4e42-4cd9-4397-8aab-28160b4a8351-tls-assets\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:34.702147 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.702146    2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:34.702348 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.702160    2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/bfbb4e42-4cd9-4397-8aab-28160b4a8351-config-out\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:34.702348 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.702174    2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:34.702348 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.702187    2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:34.702348 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.702212    2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:34.702348 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.702225    2554 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-configmap-metrics-client-ca\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:34.702348 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.702238    2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:34.702348 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.702251    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5c66\" (UniqueName: \"kubernetes.io/projected/bfbb4e42-4cd9-4397-8aab-28160b4a8351-kube-api-access-f5c66\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:34.702348 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.702264    2554 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfbb4e42-4cd9-4397-8aab-28160b4a8351-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:34.702348 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.702286    2554 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-secret-grpc-tls\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:34.702348 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.702298    2554 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/bfbb4e42-4cd9-4397-8aab-28160b4a8351-config\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:22:34.704478 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.704325    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 18 11:22:34.704478 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.704348    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 18 11:22:34.704478 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.704389    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-5rsfq\""
Jul 18 11:22:34.704478 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.704396    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 18 11:22:34.704478 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.704415    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 18 11:22:34.704705 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.704522    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8vm6fqm5gkt1j\""
Jul 18 11:22:34.704756 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.704712    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 18 11:22:34.704805 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.704787    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 18 11:22:34.704856 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.704789    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 18 11:22:34.704907 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.704898    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 18 11:22:34.704950 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.704935    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 18 11:22:34.705322 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.705302    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 18 11:22:34.705322 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.705320    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 18 11:22:34.705798 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.705330    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 18 11:22:34.705798 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.705338    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 18 11:22:34.707397 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.707379    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 18 11:22:34.710140 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.710124    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 18 11:22:34.715502 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.715484    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 11:22:34.803113 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.803066    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-web-config\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.803259 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.803121    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.803259 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.803200    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.803332 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.803282    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.803608 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.803584    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.803721 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.803707    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.803780 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.803728    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.803780 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.803758    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.803845 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.803783    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.803845 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.803820    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.803907 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.803884    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzq4w\" (UniqueName: \"kubernetes.io/projected/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-kube-api-access-hzq4w\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.803944 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.803907    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-config\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.803944 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.803931    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.804006 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.803961    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-config-out\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.804006 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.803975    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.804006 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.803997    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.804166 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.804011    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.804166 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.804133    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.804250 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.804177    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.804250 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.804194    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.905373 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.905337    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.905373 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.905374    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.905582 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.905390    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.905582 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.905410    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.905582 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.905433    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.905582 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.905456    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.905582 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.905490    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.905582 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.905524    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzq4w\" (UniqueName: \"kubernetes.io/projected/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-kube-api-access-hzq4w\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.905582 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.905547    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-config\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.905870 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.905790    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.905960 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.905932    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.906022 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.906000    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-config-out\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.906071 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.906025    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.906071 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.906050    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.906205 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.906071    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.906205 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.906116    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.906205 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.906158    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.906205 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.906182    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.906384 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.906208    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-web-config\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.906384 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.906233    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.906384 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.906268    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.906858 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.906531    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.907067 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.907043    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.908611 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.908582    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-config\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.908697 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.908655    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.908751 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.908704    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.908751 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.908715    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.908843 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.908776    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.909813 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.909208    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.909813 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.909357    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.909813 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.909734    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.909813 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.909750    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.909813 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.909753    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.909813 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.909766    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.910385 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.910361    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.910720 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.910701    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.910916 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.910896    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-config-out\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.911125 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.911083    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.911345 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.911331    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-web-config\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.913719 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.913698    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzq4w\" (UniqueName: \"kubernetes.io/projected/79adb4cd-2583-4c4b-8fb7-a9981c1af6cb-kube-api-access-hzq4w\") pod \"prometheus-k8s-0\" (UID: \"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:34.948222 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:34.948201    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfbb4e42-4cd9-4397-8aab-28160b4a8351" path="/var/lib/kubelet/pods/bfbb4e42-4cd9-4397-8aab-28160b4a8351/volumes"
Jul 18 11:22:35.010966 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:35.010933    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:22:35.140615 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:35.140584    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 18 11:22:35.143886 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:22:35.143861    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79adb4cd_2583_4c4b_8fb7_a9981c1af6cb.slice/crio-77bb585263b5168707f89b5d0d4a825843e1a733be77fbc2ee18c91e500cfa0c WatchSource:0}: Error finding container 77bb585263b5168707f89b5d0d4a825843e1a733be77fbc2ee18c91e500cfa0c: Status 404 returned error can't find the container with id 77bb585263b5168707f89b5d0d4a825843e1a733be77fbc2ee18c91e500cfa0c
Jul 18 11:22:35.649117 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:35.649059    2554 generic.go:356] "Generic (PLEG): container finished" podID="79adb4cd-2583-4c4b-8fb7-a9981c1af6cb" containerID="8c5dfb0b66e074e4fc7deb28a2d3e2860a8128dc909d9acf9c5daa2bee727ba3" exitCode=0
Jul 18 11:22:35.649553 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:35.649134    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb","Type":"ContainerDied","Data":"8c5dfb0b66e074e4fc7deb28a2d3e2860a8128dc909d9acf9c5daa2bee727ba3"}
Jul 18 11:22:35.649553 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:35.649240    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb","Type":"ContainerStarted","Data":"77bb585263b5168707f89b5d0d4a825843e1a733be77fbc2ee18c91e500cfa0c"}
Jul 18 11:22:36.656298 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:36.656264    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb","Type":"ContainerStarted","Data":"1cf75179512b854de8971627a99ad506c63af9a1e8f5397db2c9f5a60f0ca85d"}
Jul 18 11:22:36.656666 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:36.656331    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb","Type":"ContainerStarted","Data":"1d37ab6a169b610e5adb5fef61af7c0d654d7162ec02dafa7e9bb85667f3ed1c"}
Jul 18 11:22:36.656666 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:36.656356    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb","Type":"ContainerStarted","Data":"bf07fc2a8f28b2fc6cfb792a286dea1ccea9b6f20ff5018c0306e8127de0f071"}
Jul 18 11:22:36.656666 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:36.656386    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb","Type":"ContainerStarted","Data":"91ff1fd0c463d3bfeefb3c30e9cf2e4582dc63165584054ecc4cb367d37a951d"}
Jul 18 11:22:36.656666 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:36.656410    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb","Type":"ContainerStarted","Data":"cc340c61088e07780609395d38dfe1be9c857f7cca97818f1f375bb1eb1fefd8"}
Jul 18 11:22:36.656666 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:36.656442    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"79adb4cd-2583-4c4b-8fb7-a9981c1af6cb","Type":"ContainerStarted","Data":"71ec01183e004fa12aca92c5e509fd49df62486068f1b2dbfd0094b144b43f8c"}
Jul 18 11:22:36.683725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:36.683655    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.663475038 podStartE2EDuration="2.683635884s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.160846ms" isStatefulPod=false podCreationTimestamp="2026-07-18 11:22:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:22:36.68176355 +0000 UTC m=+158.283893293" watchObservedRunningTime="2026-07-18 11:22:36.683635884 +0000 UTC m=+158.285765624"
Jul 18 11:22:40.012034 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:22:40.011996    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:23:35.011533 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:23:35.011500    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:23:35.026077 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:23:35.026051    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:23:35.878962 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:23:35.878937    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 18 11:24:58.823565 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:24:58.823541    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5kkzl_2e953581-6e11-46ad-92e3-0d63df589850/ovn-acl-logging/0.log"
Jul 18 11:24:58.826559 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:24:58.826533    2554 kubelet.go:1648] "Image garbage collection succeeded"
Jul 18 11:24:58.834578 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:24:58.834559    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5kkzl_2e953581-6e11-46ad-92e3-0d63df589850/ovn-acl-logging/0.log"
Jul 18 11:25:37.505962 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:25:37.505929    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fksh8"]
Jul 18 11:25:37.509272 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:25:37.509249    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fksh8"
Jul 18 11:25:37.511999 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:25:37.511978    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 18 11:25:37.512358 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:25:37.512340    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 18 11:25:37.521002 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:25:37.520978    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fksh8"]
Jul 18 11:25:37.553768 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:25:37.553736    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h875\" (UniqueName: \"kubernetes.io/projected/bef24adc-8abd-472f-aea4-6ba74f41a44c-kube-api-access-6h875\") pod \"cert-manager-cainjector-559cdd8c87-fksh8\" (UID: \"bef24adc-8abd-472f-aea4-6ba74f41a44c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fksh8"
Jul 18 11:25:37.553929 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:25:37.553776    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bef24adc-8abd-472f-aea4-6ba74f41a44c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fksh8\" (UID: \"bef24adc-8abd-472f-aea4-6ba74f41a44c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fksh8"
Jul 18 11:25:37.654179 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:25:37.654142    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h875\" (UniqueName: \"kubernetes.io/projected/bef24adc-8abd-472f-aea4-6ba74f41a44c-kube-api-access-6h875\") pod \"cert-manager-cainjector-559cdd8c87-fksh8\" (UID: \"bef24adc-8abd-472f-aea4-6ba74f41a44c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fksh8"
Jul 18 11:25:37.654341 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:25:37.654187    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bef24adc-8abd-472f-aea4-6ba74f41a44c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fksh8\" (UID: \"bef24adc-8abd-472f-aea4-6ba74f41a44c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fksh8"
Jul 18 11:25:37.663327 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:25:37.663302    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bef24adc-8abd-472f-aea4-6ba74f41a44c-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-fksh8\" (UID: \"bef24adc-8abd-472f-aea4-6ba74f41a44c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fksh8"
Jul 18 11:25:37.663479 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:25:37.663462    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h875\" (UniqueName: \"kubernetes.io/projected/bef24adc-8abd-472f-aea4-6ba74f41a44c-kube-api-access-6h875\") pod \"cert-manager-cainjector-559cdd8c87-fksh8\" (UID: \"bef24adc-8abd-472f-aea4-6ba74f41a44c\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-fksh8"
Jul 18 11:25:37.827924 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:25:37.827830    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fksh8"
Jul 18 11:25:37.951116 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:25:37.951063    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-fksh8"]
Jul 18 11:25:37.954735 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:25:37.954696    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbef24adc_8abd_472f_aea4_6ba74f41a44c.slice/crio-5b8400c75e5b901869f166c4781a7e60256beb26004c2c791c605fff5688d9eb WatchSource:0}: Error finding container 5b8400c75e5b901869f166c4781a7e60256beb26004c2c791c605fff5688d9eb: Status 404 returned error can't find the container with id 5b8400c75e5b901869f166c4781a7e60256beb26004c2c791c605fff5688d9eb
Jul 18 11:25:37.963645 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:25:37.963626    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 11:25:38.269789 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:25:38.269750    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fksh8" event={"ID":"bef24adc-8abd-472f-aea4-6ba74f41a44c","Type":"ContainerStarted","Data":"5b8400c75e5b901869f166c4781a7e60256beb26004c2c791c605fff5688d9eb"}
Jul 18 11:25:41.282386 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:25:41.282350    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fksh8" event={"ID":"bef24adc-8abd-472f-aea4-6ba74f41a44c","Type":"ContainerStarted","Data":"56bb58d0c819064bac8e68a8ca0aae13fca659cbae4c5382584a0180208e1a6a"}
Jul 18 11:25:41.296444 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:25:41.296400    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-fksh8" podStartSLOduration=1.458927676 podStartE2EDuration="4.296386632s" totalImagesPullingTime="2.837458956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:25:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:25:41.295769013 +0000 UTC m=+342.897898771" watchObservedRunningTime="2026-07-18 11:25:41.296386632 +0000 UTC m=+342.898516370"
Jul 18 11:26:14.205373 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.205331    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-59bdd75cb8-qnvjr"]
Jul 18 11:26:14.247426 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.247396    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59bdd75cb8-qnvjr"]
Jul 18 11:26:14.247575 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.247492    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59bdd75cb8-qnvjr"
Jul 18 11:26:14.250291 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.250272    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 18 11:26:14.250407 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.250350    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 18 11:26:14.251047 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.251029    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 18 11:26:14.251212 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.251192    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 18 11:26:14.251291 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.251215    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-b96ln\""
Jul 18 11:26:14.251291 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.251255    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 18 11:26:14.335454 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.335418    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5152bab5-89e3-4ee6-b4f7-1113b2847fc9-manager-config\") pod \"lws-controller-manager-59bdd75cb8-qnvjr\" (UID: \"5152bab5-89e3-4ee6-b4f7-1113b2847fc9\") " pod="openshift-lws-operator/lws-controller-manager-59bdd75cb8-qnvjr"
Jul 18 11:26:14.335636 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.335459    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5152bab5-89e3-4ee6-b4f7-1113b2847fc9-cert\") pod \"lws-controller-manager-59bdd75cb8-qnvjr\" (UID: \"5152bab5-89e3-4ee6-b4f7-1113b2847fc9\") " pod="openshift-lws-operator/lws-controller-manager-59bdd75cb8-qnvjr"
Jul 18 11:26:14.335636 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.335579    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5152bab5-89e3-4ee6-b4f7-1113b2847fc9-metrics-cert\") pod \"lws-controller-manager-59bdd75cb8-qnvjr\" (UID: \"5152bab5-89e3-4ee6-b4f7-1113b2847fc9\") " pod="openshift-lws-operator/lws-controller-manager-59bdd75cb8-qnvjr"
Jul 18 11:26:14.335636 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.335617    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4949\" (UniqueName: \"kubernetes.io/projected/5152bab5-89e3-4ee6-b4f7-1113b2847fc9-kube-api-access-x4949\") pod \"lws-controller-manager-59bdd75cb8-qnvjr\" (UID: \"5152bab5-89e3-4ee6-b4f7-1113b2847fc9\") " pod="openshift-lws-operator/lws-controller-manager-59bdd75cb8-qnvjr"
Jul 18 11:26:14.436106 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.436063    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5152bab5-89e3-4ee6-b4f7-1113b2847fc9-metrics-cert\") pod \"lws-controller-manager-59bdd75cb8-qnvjr\" (UID: \"5152bab5-89e3-4ee6-b4f7-1113b2847fc9\") " pod="openshift-lws-operator/lws-controller-manager-59bdd75cb8-qnvjr"
Jul 18 11:26:14.436317 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.436125    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4949\" (UniqueName: \"kubernetes.io/projected/5152bab5-89e3-4ee6-b4f7-1113b2847fc9-kube-api-access-x4949\") pod \"lws-controller-manager-59bdd75cb8-qnvjr\" (UID: \"5152bab5-89e3-4ee6-b4f7-1113b2847fc9\") " pod="openshift-lws-operator/lws-controller-manager-59bdd75cb8-qnvjr"
Jul 18 11:26:14.436317 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.436165    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5152bab5-89e3-4ee6-b4f7-1113b2847fc9-manager-config\") pod \"lws-controller-manager-59bdd75cb8-qnvjr\" (UID: \"5152bab5-89e3-4ee6-b4f7-1113b2847fc9\") " pod="openshift-lws-operator/lws-controller-manager-59bdd75cb8-qnvjr"
Jul 18 11:26:14.436317 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.436185    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5152bab5-89e3-4ee6-b4f7-1113b2847fc9-cert\") pod \"lws-controller-manager-59bdd75cb8-qnvjr\" (UID: \"5152bab5-89e3-4ee6-b4f7-1113b2847fc9\") " pod="openshift-lws-operator/lws-controller-manager-59bdd75cb8-qnvjr"
Jul 18 11:26:14.436850 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.436822    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5152bab5-89e3-4ee6-b4f7-1113b2847fc9-manager-config\") pod \"lws-controller-manager-59bdd75cb8-qnvjr\" (UID: \"5152bab5-89e3-4ee6-b4f7-1113b2847fc9\") " pod="openshift-lws-operator/lws-controller-manager-59bdd75cb8-qnvjr"
Jul 18 11:26:14.438593 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.438563    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5152bab5-89e3-4ee6-b4f7-1113b2847fc9-cert\") pod \"lws-controller-manager-59bdd75cb8-qnvjr\" (UID: \"5152bab5-89e3-4ee6-b4f7-1113b2847fc9\") " pod="openshift-lws-operator/lws-controller-manager-59bdd75cb8-qnvjr"
Jul 18 11:26:14.438702 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.438628    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5152bab5-89e3-4ee6-b4f7-1113b2847fc9-metrics-cert\") pod \"lws-controller-manager-59bdd75cb8-qnvjr\" (UID: \"5152bab5-89e3-4ee6-b4f7-1113b2847fc9\") " pod="openshift-lws-operator/lws-controller-manager-59bdd75cb8-qnvjr"
Jul 18 11:26:14.443472 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.443450    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4949\" (UniqueName: \"kubernetes.io/projected/5152bab5-89e3-4ee6-b4f7-1113b2847fc9-kube-api-access-x4949\") pod \"lws-controller-manager-59bdd75cb8-qnvjr\" (UID: \"5152bab5-89e3-4ee6-b4f7-1113b2847fc9\") " pod="openshift-lws-operator/lws-controller-manager-59bdd75cb8-qnvjr"
Jul 18 11:26:14.556225 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.556191    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59bdd75cb8-qnvjr"
Jul 18 11:26:14.699700 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:14.699670    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59bdd75cb8-qnvjr"]
Jul 18 11:26:14.703503 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:26:14.703477    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5152bab5_89e3_4ee6_b4f7_1113b2847fc9.slice/crio-42e35938f5ae52f0085c5f2071091bf5caef080068174b0fc3e0a20b01bb1f5c WatchSource:0}: Error finding container 42e35938f5ae52f0085c5f2071091bf5caef080068174b0fc3e0a20b01bb1f5c: Status 404 returned error can't find the container with id 42e35938f5ae52f0085c5f2071091bf5caef080068174b0fc3e0a20b01bb1f5c
Jul 18 11:26:15.405023 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:15.404989    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59bdd75cb8-qnvjr" event={"ID":"5152bab5-89e3-4ee6-b4f7-1113b2847fc9","Type":"ContainerStarted","Data":"42e35938f5ae52f0085c5f2071091bf5caef080068174b0fc3e0a20b01bb1f5c"}
Jul 18 11:26:22.690296 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.690257    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm"]
Jul 18 11:26:22.693325 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.693307    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm"
Jul 18 11:26:22.697396 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.697375    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 18 11:26:22.697497 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.697401    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-58g65\""
Jul 18 11:26:22.697497 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.697403    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 18 11:26:22.697497 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.697373    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 18 11:26:22.697729 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.697716    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 18 11:26:22.713759 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.713735    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm"]
Jul 18 11:26:22.808527 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.808488    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a9bca71-cd64-4a00-a38b-f573d9d41a14-webhook-cert\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm\" (UID: \"2a9bca71-cd64-4a00-a38b-f573d9d41a14\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm"
Jul 18 11:26:22.808705 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.808553    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a9bca71-cd64-4a00-a38b-f573d9d41a14-tmp\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm\" (UID: \"2a9bca71-cd64-4a00-a38b-f573d9d41a14\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm"
Jul 18 11:26:22.808705 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.808579    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2a9bca71-cd64-4a00-a38b-f573d9d41a14-manifests\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm\" (UID: \"2a9bca71-cd64-4a00-a38b-f573d9d41a14\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm"
Jul 18 11:26:22.808705 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.808622    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzsms\" (UniqueName: \"kubernetes.io/projected/2a9bca71-cd64-4a00-a38b-f573d9d41a14-kube-api-access-zzsms\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm\" (UID: \"2a9bca71-cd64-4a00-a38b-f573d9d41a14\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm"
Jul 18 11:26:22.808705 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.808639    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2a9bca71-cd64-4a00-a38b-f573d9d41a14-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm\" (UID: \"2a9bca71-cd64-4a00-a38b-f573d9d41a14\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm"
Jul 18 11:26:22.909623 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.909585    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a9bca71-cd64-4a00-a38b-f573d9d41a14-webhook-cert\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm\" (UID: \"2a9bca71-cd64-4a00-a38b-f573d9d41a14\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm"
Jul 18 11:26:22.909797 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.909633    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a9bca71-cd64-4a00-a38b-f573d9d41a14-tmp\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm\" (UID: \"2a9bca71-cd64-4a00-a38b-f573d9d41a14\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm"
Jul 18 11:26:22.909797 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.909654    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2a9bca71-cd64-4a00-a38b-f573d9d41a14-manifests\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm\" (UID: \"2a9bca71-cd64-4a00-a38b-f573d9d41a14\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm"
Jul 18 11:26:22.909797 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.909707    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzsms\" (UniqueName: \"kubernetes.io/projected/2a9bca71-cd64-4a00-a38b-f573d9d41a14-kube-api-access-zzsms\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm\" (UID: \"2a9bca71-cd64-4a00-a38b-f573d9d41a14\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm"
Jul 18 11:26:22.909797 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.909731    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2a9bca71-cd64-4a00-a38b-f573d9d41a14-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm\" (UID: \"2a9bca71-cd64-4a00-a38b-f573d9d41a14\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm"
Jul 18 11:26:22.910192 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.910171    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2a9bca71-cd64-4a00-a38b-f573d9d41a14-manifests\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm\" (UID: \"2a9bca71-cd64-4a00-a38b-f573d9d41a14\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm"
Jul 18 11:26:22.911928 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.911910    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a9bca71-cd64-4a00-a38b-f573d9d41a14-tmp\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm\" (UID: \"2a9bca71-cd64-4a00-a38b-f573d9d41a14\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm"
Jul 18 11:26:22.912165 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.912148    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2a9bca71-cd64-4a00-a38b-f573d9d41a14-apiservice-cert\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm\" (UID: \"2a9bca71-cd64-4a00-a38b-f573d9d41a14\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm"
Jul 18 11:26:22.912224 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.912161    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2a9bca71-cd64-4a00-a38b-f573d9d41a14-webhook-cert\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm\" (UID: \"2a9bca71-cd64-4a00-a38b-f573d9d41a14\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm"
Jul 18 11:26:22.918374 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:22.918354    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzsms\" (UniqueName: \"kubernetes.io/projected/2a9bca71-cd64-4a00-a38b-f573d9d41a14-kube-api-access-zzsms\") pod \"opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm\" (UID: \"2a9bca71-cd64-4a00-a38b-f573d9d41a14\") " pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm"
Jul 18 11:26:23.003993 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:23.003964    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm"
Jul 18 11:26:23.133447 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:23.133294    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm"]
Jul 18 11:26:23.136335 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:26:23.136308    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a9bca71_cd64_4a00_a38b_f573d9d41a14.slice/crio-76464848050e5368b9a5614d1d569ed5e2092f9aeff23bd8ea0082fb97af417f WatchSource:0}: Error finding container 76464848050e5368b9a5614d1d569ed5e2092f9aeff23bd8ea0082fb97af417f: Status 404 returned error can't find the container with id 76464848050e5368b9a5614d1d569ed5e2092f9aeff23bd8ea0082fb97af417f
Jul 18 11:26:23.432198 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:23.432115    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm" event={"ID":"2a9bca71-cd64-4a00-a38b-f573d9d41a14","Type":"ContainerStarted","Data":"76464848050e5368b9a5614d1d569ed5e2092f9aeff23bd8ea0082fb97af417f"}
Jul 18 11:26:26.447377 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:26.447244    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm" event={"ID":"2a9bca71-cd64-4a00-a38b-f573d9d41a14","Type":"ContainerStarted","Data":"56f2eb1c18a7d2960db30944af7ddbce19041627ae3ebb9f290355ed56ac2c16"}
Jul 18 11:26:28.456808 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:28.456766    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59bdd75cb8-qnvjr" event={"ID":"5152bab5-89e3-4ee6-b4f7-1113b2847fc9","Type":"ContainerStarted","Data":"15bdcb745ab03e3176bbf554e1d06fcd77842962c2b2eb174db5452c7c915133"}
Jul 18 11:26:28.457261 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:28.456908    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-59bdd75cb8-qnvjr"
Jul 18 11:26:28.458266 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:28.458244    2554 generic.go:356] "Generic (PLEG): container finished" podID="2a9bca71-cd64-4a00-a38b-f573d9d41a14" containerID="56f2eb1c18a7d2960db30944af7ddbce19041627ae3ebb9f290355ed56ac2c16" exitCode=0
Jul 18 11:26:28.458378 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:28.458314    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm" event={"ID":"2a9bca71-cd64-4a00-a38b-f573d9d41a14","Type":"ContainerDied","Data":"56f2eb1c18a7d2960db30944af7ddbce19041627ae3ebb9f290355ed56ac2c16"}
Jul 18 11:26:28.473742 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:28.473698    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-59bdd75cb8-qnvjr" podStartSLOduration=1.478592203 podStartE2EDuration="14.473684176s" totalImagesPullingTime="12.995091973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:26:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:26:28.472387171 +0000 UTC m=+390.074516909" watchObservedRunningTime="2026-07-18 11:26:28.473684176 +0000 UTC m=+390.075813913"
Jul 18 11:26:29.463562 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:29.463527    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm" event={"ID":"2a9bca71-cd64-4a00-a38b-f573d9d41a14","Type":"ContainerStarted","Data":"22c7062ec0b65e74f91b668cd755dcc352634b65b6494a929731eb4a73e63558"}
Jul 18 11:26:29.463990 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:29.463816    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm"
Jul 18 11:26:29.484377 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:29.484326    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm" podStartSLOduration=3.002102665 podStartE2EDuration="7.484313606s" totalImagesPullingTime="3.187065758s" totalInitContainerRuntime="1.295145183s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:26:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:26:29.483757689 +0000 UTC m=+391.085887441" watchObservedRunningTime="2026-07-18 11:26:29.484313606 +0000 UTC m=+391.086443343"
Jul 18 11:26:39.465874 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:39.465845    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-59bdd75cb8-qnvjr"
Jul 18 11:26:40.471239 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:40.471209    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm"
Jul 18 11:26:42.782798 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:42.782765    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6df8599d98-zhv2d"]
Jul 18 11:26:42.791395 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:42.791378    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6df8599d98-zhv2d"
Jul 18 11:26:42.796285 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:42.796262    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 18 11:26:42.796867 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:42.796845    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-x776w\""
Jul 18 11:26:42.796958 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:42.796873    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 18 11:26:42.797280 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:42.797257    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 18 11:26:42.797362 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:42.797260    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 18 11:26:42.813406 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:42.813376    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6df8599d98-zhv2d"]
Jul 18 11:26:42.867780 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:42.867742    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x56p\" (UniqueName: \"kubernetes.io/projected/220c5f02-eca2-47b4-b816-0d448b77c3d1-kube-api-access-5x56p\") pod \"kube-auth-proxy-6df8599d98-zhv2d\" (UID: \"220c5f02-eca2-47b4-b816-0d448b77c3d1\") " pod="openshift-ingress/kube-auth-proxy-6df8599d98-zhv2d"
Jul 18 11:26:42.867780 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:42.867783    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/220c5f02-eca2-47b4-b816-0d448b77c3d1-tmp\") pod \"kube-auth-proxy-6df8599d98-zhv2d\" (UID: \"220c5f02-eca2-47b4-b816-0d448b77c3d1\") " pod="openshift-ingress/kube-auth-proxy-6df8599d98-zhv2d"
Jul 18 11:26:42.867989 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:42.867834    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/220c5f02-eca2-47b4-b816-0d448b77c3d1-tls-certs\") pod \"kube-auth-proxy-6df8599d98-zhv2d\" (UID: \"220c5f02-eca2-47b4-b816-0d448b77c3d1\") " pod="openshift-ingress/kube-auth-proxy-6df8599d98-zhv2d"
Jul 18 11:26:42.968268 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:42.968228    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x56p\" (UniqueName: \"kubernetes.io/projected/220c5f02-eca2-47b4-b816-0d448b77c3d1-kube-api-access-5x56p\") pod \"kube-auth-proxy-6df8599d98-zhv2d\" (UID: \"220c5f02-eca2-47b4-b816-0d448b77c3d1\") " pod="openshift-ingress/kube-auth-proxy-6df8599d98-zhv2d"
Jul 18 11:26:42.968268 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:42.968269    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/220c5f02-eca2-47b4-b816-0d448b77c3d1-tmp\") pod \"kube-auth-proxy-6df8599d98-zhv2d\" (UID: \"220c5f02-eca2-47b4-b816-0d448b77c3d1\") " pod="openshift-ingress/kube-auth-proxy-6df8599d98-zhv2d"
Jul 18 11:26:42.968496 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:42.968331    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/220c5f02-eca2-47b4-b816-0d448b77c3d1-tls-certs\") pod \"kube-auth-proxy-6df8599d98-zhv2d\" (UID: \"220c5f02-eca2-47b4-b816-0d448b77c3d1\") " pod="openshift-ingress/kube-auth-proxy-6df8599d98-zhv2d"
Jul 18 11:26:42.970750 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:42.970718    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/220c5f02-eca2-47b4-b816-0d448b77c3d1-tmp\") pod \"kube-auth-proxy-6df8599d98-zhv2d\" (UID: \"220c5f02-eca2-47b4-b816-0d448b77c3d1\") " pod="openshift-ingress/kube-auth-proxy-6df8599d98-zhv2d"
Jul 18 11:26:42.971229 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:42.971212    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/220c5f02-eca2-47b4-b816-0d448b77c3d1-tls-certs\") pod \"kube-auth-proxy-6df8599d98-zhv2d\" (UID: \"220c5f02-eca2-47b4-b816-0d448b77c3d1\") " pod="openshift-ingress/kube-auth-proxy-6df8599d98-zhv2d"
Jul 18 11:26:42.979172 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:42.979149    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x56p\" (UniqueName: \"kubernetes.io/projected/220c5f02-eca2-47b4-b816-0d448b77c3d1-kube-api-access-5x56p\") pod \"kube-auth-proxy-6df8599d98-zhv2d\" (UID: \"220c5f02-eca2-47b4-b816-0d448b77c3d1\") " pod="openshift-ingress/kube-auth-proxy-6df8599d98-zhv2d"
Jul 18 11:26:43.101331 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:43.101255    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6df8599d98-zhv2d"
Jul 18 11:26:43.225192 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:43.225161    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6df8599d98-zhv2d"]
Jul 18 11:26:43.228291 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:26:43.228255    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod220c5f02_eca2_47b4_b816_0d448b77c3d1.slice/crio-466b5e8bcbdc6ee6b5f57271f2b7481f72a2ca69b236f2ad31c29d1e7addbcbc WatchSource:0}: Error finding container 466b5e8bcbdc6ee6b5f57271f2b7481f72a2ca69b236f2ad31c29d1e7addbcbc: Status 404 returned error can't find the container with id 466b5e8bcbdc6ee6b5f57271f2b7481f72a2ca69b236f2ad31c29d1e7addbcbc
Jul 18 11:26:43.513946 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:43.513912    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6df8599d98-zhv2d" event={"ID":"220c5f02-eca2-47b4-b816-0d448b77c3d1","Type":"ContainerStarted","Data":"466b5e8bcbdc6ee6b5f57271f2b7481f72a2ca69b236f2ad31c29d1e7addbcbc"}
Jul 18 11:26:45.522801 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:45.522768    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6df8599d98-zhv2d" event={"ID":"220c5f02-eca2-47b4-b816-0d448b77c3d1","Type":"ContainerStarted","Data":"e6c1d7d7359dfa4e0e7ad1a252f34d064f534562a72ca5e6e876b4ce8690f02d"}
Jul 18 11:26:45.539392 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:45.539335    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6df8599d98-zhv2d" podStartSLOduration=1.309902409 podStartE2EDuration="3.539318267s" totalImagesPullingTime="2.229415858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:26:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:26:45.538315886 +0000 UTC m=+407.140445625" watchObservedRunningTime="2026-07-18 11:26:45.539318267 +0000 UTC m=+407.141448049"
Jul 18 11:26:50.748750 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.748714    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"]
Jul 18 11:26:50.752354 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.752335    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.754878 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.754860    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 18 11:26:50.755153 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.755136    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mpscq\""
Jul 18 11:26:50.764815 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.764794    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"]
Jul 18 11:26:50.826805 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.826766    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf979\" (UniqueName: \"kubernetes.io/projected/4282d415-1a26-4624-a43a-e1443282dcb3-kube-api-access-zf979\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.826986 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.826826    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4282d415-1a26-4624-a43a-e1443282dcb3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.826986 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.826847    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4282d415-1a26-4624-a43a-e1443282dcb3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.826986 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.826875    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4282d415-1a26-4624-a43a-e1443282dcb3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.826986 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.826923    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4282d415-1a26-4624-a43a-e1443282dcb3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.827244 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.827025    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4282d415-1a26-4624-a43a-e1443282dcb3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.827244 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.827087    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4282d415-1a26-4624-a43a-e1443282dcb3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.827244 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.827164    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4282d415-1a26-4624-a43a-e1443282dcb3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.827244 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.827191    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4282d415-1a26-4624-a43a-e1443282dcb3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.928523 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.928483    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4282d415-1a26-4624-a43a-e1443282dcb3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.928523 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.928520    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4282d415-1a26-4624-a43a-e1443282dcb3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.928771 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.928543    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4282d415-1a26-4624-a43a-e1443282dcb3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.928771 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.928570    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4282d415-1a26-4624-a43a-e1443282dcb3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.928771 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.928600    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4282d415-1a26-4624-a43a-e1443282dcb3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.928771 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.928628    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4282d415-1a26-4624-a43a-e1443282dcb3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.928771 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.928665    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4282d415-1a26-4624-a43a-e1443282dcb3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.928771 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.928690    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4282d415-1a26-4624-a43a-e1443282dcb3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.928771 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.928718    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf979\" (UniqueName: \"kubernetes.io/projected/4282d415-1a26-4624-a43a-e1443282dcb3-kube-api-access-zf979\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.929125 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.928997    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4282d415-1a26-4624-a43a-e1443282dcb3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.929227 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.929205    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4282d415-1a26-4624-a43a-e1443282dcb3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.929274 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.929256    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4282d415-1a26-4624-a43a-e1443282dcb3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.929330 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.929283    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4282d415-1a26-4624-a43a-e1443282dcb3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.929457 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.929441    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4282d415-1a26-4624-a43a-e1443282dcb3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.931398 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.931372    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4282d415-1a26-4624-a43a-e1443282dcb3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.931778 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.931746    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4282d415-1a26-4624-a43a-e1443282dcb3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.941789 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.941765    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf979\" (UniqueName: \"kubernetes.io/projected/4282d415-1a26-4624-a43a-e1443282dcb3-kube-api-access-zf979\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:50.944752 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:50.944735    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4282d415-1a26-4624-a43a-e1443282dcb3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4r76ph\" (UID: \"4282d415-1a26-4624-a43a-e1443282dcb3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:51.061676 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:51.061572    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:51.195937 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:51.195771    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"]
Jul 18 11:26:51.198529 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:26:51.198501    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4282d415_1a26_4624_a43a_e1443282dcb3.slice/crio-b0efcb3a8ee72b1b21bb3c1077d9c214423bc2c5d24b929262aa0f81d371a1fa WatchSource:0}: Error finding container b0efcb3a8ee72b1b21bb3c1077d9c214423bc2c5d24b929262aa0f81d371a1fa: Status 404 returned error can't find the container with id b0efcb3a8ee72b1b21bb3c1077d9c214423bc2c5d24b929262aa0f81d371a1fa
Jul 18 11:26:51.546724 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:51.546681    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph" event={"ID":"4282d415-1a26-4624-a43a-e1443282dcb3","Type":"ContainerStarted","Data":"b0efcb3a8ee72b1b21bb3c1077d9c214423bc2c5d24b929262aa0f81d371a1fa"}
Jul 18 11:26:52.814127 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:52.814071    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8668c"]
Jul 18 11:26:52.820986 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:52.820957    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8668c"
Jul 18 11:26:52.824671 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:52.824646    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 18 11:26:52.825760 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:52.825739    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-llptg\""
Jul 18 11:26:52.831929 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:52.831904    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8668c"]
Jul 18 11:26:52.848190 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:52.848161    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pr52\" (UniqueName: \"kubernetes.io/projected/6070d061-b3a8-4ed5-9a75-07aa80c8e784-kube-api-access-7pr52\") pod \"llmisvc-controller-manager-777c6bd7d5-8668c\" (UID: \"6070d061-b3a8-4ed5-9a75-07aa80c8e784\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8668c"
Jul 18 11:26:52.848366 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:52.848276    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6070d061-b3a8-4ed5-9a75-07aa80c8e784-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8668c\" (UID: \"6070d061-b3a8-4ed5-9a75-07aa80c8e784\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8668c"
Jul 18 11:26:52.948814 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:52.948782    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6070d061-b3a8-4ed5-9a75-07aa80c8e784-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8668c\" (UID: \"6070d061-b3a8-4ed5-9a75-07aa80c8e784\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8668c"
Jul 18 11:26:52.949008 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:52.948848    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pr52\" (UniqueName: \"kubernetes.io/projected/6070d061-b3a8-4ed5-9a75-07aa80c8e784-kube-api-access-7pr52\") pod \"llmisvc-controller-manager-777c6bd7d5-8668c\" (UID: \"6070d061-b3a8-4ed5-9a75-07aa80c8e784\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8668c"
Jul 18 11:26:52.951595 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:52.951572    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6070d061-b3a8-4ed5-9a75-07aa80c8e784-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8668c\" (UID: \"6070d061-b3a8-4ed5-9a75-07aa80c8e784\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8668c"
Jul 18 11:26:52.961270 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:52.961244    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pr52\" (UniqueName: \"kubernetes.io/projected/6070d061-b3a8-4ed5-9a75-07aa80c8e784-kube-api-access-7pr52\") pod \"llmisvc-controller-manager-777c6bd7d5-8668c\" (UID: \"6070d061-b3a8-4ed5-9a75-07aa80c8e784\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8668c"
Jul 18 11:26:53.133223 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:53.133136    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8668c"
Jul 18 11:26:53.683400 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:53.683354    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:26:53.683515 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:53.683456    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:26:53.683515 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:53.683502    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:26:53.755167 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:53.755112    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8668c"]
Jul 18 11:26:53.758956 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:26:53.758930    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6070d061_b3a8_4ed5_9a75_07aa80c8e784.slice/crio-4e884da39301e1f1b356d63384cd0a9b3337f7af503b8f8050cf5dc28e5a6873 WatchSource:0}: Error finding container 4e884da39301e1f1b356d63384cd0a9b3337f7af503b8f8050cf5dc28e5a6873: Status 404 returned error can't find the container with id 4e884da39301e1f1b356d63384cd0a9b3337f7af503b8f8050cf5dc28e5a6873
Jul 18 11:26:54.562303 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:54.562265    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph" event={"ID":"4282d415-1a26-4624-a43a-e1443282dcb3","Type":"ContainerStarted","Data":"52a9ff94959fb6666baaed3124ef373b89406d45204844a12c9f8226c9a67a42"}
Jul 18 11:26:54.563481 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:54.563441    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8668c" event={"ID":"6070d061-b3a8-4ed5-9a75-07aa80c8e784","Type":"ContainerStarted","Data":"4e884da39301e1f1b356d63384cd0a9b3337f7af503b8f8050cf5dc28e5a6873"}
Jul 18 11:26:54.587061 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:54.587006    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph" podStartSLOduration=2.104499819 podStartE2EDuration="4.586967487s" totalImagesPullingTime="2.482467668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:26:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:26:54.586165484 +0000 UTC m=+416.188295221" watchObservedRunningTime="2026-07-18 11:26:54.586967487 +0000 UTC m=+416.189097226"
Jul 18 11:26:55.062601 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:55.062479    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:55.068457 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:55.068426    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:55.567196 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:55.567159    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:55.568066 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:55.568047    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4r76ph"
Jul 18 11:26:56.573036 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:56.572957    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8668c" event={"ID":"6070d061-b3a8-4ed5-9a75-07aa80c8e784","Type":"ContainerStarted","Data":"d172f9b990a977571fba19d2604296f2edfbc6fe956c6a18a784442d138a19ff"}
Jul 18 11:26:56.573423 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:56.573222    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8668c"
Jul 18 11:26:56.589846 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:26:56.589797    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8668c" podStartSLOduration=2.030167964 podStartE2EDuration="4.58978129s" totalImagesPullingTime="2.559613326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:26:56.588569773 +0000 UTC m=+418.190699509" watchObservedRunningTime="2026-07-18 11:26:56.58978129 +0000 UTC m=+418.191911028"
Jul 18 11:27:27.579311 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:27.579236    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8668c"
Jul 18 11:27:40.283912 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.283864    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c7dc6455-r9txj"]
Jul 18 11:27:40.294313 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.294290    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.296844 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.296817    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 18 11:27:40.297696 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.297485    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 18 11:27:40.297696 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.297548    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 18 11:27:40.297696 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.297556    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 18 11:27:40.297696 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.297584    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 18 11:27:40.297696 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.297638    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-t4pht\""
Jul 18 11:27:40.298083 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.297714    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 18 11:27:40.298083 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.297889    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 18 11:27:40.298083 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.297950    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c7dc6455-r9txj"]
Jul 18 11:27:40.302246 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.302225    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 18 11:27:40.338518 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.338493    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66b7c568-5d8b-48e2-bd44-c6ed11085e92-console-serving-cert\") pod \"console-c7dc6455-r9txj\" (UID: \"66b7c568-5d8b-48e2-bd44-c6ed11085e92\") " pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.338637 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.338521    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxl4c\" (UniqueName: \"kubernetes.io/projected/66b7c568-5d8b-48e2-bd44-c6ed11085e92-kube-api-access-kxl4c\") pod \"console-c7dc6455-r9txj\" (UID: \"66b7c568-5d8b-48e2-bd44-c6ed11085e92\") " pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.338637 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.338554    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66b7c568-5d8b-48e2-bd44-c6ed11085e92-console-oauth-config\") pod \"console-c7dc6455-r9txj\" (UID: \"66b7c568-5d8b-48e2-bd44-c6ed11085e92\") " pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.338637 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.338583    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66b7c568-5d8b-48e2-bd44-c6ed11085e92-trusted-ca-bundle\") pod \"console-c7dc6455-r9txj\" (UID: \"66b7c568-5d8b-48e2-bd44-c6ed11085e92\") " pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.338735 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.338664    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66b7c568-5d8b-48e2-bd44-c6ed11085e92-console-config\") pod \"console-c7dc6455-r9txj\" (UID: \"66b7c568-5d8b-48e2-bd44-c6ed11085e92\") " pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.338735 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.338710    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66b7c568-5d8b-48e2-bd44-c6ed11085e92-service-ca\") pod \"console-c7dc6455-r9txj\" (UID: \"66b7c568-5d8b-48e2-bd44-c6ed11085e92\") " pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.338794 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.338734    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66b7c568-5d8b-48e2-bd44-c6ed11085e92-oauth-serving-cert\") pod \"console-c7dc6455-r9txj\" (UID: \"66b7c568-5d8b-48e2-bd44-c6ed11085e92\") " pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.439580 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.439545    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66b7c568-5d8b-48e2-bd44-c6ed11085e92-console-oauth-config\") pod \"console-c7dc6455-r9txj\" (UID: \"66b7c568-5d8b-48e2-bd44-c6ed11085e92\") " pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.439580 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.439577    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66b7c568-5d8b-48e2-bd44-c6ed11085e92-trusted-ca-bundle\") pod \"console-c7dc6455-r9txj\" (UID: \"66b7c568-5d8b-48e2-bd44-c6ed11085e92\") " pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.439804 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.439650    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66b7c568-5d8b-48e2-bd44-c6ed11085e92-console-config\") pod \"console-c7dc6455-r9txj\" (UID: \"66b7c568-5d8b-48e2-bd44-c6ed11085e92\") " pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.439804 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.439728    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66b7c568-5d8b-48e2-bd44-c6ed11085e92-service-ca\") pod \"console-c7dc6455-r9txj\" (UID: \"66b7c568-5d8b-48e2-bd44-c6ed11085e92\") " pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.439804 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.439751    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66b7c568-5d8b-48e2-bd44-c6ed11085e92-oauth-serving-cert\") pod \"console-c7dc6455-r9txj\" (UID: \"66b7c568-5d8b-48e2-bd44-c6ed11085e92\") " pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.439986 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.439938    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66b7c568-5d8b-48e2-bd44-c6ed11085e92-console-serving-cert\") pod \"console-c7dc6455-r9txj\" (UID: \"66b7c568-5d8b-48e2-bd44-c6ed11085e92\") " pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.439986 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.439975    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxl4c\" (UniqueName: \"kubernetes.io/projected/66b7c568-5d8b-48e2-bd44-c6ed11085e92-kube-api-access-kxl4c\") pod \"console-c7dc6455-r9txj\" (UID: \"66b7c568-5d8b-48e2-bd44-c6ed11085e92\") " pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.440361 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.440334    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/66b7c568-5d8b-48e2-bd44-c6ed11085e92-console-config\") pod \"console-c7dc6455-r9txj\" (UID: \"66b7c568-5d8b-48e2-bd44-c6ed11085e92\") " pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.440468 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.440433    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/66b7c568-5d8b-48e2-bd44-c6ed11085e92-oauth-serving-cert\") pod \"console-c7dc6455-r9txj\" (UID: \"66b7c568-5d8b-48e2-bd44-c6ed11085e92\") " pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.440523 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.440504    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66b7c568-5d8b-48e2-bd44-c6ed11085e92-trusted-ca-bundle\") pod \"console-c7dc6455-r9txj\" (UID: \"66b7c568-5d8b-48e2-bd44-c6ed11085e92\") " pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.440619 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.440596    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/66b7c568-5d8b-48e2-bd44-c6ed11085e92-service-ca\") pod \"console-c7dc6455-r9txj\" (UID: \"66b7c568-5d8b-48e2-bd44-c6ed11085e92\") " pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.442137 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.442120    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/66b7c568-5d8b-48e2-bd44-c6ed11085e92-console-oauth-config\") pod \"console-c7dc6455-r9txj\" (UID: \"66b7c568-5d8b-48e2-bd44-c6ed11085e92\") " pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.442547 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.442513    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/66b7c568-5d8b-48e2-bd44-c6ed11085e92-console-serving-cert\") pod \"console-c7dc6455-r9txj\" (UID: \"66b7c568-5d8b-48e2-bd44-c6ed11085e92\") " pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.451405 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.451384    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxl4c\" (UniqueName: \"kubernetes.io/projected/66b7c568-5d8b-48e2-bd44-c6ed11085e92-kube-api-access-kxl4c\") pod \"console-c7dc6455-r9txj\" (UID: \"66b7c568-5d8b-48e2-bd44-c6ed11085e92\") " pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.604325 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.604247    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:40.729400 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:40.729369    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c7dc6455-r9txj"]
Jul 18 11:27:40.732230 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:27:40.732204    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66b7c568_5d8b_48e2_bd44_c6ed11085e92.slice/crio-594a2cce0d47e6ac79e09ddfe93fd851dde9a68fbc7d85fa3ccf4e2c6e645d13 WatchSource:0}: Error finding container 594a2cce0d47e6ac79e09ddfe93fd851dde9a68fbc7d85fa3ccf4e2c6e645d13: Status 404 returned error can't find the container with id 594a2cce0d47e6ac79e09ddfe93fd851dde9a68fbc7d85fa3ccf4e2c6e645d13
Jul 18 11:27:41.740942 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:41.740907    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c7dc6455-r9txj" event={"ID":"66b7c568-5d8b-48e2-bd44-c6ed11085e92","Type":"ContainerStarted","Data":"66ab5ff24a10dfdb8d6252fed3caff8e79702acbb276f7cfb5a09b12af0e679f"}
Jul 18 11:27:41.741328 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:41.740988    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c7dc6455-r9txj" event={"ID":"66b7c568-5d8b-48e2-bd44-c6ed11085e92","Type":"ContainerStarted","Data":"594a2cce0d47e6ac79e09ddfe93fd851dde9a68fbc7d85fa3ccf4e2c6e645d13"}
Jul 18 11:27:41.759202 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:41.759157    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c7dc6455-r9txj" podStartSLOduration=1.7591438560000001 podStartE2EDuration="1.759143856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:27:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:27:41.757920109 +0000 UTC m=+463.360049873" watchObservedRunningTime="2026-07-18 11:27:41.759143856 +0000 UTC m=+463.361273592"
Jul 18 11:27:50.605139 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:50.605076    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:50.605562 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:50.605165    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:50.609667 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:50.609648    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:27:50.781061 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:27:50.781035    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c7dc6455-r9txj"
Jul 18 11:28:37.066631 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:37.066592    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gs64g"]
Jul 18 11:28:37.069525 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:37.069503    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gs64g"
Jul 18 11:28:37.071645 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:37.071626    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 18 11:28:37.071743 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:37.071684    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 18 11:28:37.072533 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:37.072513    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 18 11:28:37.072629 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:37.072553    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 18 11:28:37.072629 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:37.072576    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-799hc\""
Jul 18 11:28:37.077652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:37.077626    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gs64g"]
Jul 18 11:28:37.106390 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:37.106361    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/80589be0-03bb-4c53-a61f-506c4cbf6bba-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gs64g\" (UID: \"80589be0-03bb-4c53-a61f-506c4cbf6bba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gs64g"
Jul 18 11:28:37.106502 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:37.106400    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4pdk\" (UniqueName: \"kubernetes.io/projected/80589be0-03bb-4c53-a61f-506c4cbf6bba-kube-api-access-c4pdk\") pod \"kuadrant-console-plugin-66b5774985-gs64g\" (UID: \"80589be0-03bb-4c53-a61f-506c4cbf6bba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gs64g"
Jul 18 11:28:37.106502 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:37.106427    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/80589be0-03bb-4c53-a61f-506c4cbf6bba-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gs64g\" (UID: \"80589be0-03bb-4c53-a61f-506c4cbf6bba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gs64g"
Jul 18 11:28:37.207614 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:37.207578    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/80589be0-03bb-4c53-a61f-506c4cbf6bba-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gs64g\" (UID: \"80589be0-03bb-4c53-a61f-506c4cbf6bba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gs64g"
Jul 18 11:28:37.207614 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:37.207614    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4pdk\" (UniqueName: \"kubernetes.io/projected/80589be0-03bb-4c53-a61f-506c4cbf6bba-kube-api-access-c4pdk\") pod \"kuadrant-console-plugin-66b5774985-gs64g\" (UID: \"80589be0-03bb-4c53-a61f-506c4cbf6bba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gs64g"
Jul 18 11:28:37.207808 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:37.207635    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/80589be0-03bb-4c53-a61f-506c4cbf6bba-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gs64g\" (UID: \"80589be0-03bb-4c53-a61f-506c4cbf6bba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gs64g"
Jul 18 11:28:37.208259 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:37.208242    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/80589be0-03bb-4c53-a61f-506c4cbf6bba-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-gs64g\" (UID: \"80589be0-03bb-4c53-a61f-506c4cbf6bba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gs64g"
Jul 18 11:28:37.209785 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:37.209769    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/80589be0-03bb-4c53-a61f-506c4cbf6bba-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-gs64g\" (UID: \"80589be0-03bb-4c53-a61f-506c4cbf6bba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gs64g"
Jul 18 11:28:37.214885 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:37.214863    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4pdk\" (UniqueName: \"kubernetes.io/projected/80589be0-03bb-4c53-a61f-506c4cbf6bba-kube-api-access-c4pdk\") pod \"kuadrant-console-plugin-66b5774985-gs64g\" (UID: \"80589be0-03bb-4c53-a61f-506c4cbf6bba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gs64g"
Jul 18 11:28:37.379005 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:37.378918    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gs64g"
Jul 18 11:28:37.500515 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:37.500484    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-gs64g"]
Jul 18 11:28:37.504570 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:28:37.504541    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod80589be0_03bb_4c53_a61f_506c4cbf6bba.slice/crio-9264f0e3efb4cbc82c71064690c35338323aa739a1027f403c82a744642ad6ad WatchSource:0}: Error finding container 9264f0e3efb4cbc82c71064690c35338323aa739a1027f403c82a744642ad6ad: Status 404 returned error can't find the container with id 9264f0e3efb4cbc82c71064690c35338323aa739a1027f403c82a744642ad6ad
Jul 18 11:28:37.960445 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:37.960412    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gs64g" event={"ID":"80589be0-03bb-4c53-a61f-506c4cbf6bba","Type":"ContainerStarted","Data":"9264f0e3efb4cbc82c71064690c35338323aa739a1027f403c82a744642ad6ad"}
Jul 18 11:28:48.230081 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:48.230048    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n"]
Jul 18 11:28:48.308213 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:48.308172    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n"]
Jul 18 11:28:48.308383 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:48.308306    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n"
Jul 18 11:28:48.310830 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:48.310808    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6g7qj\""
Jul 18 11:28:48.408389 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:48.408354    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/be4938a8-9d6c-4729-889b-040e07ffad74-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9ss9n\" (UID: \"be4938a8-9d6c-4729-889b-040e07ffad74\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n"
Jul 18 11:28:48.408552 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:48.408409    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57p2j\" (UniqueName: \"kubernetes.io/projected/be4938a8-9d6c-4729-889b-040e07ffad74-kube-api-access-57p2j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9ss9n\" (UID: \"be4938a8-9d6c-4729-889b-040e07ffad74\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n"
Jul 18 11:28:48.509133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:48.509077    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57p2j\" (UniqueName: \"kubernetes.io/projected/be4938a8-9d6c-4729-889b-040e07ffad74-kube-api-access-57p2j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9ss9n\" (UID: \"be4938a8-9d6c-4729-889b-040e07ffad74\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n"
Jul 18 11:28:48.509320 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:48.509208    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/be4938a8-9d6c-4729-889b-040e07ffad74-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9ss9n\" (UID: \"be4938a8-9d6c-4729-889b-040e07ffad74\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n"
Jul 18 11:28:48.509613 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:48.509591    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/be4938a8-9d6c-4729-889b-040e07ffad74-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9ss9n\" (UID: \"be4938a8-9d6c-4729-889b-040e07ffad74\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n"
Jul 18 11:28:48.522428 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:48.522373    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57p2j\" (UniqueName: \"kubernetes.io/projected/be4938a8-9d6c-4729-889b-040e07ffad74-kube-api-access-57p2j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9ss9n\" (UID: \"be4938a8-9d6c-4729-889b-040e07ffad74\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n"
Jul 18 11:28:48.620216 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:48.620183    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n"
Jul 18 11:28:57.579399 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:57.579376    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n"]
Jul 18 11:28:57.580553 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:28:57.580530    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4938a8_9d6c_4729_889b_040e07ffad74.slice/crio-b445d15253465e485ae18e0ddaabf27eccb99803ca706820662b67b1cde3824b WatchSource:0}: Error finding container b445d15253465e485ae18e0ddaabf27eccb99803ca706820662b67b1cde3824b: Status 404 returned error can't find the container with id b445d15253465e485ae18e0ddaabf27eccb99803ca706820662b67b1cde3824b
Jul 18 11:28:58.058428 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:58.058393    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gs64g" event={"ID":"80589be0-03bb-4c53-a61f-506c4cbf6bba","Type":"ContainerStarted","Data":"fe5b33a6638b2f5498c35c82c54cf8b49f43bce7f1c4645553a8c6a6477c7851"}
Jul 18 11:28:58.059850 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:58.059822    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n" event={"ID":"be4938a8-9d6c-4729-889b-040e07ffad74","Type":"ContainerStarted","Data":"b445d15253465e485ae18e0ddaabf27eccb99803ca706820662b67b1cde3824b"}
Jul 18 11:28:58.075894 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:28:58.075845    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-gs64g" podStartSLOduration=1.05256087 podStartE2EDuration="21.075827929s" totalImagesPullingTime="20.023267059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:28:58.073618133 +0000 UTC m=+539.675747869" watchObservedRunningTime="2026-07-18 11:28:58.075827929 +0000 UTC m=+539.677957666"
Jul 18 11:29:01.578551 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:01.578459    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n"]
Jul 18 11:29:02.079511 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:02.079474    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n" event={"ID":"be4938a8-9d6c-4729-889b-040e07ffad74","Type":"ContainerStarted","Data":"64865fbf892bf8e5ad0b1af171a0b08fbeac3cbe5d33d0b6d5266712e65312c9"}
Jul 18 11:29:02.079679 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:02.079589    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n"
Jul 18 11:29:02.099941 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:02.099896    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n" podStartSLOduration=10.376210169 podStartE2EDuration="14.099883559s" totalImagesPullingTime="3.72367339s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:28:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:29:02.099262234 +0000 UTC m=+543.701391974" watchObservedRunningTime="2026-07-18 11:29:02.099883559 +0000 UTC m=+543.702013297"
Jul 18 11:29:03.083718 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:03.083652    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n" podUID="be4938a8-9d6c-4729-889b-040e07ffad74" containerName="manager" containerID="cri-o://64865fbf892bf8e5ad0b1af171a0b08fbeac3cbe5d33d0b6d5266712e65312c9" gracePeriod=10
Jul 18 11:29:03.319067 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:03.319045    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n"
Jul 18 11:29:03.445345 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:03.445270    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/be4938a8-9d6c-4729-889b-040e07ffad74-extensions-socket-volume\") pod \"be4938a8-9d6c-4729-889b-040e07ffad74\" (UID: \"be4938a8-9d6c-4729-889b-040e07ffad74\") "
Jul 18 11:29:03.445499 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:03.445361    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57p2j\" (UniqueName: \"kubernetes.io/projected/be4938a8-9d6c-4729-889b-040e07ffad74-kube-api-access-57p2j\") pod \"be4938a8-9d6c-4729-889b-040e07ffad74\" (UID: \"be4938a8-9d6c-4729-889b-040e07ffad74\") "
Jul 18 11:29:03.445725 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:03.445703    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be4938a8-9d6c-4729-889b-040e07ffad74-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "be4938a8-9d6c-4729-889b-040e07ffad74" (UID: "be4938a8-9d6c-4729-889b-040e07ffad74"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:29:03.447404 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:03.447380    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be4938a8-9d6c-4729-889b-040e07ffad74-kube-api-access-57p2j" (OuterVolumeSpecName: "kube-api-access-57p2j") pod "be4938a8-9d6c-4729-889b-040e07ffad74" (UID: "be4938a8-9d6c-4729-889b-040e07ffad74"). InnerVolumeSpecName "kube-api-access-57p2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:29:03.546262 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:03.546232    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57p2j\" (UniqueName: \"kubernetes.io/projected/be4938a8-9d6c-4729-889b-040e07ffad74-kube-api-access-57p2j\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:29:03.546262 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:03.546256    2554 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/be4938a8-9d6c-4729-889b-040e07ffad74-extensions-socket-volume\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:29:04.088986 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:04.088951    2554 generic.go:356] "Generic (PLEG): container finished" podID="be4938a8-9d6c-4729-889b-040e07ffad74" containerID="64865fbf892bf8e5ad0b1af171a0b08fbeac3cbe5d33d0b6d5266712e65312c9" exitCode=0
Jul 18 11:29:04.089394 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:04.088992    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n"
Jul 18 11:29:04.089394 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:04.089030    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n" event={"ID":"be4938a8-9d6c-4729-889b-040e07ffad74","Type":"ContainerDied","Data":"64865fbf892bf8e5ad0b1af171a0b08fbeac3cbe5d33d0b6d5266712e65312c9"}
Jul 18 11:29:04.089394 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:04.089078    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n" event={"ID":"be4938a8-9d6c-4729-889b-040e07ffad74","Type":"ContainerDied","Data":"b445d15253465e485ae18e0ddaabf27eccb99803ca706820662b67b1cde3824b"}
Jul 18 11:29:04.089394 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:04.089125    2554 scope.go:117] "RemoveContainer" containerID="64865fbf892bf8e5ad0b1af171a0b08fbeac3cbe5d33d0b6d5266712e65312c9"
Jul 18 11:29:04.102912 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:04.102895    2554 scope.go:117] "RemoveContainer" containerID="64865fbf892bf8e5ad0b1af171a0b08fbeac3cbe5d33d0b6d5266712e65312c9"
Jul 18 11:29:04.103180 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:29:04.103159    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64865fbf892bf8e5ad0b1af171a0b08fbeac3cbe5d33d0b6d5266712e65312c9\": container with ID starting with 64865fbf892bf8e5ad0b1af171a0b08fbeac3cbe5d33d0b6d5266712e65312c9 not found: ID does not exist" containerID="64865fbf892bf8e5ad0b1af171a0b08fbeac3cbe5d33d0b6d5266712e65312c9"
Jul 18 11:29:04.103261 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:04.103185    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64865fbf892bf8e5ad0b1af171a0b08fbeac3cbe5d33d0b6d5266712e65312c9"} err="failed to get container status \"64865fbf892bf8e5ad0b1af171a0b08fbeac3cbe5d33d0b6d5266712e65312c9\": rpc error: code = NotFound desc = could not find container \"64865fbf892bf8e5ad0b1af171a0b08fbeac3cbe5d33d0b6d5266712e65312c9\": container with ID starting with 64865fbf892bf8e5ad0b1af171a0b08fbeac3cbe5d33d0b6d5266712e65312c9 not found: ID does not exist"
Jul 18 11:29:04.124149 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:04.124125    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n"]
Jul 18 11:29:04.128252 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:04.128229    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9ss9n"]
Jul 18 11:29:04.949068 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:04.949032    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be4938a8-9d6c-4729-889b-040e07ffad74" path="/var/lib/kubelet/pods/be4938a8-9d6c-4729-889b-040e07ffad74/volumes"
Jul 18 11:29:17.993659 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:17.993625    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"]
Jul 18 11:29:17.994090 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:17.993910    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be4938a8-9d6c-4729-889b-040e07ffad74" containerName="manager"
Jul 18 11:29:17.994090 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:17.993923    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="be4938a8-9d6c-4729-889b-040e07ffad74" containerName="manager"
Jul 18 11:29:17.994090 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:17.993981    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="be4938a8-9d6c-4729-889b-040e07ffad74" containerName="manager"
Jul 18 11:29:18.109884 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.109847    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"]
Jul 18 11:29:18.110039 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.109949    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.112161 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.112143    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2792n\""
Jul 18 11:29:18.271482 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.271406    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.271482 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.271440    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.271482 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.271464    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.271744 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.271488    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.271744 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.271576    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.271744 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.271617    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.271744 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.271647    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqz47\" (UniqueName: \"kubernetes.io/projected/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-kube-api-access-dqz47\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.271744 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.271684    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.271892 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.271762    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.372932 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.372901    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.373107 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.372945    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.373107 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.372968    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.373107 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.372996    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.373107 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.373022    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqz47\" (UniqueName: \"kubernetes.io/projected/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-kube-api-access-dqz47\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.373107 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.373060    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.373356 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.373130    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.373356 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.373185    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.373356 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.373214    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.373506 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.373382    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.373642 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.373619    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.373723 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.373687    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.373723 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.373704    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.373880 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.373865    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.375340 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.375318    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.375449 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.375425    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.381295 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.381270    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqz47\" (UniqueName: \"kubernetes.io/projected/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-kube-api-access-dqz47\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.381592 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.381572    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-mmg4g\" (UID: \"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.419528 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.419505    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:18.608604 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.608582    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"]
Jul 18 11:29:18.610569 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:29:18.610543    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode14d47d4_fc0d_4f51_a5aa_c67d00ebb7d9.slice/crio-0838658b2110b0bffc74bae658357395a505c3bafc0edc99e5045e45d0a7f0be WatchSource:0}: Error finding container 0838658b2110b0bffc74bae658357395a505c3bafc0edc99e5045e45d0a7f0be: Status 404 returned error can't find the container with id 0838658b2110b0bffc74bae658357395a505c3bafc0edc99e5045e45d0a7f0be
Jul 18 11:29:18.612687 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.612657    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:29:18.612767 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.612720    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:29:18.612767 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:18.612746    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:29:19.152886 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:19.152847    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g" event={"ID":"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9","Type":"ContainerStarted","Data":"36bd905f83d0004a596c7e3c2f55250ce3d4155a30b2c5f7f43d0c73de2333a5"}
Jul 18 11:29:19.153380 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:19.152912    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g" event={"ID":"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9","Type":"ContainerStarted","Data":"0838658b2110b0bffc74bae658357395a505c3bafc0edc99e5045e45d0a7f0be"}
Jul 18 11:29:19.172798 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:19.172747    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g" podStartSLOduration=2.172728507 podStartE2EDuration="2.172728507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:29:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:29:19.171250369 +0000 UTC m=+560.773380141" watchObservedRunningTime="2026-07-18 11:29:19.172728507 +0000 UTC m=+560.774858308"
Jul 18 11:29:19.420439 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:19.420365    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:19.425121 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:19.425082    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:20.157535 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:20.157509    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:20.158507 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:20.158484    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:29:30.765245 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:30.765205    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-8d6mh"]
Jul 18 11:29:30.815901 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:30.815867    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8d6mh"]
Jul 18 11:29:30.816057 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:30.815953    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8d6mh"
Jul 18 11:29:30.817972 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:30.817946    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2qz95\""
Jul 18 11:29:30.866342 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:30.866314    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8zl7\" (UniqueName: \"kubernetes.io/projected/5265c593-d3ad-4008-9d69-73d69488c7b5-kube-api-access-d8zl7\") pod \"authorino-58cd955675-8d6mh\" (UID: \"5265c593-d3ad-4008-9d69-73d69488c7b5\") " pod="kuadrant-system/authorino-58cd955675-8d6mh"
Jul 18 11:29:30.966882 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:30.966845    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8zl7\" (UniqueName: \"kubernetes.io/projected/5265c593-d3ad-4008-9d69-73d69488c7b5-kube-api-access-d8zl7\") pod \"authorino-58cd955675-8d6mh\" (UID: \"5265c593-d3ad-4008-9d69-73d69488c7b5\") " pod="kuadrant-system/authorino-58cd955675-8d6mh"
Jul 18 11:29:30.974711 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:30.974685    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8zl7\" (UniqueName: \"kubernetes.io/projected/5265c593-d3ad-4008-9d69-73d69488c7b5-kube-api-access-d8zl7\") pod \"authorino-58cd955675-8d6mh\" (UID: \"5265c593-d3ad-4008-9d69-73d69488c7b5\") " pod="kuadrant-system/authorino-58cd955675-8d6mh"
Jul 18 11:29:31.125338 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:31.125259    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8d6mh"
Jul 18 11:29:31.244248 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:31.244226    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-8d6mh"]
Jul 18 11:29:31.245999 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:29:31.245973    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5265c593_d3ad_4008_9d69_73d69488c7b5.slice/crio-794e56804a81101d122be279db09898e9900a16055bea83757ef86493056ef58 WatchSource:0}: Error finding container 794e56804a81101d122be279db09898e9900a16055bea83757ef86493056ef58: Status 404 returned error can't find the container with id 794e56804a81101d122be279db09898e9900a16055bea83757ef86493056ef58
Jul 18 11:29:32.210036 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:32.209995    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8d6mh" event={"ID":"5265c593-d3ad-4008-9d69-73d69488c7b5","Type":"ContainerStarted","Data":"794e56804a81101d122be279db09898e9900a16055bea83757ef86493056ef58"}
Jul 18 11:29:35.226491 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:35.226452    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8d6mh" event={"ID":"5265c593-d3ad-4008-9d69-73d69488c7b5","Type":"ContainerStarted","Data":"62edf9070dd931af740ccabb3e1a6dd6255eb28628f2b4d7009e07aa1b472f2a"}
Jul 18 11:29:35.240509 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:35.240457    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-8d6mh" podStartSLOduration=2.313677925 podStartE2EDuration="5.240442446s" totalImagesPullingTime="2.926764521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:29:35.23886675 +0000 UTC m=+576.840996505" watchObservedRunningTime="2026-07-18 11:29:35.240442446 +0000 UTC m=+576.842572184"
Jul 18 11:29:35.797781 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:35.797751    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8d6mh"]
Jul 18 11:29:37.235123 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:37.235070    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-8d6mh" podUID="5265c593-d3ad-4008-9d69-73d69488c7b5" containerName="authorino" containerID="cri-o://62edf9070dd931af740ccabb3e1a6dd6255eb28628f2b4d7009e07aa1b472f2a" gracePeriod=30
Jul 18 11:29:37.488589 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:37.488535    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8d6mh"
Jul 18 11:29:37.513472 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:37.513446    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8zl7\" (UniqueName: \"kubernetes.io/projected/5265c593-d3ad-4008-9d69-73d69488c7b5-kube-api-access-d8zl7\") pod \"5265c593-d3ad-4008-9d69-73d69488c7b5\" (UID: \"5265c593-d3ad-4008-9d69-73d69488c7b5\") "
Jul 18 11:29:37.515407 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:37.515386    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5265c593-d3ad-4008-9d69-73d69488c7b5-kube-api-access-d8zl7" (OuterVolumeSpecName: "kube-api-access-d8zl7") pod "5265c593-d3ad-4008-9d69-73d69488c7b5" (UID: "5265c593-d3ad-4008-9d69-73d69488c7b5"). InnerVolumeSpecName "kube-api-access-d8zl7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:29:37.614699 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:37.614669    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8zl7\" (UniqueName: \"kubernetes.io/projected/5265c593-d3ad-4008-9d69-73d69488c7b5-kube-api-access-d8zl7\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:29:38.239832 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:38.239790    2554 generic.go:356] "Generic (PLEG): container finished" podID="5265c593-d3ad-4008-9d69-73d69488c7b5" containerID="62edf9070dd931af740ccabb3e1a6dd6255eb28628f2b4d7009e07aa1b472f2a" exitCode=0
Jul 18 11:29:38.240303 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:38.239845    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-8d6mh"
Jul 18 11:29:38.240303 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:38.239862    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8d6mh" event={"ID":"5265c593-d3ad-4008-9d69-73d69488c7b5","Type":"ContainerDied","Data":"62edf9070dd931af740ccabb3e1a6dd6255eb28628f2b4d7009e07aa1b472f2a"}
Jul 18 11:29:38.240303 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:38.239899    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-8d6mh" event={"ID":"5265c593-d3ad-4008-9d69-73d69488c7b5","Type":"ContainerDied","Data":"794e56804a81101d122be279db09898e9900a16055bea83757ef86493056ef58"}
Jul 18 11:29:38.240303 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:38.239920    2554 scope.go:117] "RemoveContainer" containerID="62edf9070dd931af740ccabb3e1a6dd6255eb28628f2b4d7009e07aa1b472f2a"
Jul 18 11:29:38.248493 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:38.248474    2554 scope.go:117] "RemoveContainer" containerID="62edf9070dd931af740ccabb3e1a6dd6255eb28628f2b4d7009e07aa1b472f2a"
Jul 18 11:29:38.248736 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:29:38.248709    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62edf9070dd931af740ccabb3e1a6dd6255eb28628f2b4d7009e07aa1b472f2a\": container with ID starting with 62edf9070dd931af740ccabb3e1a6dd6255eb28628f2b4d7009e07aa1b472f2a not found: ID does not exist" containerID="62edf9070dd931af740ccabb3e1a6dd6255eb28628f2b4d7009e07aa1b472f2a"
Jul 18 11:29:38.248784 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:38.248749    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62edf9070dd931af740ccabb3e1a6dd6255eb28628f2b4d7009e07aa1b472f2a"} err="failed to get container status \"62edf9070dd931af740ccabb3e1a6dd6255eb28628f2b4d7009e07aa1b472f2a\": rpc error: code = NotFound desc = could not find container \"62edf9070dd931af740ccabb3e1a6dd6255eb28628f2b4d7009e07aa1b472f2a\": container with ID starting with 62edf9070dd931af740ccabb3e1a6dd6255eb28628f2b4d7009e07aa1b472f2a not found: ID does not exist"
Jul 18 11:29:38.259437 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:38.259413    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-8d6mh"]
Jul 18 11:29:38.262958 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:38.262939    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-8d6mh"]
Jul 18 11:29:38.948657 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:38.948623    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5265c593-d3ad-4008-9d69-73d69488c7b5" path="/var/lib/kubelet/pods/5265c593-d3ad-4008-9d69-73d69488c7b5/volumes"
Jul 18 11:29:58.849538 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:58.849506    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5kkzl_2e953581-6e11-46ad-92e3-0d63df589850/ovn-acl-logging/0.log"
Jul 18 11:29:58.856523 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:29:58.856503    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5kkzl_2e953581-6e11-46ad-92e3-0d63df589850/ovn-acl-logging/0.log"
Jul 18 11:30:44.571292 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.571258    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-hmvph"]
Jul 18 11:30:44.571690 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.571562    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5265c593-d3ad-4008-9d69-73d69488c7b5" containerName="authorino"
Jul 18 11:30:44.571690 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.571574    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5265c593-d3ad-4008-9d69-73d69488c7b5" containerName="authorino"
Jul 18 11:30:44.571690 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.571619    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5265c593-d3ad-4008-9d69-73d69488c7b5" containerName="authorino"
Jul 18 11:30:44.574011 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.573996    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-hmvph"
Jul 18 11:30:44.576329 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.576307    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 18 11:30:44.576449 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.576315    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7d6bx\""
Jul 18 11:30:44.584320 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.584300    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-hmvph"]
Jul 18 11:30:44.615367 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.615335    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-ltb9d"]
Jul 18 11:30:44.618277 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.618260    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-ltb9d"
Jul 18 11:30:44.626163 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.626141    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-ltb9d"]
Jul 18 11:30:44.658267 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.658238    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97eadb98-ba93-4698-9ea9-84dfdb3fa170-plugins-config-volume\") pod \"payload-processing-5bf47cd988-ltb9d\" (UID: \"97eadb98-ba93-4698-9ea9-84dfdb3fa170\") " pod="openshift-ingress/payload-processing-5bf47cd988-ltb9d"
Jul 18 11:30:44.658417 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.658304    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gmd5\" (UniqueName: \"kubernetes.io/projected/97eadb98-ba93-4698-9ea9-84dfdb3fa170-kube-api-access-6gmd5\") pod \"payload-processing-5bf47cd988-ltb9d\" (UID: \"97eadb98-ba93-4698-9ea9-84dfdb3fa170\") " pod="openshift-ingress/payload-processing-5bf47cd988-ltb9d"
Jul 18 11:30:44.658417 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.658358    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ddcff54-f714-40d9-95fd-5a71614bdd02-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-hmvph\" (UID: \"6ddcff54-f714-40d9-95fd-5a71614bdd02\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-hmvph"
Jul 18 11:30:44.658417 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.658406    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scrc4\" (UniqueName: \"kubernetes.io/projected/6ddcff54-f714-40d9-95fd-5a71614bdd02-kube-api-access-scrc4\") pod \"payload-pre-processing-7677b774bb-hmvph\" (UID: \"6ddcff54-f714-40d9-95fd-5a71614bdd02\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-hmvph"
Jul 18 11:30:44.759326 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.759283    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gmd5\" (UniqueName: \"kubernetes.io/projected/97eadb98-ba93-4698-9ea9-84dfdb3fa170-kube-api-access-6gmd5\") pod \"payload-processing-5bf47cd988-ltb9d\" (UID: \"97eadb98-ba93-4698-9ea9-84dfdb3fa170\") " pod="openshift-ingress/payload-processing-5bf47cd988-ltb9d"
Jul 18 11:30:44.759326 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.759330    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ddcff54-f714-40d9-95fd-5a71614bdd02-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-hmvph\" (UID: \"6ddcff54-f714-40d9-95fd-5a71614bdd02\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-hmvph"
Jul 18 11:30:44.759567 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.759367    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scrc4\" (UniqueName: \"kubernetes.io/projected/6ddcff54-f714-40d9-95fd-5a71614bdd02-kube-api-access-scrc4\") pod \"payload-pre-processing-7677b774bb-hmvph\" (UID: \"6ddcff54-f714-40d9-95fd-5a71614bdd02\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-hmvph"
Jul 18 11:30:44.759567 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.759404    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97eadb98-ba93-4698-9ea9-84dfdb3fa170-plugins-config-volume\") pod \"payload-processing-5bf47cd988-ltb9d\" (UID: \"97eadb98-ba93-4698-9ea9-84dfdb3fa170\") " pod="openshift-ingress/payload-processing-5bf47cd988-ltb9d"
Jul 18 11:30:44.760059 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.760035    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ddcff54-f714-40d9-95fd-5a71614bdd02-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-hmvph\" (UID: \"6ddcff54-f714-40d9-95fd-5a71614bdd02\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-hmvph"
Jul 18 11:30:44.760170 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.760071    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/97eadb98-ba93-4698-9ea9-84dfdb3fa170-plugins-config-volume\") pod \"payload-processing-5bf47cd988-ltb9d\" (UID: \"97eadb98-ba93-4698-9ea9-84dfdb3fa170\") " pod="openshift-ingress/payload-processing-5bf47cd988-ltb9d"
Jul 18 11:30:44.767186 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.767162    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scrc4\" (UniqueName: \"kubernetes.io/projected/6ddcff54-f714-40d9-95fd-5a71614bdd02-kube-api-access-scrc4\") pod \"payload-pre-processing-7677b774bb-hmvph\" (UID: \"6ddcff54-f714-40d9-95fd-5a71614bdd02\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-hmvph"
Jul 18 11:30:44.767293 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.767190    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gmd5\" (UniqueName: \"kubernetes.io/projected/97eadb98-ba93-4698-9ea9-84dfdb3fa170-kube-api-access-6gmd5\") pod \"payload-processing-5bf47cd988-ltb9d\" (UID: \"97eadb98-ba93-4698-9ea9-84dfdb3fa170\") " pod="openshift-ingress/payload-processing-5bf47cd988-ltb9d"
Jul 18 11:30:44.884799 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.884722    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-hmvph"
Jul 18 11:30:44.928529 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:44.928495    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-ltb9d"
Jul 18 11:30:45.020736 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:45.020698    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-hmvph"]
Jul 18 11:30:45.023384 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:30:45.023349    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ddcff54_f714_40d9_95fd_5a71614bdd02.slice/crio-bd3e2a3fe4ff8528149b33fe04e0daef7f7d6454dfd772933671ef4afbb2c4f6 WatchSource:0}: Error finding container bd3e2a3fe4ff8528149b33fe04e0daef7f7d6454dfd772933671ef4afbb2c4f6: Status 404 returned error can't find the container with id bd3e2a3fe4ff8528149b33fe04e0daef7f7d6454dfd772933671ef4afbb2c4f6
Jul 18 11:30:45.025876 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:45.025802    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 11:30:45.075195 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:45.075169    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-ltb9d"]
Jul 18 11:30:45.077404 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:30:45.077380    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97eadb98_ba93_4698_9ea9_84dfdb3fa170.slice/crio-681a69e0d5cd201cef4a33039d89afc9675fd4d7d382322e7a32abeb9e65cc2e WatchSource:0}: Error finding container 681a69e0d5cd201cef4a33039d89afc9675fd4d7d382322e7a32abeb9e65cc2e: Status 404 returned error can't find the container with id 681a69e0d5cd201cef4a33039d89afc9675fd4d7d382322e7a32abeb9e65cc2e
Jul 18 11:30:45.514271 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:45.514231    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-hmvph" event={"ID":"6ddcff54-f714-40d9-95fd-5a71614bdd02","Type":"ContainerStarted","Data":"bd3e2a3fe4ff8528149b33fe04e0daef7f7d6454dfd772933671ef4afbb2c4f6"}
Jul 18 11:30:45.515304 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:45.515279    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-ltb9d" event={"ID":"97eadb98-ba93-4698-9ea9-84dfdb3fa170","Type":"ContainerStarted","Data":"681a69e0d5cd201cef4a33039d89afc9675fd4d7d382322e7a32abeb9e65cc2e"}
Jul 18 11:30:47.527111 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:47.527063    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-ltb9d" event={"ID":"97eadb98-ba93-4698-9ea9-84dfdb3fa170","Type":"ContainerStarted","Data":"102da1b8688882c36eb33b829e3f627a918cde1f51acc8c51b9622d36489396a"}
Jul 18 11:30:47.527566 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:47.527283    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-ltb9d"
Jul 18 11:30:47.528554 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:47.528528    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-hmvph" event={"ID":"6ddcff54-f714-40d9-95fd-5a71614bdd02","Type":"ContainerStarted","Data":"c51814fa7d97a8656963111baf24ccf49ee6314ba6f6bddf6cebcb6faddc6a91"}
Jul 18 11:30:47.528685 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:47.528592    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-hmvph"
Jul 18 11:30:47.543654 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:47.543611    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-ltb9d" podStartSLOduration=1.52860412 podStartE2EDuration="3.543598495s" totalImagesPullingTime="2.014994375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:30:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:30:47.542304427 +0000 UTC m=+649.144434164" watchObservedRunningTime="2026-07-18 11:30:47.543598495 +0000 UTC m=+649.145728258"
Jul 18 11:30:47.556712 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:47.556668    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-hmvph" podStartSLOduration=1.48156744 podStartE2EDuration="3.556655071s" totalImagesPullingTime="2.075087631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:30:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:30:47.555256493 +0000 UTC m=+649.157386230" watchObservedRunningTime="2026-07-18 11:30:47.556655071 +0000 UTC m=+649.158784808"
Jul 18 11:30:51.199264 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:51.199220    2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mmg4g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 18 11:30:51.199628 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:51.199287    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g" podUID="e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 18 11:30:52.554313 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:52.554279    2554 generic.go:356] "Generic (PLEG): container finished" podID="e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9" containerID="36bd905f83d0004a596c7e3c2f55250ce3d4155a30b2c5f7f43d0c73de2333a5" exitCode=0
Jul 18 11:30:52.554720 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:52.554352    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g" event={"ID":"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9","Type":"ContainerDied","Data":"36bd905f83d0004a596c7e3c2f55250ce3d4155a30b2c5f7f43d0c73de2333a5"}
Jul 18 11:30:52.554720 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:52.554701    2554 scope.go:117] "RemoveContainer" containerID="36bd905f83d0004a596c7e3c2f55250ce3d4155a30b2c5f7f43d0c73de2333a5"
Jul 18 11:30:52.555608 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:52.555581    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:30:52.555704 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:52.555663    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:30:52.555761 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:52.555713    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:30:53.560148 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:53.560090    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g" event={"ID":"e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9","Type":"ContainerStarted","Data":"71d48270b473d34ebc922e126497b0111eb02d26d5fff2c0213729dc67a76d23"}
Jul 18 11:30:54.420494 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:54.420455    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:30:54.420740 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:54.420717    2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mmg4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 18 11:30:54.420829 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:54.420803    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g" podUID="e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 18 11:30:55.420703 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:55.420671    2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mmg4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 18 11:30:55.421042 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:55.420725    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g" podUID="e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 18 11:30:56.420134 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:56.420083    2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-mmg4g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body=
Jul 18 11:30:56.420300 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:56.420152    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g" podUID="e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused"
Jul 18 11:30:57.423703 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:57.423672    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:30:57.424056 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:57.423917    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:30:57.424652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:57.424635    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-mmg4g"
Jul 18 11:30:58.536283 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:58.536244    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-ltb9d"
Jul 18 11:30:58.536637 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:30:58.536330    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-hmvph"
Jul 18 11:31:01.535546 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.535511    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"]
Jul 18 11:31:01.540089 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.540068    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:01.542397 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.542377    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-ft9rj\""
Jul 18 11:31:01.542505 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.542380    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 18 11:31:01.543170 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.543150    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 18 11:31:01.543280 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.543211    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 18 11:31:01.546950 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.546927    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"]
Jul 18 11:31:01.632182 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.632152    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c7547ce-7119-4e60-b95e-dfd0e05b87c8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk\" (UID: \"9c7547ce-7119-4e60-b95e-dfd0e05b87c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:01.632182 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.632182    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c7547ce-7119-4e60-b95e-dfd0e05b87c8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk\" (UID: \"9c7547ce-7119-4e60-b95e-dfd0e05b87c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:01.632390 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.632204    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c7547ce-7119-4e60-b95e-dfd0e05b87c8-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk\" (UID: \"9c7547ce-7119-4e60-b95e-dfd0e05b87c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:01.632390 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.632231    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c7547ce-7119-4e60-b95e-dfd0e05b87c8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk\" (UID: \"9c7547ce-7119-4e60-b95e-dfd0e05b87c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:01.632390 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.632250    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c7547ce-7119-4e60-b95e-dfd0e05b87c8-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk\" (UID: \"9c7547ce-7119-4e60-b95e-dfd0e05b87c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:01.632390 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.632271    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmxhz\" (UniqueName: \"kubernetes.io/projected/9c7547ce-7119-4e60-b95e-dfd0e05b87c8-kube-api-access-tmxhz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk\" (UID: \"9c7547ce-7119-4e60-b95e-dfd0e05b87c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:01.733173 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.733134    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c7547ce-7119-4e60-b95e-dfd0e05b87c8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk\" (UID: \"9c7547ce-7119-4e60-b95e-dfd0e05b87c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:01.733173 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.733172    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c7547ce-7119-4e60-b95e-dfd0e05b87c8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk\" (UID: \"9c7547ce-7119-4e60-b95e-dfd0e05b87c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:01.733406 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.733190    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c7547ce-7119-4e60-b95e-dfd0e05b87c8-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk\" (UID: \"9c7547ce-7119-4e60-b95e-dfd0e05b87c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:01.733406 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.733214    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c7547ce-7119-4e60-b95e-dfd0e05b87c8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk\" (UID: \"9c7547ce-7119-4e60-b95e-dfd0e05b87c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:01.733406 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.733242    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c7547ce-7119-4e60-b95e-dfd0e05b87c8-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk\" (UID: \"9c7547ce-7119-4e60-b95e-dfd0e05b87c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:01.733406 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.733276    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmxhz\" (UniqueName: \"kubernetes.io/projected/9c7547ce-7119-4e60-b95e-dfd0e05b87c8-kube-api-access-tmxhz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk\" (UID: \"9c7547ce-7119-4e60-b95e-dfd0e05b87c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:01.733673 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.733647    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9c7547ce-7119-4e60-b95e-dfd0e05b87c8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk\" (UID: \"9c7547ce-7119-4e60-b95e-dfd0e05b87c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:01.733742 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.733679    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c7547ce-7119-4e60-b95e-dfd0e05b87c8-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk\" (UID: \"9c7547ce-7119-4e60-b95e-dfd0e05b87c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:01.733742 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.733701    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9c7547ce-7119-4e60-b95e-dfd0e05b87c8-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk\" (UID: \"9c7547ce-7119-4e60-b95e-dfd0e05b87c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:01.735402 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.735383    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9c7547ce-7119-4e60-b95e-dfd0e05b87c8-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk\" (UID: \"9c7547ce-7119-4e60-b95e-dfd0e05b87c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:01.735659 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.735641    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c7547ce-7119-4e60-b95e-dfd0e05b87c8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk\" (UID: \"9c7547ce-7119-4e60-b95e-dfd0e05b87c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:01.740347 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.740328    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmxhz\" (UniqueName: \"kubernetes.io/projected/9c7547ce-7119-4e60-b95e-dfd0e05b87c8-kube-api-access-tmxhz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk\" (UID: \"9c7547ce-7119-4e60-b95e-dfd0e05b87c8\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:01.851362 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.851282    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:01.976115 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:01.976072    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"]
Jul 18 11:31:01.978441 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:31:01.978414    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c7547ce_7119_4e60_b95e_dfd0e05b87c8.slice/crio-6c30c962682a1c02ea9b1b961cf6d43269399a176461ead395e4aff742fc157f WatchSource:0}: Error finding container 6c30c962682a1c02ea9b1b961cf6d43269399a176461ead395e4aff742fc157f: Status 404 returned error can't find the container with id 6c30c962682a1c02ea9b1b961cf6d43269399a176461ead395e4aff742fc157f
Jul 18 11:31:02.601813 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:02.601776    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk" event={"ID":"9c7547ce-7119-4e60-b95e-dfd0e05b87c8","Type":"ContainerStarted","Data":"6c30c962682a1c02ea9b1b961cf6d43269399a176461ead395e4aff742fc157f"}
Jul 18 11:31:03.607188 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:03.607155    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk" event={"ID":"9c7547ce-7119-4e60-b95e-dfd0e05b87c8","Type":"ContainerStarted","Data":"ea5571dae8ca7660f6956467573e53235d4135120e1f0adb67f86b796610f95a"}
Jul 18 11:31:03.622937 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:03.622893    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk" podStartSLOduration=1.532044023 podStartE2EDuration="2.622879386s" totalImagesPullingTime="1.090835363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:31:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:31:03.621811763 +0000 UTC m=+665.223941501" watchObservedRunningTime="2026-07-18 11:31:03.622879386 +0000 UTC m=+665.225009126"
Jul 18 11:31:11.851840 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:11.851803    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:11.852388 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:11.851871    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:11.863935 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:11.863913    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:31:12.655616 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:31:12.655590    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk"
Jul 18 11:32:04.033284 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.033193    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"]
Jul 18 11:32:04.036268 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.036247    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:04.039088 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.039069    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 18 11:32:04.048077 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.048052    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"]
Jul 18 11:32:04.079960 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.079933    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ece6555-13d4-48cd-a06a-1660659ad9a5-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-79bcx\" (UID: \"4ece6555-13d4-48cd-a06a-1660659ad9a5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:04.080135 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.079963    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ece6555-13d4-48cd-a06a-1660659ad9a5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-79bcx\" (UID: \"4ece6555-13d4-48cd-a06a-1660659ad9a5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:04.080135 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.080008    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpnsg\" (UniqueName: \"kubernetes.io/projected/4ece6555-13d4-48cd-a06a-1660659ad9a5-kube-api-access-rpnsg\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-79bcx\" (UID: \"4ece6555-13d4-48cd-a06a-1660659ad9a5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:04.080135 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.080038    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ece6555-13d4-48cd-a06a-1660659ad9a5-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-79bcx\" (UID: \"4ece6555-13d4-48cd-a06a-1660659ad9a5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:04.080135 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.080059    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ece6555-13d4-48cd-a06a-1660659ad9a5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-79bcx\" (UID: \"4ece6555-13d4-48cd-a06a-1660659ad9a5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:04.080135 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.080090    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ece6555-13d4-48cd-a06a-1660659ad9a5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-79bcx\" (UID: \"4ece6555-13d4-48cd-a06a-1660659ad9a5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:04.181166 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.181132    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ece6555-13d4-48cd-a06a-1660659ad9a5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-79bcx\" (UID: \"4ece6555-13d4-48cd-a06a-1660659ad9a5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:04.181379 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.181180    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ece6555-13d4-48cd-a06a-1660659ad9a5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-79bcx\" (UID: \"4ece6555-13d4-48cd-a06a-1660659ad9a5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:04.181379 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.181220    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ece6555-13d4-48cd-a06a-1660659ad9a5-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-79bcx\" (UID: \"4ece6555-13d4-48cd-a06a-1660659ad9a5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:04.181379 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.181237    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ece6555-13d4-48cd-a06a-1660659ad9a5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-79bcx\" (UID: \"4ece6555-13d4-48cd-a06a-1660659ad9a5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:04.181379 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.181285    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpnsg\" (UniqueName: \"kubernetes.io/projected/4ece6555-13d4-48cd-a06a-1660659ad9a5-kube-api-access-rpnsg\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-79bcx\" (UID: \"4ece6555-13d4-48cd-a06a-1660659ad9a5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:04.181379 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.181312    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ece6555-13d4-48cd-a06a-1660659ad9a5-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-79bcx\" (UID: \"4ece6555-13d4-48cd-a06a-1660659ad9a5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:04.181681 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.181655    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ece6555-13d4-48cd-a06a-1660659ad9a5-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-79bcx\" (UID: \"4ece6555-13d4-48cd-a06a-1660659ad9a5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:04.181681 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.181670    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ece6555-13d4-48cd-a06a-1660659ad9a5-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-79bcx\" (UID: \"4ece6555-13d4-48cd-a06a-1660659ad9a5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:04.181764 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.181728    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ece6555-13d4-48cd-a06a-1660659ad9a5-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-79bcx\" (UID: \"4ece6555-13d4-48cd-a06a-1660659ad9a5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:04.183472 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.183444    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ece6555-13d4-48cd-a06a-1660659ad9a5-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-79bcx\" (UID: \"4ece6555-13d4-48cd-a06a-1660659ad9a5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:04.183647 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.183629    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ece6555-13d4-48cd-a06a-1660659ad9a5-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-79bcx\" (UID: \"4ece6555-13d4-48cd-a06a-1660659ad9a5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:04.190377 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.190353    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpnsg\" (UniqueName: \"kubernetes.io/projected/4ece6555-13d4-48cd-a06a-1660659ad9a5-kube-api-access-rpnsg\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-79bcx\" (UID: \"4ece6555-13d4-48cd-a06a-1660659ad9a5\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:04.344985 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.344892    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:04.474829 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.474803    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"]
Jul 18 11:32:04.477448 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:32:04.477414    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ece6555_13d4_48cd_a06a_1660659ad9a5.slice/crio-52930cb40a6a86bc853f3c242423949de3956ae2edb7d7d6d15d43924bb7b114 WatchSource:0}: Error finding container 52930cb40a6a86bc853f3c242423949de3956ae2edb7d7d6d15d43924bb7b114: Status 404 returned error can't find the container with id 52930cb40a6a86bc853f3c242423949de3956ae2edb7d7d6d15d43924bb7b114
Jul 18 11:32:04.873817 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.873777    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx" event={"ID":"4ece6555-13d4-48cd-a06a-1660659ad9a5","Type":"ContainerStarted","Data":"f55ea8f0abf848bb721df17866d4d4e630b7e082e01395ca1216855f5ca19feb"}
Jul 18 11:32:04.873817 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.873820    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx" event={"ID":"4ece6555-13d4-48cd-a06a-1660659ad9a5","Type":"ContainerStarted","Data":"52930cb40a6a86bc853f3c242423949de3956ae2edb7d7d6d15d43924bb7b114"}
Jul 18 11:32:04.890349 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:04.890285    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx" podStartSLOduration=0.673351833 podStartE2EDuration="890.268244ms" totalImagesPullingTime="216.916411ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:32:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:32:04.889023108 +0000 UTC m=+726.491152848" watchObservedRunningTime="2026-07-18 11:32:04.890268244 +0000 UTC m=+726.492397982"
Jul 18 11:32:14.345678 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:14.345640    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:14.346069 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:14.345689    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:14.358203 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:14.358176    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:14.929377 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:14.929345    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-79bcx"
Jul 18 11:32:51.891038 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:51.891002    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d7dd644d9-bjcb7"]
Jul 18 11:32:51.894257 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:51.894240    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d7dd644d9-bjcb7"
Jul 18 11:32:51.896908 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:51.896886    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 18 11:32:51.897003 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:51.896887    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2qz95\""
Jul 18 11:32:51.900526 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:51.900503    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d7dd644d9-bjcb7"]
Jul 18 11:32:51.995904 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:51.995866    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a13197af-3b3c-4a8d-9828-cf316448a318-tls-cert\") pod \"authorino-d7dd644d9-bjcb7\" (UID: \"a13197af-3b3c-4a8d-9828-cf316448a318\") " pod="kuadrant-system/authorino-d7dd644d9-bjcb7"
Jul 18 11:32:51.995904 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:51.995909    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpk6p\" (UniqueName: \"kubernetes.io/projected/a13197af-3b3c-4a8d-9828-cf316448a318-kube-api-access-fpk6p\") pod \"authorino-d7dd644d9-bjcb7\" (UID: \"a13197af-3b3c-4a8d-9828-cf316448a318\") " pod="kuadrant-system/authorino-d7dd644d9-bjcb7"
Jul 18 11:32:52.097288 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:52.097250    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a13197af-3b3c-4a8d-9828-cf316448a318-tls-cert\") pod \"authorino-d7dd644d9-bjcb7\" (UID: \"a13197af-3b3c-4a8d-9828-cf316448a318\") " pod="kuadrant-system/authorino-d7dd644d9-bjcb7"
Jul 18 11:32:52.097448 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:52.097298    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpk6p\" (UniqueName: \"kubernetes.io/projected/a13197af-3b3c-4a8d-9828-cf316448a318-kube-api-access-fpk6p\") pod \"authorino-d7dd644d9-bjcb7\" (UID: \"a13197af-3b3c-4a8d-9828-cf316448a318\") " pod="kuadrant-system/authorino-d7dd644d9-bjcb7"
Jul 18 11:32:52.099712 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:52.099681    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a13197af-3b3c-4a8d-9828-cf316448a318-tls-cert\") pod \"authorino-d7dd644d9-bjcb7\" (UID: \"a13197af-3b3c-4a8d-9828-cf316448a318\") " pod="kuadrant-system/authorino-d7dd644d9-bjcb7"
Jul 18 11:32:52.104471 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:52.104443    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpk6p\" (UniqueName: \"kubernetes.io/projected/a13197af-3b3c-4a8d-9828-cf316448a318-kube-api-access-fpk6p\") pod \"authorino-d7dd644d9-bjcb7\" (UID: \"a13197af-3b3c-4a8d-9828-cf316448a318\") " pod="kuadrant-system/authorino-d7dd644d9-bjcb7"
Jul 18 11:32:52.203696 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:52.203607    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d7dd644d9-bjcb7"
Jul 18 11:32:52.339707 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:52.337140    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d7dd644d9-bjcb7"]
Jul 18 11:32:53.083939 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:53.083893    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d7dd644d9-bjcb7" event={"ID":"a13197af-3b3c-4a8d-9828-cf316448a318","Type":"ContainerStarted","Data":"93bce7afdf7754fb42fcd4f94aed95fa62ebc1bac0b2c0ce6ffd2bfa803bfb72"}
Jul 18 11:32:53.084397 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:53.083951    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d7dd644d9-bjcb7" event={"ID":"a13197af-3b3c-4a8d-9828-cf316448a318","Type":"ContainerStarted","Data":"f9bb72cbe0f6926546971791c5061eb1bf0b21f9aa8dc14b8cfcf8b05dfc2b03"}
Jul 18 11:32:53.100272 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:32:53.100222    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d7dd644d9-bjcb7" podStartSLOduration=1.751180156 podStartE2EDuration="2.100205595s" totalImagesPullingTime="349.025439ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:32:53.098705882 +0000 UTC m=+774.700835636" watchObservedRunningTime="2026-07-18 11:32:53.100205595 +0000 UTC m=+774.702335334"
Jul 18 11:34:58.877768 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:34:58.877692    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5kkzl_2e953581-6e11-46ad-92e3-0d63df589850/ovn-acl-logging/0.log"
Jul 18 11:34:58.883032 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:34:58.883011    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5kkzl_2e953581-6e11-46ad-92e3-0d63df589850/ovn-acl-logging/0.log"
Jul 18 11:39:58.905753 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:39:58.905665    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5kkzl_2e953581-6e11-46ad-92e3-0d63df589850/ovn-acl-logging/0.log"
Jul 18 11:39:58.908289 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:39:58.908266    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5kkzl_2e953581-6e11-46ad-92e3-0d63df589850/ovn-acl-logging/0.log"
Jul 18 11:43:36.530286 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.530252    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"]
Jul 18 11:43:36.533707 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.533688    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:36.536018 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.535997    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-5626ee40-kserve-self-signed-certs\""
Jul 18 11:43:36.541452 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.541428    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"]
Jul 18 11:43:36.672547 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.672494    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-dshm\") pod \"e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") " pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:36.672750 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.672562    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-home\") pod \"e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") " pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:36.672750 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.672587    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-tmp-dir\") pod \"e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") " pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:36.672750 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.672633    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-tls-certs\") pod \"e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") " pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:36.672750 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.672663    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-model-cache\") pod \"e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") " pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:36.672750 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.672687    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4rxv\" (UniqueName: \"kubernetes.io/projected/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-kube-api-access-r4rxv\") pod \"e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") " pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:36.773452 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.773404    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-tls-certs\") pod \"e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") " pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:36.773631 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.773472    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-model-cache\") pod \"e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") " pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:36.773631 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.773501    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4rxv\" (UniqueName: \"kubernetes.io/projected/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-kube-api-access-r4rxv\") pod \"e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") " pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:36.773631 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.773588    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-dshm\") pod \"e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") " pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:36.773857 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.773643    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-home\") pod \"e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") " pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:36.773857 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.773671    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-tmp-dir\") pod \"e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") " pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:36.774047 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.774016    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-model-cache\") pod \"e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") " pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:36.774188 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.774052    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-tmp-dir\") pod \"e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") " pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:36.774188 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.774122    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-home\") pod \"e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") " pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:36.775760 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.775734    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-dshm\") pod \"e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") " pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:36.776005 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.775987    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-tls-certs\") pod \"e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") " pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:36.780795 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.780737    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4rxv\" (UniqueName: \"kubernetes.io/projected/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-kube-api-access-r4rxv\") pod \"e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") " pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:36.843008 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.842955    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:36.979267 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:36.979227    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"]
Jul 18 11:43:36.981668 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:43:36.981612    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e1d0295_cc4d_458f_9cff_16ded2e8ad40.slice/crio-11bbd2818c7120faf239ef742c0bd068842e809c9b375eb7e400b09ce0c96ca2 WatchSource:0}: Error finding container 11bbd2818c7120faf239ef742c0bd068842e809c9b375eb7e400b09ce0c96ca2: Status 404 returned error can't find the container with id 11bbd2818c7120faf239ef742c0bd068842e809c9b375eb7e400b09ce0c96ca2
Jul 18 11:43:37.958221 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:37.958187    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4" event={"ID":"7e1d0295-cc4d-458f-9cff-16ded2e8ad40","Type":"ContainerStarted","Data":"df7e22a9d8968dac7791943d44c7df7934a54112f10942ad89ab15a5e885e590"}
Jul 18 11:43:37.958221 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:37.958229    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4" event={"ID":"7e1d0295-cc4d-458f-9cff-16ded2e8ad40","Type":"ContainerStarted","Data":"11bbd2818c7120faf239ef742c0bd068842e809c9b375eb7e400b09ce0c96ca2"}
Jul 18 11:43:37.974654 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:37.974599    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4" podStartSLOduration=1.97458358 podStartE2EDuration="1.97458358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:43:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:43:37.972829881 +0000 UTC m=+1419.574959619" watchObservedRunningTime="2026-07-18 11:43:37.97458358 +0000 UTC m=+1419.576713373"
Jul 18 11:43:46.843211 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:46.843169    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:46.843653 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:46.843495    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:46.856130 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:46.856089    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:43:47.008447 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:43:47.008413    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:44:58.934065 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:44:58.934036    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5kkzl_2e953581-6e11-46ad-92e3-0d63df589850/ovn-acl-logging/0.log"
Jul 18 11:44:58.934630 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:44:58.934036    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5kkzl_2e953581-6e11-46ad-92e3-0d63df589850/ovn-acl-logging/0.log"
Jul 18 11:46:05.010462 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:05.010424    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"]
Jul 18 11:46:20.030903 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.030860    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4" podUID="7e1d0295-cc4d-458f-9cff-16ded2e8ad40" containerName="main" containerID="cri-o://df7e22a9d8968dac7791943d44c7df7934a54112f10942ad89ab15a5e885e590" gracePeriod=45
Jul 18 11:46:20.284413 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.284350    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:46:20.331869 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.331841    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-tls-certs\") pod \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") "
Jul 18 11:46:20.332041 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.331877    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-dshm\") pod \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") "
Jul 18 11:46:20.332041 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.331899    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-home\") pod \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") "
Jul 18 11:46:20.332041 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.331916    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4rxv\" (UniqueName: \"kubernetes.io/projected/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-kube-api-access-r4rxv\") pod \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") "
Jul 18 11:46:20.332041 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.331938    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-tmp-dir\") pod \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") "
Jul 18 11:46:20.332370 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.332154    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-model-cache\") pod \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\" (UID: \"7e1d0295-cc4d-458f-9cff-16ded2e8ad40\") "
Jul 18 11:46:20.332370 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.332188    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7e1d0295-cc4d-458f-9cff-16ded2e8ad40" (UID: "7e1d0295-cc4d-458f-9cff-16ded2e8ad40"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:46:20.332370 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.332205    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-home" (OuterVolumeSpecName: "home") pod "7e1d0295-cc4d-458f-9cff-16ded2e8ad40" (UID: "7e1d0295-cc4d-458f-9cff-16ded2e8ad40"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:46:20.332503 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.332370    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-model-cache" (OuterVolumeSpecName: "model-cache") pod "7e1d0295-cc4d-458f-9cff-16ded2e8ad40" (UID: "7e1d0295-cc4d-458f-9cff-16ded2e8ad40"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:46:20.332547 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.332503    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-model-cache\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:46:20.332547 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.332522    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-home\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:46:20.332547 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.332536    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-tmp-dir\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:46:20.334070 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.334048    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-dshm" (OuterVolumeSpecName: "dshm") pod "7e1d0295-cc4d-458f-9cff-16ded2e8ad40" (UID: "7e1d0295-cc4d-458f-9cff-16ded2e8ad40"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:46:20.334511 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.334479    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7e1d0295-cc4d-458f-9cff-16ded2e8ad40" (UID: "7e1d0295-cc4d-458f-9cff-16ded2e8ad40"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:46:20.334587 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.334482    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-kube-api-access-r4rxv" (OuterVolumeSpecName: "kube-api-access-r4rxv") pod "7e1d0295-cc4d-458f-9cff-16ded2e8ad40" (UID: "7e1d0295-cc4d-458f-9cff-16ded2e8ad40"). InnerVolumeSpecName "kube-api-access-r4rxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:46:20.433360 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.433307    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-tls-certs\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:46:20.433360 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.433352    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-dshm\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:46:20.433360 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.433367    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4rxv\" (UniqueName: \"kubernetes.io/projected/7e1d0295-cc4d-458f-9cff-16ded2e8ad40-kube-api-access-r4rxv\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:46:20.674670 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.674588    2554 generic.go:356] "Generic (PLEG): container finished" podID="7e1d0295-cc4d-458f-9cff-16ded2e8ad40" containerID="df7e22a9d8968dac7791943d44c7df7934a54112f10942ad89ab15a5e885e590" exitCode=0
Jul 18 11:46:20.674670 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.674632    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"
Jul 18 11:46:20.674845 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.674674    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4" event={"ID":"7e1d0295-cc4d-458f-9cff-16ded2e8ad40","Type":"ContainerDied","Data":"df7e22a9d8968dac7791943d44c7df7934a54112f10942ad89ab15a5e885e590"}
Jul 18 11:46:20.674845 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.674719    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4" event={"ID":"7e1d0295-cc4d-458f-9cff-16ded2e8ad40","Type":"ContainerDied","Data":"11bbd2818c7120faf239ef742c0bd068842e809c9b375eb7e400b09ce0c96ca2"}
Jul 18 11:46:20.674845 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.674736    2554 scope.go:117] "RemoveContainer" containerID="df7e22a9d8968dac7791943d44c7df7934a54112f10942ad89ab15a5e885e590"
Jul 18 11:46:20.683445 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.683429    2554 scope.go:117] "RemoveContainer" containerID="df7e22a9d8968dac7791943d44c7df7934a54112f10942ad89ab15a5e885e590"
Jul 18 11:46:20.683678 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:46:20.683660    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df7e22a9d8968dac7791943d44c7df7934a54112f10942ad89ab15a5e885e590\": container with ID starting with df7e22a9d8968dac7791943d44c7df7934a54112f10942ad89ab15a5e885e590 not found: ID does not exist" containerID="df7e22a9d8968dac7791943d44c7df7934a54112f10942ad89ab15a5e885e590"
Jul 18 11:46:20.683722 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.683686    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df7e22a9d8968dac7791943d44c7df7934a54112f10942ad89ab15a5e885e590"} err="failed to get container status \"df7e22a9d8968dac7791943d44c7df7934a54112f10942ad89ab15a5e885e590\": rpc error: code = NotFound desc = could not find container \"df7e22a9d8968dac7791943d44c7df7934a54112f10942ad89ab15a5e885e590\": container with ID starting with df7e22a9d8968dac7791943d44c7df7934a54112f10942ad89ab15a5e885e590 not found: ID does not exist"
Jul 18 11:46:20.694164 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.694143    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"]
Jul 18 11:46:20.698229 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.698211    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-5626ee40-kserve-5d5ffcd999-qs4x4"]
Jul 18 11:46:20.950190 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:46:20.950112    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e1d0295-cc4d-458f-9cff-16ded2e8ad40" path="/var/lib/kubelet/pods/7e1d0295-cc4d-458f-9cff-16ded2e8ad40/volumes"
Jul 18 11:49:24.205050 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.205016    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"]
Jul 18 11:49:24.207272 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.205421    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e1d0295-cc4d-458f-9cff-16ded2e8ad40" containerName="main"
Jul 18 11:49:24.207272 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.205438    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e1d0295-cc4d-458f-9cff-16ded2e8ad40" containerName="main"
Jul 18 11:49:24.207272 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.205498    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e1d0295-cc4d-458f-9cff-16ded2e8ad40" containerName="main"
Jul 18 11:49:24.208477 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.208461    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.210728 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.210707    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-97de021e-openshift-default-dockercfg-t4xrh\""
Jul 18 11:49:24.231507 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.231483    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"]
Jul 18 11:49:24.312708 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.312672    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-workload-socket\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.312889 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.312728    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-data\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.312889 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.312808    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-envoy\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.312889 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.312841    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istiod-ca-cert\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.312889 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.312870    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-credential-socket\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.313050 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.312964    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr7lb\" (UniqueName: \"kubernetes.io/projected/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-kube-api-access-tr7lb\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.313128 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.313049    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-podinfo\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.313128 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.313104    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-token\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.313204 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.313145    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-workload-certs\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.414040 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.414007    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-workload-socket\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.414418 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.414056    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-data\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.414418 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.414106    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-envoy\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.414418 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.414130    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istiod-ca-cert\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.414418 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.414152    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-credential-socket\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.414418 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.414212    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr7lb\" (UniqueName: \"kubernetes.io/projected/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-kube-api-access-tr7lb\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.414418 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.414246    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-podinfo\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.414785 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.414459    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-workload-socket\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.414785 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.414513    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-token\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.414785 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.414524    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-data\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.414785 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.414554    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-workload-certs\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.414785 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.414607    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-credential-socket\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.414962 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.414887    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-workload-certs\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.414962 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.414901    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istiod-ca-cert\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.416413 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.416392    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-envoy\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.416561 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.416544    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-podinfo\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.421899 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.421875    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-token\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.421988 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.421909    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr7lb\" (UniqueName: \"kubernetes.io/projected/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-kube-api-access-tr7lb\") pod \"e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") " pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.517848 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.517816    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:24.648705 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.648678    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"]
Jul 18 11:49:24.650956 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:49:24.650932    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38834ca8_e688_4fba_bf2d_50bb52a6b3e2.slice/crio-0f3a43162c0dca8d2e4b3b03b97471d51df65f8e65d942e8fb1e84b849c43266 WatchSource:0}: Error finding container 0f3a43162c0dca8d2e4b3b03b97471d51df65f8e65d942e8fb1e84b849c43266: Status 404 returned error can't find the container with id 0f3a43162c0dca8d2e4b3b03b97471d51df65f8e65d942e8fb1e84b849c43266
Jul 18 11:49:24.653066 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.653030    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:49:24.653205 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.653128    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:49:24.653205 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:24.653177    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:49:25.505181 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:25.505146    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2" event={"ID":"38834ca8-e688-4fba-bf2d-50bb52a6b3e2","Type":"ContainerStarted","Data":"efbde3b6d7dd100d5e221b2100ca428f7a69ded965923fe29f6afe66f119a148"}
Jul 18 11:49:25.505543 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:25.505201    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2" event={"ID":"38834ca8-e688-4fba-bf2d-50bb52a6b3e2","Type":"ContainerStarted","Data":"0f3a43162c0dca8d2e4b3b03b97471d51df65f8e65d942e8fb1e84b849c43266"}
Jul 18 11:49:25.518747 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:25.518724    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:25.523643 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:25.523615    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:25.524000 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:25.523965    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2" podStartSLOduration=1.523954787 podStartE2EDuration="1.523954787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:49:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:49:25.522446872 +0000 UTC m=+1767.124576597" watchObservedRunningTime="2026-07-18 11:49:25.523954787 +0000 UTC m=+1767.126084525"
Jul 18 11:49:26.509858 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:26.509826    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:26.510803 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:26.510782    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:41.511680 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:41.511642    2554 patch_prober.go:28] interesting pod/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 18 11:49:41.512016 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:41.511701    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2" podUID="38834ca8-e688-4fba-bf2d-50bb52a6b3e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 18 11:49:41.575620 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:41.575589    2554 generic.go:356] "Generic (PLEG): container finished" podID="38834ca8-e688-4fba-bf2d-50bb52a6b3e2" containerID="efbde3b6d7dd100d5e221b2100ca428f7a69ded965923fe29f6afe66f119a148" exitCode=0
Jul 18 11:49:41.575767 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:41.575654    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2" event={"ID":"38834ca8-e688-4fba-bf2d-50bb52a6b3e2","Type":"ContainerDied","Data":"efbde3b6d7dd100d5e221b2100ca428f7a69ded965923fe29f6afe66f119a148"}
Jul 18 11:49:41.576067 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:41.576051    2554 scope.go:117] "RemoveContainer" containerID="efbde3b6d7dd100d5e221b2100ca428f7a69ded965923fe29f6afe66f119a148"
Jul 18 11:49:41.577012 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:41.576984    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:49:41.577122 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:41.577051    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:49:41.577122 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:41.577081    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:49:42.582004 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:42.581975    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2" event={"ID":"38834ca8-e688-4fba-bf2d-50bb52a6b3e2","Type":"ContainerStarted","Data":"110d6e690fa86689016a37c12fd69671f0f7f1039b82d534a0cc5836a94dfa56"}
Jul 18 11:49:43.518038 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:43.517995    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:43.518286 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:43.518262    2554 patch_prober.go:28] interesting pod/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 18 11:49:43.518365 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:43.518320    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2" podUID="38834ca8-e688-4fba-bf2d-50bb52a6b3e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 18 11:49:44.518980 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:44.518938    2554 patch_prober.go:28] interesting pod/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 18 11:49:44.519439 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:44.519000    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2" podUID="38834ca8-e688-4fba-bf2d-50bb52a6b3e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 18 11:49:45.519085 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:45.519047    2554 patch_prober.go:28] interesting pod/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 18 11:49:45.519486 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:45.519135    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2" podUID="38834ca8-e688-4fba-bf2d-50bb52a6b3e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 18 11:49:46.518720 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:46.518680    2554 patch_prober.go:28] interesting pod/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused" start-of-body=
Jul 18 11:49:46.518898 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:46.518770    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2" podUID="38834ca8-e688-4fba-bf2d-50bb52a6b3e2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.33:15021/healthz/ready\": dial tcp 10.133.0.33:15021: connect: connection refused"
Jul 18 11:49:47.525231 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:47.525190    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:47.525713 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:47.525693    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:47.526492 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:47.526471    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:49:58.962602 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:58.962574    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5kkzl_2e953581-6e11-46ad-92e3-0d63df589850/ovn-acl-logging/0.log"
Jul 18 11:49:58.962993 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:49:58.962861    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5kkzl_2e953581-6e11-46ad-92e3-0d63df589850/ovn-acl-logging/0.log"
Jul 18 11:50:07.749507 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:07.749471    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"]
Jul 18 11:50:07.749971 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:07.749720    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2" podUID="38834ca8-e688-4fba-bf2d-50bb52a6b3e2" containerName="istio-proxy" containerID="cri-o://110d6e690fa86689016a37c12fd69671f0f7f1039b82d534a0cc5836a94dfa56" gracePeriod=30
Jul 18 11:50:12.997656 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:12.997631    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:50:13.145806 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.145736    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-podinfo\") pod \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") "
Jul 18 11:50:13.145806 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.145786    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-workload-socket\") pod \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") "
Jul 18 11:50:13.146003 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.145828    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istiod-ca-cert\") pod \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") "
Jul 18 11:50:13.146003 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.145869    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-token\") pod \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") "
Jul 18 11:50:13.146003 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.145901    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tr7lb\" (UniqueName: \"kubernetes.io/projected/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-kube-api-access-tr7lb\") pod \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") "
Jul 18 11:50:13.146003 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.145928    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-workload-certs\") pod \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") "
Jul 18 11:50:13.146189 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.146071    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-envoy\") pod \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") "
Jul 18 11:50:13.146189 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.146109    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "38834ca8-e688-4fba-bf2d-50bb52a6b3e2" (UID: "38834ca8-e688-4fba-bf2d-50bb52a6b3e2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:50:13.146189 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.146128    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-credential-socket\") pod \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") "
Jul 18 11:50:13.146333 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.146194    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-data\") pod \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\" (UID: \"38834ca8-e688-4fba-bf2d-50bb52a6b3e2\") "
Jul 18 11:50:13.146333 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.146271    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "38834ca8-e688-4fba-bf2d-50bb52a6b3e2" (UID: "38834ca8-e688-4fba-bf2d-50bb52a6b3e2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:50:13.146436 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.146371    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "38834ca8-e688-4fba-bf2d-50bb52a6b3e2" (UID: "38834ca8-e688-4fba-bf2d-50bb52a6b3e2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:50:13.146549 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.146508    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-workload-socket\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:50:13.146549 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.146520    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "38834ca8-e688-4fba-bf2d-50bb52a6b3e2" (UID: "38834ca8-e688-4fba-bf2d-50bb52a6b3e2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:50:13.146652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.146548    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istiod-ca-cert\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:50:13.146652 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.146605    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-workload-certs\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:50:13.147318 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.147259    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-data" (OuterVolumeSpecName: "istio-data") pod "38834ca8-e688-4fba-bf2d-50bb52a6b3e2" (UID: "38834ca8-e688-4fba-bf2d-50bb52a6b3e2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:50:13.148354 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.148325    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "38834ca8-e688-4fba-bf2d-50bb52a6b3e2" (UID: "38834ca8-e688-4fba-bf2d-50bb52a6b3e2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 11:50:13.148660 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.148635    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-kube-api-access-tr7lb" (OuterVolumeSpecName: "kube-api-access-tr7lb") pod "38834ca8-e688-4fba-bf2d-50bb52a6b3e2" (UID: "38834ca8-e688-4fba-bf2d-50bb52a6b3e2"). InnerVolumeSpecName "kube-api-access-tr7lb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:50:13.148735 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.148669    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-token" (OuterVolumeSpecName: "istio-token") pod "38834ca8-e688-4fba-bf2d-50bb52a6b3e2" (UID: "38834ca8-e688-4fba-bf2d-50bb52a6b3e2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:50:13.148787 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.148763    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "38834ca8-e688-4fba-bf2d-50bb52a6b3e2" (UID: "38834ca8-e688-4fba-bf2d-50bb52a6b3e2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:50:13.247548 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.247515    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-token\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:50:13.247548 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.247552    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr7lb\" (UniqueName: \"kubernetes.io/projected/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-kube-api-access-tr7lb\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:50:13.247733 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.247563    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-envoy\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:50:13.247733 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.247572    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-credential-socket\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:50:13.247733 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.247580    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-data\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:50:13.247733 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.247588    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38834ca8-e688-4fba-bf2d-50bb52a6b3e2-istio-podinfo\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:50:13.722915 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.722879    2554 generic.go:356] "Generic (PLEG): container finished" podID="38834ca8-e688-4fba-bf2d-50bb52a6b3e2" containerID="110d6e690fa86689016a37c12fd69671f0f7f1039b82d534a0cc5836a94dfa56" exitCode=0
Jul 18 11:50:13.723082 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.722928    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"
Jul 18 11:50:13.723082 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.722963    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2" event={"ID":"38834ca8-e688-4fba-bf2d-50bb52a6b3e2","Type":"ContainerDied","Data":"110d6e690fa86689016a37c12fd69671f0f7f1039b82d534a0cc5836a94dfa56"}
Jul 18 11:50:13.723082 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.723017    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2" event={"ID":"38834ca8-e688-4fba-bf2d-50bb52a6b3e2","Type":"ContainerDied","Data":"0f3a43162c0dca8d2e4b3b03b97471d51df65f8e65d942e8fb1e84b849c43266"}
Jul 18 11:50:13.723082 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.723039    2554 scope.go:117] "RemoveContainer" containerID="110d6e690fa86689016a37c12fd69671f0f7f1039b82d534a0cc5836a94dfa56"
Jul 18 11:50:13.732524 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.732507    2554 scope.go:117] "RemoveContainer" containerID="efbde3b6d7dd100d5e221b2100ca428f7a69ded965923fe29f6afe66f119a148"
Jul 18 11:50:13.739803 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.739788    2554 scope.go:117] "RemoveContainer" containerID="110d6e690fa86689016a37c12fd69671f0f7f1039b82d534a0cc5836a94dfa56"
Jul 18 11:50:13.740078 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:50:13.740060    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"110d6e690fa86689016a37c12fd69671f0f7f1039b82d534a0cc5836a94dfa56\": container with ID starting with 110d6e690fa86689016a37c12fd69671f0f7f1039b82d534a0cc5836a94dfa56 not found: ID does not exist" containerID="110d6e690fa86689016a37c12fd69671f0f7f1039b82d534a0cc5836a94dfa56"
Jul 18 11:50:13.740141 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.740085    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"110d6e690fa86689016a37c12fd69671f0f7f1039b82d534a0cc5836a94dfa56"} err="failed to get container status \"110d6e690fa86689016a37c12fd69671f0f7f1039b82d534a0cc5836a94dfa56\": rpc error: code = NotFound desc = could not find container \"110d6e690fa86689016a37c12fd69671f0f7f1039b82d534a0cc5836a94dfa56\": container with ID starting with 110d6e690fa86689016a37c12fd69671f0f7f1039b82d534a0cc5836a94dfa56 not found: ID does not exist"
Jul 18 11:50:13.740141 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.740119    2554 scope.go:117] "RemoveContainer" containerID="efbde3b6d7dd100d5e221b2100ca428f7a69ded965923fe29f6afe66f119a148"
Jul 18 11:50:13.740356 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:50:13.740338    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efbde3b6d7dd100d5e221b2100ca428f7a69ded965923fe29f6afe66f119a148\": container with ID starting with efbde3b6d7dd100d5e221b2100ca428f7a69ded965923fe29f6afe66f119a148 not found: ID does not exist" containerID="efbde3b6d7dd100d5e221b2100ca428f7a69ded965923fe29f6afe66f119a148"
Jul 18 11:50:13.740391 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.740362    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efbde3b6d7dd100d5e221b2100ca428f7a69ded965923fe29f6afe66f119a148"} err="failed to get container status \"efbde3b6d7dd100d5e221b2100ca428f7a69ded965923fe29f6afe66f119a148\": rpc error: code = NotFound desc = could not find container \"efbde3b6d7dd100d5e221b2100ca428f7a69ded965923fe29f6afe66f119a148\": container with ID starting with efbde3b6d7dd100d5e221b2100ca428f7a69ded965923fe29f6afe66f119a148 not found: ID does not exist"
Jul 18 11:50:13.749517 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.748908    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"]
Jul 18 11:50:13.753724 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:13.753702    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-97de021e-openshift-default-56bb6b796f-p8gc2"]
Jul 18 11:50:14.949241 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:14.949211    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38834ca8-e688-4fba-bf2d-50bb52a6b3e2" path="/var/lib/kubelet/pods/38834ca8-e688-4fba-bf2d-50bb52a6b3e2/volumes"
Jul 18 11:50:39.550232 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:39.550195    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c267dde-4b9nt"]
Jul 18 11:50:39.550703 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:39.550685    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38834ca8-e688-4fba-bf2d-50bb52a6b3e2" containerName="istio-proxy"
Jul 18 11:50:39.550771 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:39.550706    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="38834ca8-e688-4fba-bf2d-50bb52a6b3e2" containerName="istio-proxy"
Jul 18 11:50:39.550771 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:39.550723    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38834ca8-e688-4fba-bf2d-50bb52a6b3e2" containerName="istio-proxy"
Jul 18 11:50:39.550771 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:39.550732    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="38834ca8-e688-4fba-bf2d-50bb52a6b3e2" containerName="istio-proxy"
Jul 18 11:50:39.550916 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:39.550853    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="38834ca8-e688-4fba-bf2d-50bb52a6b3e2" containerName="istio-proxy"
Jul 18 11:50:39.553775 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:39.553755    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c267dde-4b9nt"
Jul 18 11:50:39.556135 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:39.556112    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 11:50:39.556249 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:39.556182    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-99w6p\""
Jul 18 11:50:39.563502 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:39.563479    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c267dde-4b9nt"]
Jul 18 11:50:39.580463 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:39.580431    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5e31f48-88c5-4025-9e22-d40143e00cd2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5c267dde-4b9nt\" (UID: \"d5e31f48-88c5-4025-9e22-d40143e00cd2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c267dde-4b9nt"
Jul 18 11:50:39.681799 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:39.681766    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5e31f48-88c5-4025-9e22-d40143e00cd2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5c267dde-4b9nt\" (UID: \"d5e31f48-88c5-4025-9e22-d40143e00cd2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c267dde-4b9nt"
Jul 18 11:50:39.682399 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:39.682380    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5e31f48-88c5-4025-9e22-d40143e00cd2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-5c267dde-4b9nt\" (UID: \"d5e31f48-88c5-4025-9e22-d40143e00cd2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c267dde-4b9nt"
Jul 18 11:50:39.864711 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:39.864625    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c267dde-4b9nt"
Jul 18 11:50:39.989240 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:39.989215    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c267dde-4b9nt"]
Jul 18 11:50:39.991672 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:50:39.991645    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5e31f48_88c5_4025_9e22_d40143e00cd2.slice/crio-c88c3644d74e59cd25f92baa9eb66739f4a4d0f951f77c5d9a95cf275a5ffcaa WatchSource:0}: Error finding container c88c3644d74e59cd25f92baa9eb66739f4a4d0f951f77c5d9a95cf275a5ffcaa: Status 404 returned error can't find the container with id c88c3644d74e59cd25f92baa9eb66739f4a4d0f951f77c5d9a95cf275a5ffcaa
Jul 18 11:50:39.993490 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:39.993473    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 11:50:40.842544 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:40.842506    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c267dde-4b9nt" event={"ID":"d5e31f48-88c5-4025-9e22-d40143e00cd2","Type":"ContainerStarted","Data":"c88c3644d74e59cd25f92baa9eb66739f4a4d0f951f77c5d9a95cf275a5ffcaa"}
Jul 18 11:50:42.854878 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:42.854848    2554 generic.go:356] "Generic (PLEG): container finished" podID="d5e31f48-88c5-4025-9e22-d40143e00cd2" containerID="edb71a2d2815676586c1939c4e087f2ee46cf37b442eccf6d43a397d7efbc847" exitCode=0
Jul 18 11:50:42.855269 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:42.854932    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c267dde-4b9nt" event={"ID":"d5e31f48-88c5-4025-9e22-d40143e00cd2","Type":"ContainerDied","Data":"edb71a2d2815676586c1939c4e087f2ee46cf37b442eccf6d43a397d7efbc847"}
Jul 18 11:50:43.979158 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:43.979136    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c267dde-4b9nt"
Jul 18 11:50:44.021267 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:44.021242    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5e31f48-88c5-4025-9e22-d40143e00cd2-maas-api-service-ca\") pod \"d5e31f48-88c5-4025-9e22-d40143e00cd2\" (UID: \"d5e31f48-88c5-4025-9e22-d40143e00cd2\") "
Jul 18 11:50:44.021571 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:44.021544    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5e31f48-88c5-4025-9e22-d40143e00cd2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d5e31f48-88c5-4025-9e22-d40143e00cd2" (UID: "d5e31f48-88c5-4025-9e22-d40143e00cd2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:50:44.021700 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:44.021669    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d5e31f48-88c5-4025-9e22-d40143e00cd2-maas-api-service-ca\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:50:44.866261 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:44.866233    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c267dde-4b9nt"
Jul 18 11:50:44.866468 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:44.866260    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c267dde-4b9nt" event={"ID":"d5e31f48-88c5-4025-9e22-d40143e00cd2","Type":"ContainerDied","Data":"c88c3644d74e59cd25f92baa9eb66739f4a4d0f951f77c5d9a95cf275a5ffcaa"}
Jul 18 11:50:44.866468 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:44.866301    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c88c3644d74e59cd25f92baa9eb66739f4a4d0f951f77c5d9a95cf275a5ffcaa"
Jul 18 11:50:54.633079 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:54.633042    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c267dde-4b9nt"]
Jul 18 11:50:54.637661 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:54.637635    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-5c267dde-4b9nt"]
Jul 18 11:50:54.948744 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:54.948669    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5e31f48-88c5-4025-9e22-d40143e00cd2" path="/var/lib/kubelet/pods/d5e31f48-88c5-4025-9e22-d40143e00cd2/volumes"
Jul 18 11:50:55.565513 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.565483    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"]
Jul 18 11:50:55.565821 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.565810    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5e31f48-88c5-4025-9e22-d40143e00cd2" containerName="revoke-keys"
Jul 18 11:50:55.565874 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.565823    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5e31f48-88c5-4025-9e22-d40143e00cd2" containerName="revoke-keys"
Jul 18 11:50:55.565874 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.565870    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5e31f48-88c5-4025-9e22-d40143e00cd2" containerName="revoke-keys"
Jul 18 11:50:55.565939 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.565881    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="38834ca8-e688-4fba-bf2d-50bb52a6b3e2" containerName="istio-proxy"
Jul 18 11:50:55.568979 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.568959    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.571281 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.571256    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-da009c57-openshift-default-dockercfg-mpr9s\""
Jul 18 11:50:55.583367 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.583345    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"]
Jul 18 11:50:55.620308 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.620268    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-credential-socket\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.620308 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.620311    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istiod-ca-cert\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.620528 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.620338    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-data\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.620528 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.620401    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-workload-certs\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.620528 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.620436    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-podinfo\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.620528 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.620463    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-envoy\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.620678 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.620543    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-workload-socket\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.620678 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.620580    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-token\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.620678 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.620606    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p65lg\" (UniqueName: \"kubernetes.io/projected/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-kube-api-access-p65lg\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.721245 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.721210    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-credential-socket\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.721245 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.721250    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istiod-ca-cert\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.721770 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.721267    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-data\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.721770 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.721292    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-workload-certs\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.721770 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.721314    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-podinfo\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.721770 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.721441    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-envoy\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.721770 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.721514    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-workload-socket\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.721770 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.721556    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-token\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.721770 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.721593    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p65lg\" (UniqueName: \"kubernetes.io/projected/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-kube-api-access-p65lg\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.721770 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.721655    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-credential-socket\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.721770 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.721678    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-workload-certs\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.721770 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.721720    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-data\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.722197 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.721881    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-workload-socket\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.722251 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.722234    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istiod-ca-cert\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.724056 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.724030    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-envoy\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.724293 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.724278    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-podinfo\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.729277 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.729257    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p65lg\" (UniqueName: \"kubernetes.io/projected/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-kube-api-access-p65lg\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.729667 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.729647    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-token\") pod \"e2e-ait-da009c57-openshift-default-6db88cd57c-285gx\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") " pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:55.879454 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:55.879367    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:56.005257 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:56.005231    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"]
Jul 18 11:50:56.007267 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:50:56.007241    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddf2c49a_84c0_47fa_99d2_ccf528ad9a6d.slice/crio-d8a4b786690c815212de252c368a96c76445fa35b75e03a64e1bb603dfbb8ca3 WatchSource:0}: Error finding container d8a4b786690c815212de252c368a96c76445fa35b75e03a64e1bb603dfbb8ca3: Status 404 returned error can't find the container with id d8a4b786690c815212de252c368a96c76445fa35b75e03a64e1bb603dfbb8ca3
Jul 18 11:50:56.009592 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:56.009561    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:50:56.009659 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:56.009628    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:50:56.009659 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:56.009654    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:50:56.921414 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:56.921382    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx" event={"ID":"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d","Type":"ContainerStarted","Data":"190a91ede8fbc3c439f914cf8f6f2bd49f42910bbc0eb42fea8c5c0658916263"}
Jul 18 11:50:56.921799 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:56.921431    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx" event={"ID":"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d","Type":"ContainerStarted","Data":"d8a4b786690c815212de252c368a96c76445fa35b75e03a64e1bb603dfbb8ca3"}
Jul 18 11:50:56.941201 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:56.941152    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx" podStartSLOduration=1.941137144 podStartE2EDuration="1.941137144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:50:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:50:56.939378476 +0000 UTC m=+1858.541508216" watchObservedRunningTime="2026-07-18 11:50:56.941137144 +0000 UTC m=+1858.543266880"
Jul 18 11:50:57.879806 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:57.879774    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:57.884289 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:57.884267    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:57.925446 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:57.925413    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:50:57.926253 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:50:57.926235    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:51:11.989212 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:11.989111    2554 generic.go:356] "Generic (PLEG): container finished" podID="ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d" containerID="190a91ede8fbc3c439f914cf8f6f2bd49f42910bbc0eb42fea8c5c0658916263" exitCode=0
Jul 18 11:51:11.989212 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:11.989169    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx" event={"ID":"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d","Type":"ContainerDied","Data":"190a91ede8fbc3c439f914cf8f6f2bd49f42910bbc0eb42fea8c5c0658916263"}
Jul 18 11:51:11.989999 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:11.989668    2554 scope.go:117] "RemoveContainer" containerID="190a91ede8fbc3c439f914cf8f6f2bd49f42910bbc0eb42fea8c5c0658916263"
Jul 18 11:51:11.990689 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:11.990662    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:51:11.990754 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:11.990733    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:51:11.990789 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:11.990766    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:51:12.926296 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:12.926256    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:51:12.997550 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:12.997517    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx" event={"ID":"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d","Type":"ContainerStarted","Data":"d867a6b010f822306548eafbe5fe48fb50af570d1dc3bb8bd38f3524022e0b47"}
Jul 18 11:51:13.880419 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:13.880384    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:51:13.881509 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:13.881477    2554 patch_prober.go:28] interesting pod/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 18 11:51:13.881641 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:13.881552    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx" podUID="ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 18 11:51:14.880630 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:14.880209    2554 patch_prober.go:28] interesting pod/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 18 11:51:14.880630 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:14.880270    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx" podUID="ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 18 11:51:15.881753 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:15.881711    2554 patch_prober.go:28] interesting pod/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused" start-of-body=
Jul 18 11:51:15.882790 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:15.882339    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx" podUID="ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.35:15021/healthz/ready\": dial tcp 10.133.0.35:15021: connect: connection refused"
Jul 18 11:51:16.883983 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:16.883950    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:51:16.884468 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:16.884352    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:51:16.885133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:16.885114    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:51:40.390650 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:40.390615    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"]
Jul 18 11:51:40.391145 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:40.390924    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx" podUID="ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d" containerName="istio-proxy" containerID="cri-o://d867a6b010f822306548eafbe5fe48fb50af570d1dc3bb8bd38f3524022e0b47" gracePeriod=30
Jul 18 11:51:45.629058 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.629028    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:51:45.752892 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.752863    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-workload-socket\") pod \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") "
Jul 18 11:51:45.753069 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.752922    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-data\") pod \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") "
Jul 18 11:51:45.753069 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.752957    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istiod-ca-cert\") pod \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") "
Jul 18 11:51:45.753069 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.752983    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-credential-socket\") pod \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") "
Jul 18 11:51:45.753272 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.753151    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-workload-certs\") pod \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") "
Jul 18 11:51:45.753272 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.753156    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d" (UID: "ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:51:45.753272 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.753196    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p65lg\" (UniqueName: \"kubernetes.io/projected/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-kube-api-access-p65lg\") pod \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") "
Jul 18 11:51:45.753272 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.753231    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-podinfo\") pod \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") "
Jul 18 11:51:45.753473 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.753272    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-envoy\") pod \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") "
Jul 18 11:51:45.753473 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.753297    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-token\") pod \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\" (UID: \"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d\") "
Jul 18 11:51:45.753473 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.753320    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d" (UID: "ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:51:45.753473 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.753425    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d" (UID: "ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:51:45.753473 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.753447    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d" (UID: "ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:51:45.753706 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.753595    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istiod-ca-cert\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:51:45.753706 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.753617    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-credential-socket\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:51:45.753706 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.753636    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-workload-certs\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:51:45.753706 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.753651    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-workload-socket\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:51:45.753903 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.753838    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-data" (OuterVolumeSpecName: "istio-data") pod "ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d" (UID: "ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:51:45.755450 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.755400    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d" (UID: "ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 11:51:45.755450 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.755413    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-token" (OuterVolumeSpecName: "istio-token") pod "ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d" (UID: "ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:51:45.755620 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.755495    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d" (UID: "ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:51:45.755620 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.755497    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-kube-api-access-p65lg" (OuterVolumeSpecName: "kube-api-access-p65lg") pod "ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d" (UID: "ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d"). InnerVolumeSpecName "kube-api-access-p65lg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:51:45.854636 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.854604    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p65lg\" (UniqueName: \"kubernetes.io/projected/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-kube-api-access-p65lg\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:51:45.854636 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.854634    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-podinfo\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:51:45.854636 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.854643    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-envoy\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:51:45.854847 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.854651    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-token\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:51:45.854847 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:45.854658    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d-istio-data\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:51:46.141667 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:46.141586    2554 generic.go:356] "Generic (PLEG): container finished" podID="ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d" containerID="d867a6b010f822306548eafbe5fe48fb50af570d1dc3bb8bd38f3524022e0b47" exitCode=0
Jul 18 11:51:46.141667 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:46.141635    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"
Jul 18 11:51:46.141850 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:46.141664    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx" event={"ID":"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d","Type":"ContainerDied","Data":"d867a6b010f822306548eafbe5fe48fb50af570d1dc3bb8bd38f3524022e0b47"}
Jul 18 11:51:46.141850 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:46.141720    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx" event={"ID":"ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d","Type":"ContainerDied","Data":"d8a4b786690c815212de252c368a96c76445fa35b75e03a64e1bb603dfbb8ca3"}
Jul 18 11:51:46.141850 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:46.141743    2554 scope.go:117] "RemoveContainer" containerID="d867a6b010f822306548eafbe5fe48fb50af570d1dc3bb8bd38f3524022e0b47"
Jul 18 11:51:46.150623 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:46.150605    2554 scope.go:117] "RemoveContainer" containerID="190a91ede8fbc3c439f914cf8f6f2bd49f42910bbc0eb42fea8c5c0658916263"
Jul 18 11:51:46.158219 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:46.158203    2554 scope.go:117] "RemoveContainer" containerID="d867a6b010f822306548eafbe5fe48fb50af570d1dc3bb8bd38f3524022e0b47"
Jul 18 11:51:46.158475 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:51:46.158446    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d867a6b010f822306548eafbe5fe48fb50af570d1dc3bb8bd38f3524022e0b47\": container with ID starting with d867a6b010f822306548eafbe5fe48fb50af570d1dc3bb8bd38f3524022e0b47 not found: ID does not exist" containerID="d867a6b010f822306548eafbe5fe48fb50af570d1dc3bb8bd38f3524022e0b47"
Jul 18 11:51:46.158533 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:46.158485    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d867a6b010f822306548eafbe5fe48fb50af570d1dc3bb8bd38f3524022e0b47"} err="failed to get container status \"d867a6b010f822306548eafbe5fe48fb50af570d1dc3bb8bd38f3524022e0b47\": rpc error: code = NotFound desc = could not find container \"d867a6b010f822306548eafbe5fe48fb50af570d1dc3bb8bd38f3524022e0b47\": container with ID starting with d867a6b010f822306548eafbe5fe48fb50af570d1dc3bb8bd38f3524022e0b47 not found: ID does not exist"
Jul 18 11:51:46.158533 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:46.158507    2554 scope.go:117] "RemoveContainer" containerID="190a91ede8fbc3c439f914cf8f6f2bd49f42910bbc0eb42fea8c5c0658916263"
Jul 18 11:51:46.158724 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:51:46.158709    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"190a91ede8fbc3c439f914cf8f6f2bd49f42910bbc0eb42fea8c5c0658916263\": container with ID starting with 190a91ede8fbc3c439f914cf8f6f2bd49f42910bbc0eb42fea8c5c0658916263 not found: ID does not exist" containerID="190a91ede8fbc3c439f914cf8f6f2bd49f42910bbc0eb42fea8c5c0658916263"
Jul 18 11:51:46.158766 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:46.158728    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"190a91ede8fbc3c439f914cf8f6f2bd49f42910bbc0eb42fea8c5c0658916263"} err="failed to get container status \"190a91ede8fbc3c439f914cf8f6f2bd49f42910bbc0eb42fea8c5c0658916263\": rpc error: code = NotFound desc = could not find container \"190a91ede8fbc3c439f914cf8f6f2bd49f42910bbc0eb42fea8c5c0658916263\": container with ID starting with 190a91ede8fbc3c439f914cf8f6f2bd49f42910bbc0eb42fea8c5c0658916263 not found: ID does not exist"
Jul 18 11:51:46.162592 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:46.162569    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"]
Jul 18 11:51:46.166218 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:46.166198    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-da009c57-openshift-default-6db88cd57c-285gx"]
Jul 18 11:51:46.950060 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:51:46.950025    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d" path="/var/lib/kubelet/pods/ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d/volumes"
Jul 18 11:54:58.990738 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:54:58.990661    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5kkzl_2e953581-6e11-46ad-92e3-0d63df589850/ovn-acl-logging/0.log"
Jul 18 11:54:58.991691 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:54:58.991672    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5kkzl_2e953581-6e11-46ad-92e3-0d63df589850/ovn-acl-logging/0.log"
Jul 18 11:55:32.275220 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:32.275185    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ed7924cb-ddchh"]
Jul 18 11:55:32.275685 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:32.275549    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d" containerName="istio-proxy"
Jul 18 11:55:32.275685 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:32.275562    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d" containerName="istio-proxy"
Jul 18 11:55:32.275685 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:32.275623    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d" containerName="istio-proxy"
Jul 18 11:55:32.275685 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:32.275631    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d" containerName="istio-proxy"
Jul 18 11:55:32.278409 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:32.278389    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ed7924cb-ddchh"
Jul 18 11:55:32.280646 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:32.280620    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 11:55:32.280771 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:32.280756    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-99w6p\""
Jul 18 11:55:32.285175 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:32.285146    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ed7924cb-ddchh"]
Jul 18 11:55:32.365542 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:32.365495    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3298f3fb-9d15-46d3-b255-cdafac9a687c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ed7924cb-ddchh\" (UID: \"3298f3fb-9d15-46d3-b255-cdafac9a687c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ed7924cb-ddchh"
Jul 18 11:55:32.466958 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:32.466917    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3298f3fb-9d15-46d3-b255-cdafac9a687c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ed7924cb-ddchh\" (UID: \"3298f3fb-9d15-46d3-b255-cdafac9a687c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ed7924cb-ddchh"
Jul 18 11:55:32.467624 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:32.467603    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3298f3fb-9d15-46d3-b255-cdafac9a687c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ed7924cb-ddchh\" (UID: \"3298f3fb-9d15-46d3-b255-cdafac9a687c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ed7924cb-ddchh"
Jul 18 11:55:32.589339 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:32.589257    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ed7924cb-ddchh"
Jul 18 11:55:32.722820 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:32.722780    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ed7924cb-ddchh"]
Jul 18 11:55:32.725819 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:55:32.725789    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3298f3fb_9d15_46d3_b255_cdafac9a687c.slice/crio-f42360fcf9624b7b5c43e4d53fef900d7999f76e7d542440411f2aca5a3150f2 WatchSource:0}: Error finding container f42360fcf9624b7b5c43e4d53fef900d7999f76e7d542440411f2aca5a3150f2: Status 404 returned error can't find the container with id f42360fcf9624b7b5c43e4d53fef900d7999f76e7d542440411f2aca5a3150f2
Jul 18 11:55:33.150233 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:33.150128    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ed7924cb-ddchh" event={"ID":"3298f3fb-9d15-46d3-b255-cdafac9a687c","Type":"ContainerStarted","Data":"0cecbc3651b07a934c2d6223faa59efe6a0f33f81f9abd1cc8ad390fd8ef18db"}
Jul 18 11:55:33.150233 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:33.150191    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ed7924cb-ddchh" event={"ID":"3298f3fb-9d15-46d3-b255-cdafac9a687c","Type":"ContainerStarted","Data":"f42360fcf9624b7b5c43e4d53fef900d7999f76e7d542440411f2aca5a3150f2"}
Jul 18 11:55:33.165193 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:33.165141    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ed7924cb-ddchh" podStartSLOduration=1.165124335 podStartE2EDuration="1.165124335s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:55:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:55:33.163001402 +0000 UTC m=+2134.765131162" watchObservedRunningTime="2026-07-18 11:55:33.165124335 +0000 UTC m=+2134.767254074"
Jul 18 11:55:34.155840 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:34.155803    2554 generic.go:356] "Generic (PLEG): container finished" podID="3298f3fb-9d15-46d3-b255-cdafac9a687c" containerID="0cecbc3651b07a934c2d6223faa59efe6a0f33f81f9abd1cc8ad390fd8ef18db" exitCode=0
Jul 18 11:55:34.156227 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:34.155883    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ed7924cb-ddchh" event={"ID":"3298f3fb-9d15-46d3-b255-cdafac9a687c","Type":"ContainerDied","Data":"0cecbc3651b07a934c2d6223faa59efe6a0f33f81f9abd1cc8ad390fd8ef18db"}
Jul 18 11:55:35.291285 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:35.291261    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ed7924cb-ddchh"
Jul 18 11:55:35.393761 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:35.393722    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3298f3fb-9d15-46d3-b255-cdafac9a687c-maas-api-service-ca\") pod \"3298f3fb-9d15-46d3-b255-cdafac9a687c\" (UID: \"3298f3fb-9d15-46d3-b255-cdafac9a687c\") "
Jul 18 11:55:35.394147 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:35.394124    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3298f3fb-9d15-46d3-b255-cdafac9a687c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3298f3fb-9d15-46d3-b255-cdafac9a687c" (UID: "3298f3fb-9d15-46d3-b255-cdafac9a687c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:55:35.495386 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:35.495355    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3298f3fb-9d15-46d3-b255-cdafac9a687c-maas-api-service-ca\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:55:36.165485 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:36.165456    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ed7924cb-ddchh"
Jul 18 11:55:36.165485 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:36.165482    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ed7924cb-ddchh" event={"ID":"3298f3fb-9d15-46d3-b255-cdafac9a687c","Type":"ContainerDied","Data":"f42360fcf9624b7b5c43e4d53fef900d7999f76e7d542440411f2aca5a3150f2"}
Jul 18 11:55:36.165695 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:36.165524    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f42360fcf9624b7b5c43e4d53fef900d7999f76e7d542440411f2aca5a3150f2"
Jul 18 11:55:52.347814 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:52.347704    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ed7924cb-ddchh"]
Jul 18 11:55:52.350158 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:52.350134    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ed7924cb-ddchh"]
Jul 18 11:55:52.950782 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:55:52.950747    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3298f3fb-9d15-46d3-b255-cdafac9a687c" path="/var/lib/kubelet/pods/3298f3fb-9d15-46d3-b255-cdafac9a687c/volumes"
Jul 18 11:56:59.088996 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:56:59.088959    2554 scope.go:117] "RemoveContainer" containerID="edb71a2d2815676586c1939c4e087f2ee46cf37b442eccf6d43a397d7efbc847"
Jul 18 11:57:47.610127 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.610004    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"]
Jul 18 11:57:47.610678 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.610437    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d" containerName="istio-proxy"
Jul 18 11:57:47.610678 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.610451    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddf2c49a-84c0-47fa-99d2-ccf528ad9a6d" containerName="istio-proxy"
Jul 18 11:57:47.610678 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.610476    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3298f3fb-9d15-46d3-b255-cdafac9a687c" containerName="revoke-keys"
Jul 18 11:57:47.610678 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.610489    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3298f3fb-9d15-46d3-b255-cdafac9a687c" containerName="revoke-keys"
Jul 18 11:57:47.610678 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.610546    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3298f3fb-9d15-46d3-b255-cdafac9a687c" containerName="revoke-keys"
Jul 18 11:57:47.613029 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.613011    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.615346 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.615328    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-3a9e62-openshift-default-dockercfg-qbxkb\""
Jul 18 11:57:47.623742 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.623716    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"]
Jul 18 11:57:47.664133 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.664088    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-data\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.664327 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.664156    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0082527a-390f-4be1-8b65-2cc57ae854f7-istiod-ca-cert\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.664327 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.664178    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-envoy\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.664327 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.664198    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-workload-socket\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.664327 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.664278    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-podinfo\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.664327 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.664305    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-credential-socket\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.664327 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.664322    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4ldb\" (UniqueName: \"kubernetes.io/projected/0082527a-390f-4be1-8b65-2cc57ae854f7-kube-api-access-c4ldb\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.664523 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.664344    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-token\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.664523 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.664408    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-workload-certs\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.765028 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.764998    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-token\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.765265 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.765051    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-workload-certs\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.765265 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.765079    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-data\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.765265 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.765157    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0082527a-390f-4be1-8b65-2cc57ae854f7-istiod-ca-cert\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.765265 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.765185    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-envoy\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.765265 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.765214    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-workload-socket\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.765538 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.765276    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-podinfo\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.765538 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.765313    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-credential-socket\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.765538 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.765336    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4ldb\" (UniqueName: \"kubernetes.io/projected/0082527a-390f-4be1-8b65-2cc57ae854f7-kube-api-access-c4ldb\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.765686 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.765540    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-workload-certs\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.765686 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.765641    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-data\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.765805 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.765783    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-workload-socket\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.765849 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.765814    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-credential-socket\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.766024 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.766005    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0082527a-390f-4be1-8b65-2cc57ae854f7-istiod-ca-cert\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.767614 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.767594    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-envoy\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.767778 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.767759    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-podinfo\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.773790 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.773763    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-token\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.774042 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.774020    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4ldb\" (UniqueName: \"kubernetes.io/projected/0082527a-390f-4be1-8b65-2cc57ae854f7-kube-api-access-c4ldb\") pod \"e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") " pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:47.923231 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:47.923144    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:48.058578 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:48.058552    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"]
Jul 18 11:57:48.061362 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:57:48.061325    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0082527a_390f_4be1_8b65_2cc57ae854f7.slice/crio-3c8f75edc0310722fc78630753d0e7e8c5469b25d60e71ca444fedac14f98a95 WatchSource:0}: Error finding container 3c8f75edc0310722fc78630753d0e7e8c5469b25d60e71ca444fedac14f98a95: Status 404 returned error can't find the container with id 3c8f75edc0310722fc78630753d0e7e8c5469b25d60e71ca444fedac14f98a95
Jul 18 11:57:48.063796 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:48.063756    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:57:48.063901 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:48.063828    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:57:48.063901 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:48.063854    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:57:48.767726 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:48.767694    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn" event={"ID":"0082527a-390f-4be1-8b65-2cc57ae854f7","Type":"ContainerStarted","Data":"4fda8ee5d268d87fefb1c399a2f370f56ada3fd2b51f6651f6c3585746d9dd15"}
Jul 18 11:57:48.768147 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:48.767744    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn" event={"ID":"0082527a-390f-4be1-8b65-2cc57ae854f7","Type":"ContainerStarted","Data":"3c8f75edc0310722fc78630753d0e7e8c5469b25d60e71ca444fedac14f98a95"}
Jul 18 11:57:48.787523 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:48.787466    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn" podStartSLOduration=1.7874465769999999 podStartE2EDuration="1.787446577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:57:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:57:48.786722308 +0000 UTC m=+2270.388852048" watchObservedRunningTime="2026-07-18 11:57:48.787446577 +0000 UTC m=+2270.389576321"
Jul 18 11:57:48.923517 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:48.923480    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:49.928391 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:49.928355    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:50.776780 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:50.776741    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:57:50.777672 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:57:50.777654    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:58:02.834956 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:02.834925    2554 generic.go:356] "Generic (PLEG): container finished" podID="0082527a-390f-4be1-8b65-2cc57ae854f7" containerID="4fda8ee5d268d87fefb1c399a2f370f56ada3fd2b51f6651f6c3585746d9dd15" exitCode=0
Jul 18 11:58:02.834956 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:02.834966    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn" event={"ID":"0082527a-390f-4be1-8b65-2cc57ae854f7","Type":"ContainerDied","Data":"4fda8ee5d268d87fefb1c399a2f370f56ada3fd2b51f6651f6c3585746d9dd15"}
Jul 18 11:58:02.835432 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:02.835350    2554 scope.go:117] "RemoveContainer" containerID="4fda8ee5d268d87fefb1c399a2f370f56ada3fd2b51f6651f6c3585746d9dd15"
Jul 18 11:58:02.836388 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:02.836357    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:58:02.836488 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:02.836427    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:58:02.836488 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:02.836468    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 18 11:58:03.841427 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:03.841391    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn" event={"ID":"0082527a-390f-4be1-8b65-2cc57ae854f7","Type":"ContainerStarted","Data":"fdbd03a5a73c5681907327c9c3a7601c2c44774505c5d1899aae8471f88f743b"}
Jul 18 11:58:03.923655 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:03.923621    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:58:03.924680 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:03.924651    2554 patch_prober.go:28] interesting pod/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 18 11:58:03.924792 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:03.924703    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn" podUID="0082527a-390f-4be1-8b65-2cc57ae854f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 18 11:58:04.924159 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:04.924126    2554 patch_prober.go:28] interesting pod/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 18 11:58:04.924530 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:04.924185    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn" podUID="0082527a-390f-4be1-8b65-2cc57ae854f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 18 11:58:05.777595 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:05.777553    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:58:05.923763 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:05.923725    2554 patch_prober.go:28] interesting pod/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 18 11:58:05.923920 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:05.923795    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn" podUID="0082527a-390f-4be1-8b65-2cc57ae854f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 18 11:58:06.924310 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:06.924270    2554 patch_prober.go:28] interesting pod/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body=
Jul 18 11:58:06.924769 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:06.924333    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn" podUID="0082527a-390f-4be1-8b65-2cc57ae854f7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused"
Jul 18 11:58:07.927680 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:07.927652    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:58:07.928767 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:07.928745    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:58:51.926111 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:51.926008    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"]
Jul 18 11:58:51.929533 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:51.929514    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:58:51.932732 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:51.932709    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-3a9e62\"/\"test-model-3a9e62-kserve-self-signed-certs\""
Jul 18 11:58:51.932837 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:51.932776    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-3a9e62\"/\"kube-root-ca.crt\""
Jul 18 11:58:51.932837 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:51.932779    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-3a9e62\"/\"default-dockercfg-r8v7g\""
Jul 18 11:58:51.932957 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:51.932836    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-3a9e62\"/\"openshift-service-ca.crt\""
Jul 18 11:58:51.939743 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:51.939720    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"]
Jul 18 11:58:52.048698 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:52.048666    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-home\") pod \"test-model-3a9e62-kserve-9968cb84f-cbm2t\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") " pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:58:52.048875 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:52.048707    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vl79p\" (UniqueName: \"kubernetes.io/projected/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-kube-api-access-vl79p\") pod \"test-model-3a9e62-kserve-9968cb84f-cbm2t\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") " pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:58:52.048875 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:52.048775    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-model-cache\") pod \"test-model-3a9e62-kserve-9968cb84f-cbm2t\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") " pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:58:52.048875 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:52.048835    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-tmp-dir\") pod \"test-model-3a9e62-kserve-9968cb84f-cbm2t\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") " pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:58:52.049014 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:52.048985    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-dshm\") pod \"test-model-3a9e62-kserve-9968cb84f-cbm2t\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") " pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:58:52.049145 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:52.049085    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-tls-certs\") pod \"test-model-3a9e62-kserve-9968cb84f-cbm2t\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") " pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:58:52.149758 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:52.149721    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-tls-certs\") pod \"test-model-3a9e62-kserve-9968cb84f-cbm2t\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") " pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:58:52.149758 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:52.149765    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-home\") pod \"test-model-3a9e62-kserve-9968cb84f-cbm2t\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") " pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:58:52.150005 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:52.149781    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vl79p\" (UniqueName: \"kubernetes.io/projected/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-kube-api-access-vl79p\") pod \"test-model-3a9e62-kserve-9968cb84f-cbm2t\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") " pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:58:52.150005 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:52.149903    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-model-cache\") pod \"test-model-3a9e62-kserve-9968cb84f-cbm2t\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") " pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:58:52.150005 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:52.149968    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-tmp-dir\") pod \"test-model-3a9e62-kserve-9968cb84f-cbm2t\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") " pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:58:52.150206 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:52.150038    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-dshm\") pod \"test-model-3a9e62-kserve-9968cb84f-cbm2t\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") " pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:58:52.150261 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:52.150206    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-home\") pod \"test-model-3a9e62-kserve-9968cb84f-cbm2t\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") " pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:58:52.150307 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:52.150270    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-model-cache\") pod \"test-model-3a9e62-kserve-9968cb84f-cbm2t\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") " pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:58:52.150340 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:52.150321    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-tmp-dir\") pod \"test-model-3a9e62-kserve-9968cb84f-cbm2t\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") " pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:58:52.152243 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:52.152215    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-dshm\") pod \"test-model-3a9e62-kserve-9968cb84f-cbm2t\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") " pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:58:52.152372 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:52.152343    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-tls-certs\") pod \"test-model-3a9e62-kserve-9968cb84f-cbm2t\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") " pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:58:52.157663 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:52.157642    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vl79p\" (UniqueName: \"kubernetes.io/projected/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-kube-api-access-vl79p\") pod \"test-model-3a9e62-kserve-9968cb84f-cbm2t\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") " pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:58:52.240543 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:52.240454    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:58:52.365810 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:52.365785    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"]
Jul 18 11:58:52.367482 ip-10-0-130-110 kubenswrapper[2554]: W0718 11:58:52.367456    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ff3a0cf_ce9f_470b_b80c_ed02c30cc35d.slice/crio-4961cfd143ba0d492b065558a518021bbab2c5bb81f3771ee10af71f9e5691a4 WatchSource:0}: Error finding container 4961cfd143ba0d492b065558a518021bbab2c5bb81f3771ee10af71f9e5691a4: Status 404 returned error can't find the container with id 4961cfd143ba0d492b065558a518021bbab2c5bb81f3771ee10af71f9e5691a4
Jul 18 11:58:53.057183 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:53.057147    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t" event={"ID":"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d","Type":"ContainerStarted","Data":"26ea399653179c1049640ddaa9e48663a75ebf346473fa5006d825f0f183d25e"}
Jul 18 11:58:53.057183 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:53.057185    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t" event={"ID":"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d","Type":"ContainerStarted","Data":"4961cfd143ba0d492b065558a518021bbab2c5bb81f3771ee10af71f9e5691a4"}
Jul 18 11:58:53.073393 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:58:53.073340    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t" podStartSLOduration=2.073324256 podStartE2EDuration="2.073324256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 11:58:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 11:58:53.072051501 +0000 UTC m=+2334.674181240" watchObservedRunningTime="2026-07-18 11:58:53.073324256 +0000 UTC m=+2334.675453991"
Jul 18 11:59:02.240810 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:02.240769    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:59:02.241232 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:02.240827    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:59:02.253364 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:02.253340    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:59:03.113142 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:03.113113    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:59:10.412084 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:10.412049    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"]
Jul 18 11:59:25.431925 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:25.431882    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t" podUID="4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d" containerName="main" containerID="cri-o://26ea399653179c1049640ddaa9e48663a75ebf346473fa5006d825f0f183d25e" gracePeriod=45
Jul 18 11:59:25.679971 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:25.679948    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:59:25.747237 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:25.747213    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vl79p\" (UniqueName: \"kubernetes.io/projected/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-kube-api-access-vl79p\") pod \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") "
Jul 18 11:59:25.747401 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:25.747249    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-model-cache\") pod \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") "
Jul 18 11:59:25.747401 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:25.747267    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-tmp-dir\") pod \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") "
Jul 18 11:59:25.747517 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:25.747473    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-home\") pod \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") "
Jul 18 11:59:25.747570 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:25.747522    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d" (UID: "4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:59:25.747570 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:25.747544    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-tls-certs\") pod \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") "
Jul 18 11:59:25.747668 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:25.747540    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-model-cache" (OuterVolumeSpecName: "model-cache") pod "4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d" (UID: "4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:59:25.747668 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:25.747636    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-dshm\") pod \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\" (UID: \"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d\") "
Jul 18 11:59:25.747770 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:25.747695    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-home" (OuterVolumeSpecName: "home") pod "4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d" (UID: "4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:59:25.747939 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:25.747921    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-home\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:59:25.747995 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:25.747944    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-model-cache\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:59:25.747995 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:25.747959    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-tmp-dir\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:59:25.749555 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:25.749523    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-dshm" (OuterVolumeSpecName: "dshm") pod "4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d" (UID: "4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:59:25.749671 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:25.749584    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d" (UID: "4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 11:59:25.749671 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:25.749589    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-kube-api-access-vl79p" (OuterVolumeSpecName: "kube-api-access-vl79p") pod "4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d" (UID: "4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d"). InnerVolumeSpecName "kube-api-access-vl79p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:59:25.849111 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:25.849059    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-tls-certs\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:59:25.849111 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:25.849088    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-dshm\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:59:25.849307 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:25.849122    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vl79p\" (UniqueName: \"kubernetes.io/projected/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d-kube-api-access-vl79p\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:59:26.213134 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:26.213029    2554 generic.go:356] "Generic (PLEG): container finished" podID="4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d" containerID="26ea399653179c1049640ddaa9e48663a75ebf346473fa5006d825f0f183d25e" exitCode=0
Jul 18 11:59:26.213134 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:26.213069    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"
Jul 18 11:59:26.213134 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:26.213120    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t" event={"ID":"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d","Type":"ContainerDied","Data":"26ea399653179c1049640ddaa9e48663a75ebf346473fa5006d825f0f183d25e"}
Jul 18 11:59:26.213384 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:26.213154    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t" event={"ID":"4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d","Type":"ContainerDied","Data":"4961cfd143ba0d492b065558a518021bbab2c5bb81f3771ee10af71f9e5691a4"}
Jul 18 11:59:26.213384 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:26.213172    2554 scope.go:117] "RemoveContainer" containerID="26ea399653179c1049640ddaa9e48663a75ebf346473fa5006d825f0f183d25e"
Jul 18 11:59:26.222264 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:26.222246    2554 scope.go:117] "RemoveContainer" containerID="26ea399653179c1049640ddaa9e48663a75ebf346473fa5006d825f0f183d25e"
Jul 18 11:59:26.222538 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:59:26.222520    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26ea399653179c1049640ddaa9e48663a75ebf346473fa5006d825f0f183d25e\": container with ID starting with 26ea399653179c1049640ddaa9e48663a75ebf346473fa5006d825f0f183d25e not found: ID does not exist" containerID="26ea399653179c1049640ddaa9e48663a75ebf346473fa5006d825f0f183d25e"
Jul 18 11:59:26.222585 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:26.222545    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26ea399653179c1049640ddaa9e48663a75ebf346473fa5006d825f0f183d25e"} err="failed to get container status \"26ea399653179c1049640ddaa9e48663a75ebf346473fa5006d825f0f183d25e\": rpc error: code = NotFound desc = could not find container \"26ea399653179c1049640ddaa9e48663a75ebf346473fa5006d825f0f183d25e\": container with ID starting with 26ea399653179c1049640ddaa9e48663a75ebf346473fa5006d825f0f183d25e not found: ID does not exist"
Jul 18 11:59:26.232754 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:26.232734    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"]
Jul 18 11:59:26.236241 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:26.236219    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-3a9e62/test-model-3a9e62-kserve-9968cb84f-cbm2t"]
Jul 18 11:59:26.949062 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:26.949022    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d" path="/var/lib/kubelet/pods/4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d/volumes"
Jul 18 11:59:53.836306 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:53.836268    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"]
Jul 18 11:59:53.836804 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:53.836530    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn" podUID="0082527a-390f-4be1-8b65-2cc57ae854f7" containerName="istio-proxy" containerID="cri-o://fdbd03a5a73c5681907327c9c3a7601c2c44774505c5d1899aae8471f88f743b" gracePeriod=30
Jul 18 11:59:59.032168 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.032059    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5kkzl_2e953581-6e11-46ad-92e3-0d63df589850/ovn-acl-logging/0.log"
Jul 18 11:59:59.036146 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.036120    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5kkzl_2e953581-6e11-46ad-92e3-0d63df589850/ovn-acl-logging/0.log"
Jul 18 11:59:59.097076 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.097049    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:59:59.246071 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.246040    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-podinfo\") pod \"0082527a-390f-4be1-8b65-2cc57ae854f7\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") "
Jul 18 11:59:59.246378 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.246082    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-token\") pod \"0082527a-390f-4be1-8b65-2cc57ae854f7\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") "
Jul 18 11:59:59.246378 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.246156    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-data\") pod \"0082527a-390f-4be1-8b65-2cc57ae854f7\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") "
Jul 18 11:59:59.246378 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.246178    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-workload-socket\") pod \"0082527a-390f-4be1-8b65-2cc57ae854f7\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") "
Jul 18 11:59:59.246378 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.246244    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4ldb\" (UniqueName: \"kubernetes.io/projected/0082527a-390f-4be1-8b65-2cc57ae854f7-kube-api-access-c4ldb\") pod \"0082527a-390f-4be1-8b65-2cc57ae854f7\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") "
Jul 18 11:59:59.246378 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.246273    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-envoy\") pod \"0082527a-390f-4be1-8b65-2cc57ae854f7\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") "
Jul 18 11:59:59.246378 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.246308    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0082527a-390f-4be1-8b65-2cc57ae854f7-istiod-ca-cert\") pod \"0082527a-390f-4be1-8b65-2cc57ae854f7\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") "
Jul 18 11:59:59.246378 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.246336    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-workload-certs\") pod \"0082527a-390f-4be1-8b65-2cc57ae854f7\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") "
Jul 18 11:59:59.246734 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.246400    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-credential-socket\") pod \"0082527a-390f-4be1-8b65-2cc57ae854f7\" (UID: \"0082527a-390f-4be1-8b65-2cc57ae854f7\") "
Jul 18 11:59:59.246734 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.246551    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0082527a-390f-4be1-8b65-2cc57ae854f7" (UID: "0082527a-390f-4be1-8b65-2cc57ae854f7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:59:59.246734 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.246705    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-workload-socket\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:59:59.246902 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.246740    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0082527a-390f-4be1-8b65-2cc57ae854f7" (UID: "0082527a-390f-4be1-8b65-2cc57ae854f7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:59:59.246902 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.246817    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0082527a-390f-4be1-8b65-2cc57ae854f7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0082527a-390f-4be1-8b65-2cc57ae854f7" (UID: "0082527a-390f-4be1-8b65-2cc57ae854f7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 11:59:59.247007 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.246921    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0082527a-390f-4be1-8b65-2cc57ae854f7" (UID: "0082527a-390f-4be1-8b65-2cc57ae854f7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:59:59.247169 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.247140    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-data" (OuterVolumeSpecName: "istio-data") pod "0082527a-390f-4be1-8b65-2cc57ae854f7" (UID: "0082527a-390f-4be1-8b65-2cc57ae854f7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:59:59.248274 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.248243    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0082527a-390f-4be1-8b65-2cc57ae854f7" (UID: "0082527a-390f-4be1-8b65-2cc57ae854f7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 18 11:59:59.248384 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.248342    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0082527a-390f-4be1-8b65-2cc57ae854f7" (UID: "0082527a-390f-4be1-8b65-2cc57ae854f7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 11:59:59.248519 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.248495    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-token" (OuterVolumeSpecName: "istio-token") pod "0082527a-390f-4be1-8b65-2cc57ae854f7" (UID: "0082527a-390f-4be1-8b65-2cc57ae854f7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:59:59.248691 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.248673    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0082527a-390f-4be1-8b65-2cc57ae854f7-kube-api-access-c4ldb" (OuterVolumeSpecName: "kube-api-access-c4ldb") pod "0082527a-390f-4be1-8b65-2cc57ae854f7" (UID: "0082527a-390f-4be1-8b65-2cc57ae854f7"). InnerVolumeSpecName "kube-api-access-c4ldb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 11:59:59.347663 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.347634    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-credential-socket\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:59:59.347663 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.347659    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-podinfo\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:59:59.347663 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.347668    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-token\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:59:59.347884 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.347678    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-data\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:59:59.347884 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.347686    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4ldb\" (UniqueName: \"kubernetes.io/projected/0082527a-390f-4be1-8b65-2cc57ae854f7-kube-api-access-c4ldb\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:59:59.347884 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.347694    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-istio-envoy\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:59:59.347884 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.347703    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0082527a-390f-4be1-8b65-2cc57ae854f7-istiod-ca-cert\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:59:59.347884 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.347712    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0082527a-390f-4be1-8b65-2cc57ae854f7-workload-certs\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 11:59:59.368540 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.368507    2554 generic.go:356] "Generic (PLEG): container finished" podID="0082527a-390f-4be1-8b65-2cc57ae854f7" containerID="fdbd03a5a73c5681907327c9c3a7601c2c44774505c5d1899aae8471f88f743b" exitCode=0
Jul 18 11:59:59.368654 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.368552    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"
Jul 18 11:59:59.368654 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.368601    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn" event={"ID":"0082527a-390f-4be1-8b65-2cc57ae854f7","Type":"ContainerDied","Data":"fdbd03a5a73c5681907327c9c3a7601c2c44774505c5d1899aae8471f88f743b"}
Jul 18 11:59:59.368728 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.368695    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn" event={"ID":"0082527a-390f-4be1-8b65-2cc57ae854f7","Type":"ContainerDied","Data":"3c8f75edc0310722fc78630753d0e7e8c5469b25d60e71ca444fedac14f98a95"}
Jul 18 11:59:59.368766 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.368727    2554 scope.go:117] "RemoveContainer" containerID="fdbd03a5a73c5681907327c9c3a7601c2c44774505c5d1899aae8471f88f743b"
Jul 18 11:59:59.377825 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.377809    2554 scope.go:117] "RemoveContainer" containerID="4fda8ee5d268d87fefb1c399a2f370f56ada3fd2b51f6651f6c3585746d9dd15"
Jul 18 11:59:59.385254 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.385238    2554 scope.go:117] "RemoveContainer" containerID="fdbd03a5a73c5681907327c9c3a7601c2c44774505c5d1899aae8471f88f743b"
Jul 18 11:59:59.385484 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:59:59.385466    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdbd03a5a73c5681907327c9c3a7601c2c44774505c5d1899aae8471f88f743b\": container with ID starting with fdbd03a5a73c5681907327c9c3a7601c2c44774505c5d1899aae8471f88f743b not found: ID does not exist" containerID="fdbd03a5a73c5681907327c9c3a7601c2c44774505c5d1899aae8471f88f743b"
Jul 18 11:59:59.385531 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.385491    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdbd03a5a73c5681907327c9c3a7601c2c44774505c5d1899aae8471f88f743b"} err="failed to get container status \"fdbd03a5a73c5681907327c9c3a7601c2c44774505c5d1899aae8471f88f743b\": rpc error: code = NotFound desc = could not find container \"fdbd03a5a73c5681907327c9c3a7601c2c44774505c5d1899aae8471f88f743b\": container with ID starting with fdbd03a5a73c5681907327c9c3a7601c2c44774505c5d1899aae8471f88f743b not found: ID does not exist"
Jul 18 11:59:59.385531 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.385507    2554 scope.go:117] "RemoveContainer" containerID="4fda8ee5d268d87fefb1c399a2f370f56ada3fd2b51f6651f6c3585746d9dd15"
Jul 18 11:59:59.385750 ip-10-0-130-110 kubenswrapper[2554]: E0718 11:59:59.385732    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fda8ee5d268d87fefb1c399a2f370f56ada3fd2b51f6651f6c3585746d9dd15\": container with ID starting with 4fda8ee5d268d87fefb1c399a2f370f56ada3fd2b51f6651f6c3585746d9dd15 not found: ID does not exist" containerID="4fda8ee5d268d87fefb1c399a2f370f56ada3fd2b51f6651f6c3585746d9dd15"
Jul 18 11:59:59.385792 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.385758    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fda8ee5d268d87fefb1c399a2f370f56ada3fd2b51f6651f6c3585746d9dd15"} err="failed to get container status \"4fda8ee5d268d87fefb1c399a2f370f56ada3fd2b51f6651f6c3585746d9dd15\": rpc error: code = NotFound desc = could not find container \"4fda8ee5d268d87fefb1c399a2f370f56ada3fd2b51f6651f6c3585746d9dd15\": container with ID starting with 4fda8ee5d268d87fefb1c399a2f370f56ada3fd2b51f6651f6c3585746d9dd15 not found: ID does not exist"
Jul 18 11:59:59.389149 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.389128    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"]
Jul 18 11:59:59.395471 ip-10-0-130-110 kubenswrapper[2554]: I0718 11:59:59.395452    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-3a9e62-openshift-default-585645b4ff-wxdhn"]
Jul 18 12:00:00.131293 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:00.131255    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-e3c095-29739600-x26d6"]
Jul 18 12:00:00.131693 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:00.131585    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0082527a-390f-4be1-8b65-2cc57ae854f7" containerName="istio-proxy"
Jul 18 12:00:00.131693 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:00.131595    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="0082527a-390f-4be1-8b65-2cc57ae854f7" containerName="istio-proxy"
Jul 18 12:00:00.131693 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:00.131605    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d" containerName="main"
Jul 18 12:00:00.131693 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:00.131611    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d" containerName="main"
Jul 18 12:00:00.131693 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:00.131623    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0082527a-390f-4be1-8b65-2cc57ae854f7" containerName="istio-proxy"
Jul 18 12:00:00.131693 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:00.131628    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="0082527a-390f-4be1-8b65-2cc57ae854f7" containerName="istio-proxy"
Jul 18 12:00:00.131693 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:00.131679    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="0082527a-390f-4be1-8b65-2cc57ae854f7" containerName="istio-proxy"
Jul 18 12:00:00.131693 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:00.131688    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ff3a0cf-ce9f-470b-b80c-ed02c30cc35d" containerName="main"
Jul 18 12:00:00.131693 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:00.131697    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="0082527a-390f-4be1-8b65-2cc57ae854f7" containerName="istio-proxy"
Jul 18 12:00:00.135824 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:00.135808    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-e3c095-29739600-x26d6"
Jul 18 12:00:00.137888 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:00.137870    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-99w6p\""
Jul 18 12:00:00.142630 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:00.142603    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-e3c095-29739600-x26d6"]
Jul 18 12:00:00.146466 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:00.146449    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-e3c095-29739600-x26d6"
Jul 18 12:00:00.280665 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:00.280637    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-e3c095-29739600-x26d6"]
Jul 18 12:00:00.283326 ip-10-0-130-110 kubenswrapper[2554]: W0718 12:00:00.283300    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a35f9d9_6e08_4eff_9659_b3d81e76b4db.slice/crio-6f8e6efa26115e6d7601497db17aed8d300b153b24a73079cac79213893d27aa WatchSource:0}: Error finding container 6f8e6efa26115e6d7601497db17aed8d300b153b24a73079cac79213893d27aa: Status 404 returned error can't find the container with id 6f8e6efa26115e6d7601497db17aed8d300b153b24a73079cac79213893d27aa
Jul 18 12:00:00.374850 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:00.374817    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-e3c095-29739600-x26d6" event={"ID":"1a35f9d9-6e08-4eff-9659-b3d81e76b4db","Type":"ContainerStarted","Data":"6f8e6efa26115e6d7601497db17aed8d300b153b24a73079cac79213893d27aa"}
Jul 18 12:00:00.949826 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:00.949796    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0082527a-390f-4be1-8b65-2cc57ae854f7" path="/var/lib/kubelet/pods/0082527a-390f-4be1-8b65-2cc57ae854f7/volumes"
Jul 18 12:00:01.380517 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:01.380474    2554 generic.go:356] "Generic (PLEG): container finished" podID="1a35f9d9-6e08-4eff-9659-b3d81e76b4db" containerID="ce3ab2e3699437b7721da8a42af87e7c2db7c66ef5d11d96a68963b961a3ddff" exitCode=7
Jul 18 12:00:01.380900 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:01.380556    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-e3c095-29739600-x26d6" event={"ID":"1a35f9d9-6e08-4eff-9659-b3d81e76b4db","Type":"ContainerDied","Data":"ce3ab2e3699437b7721da8a42af87e7c2db7c66ef5d11d96a68963b961a3ddff"}
Jul 18 12:00:01.380900 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:01.380678    2554 scope.go:117] "RemoveContainer" containerID="ce3ab2e3699437b7721da8a42af87e7c2db7c66ef5d11d96a68963b961a3ddff"
Jul 18 12:00:02.387049 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:02.387015    2554 generic.go:356] "Generic (PLEG): container finished" podID="1a35f9d9-6e08-4eff-9659-b3d81e76b4db" containerID="7862a03ed8b1ed906a4b533e5e9a945d68b2a3de6a6e6fa8244d0a18e5512b60" exitCode=7
Jul 18 12:00:02.387493 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:02.387074    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-e3c095-29739600-x26d6" event={"ID":"1a35f9d9-6e08-4eff-9659-b3d81e76b4db","Type":"ContainerDied","Data":"7862a03ed8b1ed906a4b533e5e9a945d68b2a3de6a6e6fa8244d0a18e5512b60"}
Jul 18 12:00:02.387493 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:02.387145    2554 scope.go:117] "RemoveContainer" containerID="ce3ab2e3699437b7721da8a42af87e7c2db7c66ef5d11d96a68963b961a3ddff"
Jul 18 12:00:02.387493 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:02.387282    2554 scope.go:117] "RemoveContainer" containerID="7862a03ed8b1ed906a4b533e5e9a945d68b2a3de6a6e6fa8244d0a18e5512b60"
Jul 18 12:00:02.387631 ip-10-0-130-110 kubenswrapper[2554]: E0718 12:00:02.387536    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-api-a-e3c095-29739600-x26d6_odh-ai-gateway-infra(1a35f9d9-6e08-4eff-9659-b3d81e76b4db)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-e3c095-29739600-x26d6" podUID="1a35f9d9-6e08-4eff-9659-b3d81e76b4db"
Jul 18 12:00:03.393159 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:03.393132    2554 scope.go:117] "RemoveContainer" containerID="7862a03ed8b1ed906a4b533e5e9a945d68b2a3de6a6e6fa8244d0a18e5512b60"
Jul 18 12:00:03.393533 ip-10-0-130-110 kubenswrapper[2554]: E0718 12:00:03.393365    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-api-a-e3c095-29739600-x26d6_odh-ai-gateway-infra(1a35f9d9-6e08-4eff-9659-b3d81e76b4db)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-e3c095-29739600-x26d6" podUID="1a35f9d9-6e08-4eff-9659-b3d81e76b4db"
Jul 18 12:00:14.944050 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:14.944018    2554 scope.go:117] "RemoveContainer" containerID="7862a03ed8b1ed906a4b533e5e9a945d68b2a3de6a6e6fa8244d0a18e5512b60"
Jul 18 12:00:15.447869 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:15.447835    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-e3c095-29739600-x26d6" event={"ID":"1a35f9d9-6e08-4eff-9659-b3d81e76b4db","Type":"ContainerStarted","Data":"ec90bad62f5b5232811544d846bbc7745d38b94b72bd4303d35b172ece44b4ba"}
Jul 18 12:00:15.462654 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:15.462606    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-e3c095-29739600-x26d6" podStartSLOduration=15.462594374 podStartE2EDuration="15.462594374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 12:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 12:00:15.461367067 +0000 UTC m=+2417.063496805" watchObservedRunningTime="2026-07-18 12:00:15.462594374 +0000 UTC m=+2417.064724113"
Jul 18 12:00:16.454484 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:16.454447    2554 generic.go:356] "Generic (PLEG): container finished" podID="1a35f9d9-6e08-4eff-9659-b3d81e76b4db" containerID="ec90bad62f5b5232811544d846bbc7745d38b94b72bd4303d35b172ece44b4ba" exitCode=0
Jul 18 12:00:16.454484 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:16.454484    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-e3c095-29739600-x26d6" event={"ID":"1a35f9d9-6e08-4eff-9659-b3d81e76b4db","Type":"ContainerDied","Data":"ec90bad62f5b5232811544d846bbc7745d38b94b72bd4303d35b172ece44b4ba"}
Jul 18 12:00:16.454964 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:16.454541    2554 scope.go:117] "RemoveContainer" containerID="7862a03ed8b1ed906a4b533e5e9a945d68b2a3de6a6e6fa8244d0a18e5512b60"
Jul 18 12:00:16.477232 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:16.477185    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-e3c095-29739600-x26d6"]
Jul 18 12:00:17.600256 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:17.600228    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-e3c095-29739600-x26d6"
Jul 18 12:00:18.467867 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:18.467840    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-e3c095-29739600-x26d6"
Jul 18 12:00:18.468039 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:18.467840    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-e3c095-29739600-x26d6" event={"ID":"1a35f9d9-6e08-4eff-9659-b3d81e76b4db","Type":"ContainerDied","Data":"6f8e6efa26115e6d7601497db17aed8d300b153b24a73079cac79213893d27aa"}
Jul 18 12:00:18.468039 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:18.467973    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f8e6efa26115e6d7601497db17aed8d300b153b24a73079cac79213893d27aa"
Jul 18 12:00:18.497571 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:18.497545    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-e3c095-29739600-x26d6"]
Jul 18 12:00:18.504616 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:18.504595    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-e3c095-29739600-x26d6"]
Jul 18 12:00:18.928139 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:18.928108    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e3c095-474kd"]
Jul 18 12:00:18.929035 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:18.929005    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a35f9d9-6e08-4eff-9659-b3d81e76b4db" containerName="cleanup"
Jul 18 12:00:18.929035 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:18.929036    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a35f9d9-6e08-4eff-9659-b3d81e76b4db" containerName="cleanup"
Jul 18 12:00:18.929242 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:18.929077    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a35f9d9-6e08-4eff-9659-b3d81e76b4db" containerName="cleanup"
Jul 18 12:00:18.929242 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:18.929086    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a35f9d9-6e08-4eff-9659-b3d81e76b4db" containerName="cleanup"
Jul 18 12:00:18.929242 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:18.929123    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a35f9d9-6e08-4eff-9659-b3d81e76b4db" containerName="cleanup"
Jul 18 12:00:18.929242 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:18.929132    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a35f9d9-6e08-4eff-9659-b3d81e76b4db" containerName="cleanup"
Jul 18 12:00:18.929430 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:18.929337    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a35f9d9-6e08-4eff-9659-b3d81e76b4db" containerName="cleanup"
Jul 18 12:00:18.929430 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:18.929349    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a35f9d9-6e08-4eff-9659-b3d81e76b4db" containerName="cleanup"
Jul 18 12:00:18.933191 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:18.933167    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e3c095-474kd"
Jul 18 12:00:18.936661 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:18.936636    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-99w6p\""
Jul 18 12:00:18.936778 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:18.936636    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 12:00:18.938565 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:18.938542    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e3c095-474kd"]
Jul 18 12:00:18.951512 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:18.951486    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a35f9d9-6e08-4eff-9659-b3d81e76b4db" path="/var/lib/kubelet/pods/1a35f9d9-6e08-4eff-9659-b3d81e76b4db/volumes"
Jul 18 12:00:19.006851 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:19.006823    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b31fe6c-dc8f-45d0-970d-87a32a9d1eea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e3c095-474kd\" (UID: \"6b31fe6c-dc8f-45d0-970d-87a32a9d1eea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e3c095-474kd"
Jul 18 12:00:19.107313 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:19.107286    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b31fe6c-dc8f-45d0-970d-87a32a9d1eea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e3c095-474kd\" (UID: \"6b31fe6c-dc8f-45d0-970d-87a32a9d1eea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e3c095-474kd"
Jul 18 12:00:19.107888 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:19.107867    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b31fe6c-dc8f-45d0-970d-87a32a9d1eea-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e3c095-474kd\" (UID: \"6b31fe6c-dc8f-45d0-970d-87a32a9d1eea\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e3c095-474kd"
Jul 18 12:00:19.245830 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:19.245810    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e3c095-474kd"
Jul 18 12:00:19.375282 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:19.375242    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e3c095-474kd"]
Jul 18 12:00:19.379985 ip-10-0-130-110 kubenswrapper[2554]: W0718 12:00:19.379946    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b31fe6c_dc8f_45d0_970d_87a32a9d1eea.slice/crio-a58b9d266f9576f4d4d3584beeaf11d10d25689a5b0940ca2e07dc85040e86ce WatchSource:0}: Error finding container a58b9d266f9576f4d4d3584beeaf11d10d25689a5b0940ca2e07dc85040e86ce: Status 404 returned error can't find the container with id a58b9d266f9576f4d4d3584beeaf11d10d25689a5b0940ca2e07dc85040e86ce
Jul 18 12:00:19.474535 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:19.474490    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e3c095-474kd" event={"ID":"6b31fe6c-dc8f-45d0-970d-87a32a9d1eea","Type":"ContainerStarted","Data":"a58b9d266f9576f4d4d3584beeaf11d10d25689a5b0940ca2e07dc85040e86ce"}
Jul 18 12:00:20.480125 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:20.480013    2554 generic.go:356] "Generic (PLEG): container finished" podID="6b31fe6c-dc8f-45d0-970d-87a32a9d1eea" containerID="cbce142f63efb5d88a9b6dfd362969648df76bc9a09fa90fc75a195bf06c83d0" exitCode=0
Jul 18 12:00:20.480468 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:20.480117    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e3c095-474kd" event={"ID":"6b31fe6c-dc8f-45d0-970d-87a32a9d1eea","Type":"ContainerDied","Data":"cbce142f63efb5d88a9b6dfd362969648df76bc9a09fa90fc75a195bf06c83d0"}
Jul 18 12:00:21.609254 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:21.609234    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e3c095-474kd"
Jul 18 12:00:21.733342 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:21.733306    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b31fe6c-dc8f-45d0-970d-87a32a9d1eea-maas-api-service-ca\") pod \"6b31fe6c-dc8f-45d0-970d-87a32a9d1eea\" (UID: \"6b31fe6c-dc8f-45d0-970d-87a32a9d1eea\") "
Jul 18 12:00:21.733651 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:21.733628    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b31fe6c-dc8f-45d0-970d-87a32a9d1eea-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6b31fe6c-dc8f-45d0-970d-87a32a9d1eea" (UID: "6b31fe6c-dc8f-45d0-970d-87a32a9d1eea"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 12:00:21.834696 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:21.834654    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b31fe6c-dc8f-45d0-970d-87a32a9d1eea-maas-api-service-ca\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:00:22.490921 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:22.490892    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e3c095-474kd"
Jul 18 12:00:22.491113 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:22.490892    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e3c095-474kd" event={"ID":"6b31fe6c-dc8f-45d0-970d-87a32a9d1eea","Type":"ContainerDied","Data":"a58b9d266f9576f4d4d3584beeaf11d10d25689a5b0940ca2e07dc85040e86ce"}
Jul 18 12:00:22.491113 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:22.491017    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a58b9d266f9576f4d4d3584beeaf11d10d25689a5b0940ca2e07dc85040e86ce"
Jul 18 12:00:39.014909 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:39.014873    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e3c095-474kd"]
Jul 18 12:00:39.017860 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:39.017836    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e3c095-474kd"]
Jul 18 12:00:40.949747 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:40.949715    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b31fe6c-dc8f-45d0-970d-87a32a9d1eea" path="/var/lib/kubelet/pods/6b31fe6c-dc8f-45d0-970d-87a32a9d1eea/volumes"
Jul 18 12:00:45.648075 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:45.648031    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1dc2c9-mftz4"]
Jul 18 12:00:45.648762 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:45.648431    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b31fe6c-dc8f-45d0-970d-87a32a9d1eea" containerName="revoke-keys"
Jul 18 12:00:45.648762 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:45.648443    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b31fe6c-dc8f-45d0-970d-87a32a9d1eea" containerName="revoke-keys"
Jul 18 12:00:45.648762 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:45.648506    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b31fe6c-dc8f-45d0-970d-87a32a9d1eea" containerName="revoke-keys"
Jul 18 12:00:45.648762 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:45.648516    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a35f9d9-6e08-4eff-9659-b3d81e76b4db" containerName="cleanup"
Jul 18 12:00:45.652535 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:45.652517    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1dc2c9-mftz4"
Jul 18 12:00:45.654940 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:45.654917    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 12:00:45.655057 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:45.654917    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-99w6p\""
Jul 18 12:00:45.657860 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:45.657836    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1dc2c9-mftz4"]
Jul 18 12:00:45.749769 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:45.749733    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbd86bab-3e68-432f-a61f-44fbca3c24b3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-1dc2c9-mftz4\" (UID: \"bbd86bab-3e68-432f-a61f-44fbca3c24b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1dc2c9-mftz4"
Jul 18 12:00:45.850276 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:45.850237    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbd86bab-3e68-432f-a61f-44fbca3c24b3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-1dc2c9-mftz4\" (UID: \"bbd86bab-3e68-432f-a61f-44fbca3c24b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1dc2c9-mftz4"
Jul 18 12:00:45.850847 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:45.850825    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbd86bab-3e68-432f-a61f-44fbca3c24b3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-1dc2c9-mftz4\" (UID: \"bbd86bab-3e68-432f-a61f-44fbca3c24b3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1dc2c9-mftz4"
Jul 18 12:00:45.964782 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:45.964676    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1dc2c9-mftz4"
Jul 18 12:00:46.094795 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:46.094766    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1dc2c9-mftz4"]
Jul 18 12:00:46.097253 ip-10-0-130-110 kubenswrapper[2554]: W0718 12:00:46.097225    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbd86bab_3e68_432f_a61f_44fbca3c24b3.slice/crio-f97b99f7811371a9b2e4ff1430e44a03a1f1b0b3c1a33e7ae2b8fada6aa7c087 WatchSource:0}: Error finding container f97b99f7811371a9b2e4ff1430e44a03a1f1b0b3c1a33e7ae2b8fada6aa7c087: Status 404 returned error can't find the container with id f97b99f7811371a9b2e4ff1430e44a03a1f1b0b3c1a33e7ae2b8fada6aa7c087
Jul 18 12:00:46.602737 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:46.602645    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1dc2c9-mftz4" event={"ID":"bbd86bab-3e68-432f-a61f-44fbca3c24b3","Type":"ContainerStarted","Data":"a7296eb814194ed1f05b2da0bc431db3454abd03a1aaac6b4d6233f58c683816"}
Jul 18 12:00:46.602737 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:46.602698    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1dc2c9-mftz4" event={"ID":"bbd86bab-3e68-432f-a61f-44fbca3c24b3","Type":"ContainerStarted","Data":"f97b99f7811371a9b2e4ff1430e44a03a1f1b0b3c1a33e7ae2b8fada6aa7c087"}
Jul 18 12:00:46.616699 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:46.616655    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1dc2c9-mftz4" podStartSLOduration=1.6166404989999998 podStartE2EDuration="1.616640499s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 12:00:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 12:00:46.615640382 +0000 UTC m=+2448.217770122" watchObservedRunningTime="2026-07-18 12:00:46.616640499 +0000 UTC m=+2448.218770237"
Jul 18 12:00:47.608454 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:47.608421    2554 generic.go:356] "Generic (PLEG): container finished" podID="bbd86bab-3e68-432f-a61f-44fbca3c24b3" containerID="a7296eb814194ed1f05b2da0bc431db3454abd03a1aaac6b4d6233f58c683816" exitCode=0
Jul 18 12:00:47.608892 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:47.608508    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1dc2c9-mftz4" event={"ID":"bbd86bab-3e68-432f-a61f-44fbca3c24b3","Type":"ContainerDied","Data":"a7296eb814194ed1f05b2da0bc431db3454abd03a1aaac6b4d6233f58c683816"}
Jul 18 12:00:48.746536 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:48.746512    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1dc2c9-mftz4"
Jul 18 12:00:48.878221 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:48.878129    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbd86bab-3e68-432f-a61f-44fbca3c24b3-maas-api-service-ca\") pod \"bbd86bab-3e68-432f-a61f-44fbca3c24b3\" (UID: \"bbd86bab-3e68-432f-a61f-44fbca3c24b3\") "
Jul 18 12:00:48.878519 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:48.878486    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbd86bab-3e68-432f-a61f-44fbca3c24b3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bbd86bab-3e68-432f-a61f-44fbca3c24b3" (UID: "bbd86bab-3e68-432f-a61f-44fbca3c24b3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 12:00:48.979340 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:48.979308    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbd86bab-3e68-432f-a61f-44fbca3c24b3-maas-api-service-ca\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:00:49.619011 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:49.618981    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1dc2c9-mftz4"
Jul 18 12:00:49.619011 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:49.618985    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1dc2c9-mftz4" event={"ID":"bbd86bab-3e68-432f-a61f-44fbca3c24b3","Type":"ContainerDied","Data":"f97b99f7811371a9b2e4ff1430e44a03a1f1b0b3c1a33e7ae2b8fada6aa7c087"}
Jul 18 12:00:49.619249 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:00:49.619032    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f97b99f7811371a9b2e4ff1430e44a03a1f1b0b3c1a33e7ae2b8fada6aa7c087"
Jul 18 12:01:05.728812 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:05.728770    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1dc2c9-mftz4"]
Jul 18 12:01:05.730644 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:05.730620    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-1dc2c9-mftz4"]
Jul 18 12:01:06.949232 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:06.949199    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbd86bab-3e68-432f-a61f-44fbca3c24b3" path="/var/lib/kubelet/pods/bbd86bab-3e68-432f-a61f-44fbca3c24b3/volumes"
Jul 18 12:01:37.122616 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.122558    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"]
Jul 18 12:01:37.123055 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.122916    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbd86bab-3e68-432f-a61f-44fbca3c24b3" containerName="revoke-keys"
Jul 18 12:01:37.123055 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.122927    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbd86bab-3e68-432f-a61f-44fbca3c24b3" containerName="revoke-keys"
Jul 18 12:01:37.123055 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.122996    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbd86bab-3e68-432f-a61f-44fbca3c24b3" containerName="revoke-keys"
Jul 18 12:01:37.125655 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.125637    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:37.128807 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.128783    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-399bd8\"/\"default-dockercfg-zr6sl\""
Jul 18 12:01:37.128807 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.128804    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-399bd8\"/\"kube-root-ca.crt\""
Jul 18 12:01:37.129001 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.128804    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-399bd8\"/\"auth-test-model-399bd8-kserve-self-signed-certs\""
Jul 18 12:01:37.129001 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.128789    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-399bd8\"/\"openshift-service-ca.crt\""
Jul 18 12:01:37.134275 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.134260    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"]
Jul 18 12:01:37.288051 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.288006    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-dshm\") pod \"auth-test-model-399bd8-kserve-658d958c-8gfzg\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") " pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:37.288051 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.288056    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-tmp-dir\") pod \"auth-test-model-399bd8-kserve-658d958c-8gfzg\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") " pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:37.288051 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.288073    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be45ac82-b82c-4ca2-b872-0dbee4a73374-tls-certs\") pod \"auth-test-model-399bd8-kserve-658d958c-8gfzg\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") " pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:37.288343 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.288168    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-model-cache\") pod \"auth-test-model-399bd8-kserve-658d958c-8gfzg\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") " pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:37.288343 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.288206    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-home\") pod \"auth-test-model-399bd8-kserve-658d958c-8gfzg\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") " pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:37.288343 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.288222    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd5ff\" (UniqueName: \"kubernetes.io/projected/be45ac82-b82c-4ca2-b872-0dbee4a73374-kube-api-access-gd5ff\") pod \"auth-test-model-399bd8-kserve-658d958c-8gfzg\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") " pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:37.389281 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.389178    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-home\") pod \"auth-test-model-399bd8-kserve-658d958c-8gfzg\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") " pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:37.389281 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.389244    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd5ff\" (UniqueName: \"kubernetes.io/projected/be45ac82-b82c-4ca2-b872-0dbee4a73374-kube-api-access-gd5ff\") pod \"auth-test-model-399bd8-kserve-658d958c-8gfzg\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") " pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:37.389505 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.389311    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-dshm\") pod \"auth-test-model-399bd8-kserve-658d958c-8gfzg\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") " pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:37.389505 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.389335    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-tmp-dir\") pod \"auth-test-model-399bd8-kserve-658d958c-8gfzg\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") " pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:37.389505 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.389359    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be45ac82-b82c-4ca2-b872-0dbee4a73374-tls-certs\") pod \"auth-test-model-399bd8-kserve-658d958c-8gfzg\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") " pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:37.389505 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.389426    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-model-cache\") pod \"auth-test-model-399bd8-kserve-658d958c-8gfzg\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") " pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:37.389903 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.389874    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-tmp-dir\") pod \"auth-test-model-399bd8-kserve-658d958c-8gfzg\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") " pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:37.392758 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.391985    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-model-cache\") pod \"auth-test-model-399bd8-kserve-658d958c-8gfzg\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") " pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:37.392758 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.392414    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be45ac82-b82c-4ca2-b872-0dbee4a73374-tls-certs\") pod \"auth-test-model-399bd8-kserve-658d958c-8gfzg\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") " pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:37.392758 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.392522    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-home\") pod \"auth-test-model-399bd8-kserve-658d958c-8gfzg\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") " pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:37.392758 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.392719    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-dshm\") pod \"auth-test-model-399bd8-kserve-658d958c-8gfzg\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") " pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:37.398498 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.398475    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd5ff\" (UniqueName: \"kubernetes.io/projected/be45ac82-b82c-4ca2-b872-0dbee4a73374-kube-api-access-gd5ff\") pod \"auth-test-model-399bd8-kserve-658d958c-8gfzg\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") " pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:37.437636 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.437612    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:37.563176 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.563149    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"]
Jul 18 12:01:37.565090 ip-10-0-130-110 kubenswrapper[2554]: W0718 12:01:37.565062    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe45ac82_b82c_4ca2_b872_0dbee4a73374.slice/crio-352f376d39d757d2f5e19fb18bc02f2cbfe0958fc13487ff9f187db7dd0a653c WatchSource:0}: Error finding container 352f376d39d757d2f5e19fb18bc02f2cbfe0958fc13487ff9f187db7dd0a653c: Status 404 returned error can't find the container with id 352f376d39d757d2f5e19fb18bc02f2cbfe0958fc13487ff9f187db7dd0a653c
Jul 18 12:01:37.844501 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.844465    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg" event={"ID":"be45ac82-b82c-4ca2-b872-0dbee4a73374","Type":"ContainerStarted","Data":"182032d8e3b8fa35f37200c6724a2debb191df46234561d67814f95d96842ee5"}
Jul 18 12:01:37.844501 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.844507    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg" event={"ID":"be45ac82-b82c-4ca2-b872-0dbee4a73374","Type":"ContainerStarted","Data":"352f376d39d757d2f5e19fb18bc02f2cbfe0958fc13487ff9f187db7dd0a653c"}
Jul 18 12:01:37.861685 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:37.861636    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg" podStartSLOduration=0.861622245 podStartE2EDuration="861.622245ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 12:01:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 12:01:37.859603313 +0000 UTC m=+2499.461733051" watchObservedRunningTime="2026-07-18 12:01:37.861622245 +0000 UTC m=+2499.463751982"
Jul 18 12:01:47.438515 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:47.438477    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:47.438910 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:47.438534    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:47.450576 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:47.450548    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:47.902558 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:47.902520    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:01:59.150436 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:01:59.150363    2554 scope.go:117] "RemoveContainer" containerID="0cecbc3651b07a934c2d6223faa59efe6a0f33f81f9abd1cc8ad390fd8ef18db"
Jul 18 12:02:20.128947 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.128909    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"]
Jul 18 12:02:20.132768 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.132747    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:20.135990 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.135966    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-276d7e\"/\"openshift-service-ca.crt\""
Jul 18 12:02:20.136138 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.136045    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-276d7e\"/\"kube-root-ca.crt\""
Jul 18 12:02:20.136138 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.135966    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-276d7e\"/\"default-dockercfg-z2j7j\""
Jul 18 12:02:20.136416 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.136400    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-276d7e\"/\"auth-test-model-276d7e-kserve-self-signed-certs\""
Jul 18 12:02:20.142140 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.142119    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"]
Jul 18 12:02:20.264920 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.264884    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17314490-d056-4bae-ad2d-f7310163852a-tls-certs\") pod \"auth-test-model-276d7e-kserve-777d95755-4929s\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") " pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:20.265145 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.264926    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-tmp-dir\") pod \"auth-test-model-276d7e-kserve-777d95755-4929s\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") " pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:20.265145 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.265001    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-home\") pod \"auth-test-model-276d7e-kserve-777d95755-4929s\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") " pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:20.265145 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.265055    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4lw2\" (UniqueName: \"kubernetes.io/projected/17314490-d056-4bae-ad2d-f7310163852a-kube-api-access-q4lw2\") pod \"auth-test-model-276d7e-kserve-777d95755-4929s\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") " pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:20.265145 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.265133    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-dshm\") pod \"auth-test-model-276d7e-kserve-777d95755-4929s\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") " pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:20.265330 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.265167    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-model-cache\") pod \"auth-test-model-276d7e-kserve-777d95755-4929s\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") " pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:20.365894 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.365854    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4lw2\" (UniqueName: \"kubernetes.io/projected/17314490-d056-4bae-ad2d-f7310163852a-kube-api-access-q4lw2\") pod \"auth-test-model-276d7e-kserve-777d95755-4929s\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") " pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:20.366055 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.365916    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-dshm\") pod \"auth-test-model-276d7e-kserve-777d95755-4929s\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") " pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:20.366055 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.365950    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-model-cache\") pod \"auth-test-model-276d7e-kserve-777d95755-4929s\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") " pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:20.366055 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.365994    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17314490-d056-4bae-ad2d-f7310163852a-tls-certs\") pod \"auth-test-model-276d7e-kserve-777d95755-4929s\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") " pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:20.366055 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.366028    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-tmp-dir\") pod \"auth-test-model-276d7e-kserve-777d95755-4929s\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") " pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:20.366261 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.366078    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-home\") pod \"auth-test-model-276d7e-kserve-777d95755-4929s\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") " pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:20.366409 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.366385    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-model-cache\") pod \"auth-test-model-276d7e-kserve-777d95755-4929s\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") " pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:20.366409 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.366401    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-home\") pod \"auth-test-model-276d7e-kserve-777d95755-4929s\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") " pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:20.366550 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.366474    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-tmp-dir\") pod \"auth-test-model-276d7e-kserve-777d95755-4929s\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") " pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:20.368208 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.368182    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-dshm\") pod \"auth-test-model-276d7e-kserve-777d95755-4929s\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") " pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:20.368449 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.368432    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17314490-d056-4bae-ad2d-f7310163852a-tls-certs\") pod \"auth-test-model-276d7e-kserve-777d95755-4929s\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") " pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:20.374145 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.374121    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4lw2\" (UniqueName: \"kubernetes.io/projected/17314490-d056-4bae-ad2d-f7310163852a-kube-api-access-q4lw2\") pod \"auth-test-model-276d7e-kserve-777d95755-4929s\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") " pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:20.445275 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.445171    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:20.573360 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:20.573323    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"]
Jul 18 12:02:20.574758 ip-10-0-130-110 kubenswrapper[2554]: W0718 12:02:20.574726    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17314490_d056_4bae_ad2d_f7310163852a.slice/crio-39c676f410b0ff503938e82cb132321e5b740cbc6b920963ab82cde22577f319 WatchSource:0}: Error finding container 39c676f410b0ff503938e82cb132321e5b740cbc6b920963ab82cde22577f319: Status 404 returned error can't find the container with id 39c676f410b0ff503938e82cb132321e5b740cbc6b920963ab82cde22577f319
Jul 18 12:02:21.042494 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:21.042454    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s" event={"ID":"17314490-d056-4bae-ad2d-f7310163852a","Type":"ContainerStarted","Data":"9f1391a6d6034b348ba59b3cf2affc457cd67876a7e10b574734ad577debef36"}
Jul 18 12:02:21.042494 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:21.042497    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s" event={"ID":"17314490-d056-4bae-ad2d-f7310163852a","Type":"ContainerStarted","Data":"39c676f410b0ff503938e82cb132321e5b740cbc6b920963ab82cde22577f319"}
Jul 18 12:02:21.058460 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:21.058409    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s" podStartSLOduration=1.058370718 podStartE2EDuration="1.058370718s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 12:02:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 12:02:21.057240872 +0000 UTC m=+2542.659370611" watchObservedRunningTime="2026-07-18 12:02:21.058370718 +0000 UTC m=+2542.660500455"
Jul 18 12:02:30.445951 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:30.445899    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:30.445951 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:30.445959    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:30.458085 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:30.458063    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:02:31.098253 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:02:31.098226    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:04:15.605317 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:15.605285    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"]
Jul 18 12:04:16.440117 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:16.440055    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"]
Jul 18 12:04:30.624883 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:30.624826    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg" podUID="be45ac82-b82c-4ca2-b872-0dbee4a73374" containerName="main" containerID="cri-o://182032d8e3b8fa35f37200c6724a2debb191df46234561d67814f95d96842ee5" gracePeriod=45
Jul 18 12:04:30.876337 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:30.876278    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:04:30.932657 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:30.932626    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-tmp-dir\") pod \"be45ac82-b82c-4ca2-b872-0dbee4a73374\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") "
Jul 18 12:04:30.932798 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:30.932679    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-model-cache\") pod \"be45ac82-b82c-4ca2-b872-0dbee4a73374\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") "
Jul 18 12:04:30.932798 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:30.932701    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be45ac82-b82c-4ca2-b872-0dbee4a73374-tls-certs\") pod \"be45ac82-b82c-4ca2-b872-0dbee4a73374\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") "
Jul 18 12:04:30.932798 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:30.932727    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-home\") pod \"be45ac82-b82c-4ca2-b872-0dbee4a73374\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") "
Jul 18 12:04:30.932968 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:30.932878    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "be45ac82-b82c-4ca2-b872-0dbee4a73374" (UID: "be45ac82-b82c-4ca2-b872-0dbee4a73374"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:04:30.932968 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:30.932907    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-dshm\") pod \"be45ac82-b82c-4ca2-b872-0dbee4a73374\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") "
Jul 18 12:04:30.932968 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:30.932946    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd5ff\" (UniqueName: \"kubernetes.io/projected/be45ac82-b82c-4ca2-b872-0dbee4a73374-kube-api-access-gd5ff\") pod \"be45ac82-b82c-4ca2-b872-0dbee4a73374\" (UID: \"be45ac82-b82c-4ca2-b872-0dbee4a73374\") "
Jul 18 12:04:30.933160 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:30.933014    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-home" (OuterVolumeSpecName: "home") pod "be45ac82-b82c-4ca2-b872-0dbee4a73374" (UID: "be45ac82-b82c-4ca2-b872-0dbee4a73374"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:04:30.933160 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:30.933027    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-model-cache" (OuterVolumeSpecName: "model-cache") pod "be45ac82-b82c-4ca2-b872-0dbee4a73374" (UID: "be45ac82-b82c-4ca2-b872-0dbee4a73374"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:04:30.933275 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:30.933254    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-tmp-dir\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:04:30.933344 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:30.933277    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-model-cache\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:04:30.933344 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:30.933287    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-home\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:04:30.935020 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:30.934989    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-dshm" (OuterVolumeSpecName: "dshm") pod "be45ac82-b82c-4ca2-b872-0dbee4a73374" (UID: "be45ac82-b82c-4ca2-b872-0dbee4a73374"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:04:30.935020 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:30.934996    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/be45ac82-b82c-4ca2-b872-0dbee4a73374-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "be45ac82-b82c-4ca2-b872-0dbee4a73374" (UID: "be45ac82-b82c-4ca2-b872-0dbee4a73374"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 12:04:30.935183 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:30.935030    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be45ac82-b82c-4ca2-b872-0dbee4a73374-kube-api-access-gd5ff" (OuterVolumeSpecName: "kube-api-access-gd5ff") pod "be45ac82-b82c-4ca2-b872-0dbee4a73374" (UID: "be45ac82-b82c-4ca2-b872-0dbee4a73374"). InnerVolumeSpecName "kube-api-access-gd5ff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 12:04:31.033705 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.033679    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/be45ac82-b82c-4ca2-b872-0dbee4a73374-tls-certs\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:04:31.033705 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.033705    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/be45ac82-b82c-4ca2-b872-0dbee4a73374-dshm\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:04:31.033848 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.033719    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd5ff\" (UniqueName: \"kubernetes.io/projected/be45ac82-b82c-4ca2-b872-0dbee4a73374-kube-api-access-gd5ff\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:04:31.459935 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.459884    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s" podUID="17314490-d056-4bae-ad2d-f7310163852a" containerName="main" containerID="cri-o://9f1391a6d6034b348ba59b3cf2affc457cd67876a7e10b574734ad577debef36" gracePeriod=45
Jul 18 12:04:31.649473 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.649439    2554 generic.go:356] "Generic (PLEG): container finished" podID="17314490-d056-4bae-ad2d-f7310163852a" containerID="9f1391a6d6034b348ba59b3cf2affc457cd67876a7e10b574734ad577debef36" exitCode=0
Jul 18 12:04:31.649863 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.649512    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s" event={"ID":"17314490-d056-4bae-ad2d-f7310163852a","Type":"ContainerDied","Data":"9f1391a6d6034b348ba59b3cf2affc457cd67876a7e10b574734ad577debef36"}
Jul 18 12:04:31.650905 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.650883    2554 generic.go:356] "Generic (PLEG): container finished" podID="be45ac82-b82c-4ca2-b872-0dbee4a73374" containerID="182032d8e3b8fa35f37200c6724a2debb191df46234561d67814f95d96842ee5" exitCode=0
Jul 18 12:04:31.651027 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.650940    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"
Jul 18 12:04:31.651027 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.650951    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg" event={"ID":"be45ac82-b82c-4ca2-b872-0dbee4a73374","Type":"ContainerDied","Data":"182032d8e3b8fa35f37200c6724a2debb191df46234561d67814f95d96842ee5"}
Jul 18 12:04:31.651027 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.650986    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg" event={"ID":"be45ac82-b82c-4ca2-b872-0dbee4a73374","Type":"ContainerDied","Data":"352f376d39d757d2f5e19fb18bc02f2cbfe0958fc13487ff9f187db7dd0a653c"}
Jul 18 12:04:31.651027 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.651009    2554 scope.go:117] "RemoveContainer" containerID="182032d8e3b8fa35f37200c6724a2debb191df46234561d67814f95d96842ee5"
Jul 18 12:04:31.661409 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.661386    2554 scope.go:117] "RemoveContainer" containerID="182032d8e3b8fa35f37200c6724a2debb191df46234561d67814f95d96842ee5"
Jul 18 12:04:31.661704 ip-10-0-130-110 kubenswrapper[2554]: E0718 12:04:31.661681    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"182032d8e3b8fa35f37200c6724a2debb191df46234561d67814f95d96842ee5\": container with ID starting with 182032d8e3b8fa35f37200c6724a2debb191df46234561d67814f95d96842ee5 not found: ID does not exist" containerID="182032d8e3b8fa35f37200c6724a2debb191df46234561d67814f95d96842ee5"
Jul 18 12:04:31.661796 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.661712    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"182032d8e3b8fa35f37200c6724a2debb191df46234561d67814f95d96842ee5"} err="failed to get container status \"182032d8e3b8fa35f37200c6724a2debb191df46234561d67814f95d96842ee5\": rpc error: code = NotFound desc = could not find container \"182032d8e3b8fa35f37200c6724a2debb191df46234561d67814f95d96842ee5\": container with ID starting with 182032d8e3b8fa35f37200c6724a2debb191df46234561d67814f95d96842ee5 not found: ID does not exist"
Jul 18 12:04:31.666698 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.666676    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"]
Jul 18 12:04:31.670627 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.670603    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-399bd8/auth-test-model-399bd8-kserve-658d958c-8gfzg"]
Jul 18 12:04:31.710765 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.710711    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:04:31.840237 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.840206    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-model-cache\") pod \"17314490-d056-4bae-ad2d-f7310163852a\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") "
Jul 18 12:04:31.840397 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.840245    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4lw2\" (UniqueName: \"kubernetes.io/projected/17314490-d056-4bae-ad2d-f7310163852a-kube-api-access-q4lw2\") pod \"17314490-d056-4bae-ad2d-f7310163852a\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") "
Jul 18 12:04:31.840397 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.840266    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-home\") pod \"17314490-d056-4bae-ad2d-f7310163852a\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") "
Jul 18 12:04:31.840397 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.840332    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-tmp-dir\") pod \"17314490-d056-4bae-ad2d-f7310163852a\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") "
Jul 18 12:04:31.840397 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.840358    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17314490-d056-4bae-ad2d-f7310163852a-tls-certs\") pod \"17314490-d056-4bae-ad2d-f7310163852a\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") "
Jul 18 12:04:31.840397 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.840378    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-dshm\") pod \"17314490-d056-4bae-ad2d-f7310163852a\" (UID: \"17314490-d056-4bae-ad2d-f7310163852a\") "
Jul 18 12:04:31.840634 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.840481    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-model-cache" (OuterVolumeSpecName: "model-cache") pod "17314490-d056-4bae-ad2d-f7310163852a" (UID: "17314490-d056-4bae-ad2d-f7310163852a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:04:31.840634 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.840556    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-home" (OuterVolumeSpecName: "home") pod "17314490-d056-4bae-ad2d-f7310163852a" (UID: "17314490-d056-4bae-ad2d-f7310163852a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:04:31.840634 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.840575    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "17314490-d056-4bae-ad2d-f7310163852a" (UID: "17314490-d056-4bae-ad2d-f7310163852a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:04:31.840781 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.840672    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-tmp-dir\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:04:31.840781 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.840690    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-model-cache\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:04:31.840781 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.840703    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-home\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:04:31.842539 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.842501    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17314490-d056-4bae-ad2d-f7310163852a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "17314490-d056-4bae-ad2d-f7310163852a" (UID: "17314490-d056-4bae-ad2d-f7310163852a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 12:04:31.842650 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.842560    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-dshm" (OuterVolumeSpecName: "dshm") pod "17314490-d056-4bae-ad2d-f7310163852a" (UID: "17314490-d056-4bae-ad2d-f7310163852a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:04:31.842650 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.842573    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17314490-d056-4bae-ad2d-f7310163852a-kube-api-access-q4lw2" (OuterVolumeSpecName: "kube-api-access-q4lw2") pod "17314490-d056-4bae-ad2d-f7310163852a" (UID: "17314490-d056-4bae-ad2d-f7310163852a"). InnerVolumeSpecName "kube-api-access-q4lw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 12:04:31.942152 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.942124    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/17314490-d056-4bae-ad2d-f7310163852a-tls-certs\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:04:31.942152 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.942149    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/17314490-d056-4bae-ad2d-f7310163852a-dshm\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:04:31.942337 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:31.942158    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4lw2\" (UniqueName: \"kubernetes.io/projected/17314490-d056-4bae-ad2d-f7310163852a-kube-api-access-q4lw2\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:04:32.133930 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.133893    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"]
Jul 18 12:04:32.134241 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.134228    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17314490-d056-4bae-ad2d-f7310163852a" containerName="main"
Jul 18 12:04:32.134288 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.134242    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="17314490-d056-4bae-ad2d-f7310163852a" containerName="main"
Jul 18 12:04:32.134288 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.134257    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be45ac82-b82c-4ca2-b872-0dbee4a73374" containerName="main"
Jul 18 12:04:32.134288 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.134263    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="be45ac82-b82c-4ca2-b872-0dbee4a73374" containerName="main"
Jul 18 12:04:32.134382 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.134339    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="be45ac82-b82c-4ca2-b872-0dbee4a73374" containerName="main"
Jul 18 12:04:32.134382 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.134349    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="17314490-d056-4bae-ad2d-f7310163852a" containerName="main"
Jul 18 12:04:32.137266 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.137250    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:32.139512 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.139481    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-399bd8\"/\"openshift-service-ca.crt\""
Jul 18 12:04:32.139635 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.139494    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-399bd8\"/\"kube-root-ca.crt\""
Jul 18 12:04:32.141259 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.140646    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-399bd8\"/\"default-dockercfg-zr6sl\""
Jul 18 12:04:32.141259 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.140707    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-399bd8\"/\"sub-test-model-399bd8-kserve-self-signed-certs\""
Jul 18 12:04:32.150938 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.150602    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"]
Jul 18 12:04:32.247073 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.247029    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-tmp-dir\") pod \"sub-test-model-399bd8-kserve-6485c596bf-rh5c9\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") " pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:32.247073 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.247071    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9sqj\" (UniqueName: \"kubernetes.io/projected/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-kube-api-access-g9sqj\") pod \"sub-test-model-399bd8-kserve-6485c596bf-rh5c9\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") " pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:32.247300 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.247126    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-tls-certs\") pod \"sub-test-model-399bd8-kserve-6485c596bf-rh5c9\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") " pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:32.247300 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.247186    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-home\") pod \"sub-test-model-399bd8-kserve-6485c596bf-rh5c9\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") " pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:32.247300 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.247231    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-model-cache\") pod \"sub-test-model-399bd8-kserve-6485c596bf-rh5c9\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") " pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:32.247300 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.247264    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-dshm\") pod \"sub-test-model-399bd8-kserve-6485c596bf-rh5c9\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") " pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:32.348226 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.348188    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-model-cache\") pod \"sub-test-model-399bd8-kserve-6485c596bf-rh5c9\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") " pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:32.348441 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.348250    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-dshm\") pod \"sub-test-model-399bd8-kserve-6485c596bf-rh5c9\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") " pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:32.348441 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.348304    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-tmp-dir\") pod \"sub-test-model-399bd8-kserve-6485c596bf-rh5c9\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") " pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:32.348441 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.348327    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9sqj\" (UniqueName: \"kubernetes.io/projected/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-kube-api-access-g9sqj\") pod \"sub-test-model-399bd8-kserve-6485c596bf-rh5c9\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") " pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:32.348441 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.348358    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-tls-certs\") pod \"sub-test-model-399bd8-kserve-6485c596bf-rh5c9\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") " pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:32.348441 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.348406    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-home\") pod \"sub-test-model-399bd8-kserve-6485c596bf-rh5c9\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") " pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:32.348705 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.348664    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-model-cache\") pod \"sub-test-model-399bd8-kserve-6485c596bf-rh5c9\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") " pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:32.348770 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.348704    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-tmp-dir\") pod \"sub-test-model-399bd8-kserve-6485c596bf-rh5c9\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") " pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:32.348862 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.348843    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-home\") pod \"sub-test-model-399bd8-kserve-6485c596bf-rh5c9\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") " pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:32.350606 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.350587    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-dshm\") pod \"sub-test-model-399bd8-kserve-6485c596bf-rh5c9\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") " pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:32.350757 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.350740    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-tls-certs\") pod \"sub-test-model-399bd8-kserve-6485c596bf-rh5c9\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") " pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:32.356340 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.356318    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9sqj\" (UniqueName: \"kubernetes.io/projected/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-kube-api-access-g9sqj\") pod \"sub-test-model-399bd8-kserve-6485c596bf-rh5c9\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") " pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:32.453958 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.453865    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:32.591138 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.591055    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"]
Jul 18 12:04:32.593281 ip-10-0-130-110 kubenswrapper[2554]: W0718 12:04:32.593245    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9c6d00e_e26a_4a3a_8961_e5f3fa33e5f2.slice/crio-4154eab48107d68870929c4cbf67bdef0f1f82d6939a15d8f553aa46a34d4313 WatchSource:0}: Error finding container 4154eab48107d68870929c4cbf67bdef0f1f82d6939a15d8f553aa46a34d4313: Status 404 returned error can't find the container with id 4154eab48107d68870929c4cbf67bdef0f1f82d6939a15d8f553aa46a34d4313
Jul 18 12:04:32.656999 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.656969    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s" event={"ID":"17314490-d056-4bae-ad2d-f7310163852a","Type":"ContainerDied","Data":"39c676f410b0ff503938e82cb132321e5b740cbc6b920963ab82cde22577f319"}
Jul 18 12:04:32.657397 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.657017    2554 scope.go:117] "RemoveContainer" containerID="9f1391a6d6034b348ba59b3cf2affc457cd67876a7e10b574734ad577debef36"
Jul 18 12:04:32.657397 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.656978    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"
Jul 18 12:04:32.659194 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.659160    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9" event={"ID":"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2","Type":"ContainerStarted","Data":"4154eab48107d68870929c4cbf67bdef0f1f82d6939a15d8f553aa46a34d4313"}
Jul 18 12:04:32.679620 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.679596    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"]
Jul 18 12:04:32.683688 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.683666    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-276d7e/auth-test-model-276d7e-kserve-777d95755-4929s"]
Jul 18 12:04:32.949669 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.949636    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17314490-d056-4bae-ad2d-f7310163852a" path="/var/lib/kubelet/pods/17314490-d056-4bae-ad2d-f7310163852a/volumes"
Jul 18 12:04:32.950051 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:32.950037    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be45ac82-b82c-4ca2-b872-0dbee4a73374" path="/var/lib/kubelet/pods/be45ac82-b82c-4ca2-b872-0dbee4a73374/volumes"
Jul 18 12:04:33.665558 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:33.665525    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9" event={"ID":"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2","Type":"ContainerStarted","Data":"db6f60d0d8b5e3e1341793c7404070de90b44d39f400dfce8d39abbcdeeb6b83"}
Jul 18 12:04:33.681410 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:33.681365    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9" podStartSLOduration=1.681350511 podStartE2EDuration="1.681350511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 12:04:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 12:04:33.680615699 +0000 UTC m=+2675.282745440" watchObservedRunningTime="2026-07-18 12:04:33.681350511 +0000 UTC m=+2675.283480250"
Jul 18 12:04:42.454608 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:42.454571    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:42.454608 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:42.454616    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:42.466648 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:42.466625    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:42.718430 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:42.718347    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:04:59.060758 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:59.060665    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5kkzl_2e953581-6e11-46ad-92e3-0d63df589850/ovn-acl-logging/0.log"
Jul 18 12:04:59.068373 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:04:59.068348    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5kkzl_2e953581-6e11-46ad-92e3-0d63df589850/ovn-acl-logging/0.log"
Jul 18 12:05:50.903910 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:05:50.903871    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"]
Jul 18 12:06:03.624389 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.624351    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"]
Jul 18 12:06:03.627450 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.627429    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:03.630015 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.629993    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-399bd8\"/\"rate-test-model-399bd8-kserve-self-signed-certs\""
Jul 18 12:06:03.637587 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.637531    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"]
Jul 18 12:06:03.769251 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.769214    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-tmp-dir\") pod \"rate-test-model-399bd8-kserve-986fff547-dwnlc\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") " pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:03.769430 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.769262    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd5q2\" (UniqueName: \"kubernetes.io/projected/7b7e2fba-42fc-4d3c-b43c-7011afd46609-kube-api-access-sd5q2\") pod \"rate-test-model-399bd8-kserve-986fff547-dwnlc\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") " pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:03.769475 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.769433    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-home\") pod \"rate-test-model-399bd8-kserve-986fff547-dwnlc\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") " pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:03.769520 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.769500    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b7e2fba-42fc-4d3c-b43c-7011afd46609-tls-certs\") pod \"rate-test-model-399bd8-kserve-986fff547-dwnlc\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") " pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:03.769556 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.769548    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-model-cache\") pod \"rate-test-model-399bd8-kserve-986fff547-dwnlc\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") " pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:03.769608 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.769594    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-dshm\") pod \"rate-test-model-399bd8-kserve-986fff547-dwnlc\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") " pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:03.870727 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.870676    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-tmp-dir\") pod \"rate-test-model-399bd8-kserve-986fff547-dwnlc\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") " pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:03.870921 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.870742    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd5q2\" (UniqueName: \"kubernetes.io/projected/7b7e2fba-42fc-4d3c-b43c-7011afd46609-kube-api-access-sd5q2\") pod \"rate-test-model-399bd8-kserve-986fff547-dwnlc\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") " pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:03.870921 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.870816    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-home\") pod \"rate-test-model-399bd8-kserve-986fff547-dwnlc\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") " pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:03.870921 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.870864    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b7e2fba-42fc-4d3c-b43c-7011afd46609-tls-certs\") pod \"rate-test-model-399bd8-kserve-986fff547-dwnlc\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") " pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:03.870921 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.870903    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-model-cache\") pod \"rate-test-model-399bd8-kserve-986fff547-dwnlc\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") " pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:03.871176 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.870934    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-dshm\") pod \"rate-test-model-399bd8-kserve-986fff547-dwnlc\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") " pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:03.871215 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.871186    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-tmp-dir\") pod \"rate-test-model-399bd8-kserve-986fff547-dwnlc\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") " pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:03.871286 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.871265    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-home\") pod \"rate-test-model-399bd8-kserve-986fff547-dwnlc\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") " pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:03.871350 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.871330    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-model-cache\") pod \"rate-test-model-399bd8-kserve-986fff547-dwnlc\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") " pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:03.873230 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.873200    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-dshm\") pod \"rate-test-model-399bd8-kserve-986fff547-dwnlc\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") " pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:03.873608 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.873587    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b7e2fba-42fc-4d3c-b43c-7011afd46609-tls-certs\") pod \"rate-test-model-399bd8-kserve-986fff547-dwnlc\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") " pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:03.879065 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.879004    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd5q2\" (UniqueName: \"kubernetes.io/projected/7b7e2fba-42fc-4d3c-b43c-7011afd46609-kube-api-access-sd5q2\") pod \"rate-test-model-399bd8-kserve-986fff547-dwnlc\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") " pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:03.938786 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:03.938736    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:04.081867 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:04.081836    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"]
Jul 18 12:06:04.085117 ip-10-0-130-110 kubenswrapper[2554]: W0718 12:06:04.085071    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b7e2fba_42fc_4d3c_b43c_7011afd46609.slice/crio-3965122263c384b2ee6b091155eb1b602a6b55e3d61f277243d7b27697af17cb WatchSource:0}: Error finding container 3965122263c384b2ee6b091155eb1b602a6b55e3d61f277243d7b27697af17cb: Status 404 returned error can't find the container with id 3965122263c384b2ee6b091155eb1b602a6b55e3d61f277243d7b27697af17cb
Jul 18 12:06:05.085687 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:05.085648    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc" event={"ID":"7b7e2fba-42fc-4d3c-b43c-7011afd46609","Type":"ContainerStarted","Data":"4bc3d698a5b8bd570d7fa4c9b3710886872dad49df40d552d090ff746d3fd531"}
Jul 18 12:06:05.086133 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:05.085701    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc" event={"ID":"7b7e2fba-42fc-4d3c-b43c-7011afd46609","Type":"ContainerStarted","Data":"3965122263c384b2ee6b091155eb1b602a6b55e3d61f277243d7b27697af17cb"}
Jul 18 12:06:05.102928 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:05.102874    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc" podStartSLOduration=2.102857501 podStartE2EDuration="2.102857501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 12:06:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 12:06:05.101937963 +0000 UTC m=+2766.704067702" watchObservedRunningTime="2026-07-18 12:06:05.102857501 +0000 UTC m=+2766.704987239"
Jul 18 12:06:05.925121 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:05.925062    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9" podUID="b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2" containerName="main" containerID="cri-o://db6f60d0d8b5e3e1341793c7404070de90b44d39f400dfce8d39abbcdeeb6b83" gracePeriod=45
Jul 18 12:06:06.092606 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:06.092569    2554 generic.go:356] "Generic (PLEG): container finished" podID="b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2" containerID="db6f60d0d8b5e3e1341793c7404070de90b44d39f400dfce8d39abbcdeeb6b83" exitCode=0
Jul 18 12:06:06.092967 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:06.092643    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9" event={"ID":"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2","Type":"ContainerDied","Data":"db6f60d0d8b5e3e1341793c7404070de90b44d39f400dfce8d39abbcdeeb6b83"}
Jul 18 12:06:06.182734 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:06.182669    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:06:06.295034 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:06.294996    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-tmp-dir\") pod \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") "
Jul 18 12:06:06.295233 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:06.295081    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9sqj\" (UniqueName: \"kubernetes.io/projected/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-kube-api-access-g9sqj\") pod \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") "
Jul 18 12:06:06.295233 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:06.295141    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-tls-certs\") pod \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") "
Jul 18 12:06:06.295233 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:06.295219    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-home\") pod \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") "
Jul 18 12:06:06.295361 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:06.295308    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-dshm\") pod \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") "
Jul 18 12:06:06.295361 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:06.295338    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2" (UID: "b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:06:06.295478 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:06.295398    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-model-cache\") pod \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\" (UID: \"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2\") "
Jul 18 12:06:06.295478 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:06.295427    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-home" (OuterVolumeSpecName: "home") pod "b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2" (UID: "b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:06:06.295607 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:06.295575    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-model-cache" (OuterVolumeSpecName: "model-cache") pod "b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2" (UID: "b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:06:06.295748 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:06.295731    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-home\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:06:06.295804 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:06.295755    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-model-cache\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:06:06.295804 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:06.295772    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-tmp-dir\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:06:06.297310 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:06.297287    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-dshm" (OuterVolumeSpecName: "dshm") pod "b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2" (UID: "b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:06:06.297384 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:06.297345    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-kube-api-access-g9sqj" (OuterVolumeSpecName: "kube-api-access-g9sqj") pod "b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2" (UID: "b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2"). InnerVolumeSpecName "kube-api-access-g9sqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 12:06:06.297420 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:06.297389    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2" (UID: "b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 12:06:06.396615 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:06.396571    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g9sqj\" (UniqueName: \"kubernetes.io/projected/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-kube-api-access-g9sqj\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:06:06.396615 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:06.396607    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-tls-certs\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:06:06.396615 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:06.396619    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2-dshm\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:06:07.099404 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:07.099376    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"
Jul 18 12:06:07.099404 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:07.099385    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9" event={"ID":"b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2","Type":"ContainerDied","Data":"4154eab48107d68870929c4cbf67bdef0f1f82d6939a15d8f553aa46a34d4313"}
Jul 18 12:06:07.099884 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:07.099438    2554 scope.go:117] "RemoveContainer" containerID="db6f60d0d8b5e3e1341793c7404070de90b44d39f400dfce8d39abbcdeeb6b83"
Jul 18 12:06:07.117316 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:07.117285    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"]
Jul 18 12:06:07.121421 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:07.121395    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-399bd8/sub-test-model-399bd8-kserve-6485c596bf-rh5c9"]
Jul 18 12:06:08.949337 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:08.949304    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2" path="/var/lib/kubelet/pods/b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2/volumes"
Jul 18 12:06:13.939708 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:13.939654    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:13.939708 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:13.939721    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:13.952326 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:13.952303    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:14.145987 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:14.145958    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:06:31.934169 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:31.934131    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"]
Jul 18 12:06:31.934722 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:31.934701    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2" containerName="main"
Jul 18 12:06:31.934769 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:31.934728    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2" containerName="main"
Jul 18 12:06:31.934848 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:31.934837    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9c6d00e-e26a-4a3a-8961-e5f3fa33e5f2" containerName="main"
Jul 18 12:06:31.943681 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:31.943651    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:31.944594 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:31.944565    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"]
Jul 18 12:06:31.946768 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:31.946744    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-276d7e\"/\"rate-test-model-276d7e-kserve-self-signed-certs\""
Jul 18 12:06:31.946883 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:31.946766    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-276d7e\"/\"kube-root-ca.crt\""
Jul 18 12:06:31.946883 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:31.946787    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-276d7e\"/\"openshift-service-ca.crt\""
Jul 18 12:06:31.946883 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:31.946815    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-276d7e\"/\"default-dockercfg-z2j7j\""
Jul 18 12:06:32.030636 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:32.030598    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-dshm\") pod \"rate-test-model-276d7e-kserve-8b46d8899-ml8rh\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") " pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:32.030636 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:32.030645    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-tmp-dir\") pod \"rate-test-model-276d7e-kserve-8b46d8899-ml8rh\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") " pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:32.030864 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:32.030740    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77cd3b5e-e424-4ce5-aa95-c854c400688c-tls-certs\") pod \"rate-test-model-276d7e-kserve-8b46d8899-ml8rh\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") " pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:32.030864 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:32.030778    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-home\") pod \"rate-test-model-276d7e-kserve-8b46d8899-ml8rh\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") " pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:32.030864 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:32.030813    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv4m4\" (UniqueName: \"kubernetes.io/projected/77cd3b5e-e424-4ce5-aa95-c854c400688c-kube-api-access-mv4m4\") pod \"rate-test-model-276d7e-kserve-8b46d8899-ml8rh\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") " pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:32.030964 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:32.030889    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-model-cache\") pod \"rate-test-model-276d7e-kserve-8b46d8899-ml8rh\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") " pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:32.131925 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:32.131881    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-model-cache\") pod \"rate-test-model-276d7e-kserve-8b46d8899-ml8rh\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") " pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:32.132177 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:32.131935    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-dshm\") pod \"rate-test-model-276d7e-kserve-8b46d8899-ml8rh\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") " pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:32.132177 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:32.131959    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-tmp-dir\") pod \"rate-test-model-276d7e-kserve-8b46d8899-ml8rh\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") " pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:32.132177 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:32.132000    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77cd3b5e-e424-4ce5-aa95-c854c400688c-tls-certs\") pod \"rate-test-model-276d7e-kserve-8b46d8899-ml8rh\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") " pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:32.132177 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:32.132022    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-home\") pod \"rate-test-model-276d7e-kserve-8b46d8899-ml8rh\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") " pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:32.132177 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:32.132046    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv4m4\" (UniqueName: \"kubernetes.io/projected/77cd3b5e-e424-4ce5-aa95-c854c400688c-kube-api-access-mv4m4\") pod \"rate-test-model-276d7e-kserve-8b46d8899-ml8rh\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") " pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:32.132453 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:32.132343    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-model-cache\") pod \"rate-test-model-276d7e-kserve-8b46d8899-ml8rh\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") " pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:32.132518 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:32.132496    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-home\") pod \"rate-test-model-276d7e-kserve-8b46d8899-ml8rh\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") " pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:32.132554 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:32.132518    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-tmp-dir\") pod \"rate-test-model-276d7e-kserve-8b46d8899-ml8rh\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") " pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:32.134353 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:32.134326    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-dshm\") pod \"rate-test-model-276d7e-kserve-8b46d8899-ml8rh\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") " pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:32.134495 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:32.134479    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77cd3b5e-e424-4ce5-aa95-c854c400688c-tls-certs\") pod \"rate-test-model-276d7e-kserve-8b46d8899-ml8rh\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") " pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:32.139437 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:32.139417    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv4m4\" (UniqueName: \"kubernetes.io/projected/77cd3b5e-e424-4ce5-aa95-c854c400688c-kube-api-access-mv4m4\") pod \"rate-test-model-276d7e-kserve-8b46d8899-ml8rh\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") " pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:32.253786 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:32.253747    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:32.390991 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:32.390966    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"]
Jul 18 12:06:32.393395 ip-10-0-130-110 kubenswrapper[2554]: W0718 12:06:32.393369    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77cd3b5e_e424_4ce5_aa95_c854c400688c.slice/crio-3b5bd21e0d97c58f6c82e7332aef57dfba378c0fed7d4ed8f04c9613ba17156b WatchSource:0}: Error finding container 3b5bd21e0d97c58f6c82e7332aef57dfba378c0fed7d4ed8f04c9613ba17156b: Status 404 returned error can't find the container with id 3b5bd21e0d97c58f6c82e7332aef57dfba378c0fed7d4ed8f04c9613ba17156b
Jul 18 12:06:33.222149 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:33.222114    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh" event={"ID":"77cd3b5e-e424-4ce5-aa95-c854c400688c","Type":"ContainerStarted","Data":"a2f94c293f62a6d9d74ab72126ea75cd1c02a0816a12ee414a31e8f50f552d81"}
Jul 18 12:06:33.222149 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:33.222157    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh" event={"ID":"77cd3b5e-e424-4ce5-aa95-c854c400688c","Type":"ContainerStarted","Data":"3b5bd21e0d97c58f6c82e7332aef57dfba378c0fed7d4ed8f04c9613ba17156b"}
Jul 18 12:06:33.238255 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:33.238203    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh" podStartSLOduration=2.238188456 podStartE2EDuration="2.238188456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-18 12:06:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 12:06:33.236959133 +0000 UTC m=+2794.839088870" watchObservedRunningTime="2026-07-18 12:06:33.238188456 +0000 UTC m=+2794.840318194"
Jul 18 12:06:42.254206 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:42.254168    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:42.254679 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:42.254224    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:42.267376 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:42.267345    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:42.278562 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:42.278527    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:06:59.202843 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:59.202808    2554 scope.go:117] "RemoveContainer" containerID="a7296eb814194ed1f05b2da0bc431db3454abd03a1aaac6b4d6233f58c683816"
Jul 18 12:06:59.211014 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:59.210989    2554 scope.go:117] "RemoveContainer" containerID="ec90bad62f5b5232811544d846bbc7745d38b94b72bd4303d35b172ece44b4ba"
Jul 18 12:06:59.218275 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:06:59.218253    2554 scope.go:117] "RemoveContainer" containerID="cbce142f63efb5d88a9b6dfd362969648df76bc9a09fa90fc75a195bf06c83d0"
Jul 18 12:07:18.162691 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:18.162658    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"]
Jul 18 12:07:19.117163 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:19.117131    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"]
Jul 18 12:07:33.184717 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.184657    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc" podUID="7b7e2fba-42fc-4d3c-b43c-7011afd46609" containerName="main" containerID="cri-o://4bc3d698a5b8bd570d7fa4c9b3710886872dad49df40d552d090ff746d3fd531" gracePeriod=45
Jul 18 12:07:33.448446 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.448383    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:07:33.499465 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.499431    2554 generic.go:356] "Generic (PLEG): container finished" podID="7b7e2fba-42fc-4d3c-b43c-7011afd46609" containerID="4bc3d698a5b8bd570d7fa4c9b3710886872dad49df40d552d090ff746d3fd531" exitCode=0
Jul 18 12:07:33.499658 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.499471    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"
Jul 18 12:07:33.499658 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.499518    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc" event={"ID":"7b7e2fba-42fc-4d3c-b43c-7011afd46609","Type":"ContainerDied","Data":"4bc3d698a5b8bd570d7fa4c9b3710886872dad49df40d552d090ff746d3fd531"}
Jul 18 12:07:33.499658 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.499566    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc" event={"ID":"7b7e2fba-42fc-4d3c-b43c-7011afd46609","Type":"ContainerDied","Data":"3965122263c384b2ee6b091155eb1b602a6b55e3d61f277243d7b27697af17cb"}
Jul 18 12:07:33.499658 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.499590    2554 scope.go:117] "RemoveContainer" containerID="4bc3d698a5b8bd570d7fa4c9b3710886872dad49df40d552d090ff746d3fd531"
Jul 18 12:07:33.507935 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.507915    2554 scope.go:117] "RemoveContainer" containerID="4bc3d698a5b8bd570d7fa4c9b3710886872dad49df40d552d090ff746d3fd531"
Jul 18 12:07:33.508212 ip-10-0-130-110 kubenswrapper[2554]: E0718 12:07:33.508194    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bc3d698a5b8bd570d7fa4c9b3710886872dad49df40d552d090ff746d3fd531\": container with ID starting with 4bc3d698a5b8bd570d7fa4c9b3710886872dad49df40d552d090ff746d3fd531 not found: ID does not exist" containerID="4bc3d698a5b8bd570d7fa4c9b3710886872dad49df40d552d090ff746d3fd531"
Jul 18 12:07:33.508289 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.508220    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bc3d698a5b8bd570d7fa4c9b3710886872dad49df40d552d090ff746d3fd531"} err="failed to get container status \"4bc3d698a5b8bd570d7fa4c9b3710886872dad49df40d552d090ff746d3fd531\": rpc error: code = NotFound desc = could not find container \"4bc3d698a5b8bd570d7fa4c9b3710886872dad49df40d552d090ff746d3fd531\": container with ID starting with 4bc3d698a5b8bd570d7fa4c9b3710886872dad49df40d552d090ff746d3fd531 not found: ID does not exist"
Jul 18 12:07:33.618158 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.618123    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-home\") pod \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") "
Jul 18 12:07:33.618354 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.618172    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-tmp-dir\") pod \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") "
Jul 18 12:07:33.618354 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.618208    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-model-cache\") pod \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") "
Jul 18 12:07:33.618354 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.618235    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-dshm\") pod \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") "
Jul 18 12:07:33.618354 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.618305    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b7e2fba-42fc-4d3c-b43c-7011afd46609-tls-certs\") pod \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") "
Jul 18 12:07:33.618526 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.618370    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sd5q2\" (UniqueName: \"kubernetes.io/projected/7b7e2fba-42fc-4d3c-b43c-7011afd46609-kube-api-access-sd5q2\") pod \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\" (UID: \"7b7e2fba-42fc-4d3c-b43c-7011afd46609\") "
Jul 18 12:07:33.618526 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.618484    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-home" (OuterVolumeSpecName: "home") pod "7b7e2fba-42fc-4d3c-b43c-7011afd46609" (UID: "7b7e2fba-42fc-4d3c-b43c-7011afd46609"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:07:33.618607 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.618545    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-model-cache" (OuterVolumeSpecName: "model-cache") pod "7b7e2fba-42fc-4d3c-b43c-7011afd46609" (UID: "7b7e2fba-42fc-4d3c-b43c-7011afd46609"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:07:33.618607 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.618558    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7b7e2fba-42fc-4d3c-b43c-7011afd46609" (UID: "7b7e2fba-42fc-4d3c-b43c-7011afd46609"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:07:33.618801 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.618775    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-home\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:07:33.618864 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.618799    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-tmp-dir\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:07:33.618864 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.618815    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-model-cache\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:07:33.620441 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.620409    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-dshm" (OuterVolumeSpecName: "dshm") pod "7b7e2fba-42fc-4d3c-b43c-7011afd46609" (UID: "7b7e2fba-42fc-4d3c-b43c-7011afd46609"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:07:33.620571 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.620549    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b7e2fba-42fc-4d3c-b43c-7011afd46609-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7b7e2fba-42fc-4d3c-b43c-7011afd46609" (UID: "7b7e2fba-42fc-4d3c-b43c-7011afd46609"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 12:07:33.620571 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.620559    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b7e2fba-42fc-4d3c-b43c-7011afd46609-kube-api-access-sd5q2" (OuterVolumeSpecName: "kube-api-access-sd5q2") pod "7b7e2fba-42fc-4d3c-b43c-7011afd46609" (UID: "7b7e2fba-42fc-4d3c-b43c-7011afd46609"). InnerVolumeSpecName "kube-api-access-sd5q2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 12:07:33.719515 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.719406    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sd5q2\" (UniqueName: \"kubernetes.io/projected/7b7e2fba-42fc-4d3c-b43c-7011afd46609-kube-api-access-sd5q2\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:07:33.719515 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.719454    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7b7e2fba-42fc-4d3c-b43c-7011afd46609-dshm\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:07:33.719515 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.719463    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b7e2fba-42fc-4d3c-b43c-7011afd46609-tls-certs\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:07:33.820905 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.820873    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"]
Jul 18 12:07:33.825298 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:33.825268    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-399bd8/rate-test-model-399bd8-kserve-986fff547-dwnlc"]
Jul 18 12:07:34.137026 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.136921    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh" podUID="77cd3b5e-e424-4ce5-aa95-c854c400688c" containerName="main" containerID="cri-o://a2f94c293f62a6d9d74ab72126ea75cd1c02a0816a12ee414a31e8f50f552d81" gracePeriod=45
Jul 18 12:07:34.385380 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.385352    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:07:34.505329 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.505295    2554 generic.go:356] "Generic (PLEG): container finished" podID="77cd3b5e-e424-4ce5-aa95-c854c400688c" containerID="a2f94c293f62a6d9d74ab72126ea75cd1c02a0816a12ee414a31e8f50f552d81" exitCode=0
Jul 18 12:07:34.505536 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.505338    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"
Jul 18 12:07:34.505536 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.505381    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh" event={"ID":"77cd3b5e-e424-4ce5-aa95-c854c400688c","Type":"ContainerDied","Data":"a2f94c293f62a6d9d74ab72126ea75cd1c02a0816a12ee414a31e8f50f552d81"}
Jul 18 12:07:34.505536 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.505427    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh" event={"ID":"77cd3b5e-e424-4ce5-aa95-c854c400688c","Type":"ContainerDied","Data":"3b5bd21e0d97c58f6c82e7332aef57dfba378c0fed7d4ed8f04c9613ba17156b"}
Jul 18 12:07:34.505536 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.505450    2554 scope.go:117] "RemoveContainer" containerID="a2f94c293f62a6d9d74ab72126ea75cd1c02a0816a12ee414a31e8f50f552d81"
Jul 18 12:07:34.513641 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.513622    2554 scope.go:117] "RemoveContainer" containerID="a2f94c293f62a6d9d74ab72126ea75cd1c02a0816a12ee414a31e8f50f552d81"
Jul 18 12:07:34.513890 ip-10-0-130-110 kubenswrapper[2554]: E0718 12:07:34.513868    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2f94c293f62a6d9d74ab72126ea75cd1c02a0816a12ee414a31e8f50f552d81\": container with ID starting with a2f94c293f62a6d9d74ab72126ea75cd1c02a0816a12ee414a31e8f50f552d81 not found: ID does not exist" containerID="a2f94c293f62a6d9d74ab72126ea75cd1c02a0816a12ee414a31e8f50f552d81"
Jul 18 12:07:34.513940 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.513899    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2f94c293f62a6d9d74ab72126ea75cd1c02a0816a12ee414a31e8f50f552d81"} err="failed to get container status \"a2f94c293f62a6d9d74ab72126ea75cd1c02a0816a12ee414a31e8f50f552d81\": rpc error: code = NotFound desc = could not find container \"a2f94c293f62a6d9d74ab72126ea75cd1c02a0816a12ee414a31e8f50f552d81\": container with ID starting with a2f94c293f62a6d9d74ab72126ea75cd1c02a0816a12ee414a31e8f50f552d81 not found: ID does not exist"
Jul 18 12:07:34.526241 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.526216    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-tmp-dir\") pod \"77cd3b5e-e424-4ce5-aa95-c854c400688c\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") "
Jul 18 12:07:34.526342 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.526259    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-dshm\") pod \"77cd3b5e-e424-4ce5-aa95-c854c400688c\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") "
Jul 18 12:07:34.526399 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.526356    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-home\") pod \"77cd3b5e-e424-4ce5-aa95-c854c400688c\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") "
Jul 18 12:07:34.526453 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.526406    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv4m4\" (UniqueName: \"kubernetes.io/projected/77cd3b5e-e424-4ce5-aa95-c854c400688c-kube-api-access-mv4m4\") pod \"77cd3b5e-e424-4ce5-aa95-c854c400688c\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") "
Jul 18 12:07:34.526518 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.526447    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "77cd3b5e-e424-4ce5-aa95-c854c400688c" (UID: "77cd3b5e-e424-4ce5-aa95-c854c400688c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:07:34.526518 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.526465    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77cd3b5e-e424-4ce5-aa95-c854c400688c-tls-certs\") pod \"77cd3b5e-e424-4ce5-aa95-c854c400688c\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") "
Jul 18 12:07:34.526518 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.526503    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-model-cache\") pod \"77cd3b5e-e424-4ce5-aa95-c854c400688c\" (UID: \"77cd3b5e-e424-4ce5-aa95-c854c400688c\") "
Jul 18 12:07:34.526675 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.526627    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-home" (OuterVolumeSpecName: "home") pod "77cd3b5e-e424-4ce5-aa95-c854c400688c" (UID: "77cd3b5e-e424-4ce5-aa95-c854c400688c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:07:34.526763 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.526742    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-model-cache" (OuterVolumeSpecName: "model-cache") pod "77cd3b5e-e424-4ce5-aa95-c854c400688c" (UID: "77cd3b5e-e424-4ce5-aa95-c854c400688c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:07:34.526882 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.526796    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-home\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:07:34.526882 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.526813    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-tmp-dir\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:07:34.528451 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.528426    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-dshm" (OuterVolumeSpecName: "dshm") pod "77cd3b5e-e424-4ce5-aa95-c854c400688c" (UID: "77cd3b5e-e424-4ce5-aa95-c854c400688c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 18 12:07:34.528543 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.528508    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77cd3b5e-e424-4ce5-aa95-c854c400688c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "77cd3b5e-e424-4ce5-aa95-c854c400688c" (UID: "77cd3b5e-e424-4ce5-aa95-c854c400688c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 18 12:07:34.528543 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.528532    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77cd3b5e-e424-4ce5-aa95-c854c400688c-kube-api-access-mv4m4" (OuterVolumeSpecName: "kube-api-access-mv4m4") pod "77cd3b5e-e424-4ce5-aa95-c854c400688c" (UID: "77cd3b5e-e424-4ce5-aa95-c854c400688c"). InnerVolumeSpecName "kube-api-access-mv4m4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 12:07:34.627940 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.627901    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-dshm\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:07:34.627940 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.627936    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv4m4\" (UniqueName: \"kubernetes.io/projected/77cd3b5e-e424-4ce5-aa95-c854c400688c-kube-api-access-mv4m4\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:07:34.627940 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.627946    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77cd3b5e-e424-4ce5-aa95-c854c400688c-tls-certs\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:07:34.627940 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.627955    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77cd3b5e-e424-4ce5-aa95-c854c400688c-model-cache\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:07:34.828746 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.828713    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"]
Jul 18 12:07:34.833223 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.833196    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-276d7e/rate-test-model-276d7e-kserve-8b46d8899-ml8rh"]
Jul 18 12:07:34.949855 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.949820    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77cd3b5e-e424-4ce5-aa95-c854c400688c" path="/var/lib/kubelet/pods/77cd3b5e-e424-4ce5-aa95-c854c400688c/volumes"
Jul 18 12:07:34.950247 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:34.950233    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b7e2fba-42fc-4d3c-b43c-7011afd46609" path="/var/lib/kubelet/pods/7b7e2fba-42fc-4d3c-b43c-7011afd46609/volumes"
Jul 18 12:07:35.055454 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:35.055417    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7870-140525223081856"]
Jul 18 12:07:35.055754 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:35.055741    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77cd3b5e-e424-4ce5-aa95-c854c400688c" containerName="main"
Jul 18 12:07:35.055796 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:35.055755    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="77cd3b5e-e424-4ce5-aa95-c854c400688c" containerName="main"
Jul 18 12:07:35.055796 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:35.055769    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b7e2fba-42fc-4d3c-b43c-7011afd46609" containerName="main"
Jul 18 12:07:35.055796 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:35.055774    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b7e2fba-42fc-4d3c-b43c-7011afd46609" containerName="main"
Jul 18 12:07:35.055887 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:35.055827    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b7e2fba-42fc-4d3c-b43c-7011afd46609" containerName="main"
Jul 18 12:07:35.055887 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:35.055838    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="77cd3b5e-e424-4ce5-aa95-c854c400688c" containerName="main"
Jul 18 12:07:35.060006 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:35.059991    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223081856"
Jul 18 12:07:35.062307 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:35.062286    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7l9gx\""
Jul 18 12:07:35.065214 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:35.065143    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7870-140525223081856"]
Jul 18 12:07:35.133588 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:35.133553    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86nvt\" (UniqueName: \"kubernetes.io/projected/a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d-kube-api-access-86nvt\") pod \"test-curl-7870-140525223081856\" (UID: \"a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d\") " pod="opendatahub/test-curl-7870-140525223081856"
Jul 18 12:07:35.234227 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:35.234195    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86nvt\" (UniqueName: \"kubernetes.io/projected/a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d-kube-api-access-86nvt\") pod \"test-curl-7870-140525223081856\" (UID: \"a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d\") " pod="opendatahub/test-curl-7870-140525223081856"
Jul 18 12:07:35.242717 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:35.242690    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86nvt\" (UniqueName: \"kubernetes.io/projected/a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d-kube-api-access-86nvt\") pod \"test-curl-7870-140525223081856\" (UID: \"a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d\") " pod="opendatahub/test-curl-7870-140525223081856"
Jul 18 12:07:35.371652 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:35.371542    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223081856"
Jul 18 12:07:35.501796 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:35.501768    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7870-140525223081856"]
Jul 18 12:07:35.504375 ip-10-0-130-110 kubenswrapper[2554]: W0718 12:07:35.504347    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7b4d748_7ee9_4f7f_b8e5_c11fed38f91d.slice/crio-4cac1bf8e3fd9d6efdea6566f70b53b2ecbb94bdb07207dff45de2eb1132ab26 WatchSource:0}: Error finding container 4cac1bf8e3fd9d6efdea6566f70b53b2ecbb94bdb07207dff45de2eb1132ab26: Status 404 returned error can't find the container with id 4cac1bf8e3fd9d6efdea6566f70b53b2ecbb94bdb07207dff45de2eb1132ab26
Jul 18 12:07:35.505628 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:35.505609    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 18 12:07:35.512921 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:35.512896    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7870-140525223081856" event={"ID":"a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d","Type":"ContainerStarted","Data":"4cac1bf8e3fd9d6efdea6566f70b53b2ecbb94bdb07207dff45de2eb1132ab26"}
Jul 18 12:07:36.519433 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:36.519398    2554 generic.go:356] "Generic (PLEG): container finished" podID="a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d" containerID="eea3a9d15a73069531846e2d6669c3f3597ab666ccbddf2f3e87d9154fc48169" exitCode=0
Jul 18 12:07:36.519851 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:36.519491    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7870-140525223081856" event={"ID":"a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d","Type":"ContainerDied","Data":"eea3a9d15a73069531846e2d6669c3f3597ab666ccbddf2f3e87d9154fc48169"}
Jul 18 12:07:37.664472 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:37.664444    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223081856"
Jul 18 12:07:37.700416 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:37.700389    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7870-140525223081856_a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d/test-curl-7870-140525223081856/0.log"
Jul 18 12:07:37.727806 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:37.727764    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7870-140525223081856"]
Jul 18 12:07:37.731488 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:37.731457    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7870-140525223081856"]
Jul 18 12:07:37.854003 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:37.853903    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86nvt\" (UniqueName: \"kubernetes.io/projected/a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d-kube-api-access-86nvt\") pod \"a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d\" (UID: \"a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d\") "
Jul 18 12:07:37.856196 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:37.856172    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d-kube-api-access-86nvt" (OuterVolumeSpecName: "kube-api-access-86nvt") pod "a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d" (UID: "a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d"). InnerVolumeSpecName "kube-api-access-86nvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 18 12:07:37.913969 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:37.913932    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-399bd8-dzlxr"]
Jul 18 12:07:37.914395 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:37.914378    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d" containerName="test-curl-7870-140525223081856"
Jul 18 12:07:37.914514 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:37.914398    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d" containerName="test-curl-7870-140525223081856"
Jul 18 12:07:37.914514 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:37.914481    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d" containerName="test-curl-7870-140525223081856"
Jul 18 12:07:37.917427 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:37.917406    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-399bd8-dzlxr"
Jul 18 12:07:37.919787 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:37.919763    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 12:07:37.919927 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:37.919839    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-99w6p\""
Jul 18 12:07:37.923771 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:37.923747    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-399bd8-dzlxr"]
Jul 18 12:07:37.955529 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:37.955488    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13aaf252-41e1-40e4-a620-b34b701c22c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-399bd8-dzlxr\" (UID: \"13aaf252-41e1-40e4-a620-b34b701c22c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-399bd8-dzlxr"
Jul 18 12:07:37.955703 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:37.955583    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86nvt\" (UniqueName: \"kubernetes.io/projected/a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d-kube-api-access-86nvt\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:07:38.056492 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:38.056453    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13aaf252-41e1-40e4-a620-b34b701c22c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-399bd8-dzlxr\" (UID: \"13aaf252-41e1-40e4-a620-b34b701c22c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-399bd8-dzlxr"
Jul 18 12:07:38.057064 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:38.057043    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13aaf252-41e1-40e4-a620-b34b701c22c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-399bd8-dzlxr\" (UID: \"13aaf252-41e1-40e4-a620-b34b701c22c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-399bd8-dzlxr"
Jul 18 12:07:38.229719 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:38.229628    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-399bd8-dzlxr"
Jul 18 12:07:38.366826 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:38.366794    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-399bd8-dzlxr"]
Jul 18 12:07:38.369513 ip-10-0-130-110 kubenswrapper[2554]: W0718 12:07:38.369481    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13aaf252_41e1_40e4_a620_b34b701c22c0.slice/crio-10b7323cda47a7de97dee0f6aae4ca3d823379d9babcb1c811cd44729c2a49d1 WatchSource:0}: Error finding container 10b7323cda47a7de97dee0f6aae4ca3d823379d9babcb1c811cd44729c2a49d1: Status 404 returned error can't find the container with id 10b7323cda47a7de97dee0f6aae4ca3d823379d9babcb1c811cd44729c2a49d1
Jul 18 12:07:38.529897 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:38.529867    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7870-140525223081856"
Jul 18 12:07:38.529897 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:38.529893    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4cac1bf8e3fd9d6efdea6566f70b53b2ecbb94bdb07207dff45de2eb1132ab26"
Jul 18 12:07:38.531138 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:38.531115    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-399bd8-dzlxr" event={"ID":"13aaf252-41e1-40e4-a620-b34b701c22c0","Type":"ContainerStarted","Data":"10b7323cda47a7de97dee0f6aae4ca3d823379d9babcb1c811cd44729c2a49d1"}
Jul 18 12:07:38.540192 ip-10-0-130-110 kubenswrapper[2554]: E0718 12:07:38.540166    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7870-140525223081856\" is forbidden: User \"system:node:ip-10-0-130-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-110.ec2.internal' and this object" podUID="a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d" pod="opendatahub/test-curl-7870-140525223081856"
Jul 18 12:07:38.948521 ip-10-0-130-110 kubenswrapper[2554]: E0718 12:07:38.948430    2554 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7870-140525223081856\" is forbidden: User \"system:node:ip-10-0-130-110.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-110.ec2.internal' and this object" podUID="a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d" pod="opendatahub/test-curl-7870-140525223081856"
Jul 18 12:07:38.951118 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:38.951074    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d" path="/var/lib/kubelet/pods/a7b4d748-7ee9-4f7f-b8e5-c11fed38f91d/volumes"
Jul 18 12:07:39.537610 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:39.537571    2554 generic.go:356] "Generic (PLEG): container finished" podID="13aaf252-41e1-40e4-a620-b34b701c22c0" containerID="1df48a0a685b0d74465f4f546d158fd1098b4bf800b63d783de18d12cee80404" exitCode=0
Jul 18 12:07:39.537802 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:39.537640    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-399bd8-dzlxr" event={"ID":"13aaf252-41e1-40e4-a620-b34b701c22c0","Type":"ContainerDied","Data":"1df48a0a685b0d74465f4f546d158fd1098b4bf800b63d783de18d12cee80404"}
Jul 18 12:07:40.677782 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:40.677748    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-399bd8-dzlxr"
Jul 18 12:07:40.779435 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:40.779392    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13aaf252-41e1-40e4-a620-b34b701c22c0-maas-api-service-ca\") pod \"13aaf252-41e1-40e4-a620-b34b701c22c0\" (UID: \"13aaf252-41e1-40e4-a620-b34b701c22c0\") "
Jul 18 12:07:40.779743 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:40.779718    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/13aaf252-41e1-40e4-a620-b34b701c22c0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "13aaf252-41e1-40e4-a620-b34b701c22c0" (UID: "13aaf252-41e1-40e4-a620-b34b701c22c0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 12:07:40.880392 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:40.880311    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/13aaf252-41e1-40e4-a620-b34b701c22c0-maas-api-service-ca\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:07:41.549283 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:41.549252    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-399bd8-dzlxr"
Jul 18 12:07:41.549458 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:41.549252    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-399bd8-dzlxr" event={"ID":"13aaf252-41e1-40e4-a620-b34b701c22c0","Type":"ContainerDied","Data":"10b7323cda47a7de97dee0f6aae4ca3d823379d9babcb1c811cd44729c2a49d1"}
Jul 18 12:07:41.549458 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:41.549375    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10b7323cda47a7de97dee0f6aae4ca3d823379d9babcb1c811cd44729c2a49d1"
Jul 18 12:07:53.014328 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:53.014237    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-399bd8-dzlxr"]
Jul 18 12:07:53.015732 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:53.015708    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-399bd8-dzlxr"]
Jul 18 12:07:54.949846 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:54.949811    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13aaf252-41e1-40e4-a620-b34b701c22c0" path="/var/lib/kubelet/pods/13aaf252-41e1-40e4-a620-b34b701c22c0/volumes"
Jul 18 12:07:59.985619 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:59.985582    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-276d7e-f4rz4"]
Jul 18 12:07:59.986020 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:59.985919    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13aaf252-41e1-40e4-a620-b34b701c22c0" containerName="revoke-keys"
Jul 18 12:07:59.986020 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:59.985930    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="13aaf252-41e1-40e4-a620-b34b701c22c0" containerName="revoke-keys"
Jul 18 12:07:59.986020 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:59.985987    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="13aaf252-41e1-40e4-a620-b34b701c22c0" containerName="revoke-keys"
Jul 18 12:07:59.990337 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:59.990315    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-276d7e-f4rz4"
Jul 18 12:07:59.992800 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:59.992778    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-99w6p\""
Jul 18 12:07:59.992919 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:59.992803    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 18 12:07:59.996822 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:07:59.996796    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-276d7e-f4rz4"]
Jul 18 12:08:00.057491 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:00.057449    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f019fbcc-a0de-4209-b73a-5ad43fd64425-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-276d7e-f4rz4\" (UID: \"f019fbcc-a0de-4209-b73a-5ad43fd64425\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-276d7e-f4rz4"
Jul 18 12:08:00.158191 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:00.158153    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f019fbcc-a0de-4209-b73a-5ad43fd64425-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-276d7e-f4rz4\" (UID: \"f019fbcc-a0de-4209-b73a-5ad43fd64425\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-276d7e-f4rz4"
Jul 18 12:08:00.158790 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:00.158769    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f019fbcc-a0de-4209-b73a-5ad43fd64425-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-276d7e-f4rz4\" (UID: \"f019fbcc-a0de-4209-b73a-5ad43fd64425\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-276d7e-f4rz4"
Jul 18 12:08:00.304278 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:00.304230    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-276d7e-f4rz4"
Jul 18 12:08:00.438692 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:00.438669    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-276d7e-f4rz4"]
Jul 18 12:08:00.441172 ip-10-0-130-110 kubenswrapper[2554]: W0718 12:08:00.441147    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf019fbcc_a0de_4209_b73a_5ad43fd64425.slice/crio-208e2f083e3705c958969f1d3f554567bb217966f4193dabbe5d68b681125e4f WatchSource:0}: Error finding container 208e2f083e3705c958969f1d3f554567bb217966f4193dabbe5d68b681125e4f: Status 404 returned error can't find the container with id 208e2f083e3705c958969f1d3f554567bb217966f4193dabbe5d68b681125e4f
Jul 18 12:08:00.637141 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:00.637016    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-276d7e-f4rz4" event={"ID":"f019fbcc-a0de-4209-b73a-5ad43fd64425","Type":"ContainerStarted","Data":"208e2f083e3705c958969f1d3f554567bb217966f4193dabbe5d68b681125e4f"}
Jul 18 12:08:01.643700 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:01.643663    2554 generic.go:356] "Generic (PLEG): container finished" podID="f019fbcc-a0de-4209-b73a-5ad43fd64425" containerID="592938ee3093de4594a309e2ab230776697d03d1f69c94d0e05b6b10ce88007a" exitCode=0
Jul 18 12:08:01.644087 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:01.643753    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-276d7e-f4rz4" event={"ID":"f019fbcc-a0de-4209-b73a-5ad43fd64425","Type":"ContainerDied","Data":"592938ee3093de4594a309e2ab230776697d03d1f69c94d0e05b6b10ce88007a"}
Jul 18 12:08:02.785762 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:02.785735    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-276d7e-f4rz4"
Jul 18 12:08:02.883206 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:02.883171    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f019fbcc-a0de-4209-b73a-5ad43fd64425-maas-api-service-ca\") pod \"f019fbcc-a0de-4209-b73a-5ad43fd64425\" (UID: \"f019fbcc-a0de-4209-b73a-5ad43fd64425\") "
Jul 18 12:08:02.886657 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:02.883905    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f019fbcc-a0de-4209-b73a-5ad43fd64425-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f019fbcc-a0de-4209-b73a-5ad43fd64425" (UID: "f019fbcc-a0de-4209-b73a-5ad43fd64425"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 18 12:08:02.984345 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:02.984305    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f019fbcc-a0de-4209-b73a-5ad43fd64425-maas-api-service-ca\") on node \"ip-10-0-130-110.ec2.internal\" DevicePath \"\""
Jul 18 12:08:03.655836 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:03.655800    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-276d7e-f4rz4" event={"ID":"f019fbcc-a0de-4209-b73a-5ad43fd64425","Type":"ContainerDied","Data":"208e2f083e3705c958969f1d3f554567bb217966f4193dabbe5d68b681125e4f"}
Jul 18 12:08:03.656047 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:03.655854    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="208e2f083e3705c958969f1d3f554567bb217966f4193dabbe5d68b681125e4f"
Jul 18 12:08:03.656047 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:03.655807    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-276d7e-f4rz4"
Jul 18 12:08:15.061320 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:15.061281    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-276d7e-f4rz4"]
Jul 18 12:08:15.065599 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:15.065571    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-276d7e-f4rz4"]
Jul 18 12:08:16.949003 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:16.948967    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f019fbcc-a0de-4209-b73a-5ad43fd64425" path="/var/lib/kubelet/pods/f019fbcc-a0de-4209-b73a-5ad43fd64425/volumes"
Jul 18 12:08:22.470108 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:22.470053    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d7dd644d9-bjcb7_a13197af-3b3c-4a8d-9828-cf316448a318/authorino/0.log"
Jul 18 12:08:28.048538 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:28.048502    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8668c_6070d061-b3a8-4ed5-9a75-07aa80c8e784/manager/0.log"
Jul 18 12:08:28.771957 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:28.771929    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm_2a9bca71-cd64-4a00-a38b-f573d9d41a14/copy-manifests/0.log"
Jul 18 12:08:28.778900 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:28.778876    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm_2a9bca71-cd64-4a00-a38b-f573d9d41a14/manager/0.log"
Jul 18 12:08:30.794240 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:30.794209    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d7dd644d9-bjcb7_a13197af-3b3c-4a8d-9828-cf316448a318/authorino/0.log"
Jul 18 12:08:31.144789 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:31.144708    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-gs64g_80589be0-03bb-4c53-a61f-506c4cbf6bba/kuadrant-console-plugin/0.log"
Jul 18 12:08:31.969907 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:31.969876    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4r76ph_4282d415-1a26-4624-a43a-e1443282dcb3/istio-proxy/0.log"
Jul 18 12:08:32.321690 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:32.321660    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6df8599d98-zhv2d_220c5f02-eca2-47b4-b816-0d448b77c3d1/kube-auth-proxy/0.log"
Jul 18 12:08:32.441351 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:32.441317    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mmg4g_e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9/istio-proxy/1.log"
Jul 18 12:08:32.573021 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:32.572943    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-hmvph_6ddcff54-f714-40d9-95fd-5a71614bdd02/payload-pre-processing/0.log"
Jul 18 12:08:32.690734 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:32.690701    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-ltb9d_97eadb98-ba93-4698-9ea9-84dfdb3fa170/payload-processing/0.log"
Jul 18 12:08:33.144081 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:33.144052    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-v25tk_9c7547ce-7119-4e60-b95e-dfd0e05b87c8/main/0.log"
Jul 18 12:08:33.704542 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:33.704512    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-79bcx_4ece6555-13d4-48cd-a06a-1660659ad9a5/main/0.log"
Jul 18 12:08:42.715733 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:42.715697    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tj4vh_6a7e7704-fd0c-4d89-935e-ddf63f7082e1/global-pull-secret-syncer/0.log"
Jul 18 12:08:42.829254 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:42.829219    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wqfc9_c2065968-1eb2-40a6-bac5-af5e502f89af/konnectivity-agent/0.log"
Jul 18 12:08:42.851581 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:42.851550    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-110.ec2.internal_97c5a81044e47f299dcb090782306fa8/haproxy/0.log"
Jul 18 12:08:47.694334 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:47.694296    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d7dd644d9-bjcb7_a13197af-3b3c-4a8d-9828-cf316448a318/authorino/0.log"
Jul 18 12:08:47.805722 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:47.805696    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-gs64g_80589be0-03bb-4c53-a61f-506c4cbf6bba/kuadrant-console-plugin/0.log"
Jul 18 12:08:49.671019 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:49.670993    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_447a6bee-9a81-4569-bccc-4a7b62c6fa59/alertmanager/0.log"
Jul 18 12:08:49.691123 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:49.691082    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_447a6bee-9a81-4569-bccc-4a7b62c6fa59/config-reloader/0.log"
Jul 18 12:08:49.710929 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:49.710892    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_447a6bee-9a81-4569-bccc-4a7b62c6fa59/kube-rbac-proxy-web/0.log"
Jul 18 12:08:49.730569 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:49.730542    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_447a6bee-9a81-4569-bccc-4a7b62c6fa59/kube-rbac-proxy/0.log"
Jul 18 12:08:49.755657 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:49.755629    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_447a6bee-9a81-4569-bccc-4a7b62c6fa59/kube-rbac-proxy-metric/0.log"
Jul 18 12:08:49.776372 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:49.776350    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_447a6bee-9a81-4569-bccc-4a7b62c6fa59/prom-label-proxy/0.log"
Jul 18 12:08:49.795581 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:49.795552    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_447a6bee-9a81-4569-bccc-4a7b62c6fa59/init-config-reloader/0.log"
Jul 18 12:08:49.999011 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:49.998985    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9zv49_4a37b360-f039-4518-9f80-0ac803dde189/node-exporter/0.log"
Jul 18 12:08:50.019223 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:50.019195    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9zv49_4a37b360-f039-4518-9f80-0ac803dde189/kube-rbac-proxy/0.log"
Jul 18 12:08:50.039288 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:50.039263    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9zv49_4a37b360-f039-4518-9f80-0ac803dde189/init-textfile/0.log"
Jul 18 12:08:50.312985 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:50.312911    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_79adb4cd-2583-4c4b-8fb7-a9981c1af6cb/prometheus/0.log"
Jul 18 12:08:50.370531 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:50.370507    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_79adb4cd-2583-4c4b-8fb7-a9981c1af6cb/config-reloader/0.log"
Jul 18 12:08:50.424138 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:50.424110    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_79adb4cd-2583-4c4b-8fb7-a9981c1af6cb/thanos-sidecar/0.log"
Jul 18 12:08:50.488171 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:50.488141    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_79adb4cd-2583-4c4b-8fb7-a9981c1af6cb/kube-rbac-proxy-web/0.log"
Jul 18 12:08:50.526338 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:50.526306    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_79adb4cd-2583-4c4b-8fb7-a9981c1af6cb/kube-rbac-proxy/0.log"
Jul 18 12:08:50.548090 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:50.548063    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_79adb4cd-2583-4c4b-8fb7-a9981c1af6cb/kube-rbac-proxy-thanos/0.log"
Jul 18 12:08:50.567788 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:50.567713    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_79adb4cd-2583-4c4b-8fb7-a9981c1af6cb/init-config-reloader/0.log"
Jul 18 12:08:50.636763 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:50.636732    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-b6qwp_33be1e8c-d7a8-4fc2-b2a2-1beb6b8236d7/prometheus-operator-admission-webhook/0.log"
Jul 18 12:08:52.950896 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:52.950862    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs"]
Jul 18 12:08:52.951289 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:52.951182    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f019fbcc-a0de-4209-b73a-5ad43fd64425" containerName="revoke-keys"
Jul 18 12:08:52.951289 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:52.951193    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f019fbcc-a0de-4209-b73a-5ad43fd64425" containerName="revoke-keys"
Jul 18 12:08:52.951289 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:52.951270    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f019fbcc-a0de-4209-b73a-5ad43fd64425" containerName="revoke-keys"
Jul 18 12:08:52.954151 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:52.954126    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs"
Jul 18 12:08:52.956703 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:52.956677    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9kfp5\"/\"default-dockercfg-jf7sl\""
Jul 18 12:08:52.957472 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:52.957445    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9kfp5\"/\"openshift-service-ca.crt\""
Jul 18 12:08:52.957592 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:52.957452    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9kfp5\"/\"kube-root-ca.crt\""
Jul 18 12:08:52.958590 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:52.958567    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs"]
Jul 18 12:08:53.052458 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:53.052401    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6d476d8f-89e2-405f-ae87-cc2807b3b982-podres\") pod \"perf-node-gather-daemonset-g7wcs\" (UID: \"6d476d8f-89e2-405f-ae87-cc2807b3b982\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs"
Jul 18 12:08:53.052662 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:53.052520    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb2zq\" (UniqueName: \"kubernetes.io/projected/6d476d8f-89e2-405f-ae87-cc2807b3b982-kube-api-access-cb2zq\") pod \"perf-node-gather-daemonset-g7wcs\" (UID: \"6d476d8f-89e2-405f-ae87-cc2807b3b982\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs"
Jul 18 12:08:53.052662 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:53.052547    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6d476d8f-89e2-405f-ae87-cc2807b3b982-proc\") pod \"perf-node-gather-daemonset-g7wcs\" (UID: \"6d476d8f-89e2-405f-ae87-cc2807b3b982\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs"
Jul 18 12:08:53.052662 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:53.052606    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d476d8f-89e2-405f-ae87-cc2807b3b982-sys\") pod \"perf-node-gather-daemonset-g7wcs\" (UID: \"6d476d8f-89e2-405f-ae87-cc2807b3b982\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs"
Jul 18 12:08:53.052662 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:53.052642    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6d476d8f-89e2-405f-ae87-cc2807b3b982-lib-modules\") pod \"perf-node-gather-daemonset-g7wcs\" (UID: \"6d476d8f-89e2-405f-ae87-cc2807b3b982\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs"
Jul 18 12:08:53.153698 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:53.153657    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6d476d8f-89e2-405f-ae87-cc2807b3b982-lib-modules\") pod \"perf-node-gather-daemonset-g7wcs\" (UID: \"6d476d8f-89e2-405f-ae87-cc2807b3b982\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs"
Jul 18 12:08:53.153890 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:53.153724    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6d476d8f-89e2-405f-ae87-cc2807b3b982-podres\") pod \"perf-node-gather-daemonset-g7wcs\" (UID: \"6d476d8f-89e2-405f-ae87-cc2807b3b982\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs"
Jul 18 12:08:53.153890 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:53.153774    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb2zq\" (UniqueName: \"kubernetes.io/projected/6d476d8f-89e2-405f-ae87-cc2807b3b982-kube-api-access-cb2zq\") pod \"perf-node-gather-daemonset-g7wcs\" (UID: \"6d476d8f-89e2-405f-ae87-cc2807b3b982\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs"
Jul 18 12:08:53.153890 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:53.153805    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6d476d8f-89e2-405f-ae87-cc2807b3b982-proc\") pod \"perf-node-gather-daemonset-g7wcs\" (UID: \"6d476d8f-89e2-405f-ae87-cc2807b3b982\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs"
Jul 18 12:08:53.153890 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:53.153840    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d476d8f-89e2-405f-ae87-cc2807b3b982-sys\") pod \"perf-node-gather-daemonset-g7wcs\" (UID: \"6d476d8f-89e2-405f-ae87-cc2807b3b982\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs"
Jul 18 12:08:53.153890 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:53.153840    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6d476d8f-89e2-405f-ae87-cc2807b3b982-lib-modules\") pod \"perf-node-gather-daemonset-g7wcs\" (UID: \"6d476d8f-89e2-405f-ae87-cc2807b3b982\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs"
Jul 18 12:08:53.154187 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:53.153899    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6d476d8f-89e2-405f-ae87-cc2807b3b982-podres\") pod \"perf-node-gather-daemonset-g7wcs\" (UID: \"6d476d8f-89e2-405f-ae87-cc2807b3b982\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs"
Jul 18 12:08:53.154187 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:53.153900    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6d476d8f-89e2-405f-ae87-cc2807b3b982-proc\") pod \"perf-node-gather-daemonset-g7wcs\" (UID: \"6d476d8f-89e2-405f-ae87-cc2807b3b982\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs"
Jul 18 12:08:53.154187 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:53.153924    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d476d8f-89e2-405f-ae87-cc2807b3b982-sys\") pod \"perf-node-gather-daemonset-g7wcs\" (UID: \"6d476d8f-89e2-405f-ae87-cc2807b3b982\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs"
Jul 18 12:08:53.161887 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:53.161853    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb2zq\" (UniqueName: \"kubernetes.io/projected/6d476d8f-89e2-405f-ae87-cc2807b3b982-kube-api-access-cb2zq\") pod \"perf-node-gather-daemonset-g7wcs\" (UID: \"6d476d8f-89e2-405f-ae87-cc2807b3b982\") " pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs"
Jul 18 12:08:53.225726 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:53.225638    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c7dc6455-r9txj_66b7c568-5d8b-48e2-bd44-c6ed11085e92/console/0.log"
Jul 18 12:08:53.266782 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:53.266753    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs"
Jul 18 12:08:53.396622 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:53.396593    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs"]
Jul 18 12:08:53.399119 ip-10-0-130-110 kubenswrapper[2554]: W0718 12:08:53.399075    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6d476d8f_89e2_405f_ae87_cc2807b3b982.slice/crio-9af45dd2086b662ed2b66ed1599f7790cd9fdc534c40dd1a16d116085caec9b2 WatchSource:0}: Error finding container 9af45dd2086b662ed2b66ed1599f7790cd9fdc534c40dd1a16d116085caec9b2: Status 404 returned error can't find the container with id 9af45dd2086b662ed2b66ed1599f7790cd9fdc534c40dd1a16d116085caec9b2
Jul 18 12:08:53.893081 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:53.893048    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs" event={"ID":"6d476d8f-89e2-405f-ae87-cc2807b3b982","Type":"ContainerStarted","Data":"4116f09d1483f0729f278d284d58863033ed092411301d15089c6fd50096c0e4"}
Jul 18 12:08:53.893294 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:53.893114    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs" event={"ID":"6d476d8f-89e2-405f-ae87-cc2807b3b982","Type":"ContainerStarted","Data":"9af45dd2086b662ed2b66ed1599f7790cd9fdc534c40dd1a16d116085caec9b2"}
Jul 18 12:08:53.893294 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:53.893196    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs"
Jul 18 12:08:53.908494 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:53.908439    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs" podStartSLOduration=1.908422458 podStartE2EDuration="1.908422458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-18 12:08:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-18 12:08:53.907876655 +0000 UTC m=+2935.510006394" watchObservedRunningTime="2026-07-18 12:08:53.908422458 +0000 UTC m=+2935.510552251"
Jul 18 12:08:55.027407 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:55.027373    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pv9kp_2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f/dns/0.log"
Jul 18 12:08:55.048000 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:55.047965    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pv9kp_2031a1ee-5208-4fd6-8faa-68fdaa8c8b1f/kube-rbac-proxy/0.log"
Jul 18 12:08:55.158035 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:55.157999    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p6t6n_e6d4988d-0ad4-4bbd-a75a-5da0d1c25749/dns-node-resolver/0.log"
Jul 18 12:08:55.774958 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:55.774924    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-np9kp_d89ecbee-c2b4-417a-a54f-1a03ac0bbc1c/node-ca/0.log"
Jul 18 12:08:56.696443 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:56.696404    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4r76ph_4282d415-1a26-4624-a43a-e1443282dcb3/istio-proxy/0.log"
Jul 18 12:08:56.864316 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:56.864288    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6df8599d98-zhv2d_220c5f02-eca2-47b4-b816-0d448b77c3d1/kube-auth-proxy/0.log"
Jul 18 12:08:56.892982 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:56.892953    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mmg4g_e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9/istio-proxy/0.log"
Jul 18 12:08:56.922453 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:56.922422    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mmg4g_e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9/istio-proxy/1.log"
Jul 18 12:08:56.949047 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:56.948970    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-hmvph_6ddcff54-f714-40d9-95fd-5a71614bdd02/payload-pre-processing/0.log"
Jul 18 12:08:56.972211 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:56.972186    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-ltb9d_97eadb98-ba93-4698-9ea9-84dfdb3fa170/payload-processing/0.log"
Jul 18 12:08:57.691332 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:57.691303    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zt4vp_fced16a6-eb16-46c1-9a0e-d02dff750a17/serve-healthcheck-canary/0.log"
Jul 18 12:08:58.282916 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:58.282888    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9rqst_39beca92-f03f-4ed9-958b-b3c2a1da17c5/kube-rbac-proxy/0.log"
Jul 18 12:08:58.301392 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:58.301368    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9rqst_39beca92-f03f-4ed9-958b-b3c2a1da17c5/exporter/0.log"
Jul 18 12:08:58.320187 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:58.320156    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9rqst_39beca92-f03f-4ed9-958b-b3c2a1da17c5/extractor/0.log"
Jul 18 12:08:59.908794 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:08:59.908770    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9kfp5/perf-node-gather-daemonset-g7wcs"
Jul 18 12:09:00.592115 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:00.592068    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8668c_6070d061-b3a8-4ed5-9a75-07aa80c8e784/manager/0.log"
Jul 18 12:09:01.003729 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:01.003700    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm_2a9bca71-cd64-4a00-a38b-f573d9d41a14/manager/0.log"
Jul 18 12:09:01.022082 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:01.022057    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-78b8cdd6f7-pd9tm_2a9bca71-cd64-4a00-a38b-f573d9d41a14/copy-manifests/0.log"
Jul 18 12:09:02.432474 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:02.432445    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-59bdd75cb8-qnvjr_5152bab5-89e3-4ee6-b4f7-1113b2847fc9/manager/0.log"
Jul 18 12:09:03.523152 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:03.523116    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4r76ph_4282d415-1a26-4624-a43a-e1443282dcb3/istio-proxy/0.log"
Jul 18 12:09:03.677160 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:03.677124    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6df8599d98-zhv2d_220c5f02-eca2-47b4-b816-0d448b77c3d1/kube-auth-proxy/0.log"
Jul 18 12:09:03.693241 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:03.693208    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mmg4g_e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9/istio-proxy/0.log"
Jul 18 12:09:03.719839 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:03.719804    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mmg4g_e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9/istio-proxy/1.log"
Jul 18 12:09:03.738712 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:03.738676    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-hmvph_6ddcff54-f714-40d9-95fd-5a71614bdd02/payload-pre-processing/0.log"
Jul 18 12:09:03.752340 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:03.752312    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-ltb9d_97eadb98-ba93-4698-9ea9-84dfdb3fa170/payload-processing/0.log"
Jul 18 12:09:05.040042 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:05.040005    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4r76ph_4282d415-1a26-4624-a43a-e1443282dcb3/istio-proxy/0.log"
Jul 18 12:09:05.188687 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:05.188635    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6df8599d98-zhv2d_220c5f02-eca2-47b4-b816-0d448b77c3d1/kube-auth-proxy/0.log"
Jul 18 12:09:05.212383 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:05.212347    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mmg4g_e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9/istio-proxy/0.log"
Jul 18 12:09:05.236362 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:05.236331    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-mmg4g_e14d47d4-fc0d-4f51-a5aa-c67d00ebb7d9/istio-proxy/1.log"
Jul 18 12:09:05.255637 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:05.255609    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-hmvph_6ddcff54-f714-40d9-95fd-5a71614bdd02/payload-pre-processing/0.log"
Jul 18 12:09:05.277786 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:05.277754    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-ltb9d_97eadb98-ba93-4698-9ea9-84dfdb3fa170/payload-processing/0.log"
Jul 18 12:09:09.210992 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:09.210904    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2gphw_e232d4ab-f385-4027-b5ae-89821bb14026/kube-multus/0.log"
Jul 18 12:09:09.418208 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:09.418181    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lbhg8_7a5e4326-d7b2-44c7-9404-2ada70d7ad0b/kube-multus-additional-cni-plugins/0.log"
Jul 18 12:09:09.439122 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:09.439084    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lbhg8_7a5e4326-d7b2-44c7-9404-2ada70d7ad0b/egress-router-binary-copy/0.log"
Jul 18 12:09:09.458899 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:09.458874    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lbhg8_7a5e4326-d7b2-44c7-9404-2ada70d7ad0b/cni-plugins/0.log"
Jul 18 12:09:09.478324 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:09.478244    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lbhg8_7a5e4326-d7b2-44c7-9404-2ada70d7ad0b/bond-cni-plugin/0.log"
Jul 18 12:09:09.497929 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:09.497902    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lbhg8_7a5e4326-d7b2-44c7-9404-2ada70d7ad0b/routeoverride-cni/0.log"
Jul 18 12:09:09.516605 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:09.516573    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lbhg8_7a5e4326-d7b2-44c7-9404-2ada70d7ad0b/whereabouts-cni-bincopy/0.log"
Jul 18 12:09:09.536743 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:09.536717    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lbhg8_7a5e4326-d7b2-44c7-9404-2ada70d7ad0b/whereabouts-cni/0.log"
Jul 18 12:09:09.838546 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:09.838516    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wd67v_f390acc5-cb52-4b39-a4fe-362b2b543fbf/network-metrics-daemon/0.log"
Jul 18 12:09:09.858042 ip-10-0-130-110 kubenswrapper[2554]: I0718 12:09:09.858016    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wd67v_f390acc5-cb52-4b39-a4fe-362b2b543fbf/kube-rbac-proxy/0.log"