Jul 28 10:05:56.095363 ip-10-0-140-175 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 28 10:05:56.095374 ip-10-0-140-175 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 28 10:05:56.095381 ip-10-0-140-175 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 28 10:05:56.095615 ip-10-0-140-175 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 28 10:06:06.261659 ip-10-0-140-175 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 28 10:06:06.261676 ip-10-0-140-175 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 88a2a720a8784aa7a072825c7d2ff772 --
Jul 28 10:07:46.503121 ip-10-0-140-175 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 10:07:46.806259 ip-10-0-140-175 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 10:07:46.806259 ip-10-0-140-175 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 10:07:46.806259 ip-10-0-140-175 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 10:07:46.806259 ip-10-0-140-175 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 10:07:46.806259 ip-10-0-140-175 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 10:07:46.807505 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.807422    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 10:07:46.811353 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811337    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 10:07:46.811353 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811352    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 10:07:46.811415 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811357    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 10:07:46.811415 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811361    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 10:07:46.811415 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811363    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 10:07:46.811415 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811366    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 10:07:46.811415 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811368    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 10:07:46.811415 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811371    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 10:07:46.811415 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811375    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 10:07:46.811415 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811377    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 10:07:46.811415 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811380    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 10:07:46.811415 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811383    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 10:07:46.811415 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811385    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 10:07:46.811415 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811388    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 10:07:46.811415 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811390    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 10:07:46.811415 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811393    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 10:07:46.811415 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811395    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 10:07:46.811415 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811398    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 10:07:46.811415 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811400    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 10:07:46.811415 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811402    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 10:07:46.811415 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811405    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 10:07:46.811415 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811407    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 10:07:46.811914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811410    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 10:07:46.811914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811413    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 10:07:46.811914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811415    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 10:07:46.811914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811418    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 10:07:46.811914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811421    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 10:07:46.811914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811424    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 10:07:46.811914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811426    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 10:07:46.811914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811429    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 10:07:46.811914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811432    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 10:07:46.811914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811434    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 10:07:46.811914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811437    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 10:07:46.811914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811440    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 10:07:46.811914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811442    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 10:07:46.811914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811445    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 10:07:46.811914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811448    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 10:07:46.811914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811450    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 10:07:46.811914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811453    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 10:07:46.811914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811456    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 10:07:46.811914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811458    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 10:07:46.811914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811460    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 10:07:46.812385 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811463    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 10:07:46.812385 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811466    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 10:07:46.812385 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811468    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 10:07:46.812385 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811470    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 10:07:46.812385 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811473    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 10:07:46.812385 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811476    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 10:07:46.812385 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811479    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 10:07:46.812385 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811482    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 10:07:46.812385 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811484    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 10:07:46.812385 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811487    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 10:07:46.812385 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811489    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 10:07:46.812385 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811492    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 10:07:46.812385 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811494    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 10:07:46.812385 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811497    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 10:07:46.812385 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811500    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 10:07:46.812385 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811503    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 10:07:46.812385 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811507    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 10:07:46.812385 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811511    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 10:07:46.812385 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811514    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 10:07:46.812849 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811517    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 10:07:46.812849 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811520    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 10:07:46.812849 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811522    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 10:07:46.812849 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811525    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 10:07:46.812849 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811528    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 10:07:46.812849 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811530    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 10:07:46.812849 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811533    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 10:07:46.812849 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811536    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 10:07:46.812849 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811538    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 10:07:46.812849 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811541    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 10:07:46.812849 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811544    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 10:07:46.812849 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811547    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 10:07:46.812849 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811549    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 10:07:46.812849 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811552    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 10:07:46.812849 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811554    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 10:07:46.812849 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811556    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 10:07:46.812849 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811560    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 10:07:46.812849 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811563    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 10:07:46.812849 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811566    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 10:07:46.812849 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811569    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 10:07:46.813327 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811571    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 10:07:46.813327 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811574    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 10:07:46.813327 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811576    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 10:07:46.813327 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811579    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 10:07:46.813327 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811581    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 10:07:46.813327 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811583    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 10:07:46.813327 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811586    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 10:07:46.813327 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811589    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 10:07:46.813327 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811593    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 10:07:46.813327 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811597    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 10:07:46.813327 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811600    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 10:07:46.813327 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811603    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 10:07:46.813327 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811606    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 10:07:46.813327 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811608    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 10:07:46.813327 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811611    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 10:07:46.813327 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811615    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 10:07:46.813327 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811618    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 10:07:46.813327 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.811621    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 10:07:46.814021 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814009    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 10:07:46.814021 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814020    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 10:07:46.814076 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814024    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 10:07:46.814076 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814026    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 10:07:46.814076 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814029    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 10:07:46.814076 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814032    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 10:07:46.814076 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814035    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 10:07:46.814076 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814038    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 10:07:46.814076 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814040    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 10:07:46.814076 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814043    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 10:07:46.814076 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814045    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 10:07:46.814076 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814050    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 10:07:46.814076 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814053    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 10:07:46.814076 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814056    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 10:07:46.814076 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814059    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 10:07:46.814076 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814061    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 10:07:46.814076 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814064    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 10:07:46.814076 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814066    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 10:07:46.814076 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814069    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 10:07:46.814076 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814071    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 10:07:46.814076 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814074    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 10:07:46.814076 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814077    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 10:07:46.814604 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814080    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 10:07:46.814604 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814083    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 10:07:46.814604 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814085    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 10:07:46.814604 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814088    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 10:07:46.814604 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814091    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 10:07:46.814604 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814094    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 10:07:46.814604 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814096    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 10:07:46.814604 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814098    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 10:07:46.814604 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814101    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 10:07:46.814604 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814103    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 10:07:46.814604 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814105    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 10:07:46.814604 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814108    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 10:07:46.814604 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814111    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 10:07:46.814604 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814113    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 10:07:46.814604 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814116    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 10:07:46.814604 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814119    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 10:07:46.814604 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814122    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 10:07:46.814604 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814124    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 10:07:46.814604 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814127    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 10:07:46.814604 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814129    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 10:07:46.815118 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814131    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 10:07:46.815118 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814134    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 10:07:46.815118 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814136    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 10:07:46.815118 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814140    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 10:07:46.815118 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814142    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 10:07:46.815118 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814144    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 10:07:46.815118 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814147    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 10:07:46.815118 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814149    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 10:07:46.815118 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814151    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 10:07:46.815118 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814154    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 10:07:46.815118 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814156    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 10:07:46.815118 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814159    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 10:07:46.815118 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814161    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 10:07:46.815118 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814165    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 10:07:46.815118 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814168    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 10:07:46.815118 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814170    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 10:07:46.815118 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814173    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 10:07:46.815118 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814175    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 10:07:46.815118 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814179    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 10:07:46.815118 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814183    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 10:07:46.815597 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814186    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 10:07:46.815597 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814189    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 10:07:46.815597 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814191    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 10:07:46.815597 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814193    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 10:07:46.815597 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814196    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 10:07:46.815597 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814201    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 10:07:46.815597 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814204    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 10:07:46.815597 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814207    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 10:07:46.815597 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814210    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 10:07:46.815597 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814213    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 10:07:46.815597 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814216    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 10:07:46.815597 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814218    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 10:07:46.815597 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814221    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 10:07:46.815597 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814223    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 10:07:46.815597 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814226    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 10:07:46.815597 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814228    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 10:07:46.815597 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814231    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 10:07:46.815597 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814233    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 10:07:46.815597 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814236    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 10:07:46.816071 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814238    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 10:07:46.816071 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814241    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 10:07:46.816071 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814243    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 10:07:46.816071 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814245    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 10:07:46.816071 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814248    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 10:07:46.816071 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814250    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 10:07:46.816071 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814253    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 10:07:46.816071 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814256    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 10:07:46.816071 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814258    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 10:07:46.816071 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814261    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 10:07:46.816071 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814263    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 10:07:46.816071 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814266    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 10:07:46.816071 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814268    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 10:07:46.816071 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814271    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 10:07:46.816071 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814273    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 10:07:46.816071 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814276    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 10:07:46.816071 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814278    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 10:07:46.816071 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814281    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 10:07:46.816071 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814645    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 10:07:46.816530 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814650    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 10:07:46.816530 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814652    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 10:07:46.816530 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814655    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 10:07:46.816530 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814658    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 10:07:46.816530 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814661    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 10:07:46.816530 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814664    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 10:07:46.816530 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814667    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 10:07:46.816530 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814669    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 10:07:46.816530 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814672    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 10:07:46.816530 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814674    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 10:07:46.816530 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814677    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 10:07:46.816530 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814680    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 10:07:46.816530 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814682    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 10:07:46.816530 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814685    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 10:07:46.816530 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814687    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 10:07:46.816530 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814690    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 10:07:46.816530 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814694    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 10:07:46.816530 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814697    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 10:07:46.816530 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814700    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 10:07:46.817003 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814703    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 10:07:46.817003 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814706    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 10:07:46.817003 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814709    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 10:07:46.817003 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814712    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 10:07:46.817003 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814715    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 10:07:46.817003 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814717    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 10:07:46.817003 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814720    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 10:07:46.817003 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814722    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 10:07:46.817003 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814725    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 10:07:46.817003 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814727    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 10:07:46.817003 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814730    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 10:07:46.817003 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814733    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 10:07:46.817003 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814735    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 10:07:46.817003 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814738    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 10:07:46.817003 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814740    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 10:07:46.817003 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814742    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 10:07:46.817003 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814745    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 10:07:46.817003 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814748    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 10:07:46.817003 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814751    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 10:07:46.817003 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814753    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 10:07:46.817490 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814755    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 10:07:46.817490 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814758    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 10:07:46.817490 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814760    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 10:07:46.817490 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814763    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 10:07:46.817490 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814765    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 10:07:46.817490 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814768    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 10:07:46.817490 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814770    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 10:07:46.817490 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814772    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 10:07:46.817490 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814776    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 10:07:46.817490 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814778    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 10:07:46.817490 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814780    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 10:07:46.817490 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814783    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 10:07:46.817490 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814785    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 10:07:46.817490 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814788    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 10:07:46.817490 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814791    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 10:07:46.817490 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814794    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 10:07:46.817490 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814797    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 10:07:46.817490 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814799    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 10:07:46.817490 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814801    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 10:07:46.817490 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814804    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 10:07:46.817993 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814811    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 10:07:46.817993 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814814    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 10:07:46.817993 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814816    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 10:07:46.817993 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814819    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 10:07:46.817993 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814822    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 10:07:46.817993 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814824    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 10:07:46.817993 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814827    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 10:07:46.817993 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814829    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 10:07:46.817993 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814831    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 10:07:46.817993 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814834    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 10:07:46.817993 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814853    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 10:07:46.817993 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814856    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 10:07:46.817993 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814859    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 10:07:46.817993 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814861    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 10:07:46.817993 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814864    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 10:07:46.817993 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814866    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 10:07:46.817993 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814869    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 10:07:46.817993 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814872    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 10:07:46.817993 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814875    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 10:07:46.817993 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814877    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 10:07:46.818468 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814880    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 10:07:46.818468 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814882    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 10:07:46.818468 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814886    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 10:07:46.818468 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814890    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 10:07:46.818468 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814893    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 10:07:46.818468 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814896    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 10:07:46.818468 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814899    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 10:07:46.818468 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814901    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 10:07:46.818468 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814904    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 10:07:46.818468 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814906    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 10:07:46.818468 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814909    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 10:07:46.818468 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814911    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 10:07:46.818468 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814915    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 10:07:46.818468 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814918    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 10:07:46.818468 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814920    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 10:07:46.818468 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814923    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 10:07:46.818468 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814926    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 10:07:46.818468 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814930    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 10:07:46.818468 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.814932    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815002    2577 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815008    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815016    2577 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815023    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815030    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815035    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815042    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815047    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815050    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815053    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815056    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815059    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815062    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815065    2577 flags.go:64] FLAG: --cgroup-root=""
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815068    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815071    2577 flags.go:64] FLAG: --client-ca-file=""
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815073    2577 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815076    2577 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815081    2577 flags.go:64] FLAG: --cluster-domain=""
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815084    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815087    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815089    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815092    2577 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 10:07:46.818943 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815096    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815099    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815104    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815107    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815110    2577 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815112    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815115    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815118    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815121    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815125    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815128    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815131    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815134    2577 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815137    2577 flags.go:64] FLAG: --enable-server="true"
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815140    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815144    2577 flags.go:64] FLAG: --event-burst="100"
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815147    2577 flags.go:64] FLAG: --event-qps="50"
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815150    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815153    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815156    2577 flags.go:64] FLAG: --eviction-hard=""
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815160    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815163    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815165    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815168    2577 flags.go:64] FLAG: --eviction-soft=""
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815171    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 10:07:46.819533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815174    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815176    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815179    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815182    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815185    2577 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815188    2577 flags.go:64] FLAG: --feature-gates=""
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815191    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815194    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815197    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815200    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815203    2577 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815206    2577 flags.go:64] FLAG: --help="false"
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815209    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-140-175.ec2.internal"
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815212    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815214    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815217    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815220    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815224    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815227    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815230    2577 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815232    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815235    2577 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815238    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815242    2577 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 10:07:46.820192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815244    2577 flags.go:64] FLAG: --kube-reserved=""
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815250    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815253    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815256    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815258    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815261    2577 flags.go:64] FLAG: --lock-file=""
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815263    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815266    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815269    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815274    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815277    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815279    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815282    2577 flags.go:64] FLAG: --logging-format="text"
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815284    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815287    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815290    2577 flags.go:64] FLAG: --manifest-url=""
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815293    2577 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815297    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815300    2577 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815303    2577 flags.go:64] FLAG: --max-pods="110"
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815306    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815309    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815311    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815314    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815317    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 10:07:46.820774 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815320    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815323    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815330    2577 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815332    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815335    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815338    2577 flags.go:64] FLAG: --pod-cidr=""
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815342    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815347    2577 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815350    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815354    2577 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815357    2577 flags.go:64] FLAG: --port="10250"
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815360    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815362    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0985407f47bd92a5d"
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815365    2577 flags.go:64] FLAG: --qos-reserved=""
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815368    2577 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815371    2577 flags.go:64] FLAG: --register-node="true"
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815378    2577 flags.go:64] FLAG: --register-with-taints=""
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815382    2577 flags.go:64] FLAG: --registry-burst="10"
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815384    2577 flags.go:64] FLAG: --registry-qps="5"
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815387    2577 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815390    2577 flags.go:64] FLAG: --reserved-memory=""
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815393    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815396    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815399    2577 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815402    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 10:07:46.821412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815405    2577 flags.go:64] FLAG: --runonce="false"
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815407    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815410    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815413    2577 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815416    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815419    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815422    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815425    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815427    2577 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815430    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815433    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815436    2577 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815438    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815441    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815445    2577 flags.go:64] FLAG: --system-cgroups=""
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815447    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815454    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815456    2577 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815459    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815463    2577 flags.go:64] FLAG: --tls-min-version=""
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815466    2577 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815469    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815471    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815474    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815476    2577 flags.go:64] FLAG: --v="2"
Jul 28 10:07:46.822082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815480    2577 flags.go:64] FLAG: --version="false"
Jul 28 10:07:46.822704 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815484    2577 flags.go:64] FLAG: --vmodule=""
Jul 28 10:07:46.822704 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815487    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 10:07:46.822704 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.815490    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 10:07:46.822704 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815598    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 10:07:46.822704 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815602    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 10:07:46.822704 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815607    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 10:07:46.822704 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815610    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 10:07:46.822704 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815614    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 10:07:46.822704 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815617    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 10:07:46.822704 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815620    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 10:07:46.822704 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815623    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 10:07:46.822704 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815626    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 10:07:46.822704 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815629    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 10:07:46.822704 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815631    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 10:07:46.822704 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815634    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 10:07:46.822704 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815637    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 10:07:46.822704 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815640    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 10:07:46.822704 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815642    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 10:07:46.822704 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815645    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 10:07:46.822704 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815648    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 10:07:46.823198 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815650    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 10:07:46.823198 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815653    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 10:07:46.823198 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815657    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 10:07:46.823198 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815660    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 10:07:46.823198 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815662    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 10:07:46.823198 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815665    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 10:07:46.823198 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815667    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 10:07:46.823198 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815670    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 10:07:46.823198 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815672    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 10:07:46.823198 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815675    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 10:07:46.823198 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815677    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 10:07:46.823198 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815680    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 10:07:46.823198 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815682    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 10:07:46.823198 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815684    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 10:07:46.823198 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815687    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 10:07:46.823198 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815689    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 10:07:46.823198 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815692    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 10:07:46.823198 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815696    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 10:07:46.823198 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815698    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 10:07:46.823747 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815701    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 10:07:46.823747 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815703    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 10:07:46.823747 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815706    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 10:07:46.823747 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815708    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 10:07:46.823747 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815711    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 10:07:46.823747 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815713    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 10:07:46.823747 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815716    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 10:07:46.823747 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815718    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 10:07:46.823747 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815721    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 10:07:46.823747 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815725    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 10:07:46.823747 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815728    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 10:07:46.823747 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815730    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 10:07:46.823747 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815733    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 10:07:46.823747 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815735    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 10:07:46.823747 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815738    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 10:07:46.823747 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815742    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 10:07:46.823747 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815745    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 10:07:46.823747 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815747    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 10:07:46.823747 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815749    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 10:07:46.823747 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815752    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 10:07:46.824271 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815754    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 10:07:46.824271 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815757    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 10:07:46.824271 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815759    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 10:07:46.824271 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815762    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 10:07:46.824271 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815764    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 10:07:46.824271 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815767    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 10:07:46.824271 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815769    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 10:07:46.824271 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815771    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 10:07:46.824271 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815774    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 10:07:46.824271 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815776    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 10:07:46.824271 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815780    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 10:07:46.824271 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815782    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 10:07:46.824271 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815785    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 10:07:46.824271 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815787    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 10:07:46.824271 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815790    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 10:07:46.824271 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815792    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 10:07:46.824271 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815795    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 10:07:46.824271 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815797    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 10:07:46.824271 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815799    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 10:07:46.824271 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815802    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 10:07:46.824766 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815805    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 10:07:46.824766 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815807    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 10:07:46.824766 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815809    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 10:07:46.824766 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815812    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 10:07:46.824766 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815814    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 10:07:46.824766 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815817    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 10:07:46.824766 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815819    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 10:07:46.824766 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815823    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 10:07:46.824766 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815826    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 10:07:46.824766 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815828    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 10:07:46.824766 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815831    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 10:07:46.824766 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815834    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 10:07:46.824766 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815852    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 10:07:46.824766 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815855    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 10:07:46.824766 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815857    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 10:07:46.824766 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815860    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 10:07:46.824766 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815862    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 10:07:46.824766 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815864    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 10:07:46.824766 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815867    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 10:07:46.824766 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815870    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 10:07:46.825268 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815872    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 10:07:46.825268 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815875    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 10:07:46.825268 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.815878    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 10:07:46.825268 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.816413    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 10:07:46.825268 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.823091    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 10:07:46.825268 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.823105    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 10:07:46.825268 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.823126    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 10:07:46.825268 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.823132    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 10:07:46.825268 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823186    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 10:07:46.825268 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823191    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 10:07:46.825268 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823195    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 10:07:46.825268 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823198    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 10:07:46.825268 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823201    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 10:07:46.825268 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823204    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 10:07:46.825613 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823207    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 10:07:46.825613 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823210    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 10:07:46.825613 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823213    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 10:07:46.825613 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823216    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 10:07:46.825613 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823219    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 10:07:46.825613 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823221    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 10:07:46.825613 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823225    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 10:07:46.825613 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823228    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 10:07:46.825613 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823230    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 10:07:46.825613 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823233    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 10:07:46.825613 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823236    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 10:07:46.825613 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823239    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 10:07:46.825613 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823241    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 10:07:46.825613 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823243    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 10:07:46.825613 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823246    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 10:07:46.825613 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823249    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 10:07:46.825613 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823251    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 10:07:46.825613 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823253    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 10:07:46.825613 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823257    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 10:07:46.826095 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823261    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 10:07:46.826095 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823264    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 10:07:46.826095 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823267    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 10:07:46.826095 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823270    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 10:07:46.826095 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823275    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 10:07:46.826095 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823277    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 10:07:46.826095 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823280    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 10:07:46.826095 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823283    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 10:07:46.826095 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823285    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 10:07:46.826095 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823288    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 10:07:46.826095 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823290    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 10:07:46.826095 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823293    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 10:07:46.826095 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823296    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 10:07:46.826095 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823299    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 10:07:46.826095 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823302    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 10:07:46.826095 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823304    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 10:07:46.826095 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823307    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 10:07:46.826095 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823311    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 10:07:46.826095 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823314    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 10:07:46.826095 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823317    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 10:07:46.826620 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823319    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 10:07:46.826620 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823322    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 10:07:46.826620 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823326    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 10:07:46.826620 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823329    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 10:07:46.826620 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823332    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 10:07:46.826620 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823335    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 10:07:46.826620 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823338    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 10:07:46.826620 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823341    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 10:07:46.826620 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823343    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 10:07:46.826620 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823346    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 10:07:46.826620 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823349    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 10:07:46.826620 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823351    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 10:07:46.826620 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823354    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 10:07:46.826620 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823356    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 10:07:46.826620 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823359    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 10:07:46.826620 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823362    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 10:07:46.826620 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823364    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 10:07:46.826620 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823368    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 10:07:46.826620 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823370    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 10:07:46.827093 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823373    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 10:07:46.827093 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823375    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 10:07:46.827093 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823378    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 10:07:46.827093 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823380    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 10:07:46.827093 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823383    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 10:07:46.827093 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823385    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 10:07:46.827093 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823388    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 10:07:46.827093 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823390    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 10:07:46.827093 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823392    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 10:07:46.827093 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823394    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 10:07:46.827093 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823397    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 10:07:46.827093 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823400    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 10:07:46.827093 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823402    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 10:07:46.827093 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823404    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 10:07:46.827093 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823407    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 10:07:46.827093 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823410    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 10:07:46.827093 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823412    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 10:07:46.827093 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823415    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 10:07:46.827093 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823417    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 10:07:46.827093 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823420    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 10:07:46.827594 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823422    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 10:07:46.827594 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823425    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 10:07:46.827594 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823427    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 10:07:46.827594 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823429    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 10:07:46.827594 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823432    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 10:07:46.827594 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823434    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 10:07:46.827594 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823436    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 10:07:46.827594 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823439    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 10:07:46.827594 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823442    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 10:07:46.827594 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823444    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 10:07:46.827594 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823447    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 10:07:46.827594 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823449    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 10:07:46.827594 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823452    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 10:07:46.827594 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823454    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 10:07:46.827594 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823457    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 10:07:46.828067 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.823461    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 10:07:46.828067 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823574    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 10:07:46.828067 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823578    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 10:07:46.828067 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823581    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 10:07:46.828067 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823584    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 10:07:46.828067 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823587    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 10:07:46.828067 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823590    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 10:07:46.828067 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823592    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 10:07:46.828067 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823595    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 10:07:46.828067 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823598    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 10:07:46.828067 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823600    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 10:07:46.828067 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823602    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 10:07:46.828067 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823605    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 10:07:46.828067 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823607    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 10:07:46.828067 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823610    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 10:07:46.828423 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823612    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 10:07:46.828423 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823615    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 10:07:46.828423 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823617    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 10:07:46.828423 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823620    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 10:07:46.828423 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823622    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 10:07:46.828423 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823625    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 10:07:46.828423 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823627    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 10:07:46.828423 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823630    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 10:07:46.828423 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823632    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 10:07:46.828423 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823634    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 10:07:46.828423 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823637    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 10:07:46.828423 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823640    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 10:07:46.828423 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823642    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 10:07:46.828423 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823644    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 10:07:46.828423 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823647    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 10:07:46.828423 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823650    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 10:07:46.828423 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823652    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 10:07:46.828423 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823655    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 10:07:46.828423 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823657    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 10:07:46.828914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823660    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 10:07:46.828914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823663    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 10:07:46.828914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823665    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 10:07:46.828914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823667    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 10:07:46.828914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823670    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 10:07:46.828914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823672    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 10:07:46.828914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823675    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 10:07:46.828914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823677    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 10:07:46.828914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823679    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 10:07:46.828914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823682    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 10:07:46.828914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823684    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 10:07:46.828914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823686    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 10:07:46.828914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823689    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 10:07:46.828914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823692    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 10:07:46.828914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823696    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 10:07:46.828914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823699    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 10:07:46.828914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823701    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 10:07:46.828914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823703    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 10:07:46.828914 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823706    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 10:07:46.829397 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823708    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 10:07:46.829397 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823711    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 10:07:46.829397 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823713    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 10:07:46.829397 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823715    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 10:07:46.829397 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823718    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 10:07:46.829397 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823720    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 10:07:46.829397 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823723    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 10:07:46.829397 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823725    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 10:07:46.829397 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823727    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 10:07:46.829397 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823730    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 10:07:46.829397 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823733    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 10:07:46.829397 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823735    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 10:07:46.829397 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823737    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 10:07:46.829397 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823740    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 10:07:46.829397 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823742    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 10:07:46.829397 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823744    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 10:07:46.829397 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823747    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 10:07:46.829397 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823749    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 10:07:46.829397 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823752    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 10:07:46.829397 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823755    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 10:07:46.829896 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823757    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 10:07:46.829896 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823760    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 10:07:46.829896 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823762    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 10:07:46.829896 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823765    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 10:07:46.829896 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823767    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 10:07:46.829896 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823769    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 10:07:46.829896 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823772    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 10:07:46.829896 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823774    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 10:07:46.829896 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823777    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 10:07:46.829896 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823780    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 10:07:46.829896 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823783    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 10:07:46.829896 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823787    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 10:07:46.829896 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823789    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 10:07:46.829896 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823792    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 10:07:46.829896 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823795    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 10:07:46.829896 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823798    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 10:07:46.829896 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823801    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 10:07:46.829896 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823803    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 10:07:46.829896 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823806    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 10:07:46.830342 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823808    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 10:07:46.830342 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823811    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 10:07:46.830342 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823813    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 10:07:46.830342 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823816    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 10:07:46.830342 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823818    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 10:07:46.830342 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823822    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 10:07:46.830342 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823826    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 10:07:46.830342 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:46.823832    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 10:07:46.830342 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.823853    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 10:07:46.830342 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.823964    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 10:07:46.830342 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.825919    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 10:07:46.830342 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.827194    2577 server.go:1019] "Starting client certificate rotation"
Jul 28 10:07:46.830342 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.827299    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 10:07:46.830342 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.827343    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 10:07:46.830754 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.829963    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 10:07:46.834162 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.834143    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 10:07:46.843270 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.843252    2577 log.go:25] "Validated CRI v1 runtime API"
Jul 28 10:07:46.845129 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.845114    2577 log.go:25] "Validated CRI v1 image API"
Jul 28 10:07:46.845957 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.845938    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 10:07:46.849301 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.849281    2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bc9f135b-ebed-44d8-97f7-ee780bd9c4a1:/dev/nvme0n1p4 c4dcca5e-8ad3-41cd-947f-2e1fceaa9934:/dev/nvme0n1p3]
Jul 28 10:07:46.849365 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.849299    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 10:07:46.854291 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.854186    2577 manager.go:216] Machine: {Timestamp:2026-07-28 10:07:46.852986594 +0000 UTC m=+0.255224985 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106594 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fe034c9c6b2c53073b5555055d950 SystemUUID:ec2fe034-c9c6-b2c5-3073-b5555055d950 BootID:88a2a720-a878-4aa7-a072-825c7d2ff772 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c5:9d:4b:7f:dd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c5:9d:4b:7f:dd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:ee:25:63:3b:cd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 10:07:46.854291 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.854285    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 10:07:46.854400 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.854393    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 10:07:46.857060 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.857033    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 10:07:46.857190 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.857061    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-175.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 10:07:46.857685 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.857675    2577 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 10:07:46.857716 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.857691    2577 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 10:07:46.857716 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.857701    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 10:07:46.857777 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.857714    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 10:07:46.858897 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.858886    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 10:07:46.860615 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.860598    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 10:07:46.862553 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.862541    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 10:07:46.862682 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.862672    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 10:07:46.862722 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.862705    2577 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 10:07:46.862722 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.862720    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 10:07:46.862785 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.862741    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 10:07:46.862785 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.862755    2577 kubelet.go:398] "Adding apiserver pod source"
Jul 28 10:07:46.862785 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.862767    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 10:07:46.863218 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.863182    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 10:07:46.863271 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.863248    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 10:07:46.865115 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.865101    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 10:07:46.866772 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.866758    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 10:07:46.866831 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.866789    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 10:07:46.868269 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.868258    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 10:07:46.868310 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.868274    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 10:07:46.868310 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.868281    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 10:07:46.868310 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.868287    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 10:07:46.868310 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.868295    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 10:07:46.868310 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.868304    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 10:07:46.868435 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.868314    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 10:07:46.868435 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.868319    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 10:07:46.868435 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.868325    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 10:07:46.868435 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.868332    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 10:07:46.868435 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.868346    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 10:07:46.868435 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.868351    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 10:07:46.869524 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.869513    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 10:07:46.869564 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.869526    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 10:07:46.872997 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.872966    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-175.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 10:07:46.873077 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:46.873007    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 10:07:46.873077 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:46.873029    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-175.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 10:07:46.873684 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.873670    2577 server.go:1268] "Started kubelet"
Jul 28 10:07:46.873779 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.873752    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 10:07:46.873866 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.873805    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 10:07:46.873866 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.873758    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 10:07:46.874576 ip-10-0-140-175 systemd[1]: Started Kubernetes Kubelet.
Jul 28 10:07:46.875352 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.875335    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 10:07:46.875709 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.875696    2577 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 10:07:46.880348 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:46.880328    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 10:07:46.881309 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.881296    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 10:07:46.881385 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.881363    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 10:07:46.881560 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:46.881539    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-175.ec2.internal\" not found"
Jul 28 10:07:46.881901 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.881883    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 10:07:46.881901 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.881883    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 10:07:46.882055 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.881913    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 10:07:46.882055 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.881990    2577 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 10:07:46.882055 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.882000    2577 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 10:07:46.882188 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.882146    2577 factory.go:55] Registering systemd factory
Jul 28 10:07:46.882188 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.882186    2577 factory.go:223] Registration of the systemd container factory successfully
Jul 28 10:07:46.882365 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.882348    2577 factory.go:153] Registering CRI-O factory
Jul 28 10:07:46.882410 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.882369    2577 factory.go:223] Registration of the crio container factory successfully
Jul 28 10:07:46.882450 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.882422    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 10:07:46.882450 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.882447    2577 factory.go:103] Registering Raw factory
Jul 28 10:07:46.882553 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.882463    2577 manager.go:1196] Started watching for new ooms in manager
Jul 28 10:07:46.882925 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:46.882056    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-175.ec2.internal.18c66c3299368229  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-175.ec2.internal,UID:ip-10-0-140-175.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-175.ec2.internal,},FirstTimestamp:2026-07-28 10:07:46.873631273 +0000 UTC m=+0.275869663,LastTimestamp:2026-07-28 10:07:46.873631273 +0000 UTC m=+0.275869663,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-175.ec2.internal,}"
Jul 28 10:07:46.882925 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.882915    2577 manager.go:349] Starting recovery of all containers
Jul 28 10:07:46.887579 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:46.887558    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 10:07:46.887672 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:46.887650    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-175.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 10:07:46.893533 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.893517    2577 manager.go:354] Recovery completed
Jul 28 10:07:46.897462 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:46.897439    2577 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 28 10:07:46.900425 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.900413    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 10:07:46.902287 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.902270    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 10:07:46.902360 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.902299    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 10:07:46.902360 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.902308    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientPID"
Jul 28 10:07:46.902923 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.902910    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 10:07:46.903002 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.902910    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 10:07:46.903043 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.903005    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 10:07:46.903043 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.903024    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 10:07:46.903681 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.903666    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 10:07:46.903741 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.903695    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 10:07:46.903741 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.903708    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientPID"
Jul 28 10:07:46.904212 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:46.904139    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-175.ec2.internal.18c66c329aebc132  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-175.ec2.internal,UID:ip-10-0-140-175.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-175.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-175.ec2.internal,},FirstTimestamp:2026-07-28 10:07:46.902286642 +0000 UTC m=+0.304525031,LastTimestamp:2026-07-28 10:07:46.902286642 +0000 UTC m=+0.304525031,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-175.ec2.internal,}"
Jul 28 10:07:46.905587 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.905575    2577 policy_none.go:49] "None policy: Start"
Jul 28 10:07:46.905627 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.905591    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 10:07:46.905627 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.905601    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 10:07:46.907467 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.907457    2577 policy_none.go:47] "Start"
Jul 28 10:07:46.913790 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:46.913722    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-175.ec2.internal.18c66c329aec038f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-175.ec2.internal,UID:ip-10-0-140-175.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-175.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-175.ec2.internal,},FirstTimestamp:2026-07-28 10:07:46.902303631 +0000 UTC m=+0.304542020,LastTimestamp:2026-07-28 10:07:46.902303631 +0000 UTC m=+0.304542020,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-175.ec2.internal,}"
Jul 28 10:07:46.924124 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:46.923956    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-175.ec2.internal.18c66c329aec25c5  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-175.ec2.internal,UID:ip-10-0-140-175.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-175.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-175.ec2.internal,},FirstTimestamp:2026-07-28 10:07:46.902312389 +0000 UTC m=+0.304550778,LastTimestamp:2026-07-28 10:07:46.902312389 +0000 UTC m=+0.304550778,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-175.ec2.internal,}"
Jul 28 10:07:46.932391 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.932374    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sl28f"
Jul 28 10:07:46.933676 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:46.933618    2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-175.ec2.internal.18c66c329aebc132\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-175.ec2.internal.18c66c329aebc132  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-175.ec2.internal,UID:ip-10-0-140-175.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-175.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-175.ec2.internal,},FirstTimestamp:2026-07-28 10:07:46.902286642 +0000 UTC m=+0.304525031,LastTimestamp:2026-07-28 10:07:46.903679772 +0000 UTC m=+0.305918165,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-175.ec2.internal,}"
Jul 28 10:07:46.939348 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.939335    2577 manager.go:337] "Starting Device Plugin manager"
Jul 28 10:07:46.939407 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:46.939363    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 10:07:46.939407 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.939372    2577 server.go:87] "Starting device plugin registration server"
Jul 28 10:07:46.939603 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.939592    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 10:07:46.939637 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.939604    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 10:07:46.939707 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.939690    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 10:07:46.939787 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.939772    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 10:07:46.939902 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.939785    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 10:07:46.940360 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:46.940338    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 10:07:46.940444 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:46.940399    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-175.ec2.internal\" not found"
Jul 28 10:07:46.942662 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:46.942607    2577 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-140-175.ec2.internal.18c66c329aec038f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-175.ec2.internal.18c66c329aec038f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-175.ec2.internal,UID:ip-10-0-140-175.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-175.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-175.ec2.internal,},FirstTimestamp:2026-07-28 10:07:46.902303631 +0000 UTC m=+0.304542020,LastTimestamp:2026-07-28 10:07:46.903702355 +0000 UTC m=+0.305940743,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-175.ec2.internal,}"
Jul 28 10:07:46.943754 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.943739    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sl28f"
Jul 28 10:07:46.953791 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:46.953775    2577 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2609 into the system container \"/system.slice\": <nil>"
Jul 28 10:07:47.037358 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.037326    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 10:07:47.039502 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.038591    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 10:07:47.039502 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.038637    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 10:07:47.039502 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.038661    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 10:07:47.039502 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:47.038703    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 10:07:47.039674 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.039646    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 10:07:47.040469 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.040451    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 10:07:47.040578 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.040489    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 10:07:47.040578 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.040504    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientPID"
Jul 28 10:07:47.040578 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.040532    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-175.ec2.internal"
Jul 28 10:07:47.041542 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.041528    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 10:07:47.050096 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.050081    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-175.ec2.internal"
Jul 28 10:07:47.050150 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:47.050100    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-175.ec2.internal\": node \"ip-10-0-140-175.ec2.internal\" not found"
Jul 28 10:07:47.072834 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:47.072817    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-175.ec2.internal\" not found"
Jul 28 10:07:47.139440 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.139417    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-175.ec2.internal"]
Jul 28 10:07:47.139538 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.139480    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 10:07:47.140869 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.140854    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 10:07:47.140954 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.140884    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 10:07:47.140954 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.140900    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientPID"
Jul 28 10:07:47.143174 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.143160    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 10:07:47.143299 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.143285    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal"
Jul 28 10:07:47.143346 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.143312    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 10:07:47.143879 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.143864    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 10:07:47.143968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.143892    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 10:07:47.143968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.143912    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientPID"
Jul 28 10:07:47.143968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.143915    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 10:07:47.143968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.143934    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 10:07:47.143968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.143942    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientPID"
Jul 28 10:07:47.146120 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.146103    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-175.ec2.internal"
Jul 28 10:07:47.146176 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.146132    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 10:07:47.146754 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.146742    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 10:07:47.146818 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.146768    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 10:07:47.146818 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.146785    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeHasSufficientPID"
Jul 28 10:07:47.173316 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:47.173297    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-175.ec2.internal\" not found"
Jul 28 10:07:47.178442 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:47.178426    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-175.ec2.internal\" not found" node="ip-10-0-140-175.ec2.internal"
Jul 28 10:07:47.182796 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:47.182781    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-175.ec2.internal\" not found" node="ip-10-0-140-175.ec2.internal"
Jul 28 10:07:47.273514 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:47.273488    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-175.ec2.internal\" not found"
Jul 28 10:07:47.282767 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.282742    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/59086c5e245afc5c657648266b073d96-config\") pod \"kube-apiserver-proxy-ip-10-0-140-175.ec2.internal\" (UID: \"59086c5e245afc5c657648266b073d96\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-175.ec2.internal"
Jul 28 10:07:47.282882 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.282772    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/432bde8bde3ecc017eb0427e4b34b805-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal\" (UID: \"432bde8bde3ecc017eb0427e4b34b805\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal"
Jul 28 10:07:47.282882 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.282806    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/432bde8bde3ecc017eb0427e4b34b805-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal\" (UID: \"432bde8bde3ecc017eb0427e4b34b805\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal"
Jul 28 10:07:47.374251 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:47.374196    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-175.ec2.internal\" not found"
Jul 28 10:07:47.383500 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.383466    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/432bde8bde3ecc017eb0427e4b34b805-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal\" (UID: \"432bde8bde3ecc017eb0427e4b34b805\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal"
Jul 28 10:07:47.383561 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.383505    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/432bde8bde3ecc017eb0427e4b34b805-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal\" (UID: \"432bde8bde3ecc017eb0427e4b34b805\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal"
Jul 28 10:07:47.383561 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.383526    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/59086c5e245afc5c657648266b073d96-config\") pod \"kube-apiserver-proxy-ip-10-0-140-175.ec2.internal\" (UID: \"59086c5e245afc5c657648266b073d96\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-175.ec2.internal"
Jul 28 10:07:47.383655 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.383574    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/432bde8bde3ecc017eb0427e4b34b805-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal\" (UID: \"432bde8bde3ecc017eb0427e4b34b805\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal"
Jul 28 10:07:47.383655 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.383586    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/432bde8bde3ecc017eb0427e4b34b805-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal\" (UID: \"432bde8bde3ecc017eb0427e4b34b805\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal"
Jul 28 10:07:47.383655 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.383617    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/59086c5e245afc5c657648266b073d96-config\") pod \"kube-apiserver-proxy-ip-10-0-140-175.ec2.internal\" (UID: \"59086c5e245afc5c657648266b073d96\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-175.ec2.internal"
Jul 28 10:07:47.474672 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:47.474640    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-175.ec2.internal\" not found"
Jul 28 10:07:47.480807 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.480790    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal"
Jul 28 10:07:47.486792 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.486773    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-175.ec2.internal"
Jul 28 10:07:47.575491 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:47.575455    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-175.ec2.internal\" not found"
Jul 28 10:07:47.676043 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:47.675969    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-175.ec2.internal\" not found"
Jul 28 10:07:47.717673 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.717645    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 10:07:47.776668 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:47.776639    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-175.ec2.internal\" not found"
Jul 28 10:07:47.827200 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.827167    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 10:07:47.827647 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.827341    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 10:07:47.827647 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.827346    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 10:07:47.876943 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:47.876912    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-175.ec2.internal\" not found"
Jul 28 10:07:47.948445 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.948367    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 10:02:46 +0000 UTC" deadline="2028-02-13 13:28:37.899844745 +0000 UTC"
Jul 28 10:07:47.948445 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.948402    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13563h20m49.951447937s"
Jul 28 10:07:47.977533 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:47.977507    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-175.ec2.internal\" not found"
Jul 28 10:07:47.993088 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:47.993066    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 10:07:48.007329 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:48.007295    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod432bde8bde3ecc017eb0427e4b34b805.slice/crio-bf565ee93f601b51141f407d46345070cc46db1865de99360d23019a05bfebc5 WatchSource:0}: Error finding container bf565ee93f601b51141f407d46345070cc46db1865de99360d23019a05bfebc5: Status 404 returned error can't find the container with id bf565ee93f601b51141f407d46345070cc46db1865de99360d23019a05bfebc5
Jul 28 10:07:48.007551 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:48.007532    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59086c5e245afc5c657648266b073d96.slice/crio-188af99201f942205d650e7c9c325ab024ce41bea29b1a7ec2793b5de49d7bf9 WatchSource:0}: Error finding container 188af99201f942205d650e7c9c325ab024ce41bea29b1a7ec2793b5de49d7bf9: Status 404 returned error can't find the container with id 188af99201f942205d650e7c9c325ab024ce41bea29b1a7ec2793b5de49d7bf9
Jul 28 10:07:48.012898 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.012885    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 10:07:48.041615 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.041560    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal" event={"ID":"432bde8bde3ecc017eb0427e4b34b805","Type":"ContainerStarted","Data":"bf565ee93f601b51141f407d46345070cc46db1865de99360d23019a05bfebc5"}
Jul 28 10:07:48.042558 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.042538    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-175.ec2.internal" event={"ID":"59086c5e245afc5c657648266b073d96","Type":"ContainerStarted","Data":"188af99201f942205d650e7c9c325ab024ce41bea29b1a7ec2793b5de49d7bf9"}
Jul 28 10:07:48.082030 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.082011    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-175.ec2.internal"
Jul 28 10:07:48.091963 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.091948    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 10:07:48.093407 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.093396    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal"
Jul 28 10:07:48.107218 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.107202    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 10:07:48.187704 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.187683    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 10:07:48.864614 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.864584    2577 apiserver.go:52] "Watching apiserver"
Jul 28 10:07:48.874007 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.873985    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 10:07:48.874450 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.874423    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-175.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c","openshift-cluster-node-tuning-operator/tuned-6qk4z","openshift-dns/node-resolver-g59wc","openshift-image-registry/node-ca-k7rg8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal","openshift-multus/multus-additional-cni-plugins-4mfhr","openshift-multus/multus-hcmhj","openshift-multus/network-metrics-daemon-8dw4k","openshift-network-diagnostics/network-check-target-rj8l7","openshift-network-operator/iptables-alerter-z9k86","openshift-ovn-kubernetes/ovnkube-node-nsv94","kube-system/global-pull-secret-syncer-v26n5","kube-system/konnectivity-agent-z8vrl"]
Jul 28 10:07:48.877187 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.877159    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.879295 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.879272    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 10:07:48.879389 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.879358    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:07:48.879471 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.879450    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 10:07:48.879520 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:48.879448    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v26n5" podUID="5536a6cc-73fa-4449-8a5c-d3798c359de8"
Jul 28 10:07:48.879763 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.879741    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 10:07:48.879871 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.879860    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 10:07:48.880220 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.880198    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z87q9\""
Jul 28 10:07:48.880220 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.880211    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 10:07:48.883657 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.883639    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.884748 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.883986    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g59wc"
Jul 28 10:07:48.884748 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.884007    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 10:07:48.885783 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.885688    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 10:07:48.885783 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.885713    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 10:07:48.887002 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.886155    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k7rg8"
Jul 28 10:07:48.887002 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.886248    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 10:07:48.887002 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.886463    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hlc5n\""
Jul 28 10:07:48.887002 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.886625    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wl5rq\""
Jul 28 10:07:48.887002 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.886823    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 10:07:48.888924 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.888191    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z8vrl"
Jul 28 10:07:48.891027 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.889257    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 10:07:48.891027 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.889881    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 10:07:48.891027 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.890220    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 10:07:48.891027 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.890411    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vs8gm\""
Jul 28 10:07:48.891027 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.890878    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:07:48.891027 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:48.890959    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dw4k" podUID="af1264bf-57b1-45a9-8753-f359fe2f0b65"
Jul 28 10:07:48.894172 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.891597    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32577247-d03d-457c-b09c-8a0e7f1ac054-etc-tuned\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.894172 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.891637    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-etc-sysctl-d\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.894172 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.891669    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6f7n\" (UniqueName: \"kubernetes.io/projected/32577247-d03d-457c-b09c-8a0e7f1ac054-kube-api-access-m6f7n\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.894172 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.891697    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d7b8d225-6dc7-4a2b-9201-a47e73ffe254-serviceca\") pod \"node-ca-k7rg8\" (UID: \"d7b8d225-6dc7-4a2b-9201-a47e73ffe254\") " pod="openshift-image-registry/node-ca-k7rg8"
Jul 28 10:07:48.894172 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.891726    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-etc-sysctl-conf\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.894172 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.891790    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-etc-systemd\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.894172 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.891823    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 10:07:48.894172 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.891861    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-sys\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.894172 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.891893    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-var-lib-kubelet\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.894172 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892007    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5536a6cc-73fa-4449-8a5c-d3798c359de8-kubelet-config\") pod \"global-pull-secret-syncer-v26n5\" (UID: \"5536a6cc-73fa-4449-8a5c-d3798c359de8\") " pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:07:48.894172 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892042    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-run\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.894172 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892095    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-etc-modprobe-d\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.894172 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892123    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-etc-kubernetes\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.894172 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892135    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hfjdr\""
Jul 28 10:07:48.894172 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892149    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7b8d225-6dc7-4a2b-9201-a47e73ffe254-host\") pod \"node-ca-k7rg8\" (UID: \"d7b8d225-6dc7-4a2b-9201-a47e73ffe254\") " pod="openshift-image-registry/node-ca-k7rg8"
Jul 28 10:07:48.894172 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892176    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75a3cd6d-6743-42dd-953e-b7270ecbe64e-cnibin\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.894172 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892204    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75a3cd6d-6743-42dd-953e-b7270ecbe64e-os-release\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.894172 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892229    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjtz5\" (UniqueName: \"kubernetes.io/projected/75a3cd6d-6743-42dd-953e-b7270ecbe64e-kube-api-access-bjtz5\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.894919 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892260    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5536a6cc-73fa-4449-8a5c-d3798c359de8-dbus\") pod \"global-pull-secret-syncer-v26n5\" (UID: \"5536a6cc-73fa-4449-8a5c-d3798c359de8\") " pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:07:48.894919 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892288    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-etc-sysconfig\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.894919 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892339    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-lib-modules\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.894919 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892364    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/166cc762-9ac9-414d-bc70-1cc5d7a9d718-hosts-file\") pod \"node-resolver-g59wc\" (UID: \"166cc762-9ac9-414d-bc70-1cc5d7a9d718\") " pod="openshift-dns/node-resolver-g59wc"
Jul 28 10:07:48.894919 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892393    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv7xz\" (UniqueName: \"kubernetes.io/projected/166cc762-9ac9-414d-bc70-1cc5d7a9d718-kube-api-access-wv7xz\") pod \"node-resolver-g59wc\" (UID: \"166cc762-9ac9-414d-bc70-1cc5d7a9d718\") " pod="openshift-dns/node-resolver-g59wc"
Jul 28 10:07:48.894919 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892426    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75a3cd6d-6743-42dd-953e-b7270ecbe64e-cni-binary-copy\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.894919 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892454    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-host\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.894919 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892498    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/166cc762-9ac9-414d-bc70-1cc5d7a9d718-tmp-dir\") pod \"node-resolver-g59wc\" (UID: \"166cc762-9ac9-414d-bc70-1cc5d7a9d718\") " pod="openshift-dns/node-resolver-g59wc"
Jul 28 10:07:48.894919 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892529    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75a3cd6d-6743-42dd-953e-b7270ecbe64e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.894919 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892547    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75a3cd6d-6743-42dd-953e-b7270ecbe64e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.894919 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892568    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75a3cd6d-6743-42dd-953e-b7270ecbe64e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.894919 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892610    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32577247-d03d-457c-b09c-8a0e7f1ac054-tmp\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.894919 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892685    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgzh2\" (UniqueName: \"kubernetes.io/projected/d7b8d225-6dc7-4a2b-9201-a47e73ffe254-kube-api-access-zgzh2\") pod \"node-ca-k7rg8\" (UID: \"d7b8d225-6dc7-4a2b-9201-a47e73ffe254\") " pod="openshift-image-registry/node-ca-k7rg8"
Jul 28 10:07:48.894919 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.892397    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 10:07:48.894919 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.893357    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75a3cd6d-6743-42dd-953e-b7270ecbe64e-system-cni-dir\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.894919 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.893399    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret\") pod \"global-pull-secret-syncer-v26n5\" (UID: \"5536a6cc-73fa-4449-8a5c-d3798c359de8\") " pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:07:48.894919 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.893706    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:48.895759 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.895585    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 10:07:48.895881 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.895863    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 10:07:48.895960 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.895937    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s9fw5\""
Jul 28 10:07:48.896509 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.896492    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:48.898390 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.898371    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 10:07:48.898651 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.898632    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p9l6p\""
Jul 28 10:07:48.898757 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.898737    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 10:07:48.898930 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.898912    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 10:07:48.899073 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.899053    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:07:48.899162 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:48.899136    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj8l7" podUID="0b17897e-d028-4f8b-ba02-5f5a0de532e7"
Jul 28 10:07:48.901117 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.901098    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z9k86"
Jul 28 10:07:48.907631 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.903435    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 10:07:48.907631 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.903621    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 10:07:48.907631 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.903945    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jzdx6\""
Jul 28 10:07:48.907631 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.904205    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:48.907631 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.905069    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 10:07:48.907631 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.906009    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 10:07:48.907631 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.906416    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 10:07:48.907631 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.907227    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 10:07:48.907631 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.907419    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 10:07:48.907631 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.907527    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 10:07:48.907631 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.907419    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p57kj\""
Jul 28 10:07:48.908290 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.908049    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 10:07:48.914750 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.914724    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tkrw5"
Jul 28 10:07:48.922535 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.922516    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tkrw5"
Jul 28 10:07:48.983039 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.983014    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 10:07:48.993553 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.993531    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-run-openvswitch\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:48.993689 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.993558    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/08f379a0-030f-490c-8f02-22278e6e2fb9-ovnkube-config\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:48.993689 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.993577    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/08f379a0-030f-490c-8f02-22278e6e2fb9-env-overrides\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:48.993689 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.993623    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgzh2\" (UniqueName: \"kubernetes.io/projected/d7b8d225-6dc7-4a2b-9201-a47e73ffe254-kube-api-access-zgzh2\") pod \"node-ca-k7rg8\" (UID: \"d7b8d225-6dc7-4a2b-9201-a47e73ffe254\") " pod="openshift-image-registry/node-ca-k7rg8"
Jul 28 10:07:48.993689 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.993647    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/daa091f9-dcf8-4259-ae5d-22cec31c3676-cni-binary-copy\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:48.994012 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.993704    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6657cdfc-7df6-47c1-8c2c-71d047c76a2b-socket-dir\") pod \"aws-ebs-csi-driver-node-jtq4c\" (UID: \"6657cdfc-7df6-47c1-8c2c-71d047c76a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:48.994012 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.993737    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-etc-openvswitch\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:48.994012 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.993771    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32577247-d03d-457c-b09c-8a0e7f1ac054-etc-tuned\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.994012 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.993786    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-multus-cni-dir\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:48.994012 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.993819    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkxfh\" (UniqueName: \"kubernetes.io/projected/daa091f9-dcf8-4259-ae5d-22cec31c3676-kube-api-access-nkxfh\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:48.994012 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.993862    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bda53755-d48d-4341-977a-20e3b5c41842-iptables-alerter-script\") pod \"iptables-alerter-z9k86\" (UID: \"bda53755-d48d-4341-977a-20e3b5c41842\") " pod="openshift-network-operator/iptables-alerter-z9k86"
Jul 28 10:07:48.994012 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.993906    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-run-systemd\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:48.994012 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.993937    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-node-log\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:48.994012 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.993976    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-host-cni-bin\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:48.994012 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994014    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-etc-sysctl-d\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.994487 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994034    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-host-run-netns\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:48.994487 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994051    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-etc-systemd\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.994487 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994073    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5536a6cc-73fa-4449-8a5c-d3798c359de8-kubelet-config\") pod \"global-pull-secret-syncer-v26n5\" (UID: \"5536a6cc-73fa-4449-8a5c-d3798c359de8\") " pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:07:48.994487 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994094    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-host-var-lib-cni-multus\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:48.994487 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994126    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-multus-conf-dir\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:48.994487 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994147    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-run\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.994487 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994155    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-etc-systemd\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.994487 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-host-run-netns\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:48.994487 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994174    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 10:07:48.994487 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994192    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6657cdfc-7df6-47c1-8c2c-71d047c76a2b-registration-dir\") pod \"aws-ebs-csi-driver-node-jtq4c\" (UID: \"6657cdfc-7df6-47c1-8c2c-71d047c76a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:48.994487 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994196    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-etc-sysctl-d\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.994487 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994233    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xz68\" (UniqueName: \"kubernetes.io/projected/af1264bf-57b1-45a9-8753-f359fe2f0b65-kube-api-access-6xz68\") pod \"network-metrics-daemon-8dw4k\" (UID: \"af1264bf-57b1-45a9-8753-f359fe2f0b65\") " pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:07:48.994487 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994262    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-host-slash\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:48.994487 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994272    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-run\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.994487 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994282    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/08f379a0-030f-490c-8f02-22278e6e2fb9-ovn-node-metrics-cert\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:48.994487 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994301    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-etc-modprobe-d\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.994487 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994339    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-etc-kubernetes\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.995367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994361    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7b8d225-6dc7-4a2b-9201-a47e73ffe254-host\") pod \"node-ca-k7rg8\" (UID: \"d7b8d225-6dc7-4a2b-9201-a47e73ffe254\") " pod="openshift-image-registry/node-ca-k7rg8"
Jul 28 10:07:48.995367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994396    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-etc-modprobe-d\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.995367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994412    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75a3cd6d-6743-42dd-953e-b7270ecbe64e-os-release\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.995367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994413    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-etc-kubernetes\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.995367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994448    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d7b8d225-6dc7-4a2b-9201-a47e73ffe254-host\") pod \"node-ca-k7rg8\" (UID: \"d7b8d225-6dc7-4a2b-9201-a47e73ffe254\") " pod="openshift-image-registry/node-ca-k7rg8"
Jul 28 10:07:48.995367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994477    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75a3cd6d-6743-42dd-953e-b7270ecbe64e-os-release\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.995367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994452    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5536a6cc-73fa-4449-8a5c-d3798c359de8-dbus\") pod \"global-pull-secret-syncer-v26n5\" (UID: \"5536a6cc-73fa-4449-8a5c-d3798c359de8\") " pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:07:48.995367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994525    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-cnibin\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:48.995367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994565    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-systemd-units\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:48.995367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994579    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5536a6cc-73fa-4449-8a5c-d3798c359de8-dbus\") pod \"global-pull-secret-syncer-v26n5\" (UID: \"5536a6cc-73fa-4449-8a5c-d3798c359de8\") " pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:07:48.995367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994595    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-lib-modules\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.995367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994615    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv7xz\" (UniqueName: \"kubernetes.io/projected/166cc762-9ac9-414d-bc70-1cc5d7a9d718-kube-api-access-wv7xz\") pod \"node-resolver-g59wc\" (UID: \"166cc762-9ac9-414d-bc70-1cc5d7a9d718\") " pod="openshift-dns/node-resolver-g59wc"
Jul 28 10:07:48.995367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994629    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75a3cd6d-6743-42dd-953e-b7270ecbe64e-cni-binary-copy\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.995367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994630    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5536a6cc-73fa-4449-8a5c-d3798c359de8-kubelet-config\") pod \"global-pull-secret-syncer-v26n5\" (UID: \"5536a6cc-73fa-4449-8a5c-d3798c359de8\") " pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:07:48.995367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994644    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-multus-socket-dir-parent\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:48.995367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994668    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnbtc\" (UniqueName: \"kubernetes.io/projected/6657cdfc-7df6-47c1-8c2c-71d047c76a2b-kube-api-access-qnbtc\") pod \"aws-ebs-csi-driver-node-jtq4c\" (UID: \"6657cdfc-7df6-47c1-8c2c-71d047c76a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:48.995367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994689    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-host\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.996198 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994719    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/daa091f9-dcf8-4259-ae5d-22cec31c3676-multus-daemon-config\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:48.996198 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994740    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-etc-kubernetes\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:48.996198 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994762    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqshz\" (UniqueName: \"kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz\") pod \"network-check-target-rj8l7\" (UID: \"0b17897e-d028-4f8b-ba02-5f5a0de532e7\") " pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:07:48.996198 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994784    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bda53755-d48d-4341-977a-20e3b5c41842-host-slash\") pod \"iptables-alerter-z9k86\" (UID: \"bda53755-d48d-4341-977a-20e3b5c41842\") " pod="openshift-network-operator/iptables-alerter-z9k86"
Jul 28 10:07:48.996198 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994804    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-run-ovn\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:48.996198 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994825    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-host-cni-netd\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:48.996198 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994869    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v24fn\" (UniqueName: \"kubernetes.io/projected/08f379a0-030f-490c-8f02-22278e6e2fb9-kube-api-access-v24fn\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:48.996198 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994904    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-host\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.996198 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994919    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32577247-d03d-457c-b09c-8a0e7f1ac054-tmp\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.996198 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994949    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75a3cd6d-6743-42dd-953e-b7270ecbe64e-system-cni-dir\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.996198 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994990    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75a3cd6d-6743-42dd-953e-b7270ecbe64e-system-cni-dir\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.996198 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.994995    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-lib-modules\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.996198 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995063    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret\") pod \"global-pull-secret-syncer-v26n5\" (UID: \"5536a6cc-73fa-4449-8a5c-d3798c359de8\") " pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:07:48.996198 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995101    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-system-cni-dir\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:48.996198 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995126    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6657cdfc-7df6-47c1-8c2c-71d047c76a2b-sys-fs\") pod \"aws-ebs-csi-driver-node-jtq4c\" (UID: \"6657cdfc-7df6-47c1-8c2c-71d047c76a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:48.996198 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995162    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/08f379a0-030f-490c-8f02-22278e6e2fb9-ovnkube-script-lib\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:48.996198 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995190    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6f7n\" (UniqueName: \"kubernetes.io/projected/32577247-d03d-457c-b09c-8a0e7f1ac054-kube-api-access-m6f7n\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.996968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995215    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d7b8d225-6dc7-4a2b-9201-a47e73ffe254-serviceca\") pod \"node-ca-k7rg8\" (UID: \"d7b8d225-6dc7-4a2b-9201-a47e73ffe254\") " pod="openshift-image-registry/node-ca-k7rg8"
Jul 28 10:07:48.996968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995238    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-hostroot\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:48.996968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995308    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-host-run-ovn-kubernetes\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:48.996968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995334    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-etc-sysctl-conf\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.996968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995340    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75a3cd6d-6743-42dd-953e-b7270ecbe64e-cni-binary-copy\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.996968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995360    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-sys\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.996968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995383    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-var-lib-kubelet\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.996968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995407    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f30801a2-932d-4b83-97d7-c61d81b859c5-agent-certs\") pod \"konnectivity-agent-z8vrl\" (UID: \"f30801a2-932d-4b83-97d7-c61d81b859c5\") " pod="kube-system/konnectivity-agent-z8vrl"
Jul 28 10:07:48.996968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995447    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-host-run-multus-certs\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:48.996968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995458    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-var-lib-kubelet\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.996968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995471    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f30801a2-932d-4b83-97d7-c61d81b859c5-konnectivity-ca\") pod \"konnectivity-agent-z8vrl\" (UID: \"f30801a2-932d-4b83-97d7-c61d81b859c5\") " pod="kube-system/konnectivity-agent-z8vrl"
Jul 28 10:07:48.996968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995522    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-os-release\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:48.996968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995545    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-host-run-k8s-cni-cncf-io\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:48.996968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995580    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-etc-sysctl-conf\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.996968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995590    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs\") pod \"network-metrics-daemon-8dw4k\" (UID: \"af1264bf-57b1-45a9-8753-f359fe2f0b65\") " pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:07:48.996968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995620    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-host-kubelet\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:48.996968 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:48.995689    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 10:07:48.996968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995727    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-var-lib-openvswitch\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:48.997611 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995764    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:48.997611 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995807    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d7b8d225-6dc7-4a2b-9201-a47e73ffe254-serviceca\") pod \"node-ca-k7rg8\" (UID: \"d7b8d225-6dc7-4a2b-9201-a47e73ffe254\") " pod="openshift-image-registry/node-ca-k7rg8"
Jul 28 10:07:48.997611 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995817    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-sys\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.997611 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.995967    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75a3cd6d-6743-42dd-953e-b7270ecbe64e-cnibin\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.997611 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.996004    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjtz5\" (UniqueName: \"kubernetes.io/projected/75a3cd6d-6743-42dd-953e-b7270ecbe64e-kube-api-access-bjtz5\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.997611 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.996030    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75a3cd6d-6743-42dd-953e-b7270ecbe64e-cnibin\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.997611 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:48.996035    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret podName:5536a6cc-73fa-4449-8a5c-d3798c359de8 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:49.495999424 +0000 UTC m=+2.898237802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret") pod "global-pull-secret-syncer-v26n5" (UID: "5536a6cc-73fa-4449-8a5c-d3798c359de8") : object "kube-system"/"original-pull-secret" not registered
Jul 28 10:07:48.997611 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.996097    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6657cdfc-7df6-47c1-8c2c-71d047c76a2b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jtq4c\" (UID: \"6657cdfc-7df6-47c1-8c2c-71d047c76a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:48.997611 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.996124    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-874sj\" (UniqueName: \"kubernetes.io/projected/bda53755-d48d-4341-977a-20e3b5c41842-kube-api-access-874sj\") pod \"iptables-alerter-z9k86\" (UID: \"bda53755-d48d-4341-977a-20e3b5c41842\") " pod="openshift-network-operator/iptables-alerter-z9k86"
Jul 28 10:07:48.997611 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.996146    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-log-socket\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:48.997611 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.996175    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-etc-sysconfig\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.997611 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.996198    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/166cc762-9ac9-414d-bc70-1cc5d7a9d718-hosts-file\") pod \"node-resolver-g59wc\" (UID: \"166cc762-9ac9-414d-bc70-1cc5d7a9d718\") " pod="openshift-dns/node-resolver-g59wc"
Jul 28 10:07:48.997611 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.996223    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/32577247-d03d-457c-b09c-8a0e7f1ac054-etc-sysconfig\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.997611 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.996225    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-host-var-lib-cni-bin\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:48.997611 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.996275    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/166cc762-9ac9-414d-bc70-1cc5d7a9d718-hosts-file\") pod \"node-resolver-g59wc\" (UID: \"166cc762-9ac9-414d-bc70-1cc5d7a9d718\") " pod="openshift-dns/node-resolver-g59wc"
Jul 28 10:07:48.997611 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.996291    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-host-var-lib-kubelet\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:48.998294 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.996314    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6657cdfc-7df6-47c1-8c2c-71d047c76a2b-device-dir\") pod \"aws-ebs-csi-driver-node-jtq4c\" (UID: \"6657cdfc-7df6-47c1-8c2c-71d047c76a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:48.998294 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.996338    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6657cdfc-7df6-47c1-8c2c-71d047c76a2b-etc-selinux\") pod \"aws-ebs-csi-driver-node-jtq4c\" (UID: \"6657cdfc-7df6-47c1-8c2c-71d047c76a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:48.998294 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.996363    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/166cc762-9ac9-414d-bc70-1cc5d7a9d718-tmp-dir\") pod \"node-resolver-g59wc\" (UID: \"166cc762-9ac9-414d-bc70-1cc5d7a9d718\") " pod="openshift-dns/node-resolver-g59wc"
Jul 28 10:07:48.998294 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.996386    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75a3cd6d-6743-42dd-953e-b7270ecbe64e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.998294 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.996410    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75a3cd6d-6743-42dd-953e-b7270ecbe64e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.998294 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.996434    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75a3cd6d-6743-42dd-953e-b7270ecbe64e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.998294 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.996618    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75a3cd6d-6743-42dd-953e-b7270ecbe64e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.998294 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.996854    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/166cc762-9ac9-414d-bc70-1cc5d7a9d718-tmp-dir\") pod \"node-resolver-g59wc\" (UID: \"166cc762-9ac9-414d-bc70-1cc5d7a9d718\") " pod="openshift-dns/node-resolver-g59wc"
Jul 28 10:07:48.998294 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.997383    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75a3cd6d-6743-42dd-953e-b7270ecbe64e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.998294 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.997411    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75a3cd6d-6743-42dd-953e-b7270ecbe64e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:48.998294 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.998084    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/32577247-d03d-457c-b09c-8a0e7f1ac054-tmp\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:48.998886 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:48.998865    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/32577247-d03d-457c-b09c-8a0e7f1ac054-etc-tuned\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:49.005855 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.005795    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv7xz\" (UniqueName: \"kubernetes.io/projected/166cc762-9ac9-414d-bc70-1cc5d7a9d718-kube-api-access-wv7xz\") pod \"node-resolver-g59wc\" (UID: \"166cc762-9ac9-414d-bc70-1cc5d7a9d718\") " pod="openshift-dns/node-resolver-g59wc"
Jul 28 10:07:49.006973 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.006949    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6f7n\" (UniqueName: \"kubernetes.io/projected/32577247-d03d-457c-b09c-8a0e7f1ac054-kube-api-access-m6f7n\") pod \"tuned-6qk4z\" (UID: \"32577247-d03d-457c-b09c-8a0e7f1ac054\") " pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:49.009004 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.008858    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgzh2\" (UniqueName: \"kubernetes.io/projected/d7b8d225-6dc7-4a2b-9201-a47e73ffe254-kube-api-access-zgzh2\") pod \"node-ca-k7rg8\" (UID: \"d7b8d225-6dc7-4a2b-9201-a47e73ffe254\") " pod="openshift-image-registry/node-ca-k7rg8"
Jul 28 10:07:49.010281 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.010263    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjtz5\" (UniqueName: \"kubernetes.io/projected/75a3cd6d-6743-42dd-953e-b7270ecbe64e-kube-api-access-bjtz5\") pod \"multus-additional-cni-plugins-4mfhr\" (UID: \"75a3cd6d-6743-42dd-953e-b7270ecbe64e\") " pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:49.064964 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.064937    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 10:07:49.097480 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.097411    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-host-run-ovn-kubernetes\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.097480 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.097456    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f30801a2-932d-4b83-97d7-c61d81b859c5-agent-certs\") pod \"konnectivity-agent-z8vrl\" (UID: \"f30801a2-932d-4b83-97d7-c61d81b859c5\") " pod="kube-system/konnectivity-agent-z8vrl"
Jul 28 10:07:49.097480 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.097479    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-host-run-multus-certs\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.097703 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.097504    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f30801a2-932d-4b83-97d7-c61d81b859c5-konnectivity-ca\") pod \"konnectivity-agent-z8vrl\" (UID: \"f30801a2-932d-4b83-97d7-c61d81b859c5\") " pod="kube-system/konnectivity-agent-z8vrl"
Jul 28 10:07:49.097703 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.097544    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-host-run-ovn-kubernetes\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.097703 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.097555    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-host-run-multus-certs\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.097703 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.097598    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-os-release\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.097703 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.097624    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-host-run-k8s-cni-cncf-io\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.097703 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.097645    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs\") pod \"network-metrics-daemon-8dw4k\" (UID: \"af1264bf-57b1-45a9-8753-f359fe2f0b65\") " pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:07:49.097703 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.097664    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-host-kubelet\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.097703 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.097679    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-os-release\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.097703 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.097692    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-var-lib-openvswitch\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.098110 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.097716    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-host-run-k8s-cni-cncf-io\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.098110 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:49.097756    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 10:07:49.098110 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.097758    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-host-kubelet\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.098110 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.097790    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-var-lib-openvswitch\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.098110 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:49.097807    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs podName:af1264bf-57b1-45a9-8753-f359fe2f0b65 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:49.597789039 +0000 UTC m=+3.000027421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs") pod "network-metrics-daemon-8dw4k" (UID: "af1264bf-57b1-45a9-8753-f359fe2f0b65") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 10:07:49.098110 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.097829    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.098110 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.097877    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6657cdfc-7df6-47c1-8c2c-71d047c76a2b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jtq4c\" (UID: \"6657cdfc-7df6-47c1-8c2c-71d047c76a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:49.098110 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.097888    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.098110 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.097913    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-874sj\" (UniqueName: \"kubernetes.io/projected/bda53755-d48d-4341-977a-20e3b5c41842-kube-api-access-874sj\") pod \"iptables-alerter-z9k86\" (UID: \"bda53755-d48d-4341-977a-20e3b5c41842\") " pod="openshift-network-operator/iptables-alerter-z9k86"
Jul 28 10:07:49.098110 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.097938    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-log-socket\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.098110 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.097957    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6657cdfc-7df6-47c1-8c2c-71d047c76a2b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jtq4c\" (UID: \"6657cdfc-7df6-47c1-8c2c-71d047c76a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:49.098110 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.097962    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-host-var-lib-cni-bin\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.098110 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098012    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-host-var-lib-cni-bin\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.098110 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098021    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-log-socket\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.098110 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-host-var-lib-kubelet\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.098110 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098056    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-host-var-lib-kubelet\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.098110 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098056    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6657cdfc-7df6-47c1-8c2c-71d047c76a2b-device-dir\") pod \"aws-ebs-csi-driver-node-jtq4c\" (UID: \"6657cdfc-7df6-47c1-8c2c-71d047c76a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:49.099079 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098079    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6657cdfc-7df6-47c1-8c2c-71d047c76a2b-etc-selinux\") pod \"aws-ebs-csi-driver-node-jtq4c\" (UID: \"6657cdfc-7df6-47c1-8c2c-71d047c76a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:49.099079 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098093    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6657cdfc-7df6-47c1-8c2c-71d047c76a2b-device-dir\") pod \"aws-ebs-csi-driver-node-jtq4c\" (UID: \"6657cdfc-7df6-47c1-8c2c-71d047c76a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:49.099079 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098105    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-run-openvswitch\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.099079 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098117    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f30801a2-932d-4b83-97d7-c61d81b859c5-konnectivity-ca\") pod \"konnectivity-agent-z8vrl\" (UID: \"f30801a2-932d-4b83-97d7-c61d81b859c5\") " pod="kube-system/konnectivity-agent-z8vrl"
Jul 28 10:07:49.099079 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098127    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/08f379a0-030f-490c-8f02-22278e6e2fb9-ovnkube-config\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.099079 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098128    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-run-openvswitch\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.099079 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098147    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/08f379a0-030f-490c-8f02-22278e6e2fb9-env-overrides\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.099079 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098178    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/daa091f9-dcf8-4259-ae5d-22cec31c3676-cni-binary-copy\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.099079 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098195    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6657cdfc-7df6-47c1-8c2c-71d047c76a2b-etc-selinux\") pod \"aws-ebs-csi-driver-node-jtq4c\" (UID: \"6657cdfc-7df6-47c1-8c2c-71d047c76a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:49.099079 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098202    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6657cdfc-7df6-47c1-8c2c-71d047c76a2b-socket-dir\") pod \"aws-ebs-csi-driver-node-jtq4c\" (UID: \"6657cdfc-7df6-47c1-8c2c-71d047c76a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:49.099079 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098225    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-etc-openvswitch\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.099079 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098251    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-multus-cni-dir\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.099079 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098274    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkxfh\" (UniqueName: \"kubernetes.io/projected/daa091f9-dcf8-4259-ae5d-22cec31c3676-kube-api-access-nkxfh\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.099079 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098300    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bda53755-d48d-4341-977a-20e3b5c41842-iptables-alerter-script\") pod \"iptables-alerter-z9k86\" (UID: \"bda53755-d48d-4341-977a-20e3b5c41842\") " pod="openshift-network-operator/iptables-alerter-z9k86"
Jul 28 10:07:49.099079 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098302    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-etc-openvswitch\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.099079 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098321    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-run-systemd\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.099079 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098345    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-node-log\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.099932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098351    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-multus-cni-dir\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.099932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098370    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-host-cni-bin\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.099932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098393    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6657cdfc-7df6-47c1-8c2c-71d047c76a2b-socket-dir\") pod \"aws-ebs-csi-driver-node-jtq4c\" (UID: \"6657cdfc-7df6-47c1-8c2c-71d047c76a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:49.099932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098400    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-host-run-netns\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.099932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098437    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-host-var-lib-cni-multus\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.099932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098442    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-node-log\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.099932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098471    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-multus-conf-dir\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.099932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098479    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-run-systemd\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.099932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098502    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-host-run-netns\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.099932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098509    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-host-cni-bin\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.099932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098525    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6657cdfc-7df6-47c1-8c2c-71d047c76a2b-registration-dir\") pod \"aws-ebs-csi-driver-node-jtq4c\" (UID: \"6657cdfc-7df6-47c1-8c2c-71d047c76a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:49.099932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098550    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xz68\" (UniqueName: \"kubernetes.io/projected/af1264bf-57b1-45a9-8753-f359fe2f0b65-kube-api-access-6xz68\") pod \"network-metrics-daemon-8dw4k\" (UID: \"af1264bf-57b1-45a9-8753-f359fe2f0b65\") " pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:07:49.099932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098604    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-host-slash\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.099932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098623    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-host-run-netns\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.099932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098626    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/08f379a0-030f-490c-8f02-22278e6e2fb9-env-overrides\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.099932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098628    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/08f379a0-030f-490c-8f02-22278e6e2fb9-ovn-node-metrics-cert\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.099932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098664    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-multus-conf-dir\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.099932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098682    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-host-var-lib-cni-multus\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.100730 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098698    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-host-run-netns\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.100730 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098697    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/08f379a0-030f-490c-8f02-22278e6e2fb9-ovnkube-config\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.100730 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098730    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-cnibin\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.100730 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098734    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/daa091f9-dcf8-4259-ae5d-22cec31c3676-cni-binary-copy\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.100730 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098740    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-host-slash\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.100730 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098763    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6657cdfc-7df6-47c1-8c2c-71d047c76a2b-registration-dir\") pod \"aws-ebs-csi-driver-node-jtq4c\" (UID: \"6657cdfc-7df6-47c1-8c2c-71d047c76a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:49.100730 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098773    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-systemd-units\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.100730 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098799    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-cnibin\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.100730 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098804    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-multus-socket-dir-parent\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.100730 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098822    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-systemd-units\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.100730 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098858    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnbtc\" (UniqueName: \"kubernetes.io/projected/6657cdfc-7df6-47c1-8c2c-71d047c76a2b-kube-api-access-qnbtc\") pod \"aws-ebs-csi-driver-node-jtq4c\" (UID: \"6657cdfc-7df6-47c1-8c2c-71d047c76a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:49.100730 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098868    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-multus-socket-dir-parent\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.100730 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098888    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/daa091f9-dcf8-4259-ae5d-22cec31c3676-multus-daemon-config\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.100730 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098912    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-etc-kubernetes\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.100730 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098938    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqshz\" (UniqueName: \"kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz\") pod \"network-check-target-rj8l7\" (UID: \"0b17897e-d028-4f8b-ba02-5f5a0de532e7\") " pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:07:49.100730 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098964    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bda53755-d48d-4341-977a-20e3b5c41842-host-slash\") pod \"iptables-alerter-z9k86\" (UID: \"bda53755-d48d-4341-977a-20e3b5c41842\") " pod="openshift-network-operator/iptables-alerter-z9k86"
Jul 28 10:07:49.100730 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098969    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-etc-kubernetes\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.100730 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.098986    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-run-ovn\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.101508 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.099015    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-host-cni-netd\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.101508 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.099018    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-run-ovn\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.101508 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.099046    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bda53755-d48d-4341-977a-20e3b5c41842-iptables-alerter-script\") pod \"iptables-alerter-z9k86\" (UID: \"bda53755-d48d-4341-977a-20e3b5c41842\") " pod="openshift-network-operator/iptables-alerter-z9k86"
Jul 28 10:07:49.101508 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.099050    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v24fn\" (UniqueName: \"kubernetes.io/projected/08f379a0-030f-490c-8f02-22278e6e2fb9-kube-api-access-v24fn\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.101508 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.099065    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/08f379a0-030f-490c-8f02-22278e6e2fb9-host-cni-netd\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.101508 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.099099    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-system-cni-dir\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.101508 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.099134    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6657cdfc-7df6-47c1-8c2c-71d047c76a2b-sys-fs\") pod \"aws-ebs-csi-driver-node-jtq4c\" (UID: \"6657cdfc-7df6-47c1-8c2c-71d047c76a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:49.101508 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.099144    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bda53755-d48d-4341-977a-20e3b5c41842-host-slash\") pod \"iptables-alerter-z9k86\" (UID: \"bda53755-d48d-4341-977a-20e3b5c41842\") " pod="openshift-network-operator/iptables-alerter-z9k86"
Jul 28 10:07:49.101508 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.099159    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/08f379a0-030f-490c-8f02-22278e6e2fb9-ovnkube-script-lib\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.101508 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.099191    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-hostroot\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.101508 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.099232    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6657cdfc-7df6-47c1-8c2c-71d047c76a2b-sys-fs\") pod \"aws-ebs-csi-driver-node-jtq4c\" (UID: \"6657cdfc-7df6-47c1-8c2c-71d047c76a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:49.101508 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.099219    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-system-cni-dir\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.101508 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.099265    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/daa091f9-dcf8-4259-ae5d-22cec31c3676-hostroot\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.101508 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.099360    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/daa091f9-dcf8-4259-ae5d-22cec31c3676-multus-daemon-config\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.101508 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.099617    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/08f379a0-030f-490c-8f02-22278e6e2fb9-ovnkube-script-lib\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.101508 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.100457    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f30801a2-932d-4b83-97d7-c61d81b859c5-agent-certs\") pod \"konnectivity-agent-z8vrl\" (UID: \"f30801a2-932d-4b83-97d7-c61d81b859c5\") " pod="kube-system/konnectivity-agent-z8vrl"
Jul 28 10:07:49.101508 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.101275    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/08f379a0-030f-490c-8f02-22278e6e2fb9-ovn-node-metrics-cert\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.107614 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:49.107595    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 10:07:49.107614 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:49.107612    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 10:07:49.107783 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:49.107622    2577 projected.go:196] Error preparing data for projected volume kube-api-access-wqshz for pod openshift-network-diagnostics/network-check-target-rj8l7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 10:07:49.107783 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:49.107677    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz podName:0b17897e-d028-4f8b-ba02-5f5a0de532e7 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:49.607660402 +0000 UTC m=+3.009898792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wqshz" (UniqueName: "kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz") pod "network-check-target-rj8l7" (UID: "0b17897e-d028-4f8b-ba02-5f5a0de532e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 10:07:49.108485 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.108440    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-874sj\" (UniqueName: \"kubernetes.io/projected/bda53755-d48d-4341-977a-20e3b5c41842-kube-api-access-874sj\") pod \"iptables-alerter-z9k86\" (UID: \"bda53755-d48d-4341-977a-20e3b5c41842\") " pod="openshift-network-operator/iptables-alerter-z9k86"
Jul 28 10:07:49.111108 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.111087    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v24fn\" (UniqueName: \"kubernetes.io/projected/08f379a0-030f-490c-8f02-22278e6e2fb9-kube-api-access-v24fn\") pod \"ovnkube-node-nsv94\" (UID: \"08f379a0-030f-490c-8f02-22278e6e2fb9\") " pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.111312 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.111291    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xz68\" (UniqueName: \"kubernetes.io/projected/af1264bf-57b1-45a9-8753-f359fe2f0b65-kube-api-access-6xz68\") pod \"network-metrics-daemon-8dw4k\" (UID: \"af1264bf-57b1-45a9-8753-f359fe2f0b65\") " pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:07:49.111388 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.111333    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnbtc\" (UniqueName: \"kubernetes.io/projected/6657cdfc-7df6-47c1-8c2c-71d047c76a2b-kube-api-access-qnbtc\") pod \"aws-ebs-csi-driver-node-jtq4c\" (UID: \"6657cdfc-7df6-47c1-8c2c-71d047c76a2b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:49.112633 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.112615    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkxfh\" (UniqueName: \"kubernetes.io/projected/daa091f9-dcf8-4259-ae5d-22cec31c3676-kube-api-access-nkxfh\") pod \"multus-hcmhj\" (UID: \"daa091f9-dcf8-4259-ae5d-22cec31c3676\") " pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.193728 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.193691    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-4mfhr"
Jul 28 10:07:49.200972 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.200946    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6qk4z"
Jul 28 10:07:49.212771 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.212749    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-g59wc"
Jul 28 10:07:49.218269 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.218249    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k7rg8"
Jul 28 10:07:49.225735 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.225719    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-z8vrl"
Jul 28 10:07:49.235362 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.235345    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hcmhj"
Jul 28 10:07:49.242266 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.242249    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c"
Jul 28 10:07:49.251061 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.251038    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z9k86"
Jul 28 10:07:49.256073 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.256057    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:07:49.502869 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.502777    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret\") pod \"global-pull-secret-syncer-v26n5\" (UID: \"5536a6cc-73fa-4449-8a5c-d3798c359de8\") " pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:07:49.503020 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:49.502925    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 10:07:49.503020 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:49.502982    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret podName:5536a6cc-73fa-4449-8a5c-d3798c359de8 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:50.502966911 +0000 UTC m=+3.905205286 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret") pod "global-pull-secret-syncer-v26n5" (UID: "5536a6cc-73fa-4449-8a5c-d3798c359de8") : object "kube-system"/"original-pull-secret" not registered
Jul 28 10:07:49.603139 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.603109    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs\") pod \"network-metrics-daemon-8dw4k\" (UID: \"af1264bf-57b1-45a9-8753-f359fe2f0b65\") " pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:07:49.603295 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:49.603240    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 10:07:49.603371 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:49.603301    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs podName:af1264bf-57b1-45a9-8753-f359fe2f0b65 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:50.603281433 +0000 UTC m=+4.005519825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs") pod "network-metrics-daemon-8dw4k" (UID: "af1264bf-57b1-45a9-8753-f359fe2f0b65") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 10:07:49.703761 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.703685    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqshz\" (UniqueName: \"kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz\") pod \"network-check-target-rj8l7\" (UID: \"0b17897e-d028-4f8b-ba02-5f5a0de532e7\") " pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:07:49.703932 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:49.703852    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 10:07:49.703932 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:49.703879    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 10:07:49.703932 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:49.703895    2577 projected.go:196] Error preparing data for projected volume kube-api-access-wqshz for pod openshift-network-diagnostics/network-check-target-rj8l7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 10:07:49.704093 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:49.703960    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz podName:0b17897e-d028-4f8b-ba02-5f5a0de532e7 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:50.703941869 +0000 UTC m=+4.106180260 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wqshz" (UniqueName: "kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz") pod "network-check-target-rj8l7" (UID: "0b17897e-d028-4f8b-ba02-5f5a0de532e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 10:07:49.871264 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:49.871208    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7b8d225_6dc7_4a2b_9201_a47e73ffe254.slice/crio-9e37aceeb6e2bbf4f656ec47eaa0f3ec36dfac634a8306078e157b54acfbbee9 WatchSource:0}: Error finding container 9e37aceeb6e2bbf4f656ec47eaa0f3ec36dfac634a8306078e157b54acfbbee9: Status 404 returned error can't find the container with id 9e37aceeb6e2bbf4f656ec47eaa0f3ec36dfac634a8306078e157b54acfbbee9
Jul 28 10:07:49.875709 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:49.875474    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08f379a0_030f_490c_8f02_22278e6e2fb9.slice/crio-4d2b2eaa6c36823a86929f76bb68087d68916ea68a11952c2baf196cefaa2212 WatchSource:0}: Error finding container 4d2b2eaa6c36823a86929f76bb68087d68916ea68a11952c2baf196cefaa2212: Status 404 returned error can't find the container with id 4d2b2eaa6c36823a86929f76bb68087d68916ea68a11952c2baf196cefaa2212
Jul 28 10:07:49.878660 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:49.878629    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod166cc762_9ac9_414d_bc70_1cc5d7a9d718.slice/crio-0fff9be329af1f4e650c0da9ae857431226a39c1b1eaa07a213ae5794b316179 WatchSource:0}: Error finding container 0fff9be329af1f4e650c0da9ae857431226a39c1b1eaa07a213ae5794b316179: Status 404 returned error can't find the container with id 0fff9be329af1f4e650c0da9ae857431226a39c1b1eaa07a213ae5794b316179
Jul 28 10:07:49.879589 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:49.879547    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaa091f9_dcf8_4259_ae5d_22cec31c3676.slice/crio-ffa0d601671e33acf106676d5a06b092668dffb9b82f0770d2c37d6eb7954b35 WatchSource:0}: Error finding container ffa0d601671e33acf106676d5a06b092668dffb9b82f0770d2c37d6eb7954b35: Status 404 returned error can't find the container with id ffa0d601671e33acf106676d5a06b092668dffb9b82f0770d2c37d6eb7954b35
Jul 28 10:07:49.880437 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:49.880416    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf30801a2_932d_4b83_97d7_c61d81b859c5.slice/crio-d000bec575d002daca463b13635679279858e3a59a3f01d63650c1a67ca43131 WatchSource:0}: Error finding container d000bec575d002daca463b13635679279858e3a59a3f01d63650c1a67ca43131: Status 404 returned error can't find the container with id d000bec575d002daca463b13635679279858e3a59a3f01d63650c1a67ca43131
Jul 28 10:07:49.881132 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:49.881112    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32577247_d03d_457c_b09c_8a0e7f1ac054.slice/crio-564e6ebc28d0f030f6ab542047bc9e0ba5ec40ad4968b0199825e700f6b4b314 WatchSource:0}: Error finding container 564e6ebc28d0f030f6ab542047bc9e0ba5ec40ad4968b0199825e700f6b4b314: Status 404 returned error can't find the container with id 564e6ebc28d0f030f6ab542047bc9e0ba5ec40ad4968b0199825e700f6b4b314
Jul 28 10:07:49.883065 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:49.883043    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbda53755_d48d_4341_977a_20e3b5c41842.slice/crio-a523ee359e75e6212bebd795270efb194b0395d9a01c9293f520dbef03081d26 WatchSource:0}: Error finding container a523ee359e75e6212bebd795270efb194b0395d9a01c9293f520dbef03081d26: Status 404 returned error can't find the container with id a523ee359e75e6212bebd795270efb194b0395d9a01c9293f520dbef03081d26
Jul 28 10:07:49.884409 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:49.884355    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a3cd6d_6743_42dd_953e_b7270ecbe64e.slice/crio-6ec62188ac16f991b764cfa9c4c42d9588865a07f83ebe8b5304d79e472a4f89 WatchSource:0}: Error finding container 6ec62188ac16f991b764cfa9c4c42d9588865a07f83ebe8b5304d79e472a4f89: Status 404 returned error can't find the container with id 6ec62188ac16f991b764cfa9c4c42d9588865a07f83ebe8b5304d79e472a4f89
Jul 28 10:07:49.886315 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:07:49.886172    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6657cdfc_7df6_47c1_8c2c_71d047c76a2b.slice/crio-a804fc9c8a1ee1f07253e19a868f4e0aed1e07b7a6fc981b21d13e3b679a8e6e WatchSource:0}: Error finding container a804fc9c8a1ee1f07253e19a868f4e0aed1e07b7a6fc981b21d13e3b679a8e6e: Status 404 returned error can't find the container with id a804fc9c8a1ee1f07253e19a868f4e0aed1e07b7a6fc981b21d13e3b679a8e6e
Jul 28 10:07:49.925633 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.925585    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 10:02:48 +0000 UTC" deadline="2028-05-12 02:46:24.474917404 +0000 UTC"
Jul 28 10:07:49.925697 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:49.925635    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15688h38m34.549285662s"
Jul 28 10:07:50.039465 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:50.039244    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:07:50.039589 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:50.039251    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:07:50.039628 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:50.039592    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj8l7" podUID="0b17897e-d028-4f8b-ba02-5f5a0de532e7"
Jul 28 10:07:50.039628 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:50.039607    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v26n5" podUID="5536a6cc-73fa-4449-8a5c-d3798c359de8"
Jul 28 10:07:50.047229 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:50.047196    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-175.ec2.internal" event={"ID":"59086c5e245afc5c657648266b073d96","Type":"ContainerStarted","Data":"3502c63662021c547e9ecca8ed44cf8e38dd8fef3d9af43cf14b8b21b43afa77"}
Jul 28 10:07:50.048313 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:50.048292    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hcmhj" event={"ID":"daa091f9-dcf8-4259-ae5d-22cec31c3676","Type":"ContainerStarted","Data":"ffa0d601671e33acf106676d5a06b092668dffb9b82f0770d2c37d6eb7954b35"}
Jul 28 10:07:50.049284 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:50.049265    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z9k86" event={"ID":"bda53755-d48d-4341-977a-20e3b5c41842","Type":"ContainerStarted","Data":"a523ee359e75e6212bebd795270efb194b0395d9a01c9293f520dbef03081d26"}
Jul 28 10:07:50.050416 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:50.050391    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6qk4z" event={"ID":"32577247-d03d-457c-b09c-8a0e7f1ac054","Type":"ContainerStarted","Data":"564e6ebc28d0f030f6ab542047bc9e0ba5ec40ad4968b0199825e700f6b4b314"}
Jul 28 10:07:50.051426 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:50.051405    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z8vrl" event={"ID":"f30801a2-932d-4b83-97d7-c61d81b859c5","Type":"ContainerStarted","Data":"d000bec575d002daca463b13635679279858e3a59a3f01d63650c1a67ca43131"}
Jul 28 10:07:50.052566 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:50.052535    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsv94" event={"ID":"08f379a0-030f-490c-8f02-22278e6e2fb9","Type":"ContainerStarted","Data":"4d2b2eaa6c36823a86929f76bb68087d68916ea68a11952c2baf196cefaa2212"}
Jul 28 10:07:50.053534 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:50.053514    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k7rg8" event={"ID":"d7b8d225-6dc7-4a2b-9201-a47e73ffe254","Type":"ContainerStarted","Data":"9e37aceeb6e2bbf4f656ec47eaa0f3ec36dfac634a8306078e157b54acfbbee9"}
Jul 28 10:07:50.054602 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:50.054584    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c" event={"ID":"6657cdfc-7df6-47c1-8c2c-71d047c76a2b","Type":"ContainerStarted","Data":"a804fc9c8a1ee1f07253e19a868f4e0aed1e07b7a6fc981b21d13e3b679a8e6e"}
Jul 28 10:07:50.055589 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:50.055563    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mfhr" event={"ID":"75a3cd6d-6743-42dd-953e-b7270ecbe64e","Type":"ContainerStarted","Data":"6ec62188ac16f991b764cfa9c4c42d9588865a07f83ebe8b5304d79e472a4f89"}
Jul 28 10:07:50.056551 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:50.056527    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g59wc" event={"ID":"166cc762-9ac9-414d-bc70-1cc5d7a9d718","Type":"ContainerStarted","Data":"0fff9be329af1f4e650c0da9ae857431226a39c1b1eaa07a213ae5794b316179"}
Jul 28 10:07:50.064189 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:50.064149    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-175.ec2.internal" podStartSLOduration=2.064129277 podStartE2EDuration="2.064129277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:07:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:07:50.063872703 +0000 UTC m=+3.466111101" watchObservedRunningTime="2026-07-28 10:07:50.064129277 +0000 UTC m=+3.466367675"
Jul 28 10:07:50.512124 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:50.511485    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret\") pod \"global-pull-secret-syncer-v26n5\" (UID: \"5536a6cc-73fa-4449-8a5c-d3798c359de8\") " pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:07:50.512124 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:50.511619    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 10:07:50.512124 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:50.511691    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret podName:5536a6cc-73fa-4449-8a5c-d3798c359de8 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:52.511672365 +0000 UTC m=+5.913910757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret") pod "global-pull-secret-syncer-v26n5" (UID: "5536a6cc-73fa-4449-8a5c-d3798c359de8") : object "kube-system"/"original-pull-secret" not registered
Jul 28 10:07:50.612625 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:50.612586    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs\") pod \"network-metrics-daemon-8dw4k\" (UID: \"af1264bf-57b1-45a9-8753-f359fe2f0b65\") " pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:07:50.612873 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:50.612812    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 10:07:50.612944 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:50.612894    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs podName:af1264bf-57b1-45a9-8753-f359fe2f0b65 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:52.612874916 +0000 UTC m=+6.015113306 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs") pod "network-metrics-daemon-8dw4k" (UID: "af1264bf-57b1-45a9-8753-f359fe2f0b65") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 10:07:50.714057 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:50.714023    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqshz\" (UniqueName: \"kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz\") pod \"network-check-target-rj8l7\" (UID: \"0b17897e-d028-4f8b-ba02-5f5a0de532e7\") " pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:07:50.714235 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:50.714224    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 10:07:50.714303 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:50.714242    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 10:07:50.714303 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:50.714255    2577 projected.go:196] Error preparing data for projected volume kube-api-access-wqshz for pod openshift-network-diagnostics/network-check-target-rj8l7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 10:07:50.714404 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:50.714313    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz podName:0b17897e-d028-4f8b-ba02-5f5a0de532e7 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:52.714294579 +0000 UTC m=+6.116532960 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wqshz" (UniqueName: "kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz") pod "network-check-target-rj8l7" (UID: "0b17897e-d028-4f8b-ba02-5f5a0de532e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 10:07:50.926824 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:50.926708    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 10:02:48 +0000 UTC" deadline="2027-12-31 12:44:27.963469378 +0000 UTC"
Jul 28 10:07:50.926824 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:50.926748    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12506h36m37.036726541s"
Jul 28 10:07:50.980770 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:50.980514    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 10:07:51.042162 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:51.039294    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:07:51.042162 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:51.039436    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dw4k" podUID="af1264bf-57b1-45a9-8753-f359fe2f0b65"
Jul 28 10:07:51.072414 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:51.072377    2577 generic.go:356] "Generic (PLEG): container finished" podID="432bde8bde3ecc017eb0427e4b34b805" containerID="1d0f98cb57d8a8ae521176a1541205d7e27bfd4129ab130991c45dac0e80562e" exitCode=0
Jul 28 10:07:51.073610 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:51.073351    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal" event={"ID":"432bde8bde3ecc017eb0427e4b34b805","Type":"ContainerDied","Data":"1d0f98cb57d8a8ae521176a1541205d7e27bfd4129ab130991c45dac0e80562e"}
Jul 28 10:07:52.039038 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:52.039007    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:07:52.039038 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:52.039015    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:07:52.039556 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:52.039138    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v26n5" podUID="5536a6cc-73fa-4449-8a5c-d3798c359de8"
Jul 28 10:07:52.039556 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:52.039256    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj8l7" podUID="0b17897e-d028-4f8b-ba02-5f5a0de532e7"
Jul 28 10:07:52.081196 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:52.081162    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal" event={"ID":"432bde8bde3ecc017eb0427e4b34b805","Type":"ContainerStarted","Data":"fa033e108fd7a811130f7b5dc85a0ccb69f994349a50af15819baa13fbeb5838"}
Jul 28 10:07:52.528965 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:52.528876    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret\") pod \"global-pull-secret-syncer-v26n5\" (UID: \"5536a6cc-73fa-4449-8a5c-d3798c359de8\") " pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:07:52.529125 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:52.529064    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 10:07:52.529181 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:52.529130    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret podName:5536a6cc-73fa-4449-8a5c-d3798c359de8 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:56.529109262 +0000 UTC m=+9.931347653 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret") pod "global-pull-secret-syncer-v26n5" (UID: "5536a6cc-73fa-4449-8a5c-d3798c359de8") : object "kube-system"/"original-pull-secret" not registered
Jul 28 10:07:52.631316 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:52.631268    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs\") pod \"network-metrics-daemon-8dw4k\" (UID: \"af1264bf-57b1-45a9-8753-f359fe2f0b65\") " pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:07:52.631498 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:52.631466    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 10:07:52.631560 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:52.631530    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs podName:af1264bf-57b1-45a9-8753-f359fe2f0b65 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:56.631509819 +0000 UTC m=+10.033748201 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs") pod "network-metrics-daemon-8dw4k" (UID: "af1264bf-57b1-45a9-8753-f359fe2f0b65") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 10:07:52.731919 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:52.731884    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqshz\" (UniqueName: \"kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz\") pod \"network-check-target-rj8l7\" (UID: \"0b17897e-d028-4f8b-ba02-5f5a0de532e7\") " pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:07:52.732095 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:52.732030    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 10:07:52.732095 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:52.732044    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 10:07:52.732095 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:52.732053    2577 projected.go:196] Error preparing data for projected volume kube-api-access-wqshz for pod openshift-network-diagnostics/network-check-target-rj8l7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 10:07:52.732095 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:52.732097    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz podName:0b17897e-d028-4f8b-ba02-5f5a0de532e7 nodeName:}" failed. No retries permitted until 2026-07-28 10:07:56.732084531 +0000 UTC m=+10.134322907 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wqshz" (UniqueName: "kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz") pod "network-check-target-rj8l7" (UID: "0b17897e-d028-4f8b-ba02-5f5a0de532e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 10:07:53.044371 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:53.043868    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:07:53.044371 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:53.044022    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dw4k" podUID="af1264bf-57b1-45a9-8753-f359fe2f0b65"
Jul 28 10:07:54.039743 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:54.039155    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:07:54.039743 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:54.039275    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj8l7" podUID="0b17897e-d028-4f8b-ba02-5f5a0de532e7"
Jul 28 10:07:54.039743 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:54.039611    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:07:54.039743 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:54.039699    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v26n5" podUID="5536a6cc-73fa-4449-8a5c-d3798c359de8"
Jul 28 10:07:55.039204 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:55.039165    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:07:55.039757 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:55.039323    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dw4k" podUID="af1264bf-57b1-45a9-8753-f359fe2f0b65"
Jul 28 10:07:56.039872 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:56.039303    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:07:56.039872 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:56.039419    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj8l7" podUID="0b17897e-d028-4f8b-ba02-5f5a0de532e7"
Jul 28 10:07:56.039872 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:56.039740    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:07:56.039872 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:56.039824    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v26n5" podUID="5536a6cc-73fa-4449-8a5c-d3798c359de8"
Jul 28 10:07:56.564531 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:56.564493    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret\") pod \"global-pull-secret-syncer-v26n5\" (UID: \"5536a6cc-73fa-4449-8a5c-d3798c359de8\") " pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:07:56.564727 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:56.564639    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 10:07:56.564727 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:56.564706    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret podName:5536a6cc-73fa-4449-8a5c-d3798c359de8 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:04.564686663 +0000 UTC m=+17.966925056 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret") pod "global-pull-secret-syncer-v26n5" (UID: "5536a6cc-73fa-4449-8a5c-d3798c359de8") : object "kube-system"/"original-pull-secret" not registered
Jul 28 10:07:56.665256 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:56.665137    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs\") pod \"network-metrics-daemon-8dw4k\" (UID: \"af1264bf-57b1-45a9-8753-f359fe2f0b65\") " pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:07:56.665433 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:56.665306    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 10:07:56.665433 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:56.665381    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs podName:af1264bf-57b1-45a9-8753-f359fe2f0b65 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:04.66536351 +0000 UTC m=+18.067601891 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs") pod "network-metrics-daemon-8dw4k" (UID: "af1264bf-57b1-45a9-8753-f359fe2f0b65") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 10:07:56.766248 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:56.766216    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqshz\" (UniqueName: \"kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz\") pod \"network-check-target-rj8l7\" (UID: \"0b17897e-d028-4f8b-ba02-5f5a0de532e7\") " pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:07:56.766472 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:56.766377    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 10:07:56.766472 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:56.766399    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 10:07:56.766472 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:56.766411    2577 projected.go:196] Error preparing data for projected volume kube-api-access-wqshz for pod openshift-network-diagnostics/network-check-target-rj8l7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 10:07:56.766472 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:56.766469    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz podName:0b17897e-d028-4f8b-ba02-5f5a0de532e7 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:04.766451085 +0000 UTC m=+18.168689477 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wqshz" (UniqueName: "kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz") pod "network-check-target-rj8l7" (UID: "0b17897e-d028-4f8b-ba02-5f5a0de532e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 10:07:57.039953 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:57.039871    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:07:57.040360 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:57.040010    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dw4k" podUID="af1264bf-57b1-45a9-8753-f359fe2f0b65"
Jul 28 10:07:58.039548 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:58.039520    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:07:58.039676 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:58.039646    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj8l7" podUID="0b17897e-d028-4f8b-ba02-5f5a0de532e7"
Jul 28 10:07:58.039751 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:58.039718    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:07:58.039807 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:58.039795    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v26n5" podUID="5536a6cc-73fa-4449-8a5c-d3798c359de8"
Jul 28 10:07:59.042656 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:07:59.042621    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:07:59.043123 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:07:59.042727    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dw4k" podUID="af1264bf-57b1-45a9-8753-f359fe2f0b65"
Jul 28 10:08:00.039892 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:00.039852    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:08:00.040102 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:00.039852    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:08:00.040102 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:00.040002    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v26n5" podUID="5536a6cc-73fa-4449-8a5c-d3798c359de8"
Jul 28 10:08:00.040102 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:00.040070    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj8l7" podUID="0b17897e-d028-4f8b-ba02-5f5a0de532e7"
Jul 28 10:08:01.047477 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:01.047440    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:08:01.047881 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:01.047584    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dw4k" podUID="af1264bf-57b1-45a9-8753-f359fe2f0b65"
Jul 28 10:08:02.039240 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:02.039200    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:08:02.039434 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:02.039207    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:08:02.039434 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:02.039312    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj8l7" podUID="0b17897e-d028-4f8b-ba02-5f5a0de532e7"
Jul 28 10:08:02.039434 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:02.039417    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v26n5" podUID="5536a6cc-73fa-4449-8a5c-d3798c359de8"
Jul 28 10:08:03.039554 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:03.039511    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:08:03.039992 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:03.039655    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dw4k" podUID="af1264bf-57b1-45a9-8753-f359fe2f0b65"
Jul 28 10:08:04.039854 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:04.039811    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:08:04.040361 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:04.039885    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:08:04.040361 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:04.039967    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj8l7" podUID="0b17897e-d028-4f8b-ba02-5f5a0de532e7"
Jul 28 10:08:04.040361 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:04.040110    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v26n5" podUID="5536a6cc-73fa-4449-8a5c-d3798c359de8"
Jul 28 10:08:04.629087 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:04.629048    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret\") pod \"global-pull-secret-syncer-v26n5\" (UID: \"5536a6cc-73fa-4449-8a5c-d3798c359de8\") " pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:08:04.629241 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:04.629188    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 10:08:04.629278 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:04.629242    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret podName:5536a6cc-73fa-4449-8a5c-d3798c359de8 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:20.629227436 +0000 UTC m=+34.031465811 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret") pod "global-pull-secret-syncer-v26n5" (UID: "5536a6cc-73fa-4449-8a5c-d3798c359de8") : object "kube-system"/"original-pull-secret" not registered
Jul 28 10:08:04.730186 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:04.730153    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs\") pod \"network-metrics-daemon-8dw4k\" (UID: \"af1264bf-57b1-45a9-8753-f359fe2f0b65\") " pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:08:04.730351 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:04.730262    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 10:08:04.730351 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:04.730316    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs podName:af1264bf-57b1-45a9-8753-f359fe2f0b65 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:20.730301684 +0000 UTC m=+34.132540060 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs") pod "network-metrics-daemon-8dw4k" (UID: "af1264bf-57b1-45a9-8753-f359fe2f0b65") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 10:08:04.830772 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:04.830739    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqshz\" (UniqueName: \"kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz\") pod \"network-check-target-rj8l7\" (UID: \"0b17897e-d028-4f8b-ba02-5f5a0de532e7\") " pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:08:04.830969 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:04.830944    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 10:08:04.830969 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:04.830965    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 10:08:04.831065 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:04.830976    2577 projected.go:196] Error preparing data for projected volume kube-api-access-wqshz for pod openshift-network-diagnostics/network-check-target-rj8l7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 10:08:04.831065 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:04.831037    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz podName:0b17897e-d028-4f8b-ba02-5f5a0de532e7 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:20.831017441 +0000 UTC m=+34.233255829 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wqshz" (UniqueName: "kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz") pod "network-check-target-rj8l7" (UID: "0b17897e-d028-4f8b-ba02-5f5a0de532e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 10:08:05.040057 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:05.039972    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:08:05.040471 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:05.040116    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dw4k" podUID="af1264bf-57b1-45a9-8753-f359fe2f0b65"
Jul 28 10:08:06.039468 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:06.039431    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:08:06.039662 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:06.039446    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:08:06.039662 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:06.039563    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj8l7" podUID="0b17897e-d028-4f8b-ba02-5f5a0de532e7"
Jul 28 10:08:06.039662 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:06.039620    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v26n5" podUID="5536a6cc-73fa-4449-8a5c-d3798c359de8"
Jul 28 10:08:07.040276 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:07.040240    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:08:07.040742 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:07.040367    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dw4k" podUID="af1264bf-57b1-45a9-8753-f359fe2f0b65"
Jul 28 10:08:08.039606 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:08.039574    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:08:08.039799 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:08.039574    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:08:08.039799 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:08.039709    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v26n5" podUID="5536a6cc-73fa-4449-8a5c-d3798c359de8"
Jul 28 10:08:08.039799 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:08.039774    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj8l7" podUID="0b17897e-d028-4f8b-ba02-5f5a0de532e7"
Jul 28 10:08:09.040096 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.039775    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:08:09.040771 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:09.040190    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dw4k" podUID="af1264bf-57b1-45a9-8753-f359fe2f0b65"
Jul 28 10:08:09.116729 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.116684    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hcmhj" event={"ID":"daa091f9-dcf8-4259-ae5d-22cec31c3676","Type":"ContainerStarted","Data":"d00d3c5236a6376b1bcddad6a704e9034c8b7f6e135d3b8762361dcc2f865ec0"}
Jul 28 10:08:09.118183 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.118161    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6qk4z" event={"ID":"32577247-d03d-457c-b09c-8a0e7f1ac054","Type":"ContainerStarted","Data":"2f520fdc482563b0c65fe12bf7d87dacff9ab401a191f76b7896337e65364dc4"}
Jul 28 10:08:09.119721 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.119702    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-z8vrl" event={"ID":"f30801a2-932d-4b83-97d7-c61d81b859c5","Type":"ContainerStarted","Data":"112f805778ad882c7f47937f05dae69065fde86d7de54665f7f615b197e015aa"}
Jul 28 10:08:09.123020 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.122996    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsv94" event={"ID":"08f379a0-030f-490c-8f02-22278e6e2fb9","Type":"ContainerStarted","Data":"812aa464abe7337ae5f916aaf918cd1d9655c48c039789227954d53545354c32"}
Jul 28 10:08:09.123107 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.123079    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsv94" event={"ID":"08f379a0-030f-490c-8f02-22278e6e2fb9","Type":"ContainerStarted","Data":"900df3544e1ec02c7e9654805b644a8c1c81b45e53c2aeb2aa7af385fc390abf"}
Jul 28 10:08:09.123154 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.123131    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsv94" event={"ID":"08f379a0-030f-490c-8f02-22278e6e2fb9","Type":"ContainerStarted","Data":"c081a325dc4af3b680a2519cfc2c35431c581e65dfe9efdcc2d0961ab69794c6"}
Jul 28 10:08:09.123193 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.123178    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsv94" event={"ID":"08f379a0-030f-490c-8f02-22278e6e2fb9","Type":"ContainerStarted","Data":"bc53d440da32c53ad66ecb2f2e80421f4a7a2e1f4b4aabd8e0f8b4abaf5802a8"}
Jul 28 10:08:09.123238 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.123226    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsv94" event={"ID":"08f379a0-030f-490c-8f02-22278e6e2fb9","Type":"ContainerStarted","Data":"f4d4452578a77fe0387ab02117b993703878f7bab8e38edd9f3b2998db54ff3c"}
Jul 28 10:08:09.124743 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.124717    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k7rg8" event={"ID":"d7b8d225-6dc7-4a2b-9201-a47e73ffe254","Type":"ContainerStarted","Data":"d23ba21d9f2321ed613ae7c19c00d69b468d4969bad28dbfcde372dea6bead56"}
Jul 28 10:08:09.126349 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.126317    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c" event={"ID":"6657cdfc-7df6-47c1-8c2c-71d047c76a2b","Type":"ContainerStarted","Data":"c8523a895fe475cd117a5560387309dd9baa3af42d277e833513eb22758671ad"}
Jul 28 10:08:09.128228 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.128199    2577 generic.go:356] "Generic (PLEG): container finished" podID="75a3cd6d-6743-42dd-953e-b7270ecbe64e" containerID="cd9c50bee647ed475cbdf0d3089bb44eb51f12e692ba159b5395de5e2a8165e3" exitCode=0
Jul 28 10:08:09.128328 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.128275    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mfhr" event={"ID":"75a3cd6d-6743-42dd-953e-b7270ecbe64e","Type":"ContainerDied","Data":"cd9c50bee647ed475cbdf0d3089bb44eb51f12e692ba159b5395de5e2a8165e3"}
Jul 28 10:08:09.130014 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.129995    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-g59wc" event={"ID":"166cc762-9ac9-414d-bc70-1cc5d7a9d718","Type":"ContainerStarted","Data":"35c41666efe7d21145a0eeb7db85f11f7272829a961089c81143e90ed5945acc"}
Jul 28 10:08:09.139340 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.139303    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-175.ec2.internal" podStartSLOduration=21.139277592 podStartE2EDuration="21.139277592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:07:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:07:52.098017948 +0000 UTC m=+5.500256340" watchObservedRunningTime="2026-07-28 10:08:09.139277592 +0000 UTC m=+22.541515968"
Jul 28 10:08:09.139806 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.139498    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hcmhj" podStartSLOduration=3.450648825 podStartE2EDuration="22.13949097s" totalImagesPullingTime="18.688842145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:09.138899433 +0000 UTC m=+22.541137831" watchObservedRunningTime="2026-07-28 10:08:09.13949097 +0000 UTC m=+22.541729367"
Jul 28 10:08:09.156058 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.156017    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6qk4z" podStartSLOduration=3.520845566 podStartE2EDuration="22.155999204s" totalImagesPullingTime="18.635153638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:09.154978264 +0000 UTC m=+22.557216669" watchObservedRunningTime="2026-07-28 10:08:09.155999204 +0000 UTC m=+22.558237601"
Jul 28 10:08:09.193738 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.193686    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-g59wc" podStartSLOduration=3.558136869 podStartE2EDuration="22.193666652s" totalImagesPullingTime="18.635529783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:09.193017467 +0000 UTC m=+22.595255876" watchObservedRunningTime="2026-07-28 10:08:09.193666652 +0000 UTC m=+22.595905050"
Jul 28 10:08:09.213503 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.213455    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k7rg8" podStartSLOduration=3.572570206 podStartE2EDuration="22.213433504s" totalImagesPullingTime="18.640863298s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:09.213049194 +0000 UTC m=+22.615287590" watchObservedRunningTime="2026-07-28 10:08:09.213433504 +0000 UTC m=+22.615671906"
Jul 28 10:08:09.229341 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.229294    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-z8vrl" podStartSLOduration=11.529095157 podStartE2EDuration="22.229277197s" totalImagesPullingTime="10.70018204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:09.228754172 +0000 UTC m=+22.630992567" watchObservedRunningTime="2026-07-28 10:08:09.229277197 +0000 UTC m=+22.631515628"
Jul 28 10:08:09.933679 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.933643    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 10:08:09.951759 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.951668    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T10:08:09.933666762Z","UUID":"50d115ae-d181-42bd-b538-6b8a078a9ee1","Handler":null,"Name":"","Endpoint":""}
Jul 28 10:08:09.953210 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.953192    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 10:08:09.953315 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:09.953235    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 10:08:10.039855 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:10.039806    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:08:10.040072 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:10.039819    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:08:10.040072 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:10.039954    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj8l7" podUID="0b17897e-d028-4f8b-ba02-5f5a0de532e7"
Jul 28 10:08:10.040072 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:10.040021    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v26n5" podUID="5536a6cc-73fa-4449-8a5c-d3798c359de8"
Jul 28 10:08:10.134619 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:10.134538    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z9k86" event={"ID":"bda53755-d48d-4341-977a-20e3b5c41842","Type":"ContainerStarted","Data":"b1e934ade6d2e6694b2f1b499bc987f575767828c20a429ea24f0291c1929b47"}
Jul 28 10:08:10.137935 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:10.137902    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsv94" event={"ID":"08f379a0-030f-490c-8f02-22278e6e2fb9","Type":"ContainerStarted","Data":"9722b8f585af86c54dbe9fefd63f22e2d0ab9707a25d1f34bf89c549156c87dd"}
Jul 28 10:08:10.140033 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:10.140001    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c" event={"ID":"6657cdfc-7df6-47c1-8c2c-71d047c76a2b","Type":"ContainerStarted","Data":"d1affcd8b4b3d2ea7c80be5473c26a06def1be93d5099b9e4a6b524c7c8d6fea"}
Jul 28 10:08:10.150184 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:10.150141    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z9k86" podStartSLOduration=4.519188178 podStartE2EDuration="23.150127868s" totalImagesPullingTime="18.63093969s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:10.149794487 +0000 UTC m=+23.552032884" watchObservedRunningTime="2026-07-28 10:08:10.150127868 +0000 UTC m=+23.552366266"
Jul 28 10:08:11.039316 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:11.039280    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:08:11.039636 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:11.039416    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dw4k" podUID="af1264bf-57b1-45a9-8753-f359fe2f0b65"
Jul 28 10:08:12.039811 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:12.039772    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:08:12.040221 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:12.039912    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj8l7" podUID="0b17897e-d028-4f8b-ba02-5f5a0de532e7"
Jul 28 10:08:12.040221 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:12.039967    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:08:12.040221 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:12.040063    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v26n5" podUID="5536a6cc-73fa-4449-8a5c-d3798c359de8"
Jul 28 10:08:12.148553 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:12.148515    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsv94" event={"ID":"08f379a0-030f-490c-8f02-22278e6e2fb9","Type":"ContainerStarted","Data":"5a04b90499ff5114c6e563a8f72fe3c6f84f848fa30a0b89f9c16542d2fdabc1"}
Jul 28 10:08:12.150798 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:12.150768    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c" event={"ID":"6657cdfc-7df6-47c1-8c2c-71d047c76a2b","Type":"ContainerStarted","Data":"cf055f032e02bfb7258c020c50d8b675ba2fc2ab6603be82717e833e0473e0ab"}
Jul 28 10:08:12.171183 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:12.171130    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jtq4c" podStartSLOduration=4.193495517 podStartE2EDuration="25.171116559s" totalImagesPullingTime="20.977621042s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:07:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:12.170029209 +0000 UTC m=+25.572267607" watchObservedRunningTime="2026-07-28 10:08:12.171116559 +0000 UTC m=+25.573354995"
Jul 28 10:08:12.699186 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:12.698417    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-z8vrl"
Jul 28 10:08:12.699186 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:12.699177    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-z8vrl"
Jul 28 10:08:13.039959 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:13.039885    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:08:13.040372 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:13.040017    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dw4k" podUID="af1264bf-57b1-45a9-8753-f359fe2f0b65"
Jul 28 10:08:13.152850 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:13.152822    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-z8vrl"
Jul 28 10:08:13.153374 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:13.153348    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-z8vrl"
Jul 28 10:08:14.039791 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:14.039570    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:08:14.039992 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:14.039587    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:08:14.039992 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:14.039816    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj8l7" podUID="0b17897e-d028-4f8b-ba02-5f5a0de532e7"
Jul 28 10:08:14.039992 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:14.039948    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v26n5" podUID="5536a6cc-73fa-4449-8a5c-d3798c359de8"
Jul 28 10:08:14.158955 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:14.158923    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nsv94" event={"ID":"08f379a0-030f-490c-8f02-22278e6e2fb9","Type":"ContainerStarted","Data":"4999d3547c01073327afec8a17134274a12a16cdbc05ca848712e3d809c5be91"}
Jul 28 10:08:14.159264 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:14.159242    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:08:14.159388 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:14.159316    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:08:14.162580 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:14.161234    2577 generic.go:356] "Generic (PLEG): container finished" podID="75a3cd6d-6743-42dd-953e-b7270ecbe64e" containerID="8f24bbd273807133d7f40be0a21f363ef9caff531705f2dd6a18e233afdfa5e8" exitCode=0
Jul 28 10:08:14.162580 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:14.161370    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mfhr" event={"ID":"75a3cd6d-6743-42dd-953e-b7270ecbe64e","Type":"ContainerDied","Data":"8f24bbd273807133d7f40be0a21f363ef9caff531705f2dd6a18e233afdfa5e8"}
Jul 28 10:08:14.176784 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:14.176759    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:08:14.187185 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:14.187147    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nsv94" podStartSLOduration=8.475990351 podStartE2EDuration="27.187135475s" totalImagesPullingTime="18.711145124s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:14.186300783 +0000 UTC m=+27.588539181" watchObservedRunningTime="2026-07-28 10:08:14.187135475 +0000 UTC m=+27.589373873"
Jul 28 10:08:15.039165 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:15.039108    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:08:15.039511 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:15.039261    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dw4k" podUID="af1264bf-57b1-45a9-8753-f359fe2f0b65"
Jul 28 10:08:15.163912 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:15.163873    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:08:15.178933 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:15.178910    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:08:15.383670 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:15.383588    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v26n5"]
Jul 28 10:08:15.383884 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:15.383700    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:08:15.383884 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:15.383779    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v26n5" podUID="5536a6cc-73fa-4449-8a5c-d3798c359de8"
Jul 28 10:08:15.384269 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:15.384252    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8dw4k"]
Jul 28 10:08:15.384341 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:15.384324    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:08:15.384418 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:15.384401    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dw4k" podUID="af1264bf-57b1-45a9-8753-f359fe2f0b65"
Jul 28 10:08:15.384965 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:15.384942    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rj8l7"]
Jul 28 10:08:15.385110 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:15.385038    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:08:15.385175 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:15.385132    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj8l7" podUID="0b17897e-d028-4f8b-ba02-5f5a0de532e7"
Jul 28 10:08:16.167498 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:16.167409    2577 generic.go:356] "Generic (PLEG): container finished" podID="75a3cd6d-6743-42dd-953e-b7270ecbe64e" containerID="ced068d9354579e8003937b8e5e8cf59a49126562c6e287dc2fa7bc4259788b7" exitCode=0
Jul 28 10:08:16.167498 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:16.167485    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mfhr" event={"ID":"75a3cd6d-6743-42dd-953e-b7270ecbe64e","Type":"ContainerDied","Data":"ced068d9354579e8003937b8e5e8cf59a49126562c6e287dc2fa7bc4259788b7"}
Jul 28 10:08:17.042052 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:17.042024    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:08:17.042239 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:17.042117    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:08:17.042239 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:17.042129    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj8l7" podUID="0b17897e-d028-4f8b-ba02-5f5a0de532e7"
Jul 28 10:08:17.042239 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:17.042140    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:08:17.042239 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:17.042202    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v26n5" podUID="5536a6cc-73fa-4449-8a5c-d3798c359de8"
Jul 28 10:08:17.042431 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:17.042283    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dw4k" podUID="af1264bf-57b1-45a9-8753-f359fe2f0b65"
Jul 28 10:08:18.176311 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:18.176263    2577 generic.go:356] "Generic (PLEG): container finished" podID="75a3cd6d-6743-42dd-953e-b7270ecbe64e" containerID="23aa609e41208ba8e6d504fa4ff2ac611d10a94c6dda25f1b0f94666b254b08c" exitCode=0
Jul 28 10:08:18.176743 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:18.176326    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mfhr" event={"ID":"75a3cd6d-6743-42dd-953e-b7270ecbe64e","Type":"ContainerDied","Data":"23aa609e41208ba8e6d504fa4ff2ac611d10a94c6dda25f1b0f94666b254b08c"}
Jul 28 10:08:19.039978 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:19.039944    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:08:19.040194 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:19.039944    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:08:19.040194 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:19.040074    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:08:19.040194 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:19.040073    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dw4k" podUID="af1264bf-57b1-45a9-8753-f359fe2f0b65"
Jul 28 10:08:19.040368 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:19.040183    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v26n5" podUID="5536a6cc-73fa-4449-8a5c-d3798c359de8"
Jul 28 10:08:19.040368 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:19.040259    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj8l7" podUID="0b17897e-d028-4f8b-ba02-5f5a0de532e7"
Jul 28 10:08:20.651753 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:20.651716    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret\") pod \"global-pull-secret-syncer-v26n5\" (UID: \"5536a6cc-73fa-4449-8a5c-d3798c359de8\") " pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:08:20.652182 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:20.651835    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 10:08:20.652182 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:20.651906    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret podName:5536a6cc-73fa-4449-8a5c-d3798c359de8 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:52.651891667 +0000 UTC m=+66.054130043 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret") pod "global-pull-secret-syncer-v26n5" (UID: "5536a6cc-73fa-4449-8a5c-d3798c359de8") : object "kube-system"/"original-pull-secret" not registered
Jul 28 10:08:20.752330 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:20.752294    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs\") pod \"network-metrics-daemon-8dw4k\" (UID: \"af1264bf-57b1-45a9-8753-f359fe2f0b65\") " pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:08:20.752494 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:20.752460    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 10:08:20.752538 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:20.752524    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs podName:af1264bf-57b1-45a9-8753-f359fe2f0b65 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:52.752507888 +0000 UTC m=+66.154746264 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs") pod "network-metrics-daemon-8dw4k" (UID: "af1264bf-57b1-45a9-8753-f359fe2f0b65") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 10:08:20.853104 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:20.853072    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqshz\" (UniqueName: \"kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz\") pod \"network-check-target-rj8l7\" (UID: \"0b17897e-d028-4f8b-ba02-5f5a0de532e7\") " pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:08:20.853263 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:20.853242    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 10:08:20.853300 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:20.853269    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 10:08:20.853300 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:20.853283    2577 projected.go:196] Error preparing data for projected volume kube-api-access-wqshz for pod openshift-network-diagnostics/network-check-target-rj8l7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 10:08:20.853376 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:20.853337    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz podName:0b17897e-d028-4f8b-ba02-5f5a0de532e7 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:52.8533234 +0000 UTC m=+66.255561776 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wqshz" (UniqueName: "kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz") pod "network-check-target-rj8l7" (UID: "0b17897e-d028-4f8b-ba02-5f5a0de532e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 10:08:21.039489 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.039461    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:08:21.039489 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.039484    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:08:21.039689 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.039566    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:08:21.039689 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:21.039581    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v26n5" podUID="5536a6cc-73fa-4449-8a5c-d3798c359de8"
Jul 28 10:08:21.039689 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:21.039673    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rj8l7" podUID="0b17897e-d028-4f8b-ba02-5f5a0de532e7"
Jul 28 10:08:21.039862 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:21.039773    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8dw4k" podUID="af1264bf-57b1-45a9-8753-f359fe2f0b65"
Jul 28 10:08:21.339229 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.339155    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-175.ec2.internal" event="NodeReady"
Jul 28 10:08:21.339387 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.339283    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 10:08:21.381063 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.381035    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-b55955d75-mh9fw"]
Jul 28 10:08:21.385996 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.385972    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.390540 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.390515    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 10:08:21.390674 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.390565    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 10:08:21.391070 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.390882    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 10:08:21.391070 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.390980    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bcfzv\""
Jul 28 10:08:21.403194 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.403171    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-j5k8g"]
Jul 28 10:08:21.404216 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.404193    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 10:08:21.406831 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.406813    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:08:21.409211 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.409192    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r2sgh"]
Jul 28 10:08:21.409597 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.409578    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kvgz4\""
Jul 28 10:08:21.409828 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.409810    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 10:08:21.409932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.409826    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 10:08:21.412528 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.412509    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r2sgh"
Jul 28 10:08:21.415187 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.415171    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 10:08:21.416675 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.416657    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b55955d75-mh9fw"]
Jul 28 10:08:21.418225 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.418206    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 10:08:21.418225 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.418212    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7qffd\""
Jul 28 10:08:21.418367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.418250    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 10:08:21.427409 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.427387    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j5k8g"]
Jul 28 10:08:21.432094 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.432073    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r2sgh"]
Jul 28 10:08:21.457926 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.457902    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4aa30efc-6e3a-4303-98e2-966b1268902f-trusted-ca\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.458075 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.457960    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4aa30efc-6e3a-4303-98e2-966b1268902f-ca-trust-extracted\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.458075 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.457992    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4aa30efc-6e3a-4303-98e2-966b1268902f-image-registry-private-configuration\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.458075 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.458029    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-bound-sa-token\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.458075 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.458053    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-certificates\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.458266 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.458107    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g926\" (UniqueName: \"kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-kube-api-access-9g926\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.458266 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.458177    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.458266 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.458207    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4aa30efc-6e3a-4303-98e2-966b1268902f-installation-pull-secrets\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.559422 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.559379    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g926\" (UniqueName: \"kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-kube-api-access-9g926\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.559422 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.559419    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d8c1a3b-efee-4b30-9022-087775f8ea49-tmp-dir\") pod \"dns-default-j5k8g\" (UID: \"4d8c1a3b-efee-4b30-9022-087775f8ea49\") " pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:08:21.559627 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.559446    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.559627 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.559463    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4aa30efc-6e3a-4303-98e2-966b1268902f-installation-pull-secrets\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.559627 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.559482    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls\") pod \"dns-default-j5k8g\" (UID: \"4d8c1a3b-efee-4b30-9022-087775f8ea49\") " pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:08:21.559627 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.559508    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4aa30efc-6e3a-4303-98e2-966b1268902f-trusted-ca\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.559627 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.559539    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4m5k\" (UniqueName: \"kubernetes.io/projected/c70e4831-8e62-4e7c-8fd3-fb6404548c26-kube-api-access-q4m5k\") pod \"ingress-canary-r2sgh\" (UID: \"c70e4831-8e62-4e7c-8fd3-fb6404548c26\") " pod="openshift-ingress-canary/ingress-canary-r2sgh"
Jul 28 10:08:21.559627 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:21.559583    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 10:08:21.559627 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:21.559602    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b55955d75-mh9fw: secret "image-registry-tls" not found
Jul 28 10:08:21.559933 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:21.559680    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls podName:4aa30efc-6e3a-4303-98e2-966b1268902f nodeName:}" failed. No retries permitted until 2026-07-28 10:08:22.059659755 +0000 UTC m=+35.461898151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls") pod "image-registry-b55955d75-mh9fw" (UID: "4aa30efc-6e3a-4303-98e2-966b1268902f") : secret "image-registry-tls" not found
Jul 28 10:08:21.559933 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.559715    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4aa30efc-6e3a-4303-98e2-966b1268902f-ca-trust-extracted\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.559933 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.559741    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d8c1a3b-efee-4b30-9022-087775f8ea49-config-volume\") pod \"dns-default-j5k8g\" (UID: \"4d8c1a3b-efee-4b30-9022-087775f8ea49\") " pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:08:21.559933 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.559770    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4aa30efc-6e3a-4303-98e2-966b1268902f-image-registry-private-configuration\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.559933 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.559792    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nwnl\" (UniqueName: \"kubernetes.io/projected/4d8c1a3b-efee-4b30-9022-087775f8ea49-kube-api-access-2nwnl\") pod \"dns-default-j5k8g\" (UID: \"4d8c1a3b-efee-4b30-9022-087775f8ea49\") " pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:08:21.559933 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.559886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-bound-sa-token\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.559933 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.559925    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c70e4831-8e62-4e7c-8fd3-fb6404548c26-cert\") pod \"ingress-canary-r2sgh\" (UID: \"c70e4831-8e62-4e7c-8fd3-fb6404548c26\") " pod="openshift-ingress-canary/ingress-canary-r2sgh"
Jul 28 10:08:21.560278 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.559963    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-certificates\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.560489 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.560469    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-certificates\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.560559 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.560513    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4aa30efc-6e3a-4303-98e2-966b1268902f-trusted-ca\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.560726 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.560712    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4aa30efc-6e3a-4303-98e2-966b1268902f-ca-trust-extracted\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.564098 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.564073    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4aa30efc-6e3a-4303-98e2-966b1268902f-installation-pull-secrets\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.564216 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.564096    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4aa30efc-6e3a-4303-98e2-966b1268902f-image-registry-private-configuration\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.570609 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.570592    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-bound-sa-token\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.570976 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.570956    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g926\" (UniqueName: \"kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-kube-api-access-9g926\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:21.660885 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.660790    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d8c1a3b-efee-4b30-9022-087775f8ea49-config-volume\") pod \"dns-default-j5k8g\" (UID: \"4d8c1a3b-efee-4b30-9022-087775f8ea49\") " pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:08:21.660885 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.660833    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nwnl\" (UniqueName: \"kubernetes.io/projected/4d8c1a3b-efee-4b30-9022-087775f8ea49-kube-api-access-2nwnl\") pod \"dns-default-j5k8g\" (UID: \"4d8c1a3b-efee-4b30-9022-087775f8ea49\") " pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:08:21.660885 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.660885    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c70e4831-8e62-4e7c-8fd3-fb6404548c26-cert\") pod \"ingress-canary-r2sgh\" (UID: \"c70e4831-8e62-4e7c-8fd3-fb6404548c26\") " pod="openshift-ingress-canary/ingress-canary-r2sgh"
Jul 28 10:08:21.661535 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.660912    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d8c1a3b-efee-4b30-9022-087775f8ea49-tmp-dir\") pod \"dns-default-j5k8g\" (UID: \"4d8c1a3b-efee-4b30-9022-087775f8ea49\") " pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:08:21.661535 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.660943    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls\") pod \"dns-default-j5k8g\" (UID: \"4d8c1a3b-efee-4b30-9022-087775f8ea49\") " pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:08:21.661535 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.660980    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4m5k\" (UniqueName: \"kubernetes.io/projected/c70e4831-8e62-4e7c-8fd3-fb6404548c26-kube-api-access-q4m5k\") pod \"ingress-canary-r2sgh\" (UID: \"c70e4831-8e62-4e7c-8fd3-fb6404548c26\") " pod="openshift-ingress-canary/ingress-canary-r2sgh"
Jul 28 10:08:21.662069 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:21.661802    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 10:08:21.662069 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.661801    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4d8c1a3b-efee-4b30-9022-087775f8ea49-config-volume\") pod \"dns-default-j5k8g\" (UID: \"4d8c1a3b-efee-4b30-9022-087775f8ea49\") " pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:08:21.662069 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:21.661907    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls podName:4d8c1a3b-efee-4b30-9022-087775f8ea49 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:22.161886631 +0000 UTC m=+35.564125024 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls") pod "dns-default-j5k8g" (UID: "4d8c1a3b-efee-4b30-9022-087775f8ea49") : secret "dns-default-metrics-tls" not found
Jul 28 10:08:21.662069 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.661968    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4d8c1a3b-efee-4b30-9022-087775f8ea49-tmp-dir\") pod \"dns-default-j5k8g\" (UID: \"4d8c1a3b-efee-4b30-9022-087775f8ea49\") " pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:08:21.664312 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.664294    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c70e4831-8e62-4e7c-8fd3-fb6404548c26-cert\") pod \"ingress-canary-r2sgh\" (UID: \"c70e4831-8e62-4e7c-8fd3-fb6404548c26\") " pod="openshift-ingress-canary/ingress-canary-r2sgh"
Jul 28 10:08:21.674563 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.674542    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nwnl\" (UniqueName: \"kubernetes.io/projected/4d8c1a3b-efee-4b30-9022-087775f8ea49-kube-api-access-2nwnl\") pod \"dns-default-j5k8g\" (UID: \"4d8c1a3b-efee-4b30-9022-087775f8ea49\") " pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:08:21.674730 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.674714    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4m5k\" (UniqueName: \"kubernetes.io/projected/c70e4831-8e62-4e7c-8fd3-fb6404548c26-kube-api-access-q4m5k\") pod \"ingress-canary-r2sgh\" (UID: \"c70e4831-8e62-4e7c-8fd3-fb6404548c26\") " pod="openshift-ingress-canary/ingress-canary-r2sgh"
Jul 28 10:08:21.724951 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:21.724920    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r2sgh"
Jul 28 10:08:22.064208 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:22.064121    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:22.064349 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:22.064258    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 10:08:22.064349 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:22.064271    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b55955d75-mh9fw: secret "image-registry-tls" not found
Jul 28 10:08:22.064349 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:22.064326    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls podName:4aa30efc-6e3a-4303-98e2-966b1268902f nodeName:}" failed. No retries permitted until 2026-07-28 10:08:23.064312649 +0000 UTC m=+36.466551025 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls") pod "image-registry-b55955d75-mh9fw" (UID: "4aa30efc-6e3a-4303-98e2-966b1268902f") : secret "image-registry-tls" not found
Jul 28 10:08:22.165085 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:22.165032    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls\") pod \"dns-default-j5k8g\" (UID: \"4d8c1a3b-efee-4b30-9022-087775f8ea49\") " pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:08:22.165262 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:22.165203    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 10:08:22.165311 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:22.165273    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls podName:4d8c1a3b-efee-4b30-9022-087775f8ea49 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:23.165254492 +0000 UTC m=+36.567492868 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls") pod "dns-default-j5k8g" (UID: "4d8c1a3b-efee-4b30-9022-087775f8ea49") : secret "dns-default-metrics-tls" not found
Jul 28 10:08:22.564442 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:22.564291    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r2sgh"]
Jul 28 10:08:22.567616 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:08:22.567589    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc70e4831_8e62_4e7c_8fd3_fb6404548c26.slice/crio-d9018b33980ee9c4aa5263c943391cca5e25a1421c8f61bb7195bfdd479a323c WatchSource:0}: Error finding container d9018b33980ee9c4aa5263c943391cca5e25a1421c8f61bb7195bfdd479a323c: Status 404 returned error can't find the container with id d9018b33980ee9c4aa5263c943391cca5e25a1421c8f61bb7195bfdd479a323c
Jul 28 10:08:23.039822 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:23.039738    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:08:23.040751 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:23.039747    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:08:23.040751 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:23.040200    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:08:23.043347 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:23.043116    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 10:08:23.043347 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:23.043124    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 10:08:23.043347 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:23.043137    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tgfjj\""
Jul 28 10:08:23.043347 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:23.043146    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 10:08:23.043347 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:23.043172    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nwnjm\""
Jul 28 10:08:23.043347 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:23.043124    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 10:08:23.075595 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:23.075571    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:23.075726 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:23.075705    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 10:08:23.075726 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:23.075717    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b55955d75-mh9fw: secret "image-registry-tls" not found
Jul 28 10:08:23.075812 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:23.075768    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls podName:4aa30efc-6e3a-4303-98e2-966b1268902f nodeName:}" failed. No retries permitted until 2026-07-28 10:08:25.075751754 +0000 UTC m=+38.477990134 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls") pod "image-registry-b55955d75-mh9fw" (UID: "4aa30efc-6e3a-4303-98e2-966b1268902f") : secret "image-registry-tls" not found
Jul 28 10:08:23.176901 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:23.176864    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls\") pod \"dns-default-j5k8g\" (UID: \"4d8c1a3b-efee-4b30-9022-087775f8ea49\") " pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:08:23.177055 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:23.177033    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 10:08:23.177137 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:23.177115    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls podName:4d8c1a3b-efee-4b30-9022-087775f8ea49 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:25.177093547 +0000 UTC m=+38.579331923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls") pod "dns-default-j5k8g" (UID: "4d8c1a3b-efee-4b30-9022-087775f8ea49") : secret "dns-default-metrics-tls" not found
Jul 28 10:08:23.192049 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:23.192018    2577 generic.go:356] "Generic (PLEG): container finished" podID="75a3cd6d-6743-42dd-953e-b7270ecbe64e" containerID="8cc8ad6fc0304cb69dde904ac74c450acfc7705013b474ba560326e5d160204d" exitCode=0
Jul 28 10:08:23.192211 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:23.192090    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mfhr" event={"ID":"75a3cd6d-6743-42dd-953e-b7270ecbe64e","Type":"ContainerDied","Data":"8cc8ad6fc0304cb69dde904ac74c450acfc7705013b474ba560326e5d160204d"}
Jul 28 10:08:23.193461 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:23.193431    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r2sgh" event={"ID":"c70e4831-8e62-4e7c-8fd3-fb6404548c26","Type":"ContainerStarted","Data":"d9018b33980ee9c4aa5263c943391cca5e25a1421c8f61bb7195bfdd479a323c"}
Jul 28 10:08:24.199444 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:24.199409    2577 generic.go:356] "Generic (PLEG): container finished" podID="75a3cd6d-6743-42dd-953e-b7270ecbe64e" containerID="78ff8e126ec39343375c5963f667b743a72262532f7d59f9190ec8b4db52572d" exitCode=0
Jul 28 10:08:24.199812 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:24.199493    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mfhr" event={"ID":"75a3cd6d-6743-42dd-953e-b7270ecbe64e","Type":"ContainerDied","Data":"78ff8e126ec39343375c5963f667b743a72262532f7d59f9190ec8b4db52572d"}
Jul 28 10:08:25.092353 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:25.092325    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:25.092526 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:25.092441    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 10:08:25.092526 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:25.092453    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b55955d75-mh9fw: secret "image-registry-tls" not found
Jul 28 10:08:25.092526 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:25.092501    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls podName:4aa30efc-6e3a-4303-98e2-966b1268902f nodeName:}" failed. No retries permitted until 2026-07-28 10:08:29.092488899 +0000 UTC m=+42.494727275 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls") pod "image-registry-b55955d75-mh9fw" (UID: "4aa30efc-6e3a-4303-98e2-966b1268902f") : secret "image-registry-tls" not found
Jul 28 10:08:25.193155 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:25.193070    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls\") pod \"dns-default-j5k8g\" (UID: \"4d8c1a3b-efee-4b30-9022-087775f8ea49\") " pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:08:25.193292 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:25.193211    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 10:08:25.193292 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:25.193274    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls podName:4d8c1a3b-efee-4b30-9022-087775f8ea49 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:29.193258384 +0000 UTC m=+42.595496759 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls") pod "dns-default-j5k8g" (UID: "4d8c1a3b-efee-4b30-9022-087775f8ea49") : secret "dns-default-metrics-tls" not found
Jul 28 10:08:25.205187 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:25.205154    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-4mfhr" event={"ID":"75a3cd6d-6743-42dd-953e-b7270ecbe64e","Type":"ContainerStarted","Data":"6d0fec6e939eec43a1d7462c585d89c2426685ad8b84b696f6a193ec5fa6f33f"}
Jul 28 10:08:25.206535 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:25.206513    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r2sgh" event={"ID":"c70e4831-8e62-4e7c-8fd3-fb6404548c26","Type":"ContainerStarted","Data":"b037e67adb05a3730ff650e0aa41b76348e3279264bbaa939e471228c36c145d"}
Jul 28 10:08:25.233588 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:25.233540    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-4mfhr" podStartSLOduration=8.735800966 podStartE2EDuration="38.23352775s" totalImagesPullingTime="29.497726784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:07:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:25.233052446 +0000 UTC m=+38.635290846" watchObservedRunningTime="2026-07-28 10:08:25.23352775 +0000 UTC m=+38.635766148"
Jul 28 10:08:25.254977 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:25.254930    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r2sgh" podStartSLOduration=2.21555469 podStartE2EDuration="4.254914312s" totalImagesPullingTime="2.039359622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:08:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:25.254816221 +0000 UTC m=+38.657054619" watchObservedRunningTime="2026-07-28 10:08:25.254914312 +0000 UTC m=+38.657152710"
Jul 28 10:08:25.406762 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:25.406720    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-z8vrl_f30801a2-932d-4b83-97d7-c61d81b859c5/konnectivity-agent/0.log" limit=1024
Jul 28 10:08:25.495352 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:25.495272    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-z8vrl_f30801a2-932d-4b83-97d7-c61d81b859c5/konnectivity-agent/0.log" limit=1024
Jul 28 10:08:26.298366 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:26.298188    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-z8vrl_f30801a2-932d-4b83-97d7-c61d81b859c5/konnectivity-agent/0.log" limit=1024
Jul 28 10:08:26.354872 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:26.354818    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-z8vrl_f30801a2-932d-4b83-97d7-c61d81b859c5/konnectivity-agent/0.log" limit=1024
Jul 28 10:08:29.119548 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:29.119507    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:29.119935 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:29.119632    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 10:08:29.119935 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:29.119643    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b55955d75-mh9fw: secret "image-registry-tls" not found
Jul 28 10:08:29.119935 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:29.119695    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls podName:4aa30efc-6e3a-4303-98e2-966b1268902f nodeName:}" failed. No retries permitted until 2026-07-28 10:08:37.119681249 +0000 UTC m=+50.521919625 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls") pod "image-registry-b55955d75-mh9fw" (UID: "4aa30efc-6e3a-4303-98e2-966b1268902f") : secret "image-registry-tls" not found
Jul 28 10:08:29.220584 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:29.220553    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls\") pod \"dns-default-j5k8g\" (UID: \"4d8c1a3b-efee-4b30-9022-087775f8ea49\") " pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:08:29.220742 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:29.220715    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 10:08:29.220788 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:29.220778    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls podName:4d8c1a3b-efee-4b30-9022-087775f8ea49 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:37.220760597 +0000 UTC m=+50.622998974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls") pod "dns-default-j5k8g" (UID: "4d8c1a3b-efee-4b30-9022-087775f8ea49") : secret "dns-default-metrics-tls" not found
Jul 28 10:08:37.178545 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:37.178510    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:37.179013 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:37.178626    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 10:08:37.179013 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:37.178639    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b55955d75-mh9fw: secret "image-registry-tls" not found
Jul 28 10:08:37.179013 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:37.178689    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls podName:4aa30efc-6e3a-4303-98e2-966b1268902f nodeName:}" failed. No retries permitted until 2026-07-28 10:08:53.178674868 +0000 UTC m=+66.580913245 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls") pod "image-registry-b55955d75-mh9fw" (UID: "4aa30efc-6e3a-4303-98e2-966b1268902f") : secret "image-registry-tls" not found
Jul 28 10:08:37.279879 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:37.279814    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls\") pod \"dns-default-j5k8g\" (UID: \"4d8c1a3b-efee-4b30-9022-087775f8ea49\") " pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:08:37.280034 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:37.279976    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 10:08:37.280080 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:37.280053    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls podName:4d8c1a3b-efee-4b30-9022-087775f8ea49 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:53.280035153 +0000 UTC m=+66.682273529 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls") pod "dns-default-j5k8g" (UID: "4d8c1a3b-efee-4b30-9022-087775f8ea49") : secret "dns-default-metrics-tls" not found
Jul 28 10:08:45.565088 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:45.565054    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw"]
Jul 28 10:08:45.568225 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:45.568208    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw"
Jul 28 10:08:45.570864 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:45.570826    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 10:08:45.570977 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:45.570870    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 10:08:45.572574 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:45.572557    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 28 10:08:45.572950 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:45.572936    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qrrkm\""
Jul 28 10:08:45.573034 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:45.573007    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 28 10:08:45.586336 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:45.586316    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw"]
Jul 28 10:08:45.742907 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:45.742864    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b826c4f0-64f0-45ef-9a39-2b56774f783d-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-85whw\" (UID: \"b826c4f0-64f0-45ef-9a39-2b56774f783d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw"
Jul 28 10:08:45.743095 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:45.742929    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whpzn\" (UniqueName: \"kubernetes.io/projected/b826c4f0-64f0-45ef-9a39-2b56774f783d-kube-api-access-whpzn\") pod \"cluster-monitoring-operator-548b489cb8-85whw\" (UID: \"b826c4f0-64f0-45ef-9a39-2b56774f783d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw"
Jul 28 10:08:45.743095 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:45.742991    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b826c4f0-64f0-45ef-9a39-2b56774f783d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-85whw\" (UID: \"b826c4f0-64f0-45ef-9a39-2b56774f783d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw"
Jul 28 10:08:45.843452 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:45.843371    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b826c4f0-64f0-45ef-9a39-2b56774f783d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-85whw\" (UID: \"b826c4f0-64f0-45ef-9a39-2b56774f783d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw"
Jul 28 10:08:45.843452 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:45.843432    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b826c4f0-64f0-45ef-9a39-2b56774f783d-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-85whw\" (UID: \"b826c4f0-64f0-45ef-9a39-2b56774f783d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw"
Jul 28 10:08:45.843645 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:45.843459    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whpzn\" (UniqueName: \"kubernetes.io/projected/b826c4f0-64f0-45ef-9a39-2b56774f783d-kube-api-access-whpzn\") pod \"cluster-monitoring-operator-548b489cb8-85whw\" (UID: \"b826c4f0-64f0-45ef-9a39-2b56774f783d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw"
Jul 28 10:08:45.843645 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:45.843512    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 10:08:45.843645 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:45.843585    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b826c4f0-64f0-45ef-9a39-2b56774f783d-cluster-monitoring-operator-tls podName:b826c4f0-64f0-45ef-9a39-2b56774f783d nodeName:}" failed. No retries permitted until 2026-07-28 10:08:46.34356958 +0000 UTC m=+59.745807955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b826c4f0-64f0-45ef-9a39-2b56774f783d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-85whw" (UID: "b826c4f0-64f0-45ef-9a39-2b56774f783d") : secret "cluster-monitoring-operator-tls" not found
Jul 28 10:08:45.844136 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:45.844119    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b826c4f0-64f0-45ef-9a39-2b56774f783d-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-85whw\" (UID: \"b826c4f0-64f0-45ef-9a39-2b56774f783d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw"
Jul 28 10:08:45.854351 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:45.854325    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whpzn\" (UniqueName: \"kubernetes.io/projected/b826c4f0-64f0-45ef-9a39-2b56774f783d-kube-api-access-whpzn\") pod \"cluster-monitoring-operator-548b489cb8-85whw\" (UID: \"b826c4f0-64f0-45ef-9a39-2b56774f783d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw"
Jul 28 10:08:46.347194 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:46.347154    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b826c4f0-64f0-45ef-9a39-2b56774f783d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-85whw\" (UID: \"b826c4f0-64f0-45ef-9a39-2b56774f783d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw"
Jul 28 10:08:46.347366 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:46.347320    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 10:08:46.347415 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:46.347402    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b826c4f0-64f0-45ef-9a39-2b56774f783d-cluster-monitoring-operator-tls podName:b826c4f0-64f0-45ef-9a39-2b56774f783d nodeName:}" failed. No retries permitted until 2026-07-28 10:08:47.347383518 +0000 UTC m=+60.749621896 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b826c4f0-64f0-45ef-9a39-2b56774f783d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-85whw" (UID: "b826c4f0-64f0-45ef-9a39-2b56774f783d") : secret "cluster-monitoring-operator-tls" not found
Jul 28 10:08:47.183515 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:47.183476    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nsv94"
Jul 28 10:08:47.354192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:47.354153    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b826c4f0-64f0-45ef-9a39-2b56774f783d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-85whw\" (UID: \"b826c4f0-64f0-45ef-9a39-2b56774f783d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw"
Jul 28 10:08:47.354379 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:47.354344    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 10:08:47.354448 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:47.354422    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b826c4f0-64f0-45ef-9a39-2b56774f783d-cluster-monitoring-operator-tls podName:b826c4f0-64f0-45ef-9a39-2b56774f783d nodeName:}" failed. No retries permitted until 2026-07-28 10:08:49.354399296 +0000 UTC m=+62.756637672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b826c4f0-64f0-45ef-9a39-2b56774f783d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-85whw" (UID: "b826c4f0-64f0-45ef-9a39-2b56774f783d") : secret "cluster-monitoring-operator-tls" not found
Jul 28 10:08:49.369858 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:49.369807    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b826c4f0-64f0-45ef-9a39-2b56774f783d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-85whw\" (UID: \"b826c4f0-64f0-45ef-9a39-2b56774f783d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw"
Jul 28 10:08:49.370322 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:49.370275    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 10:08:49.370447 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:49.370407    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b826c4f0-64f0-45ef-9a39-2b56774f783d-cluster-monitoring-operator-tls podName:b826c4f0-64f0-45ef-9a39-2b56774f783d nodeName:}" failed. No retries permitted until 2026-07-28 10:08:53.37037266 +0000 UTC m=+66.772611118 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b826c4f0-64f0-45ef-9a39-2b56774f783d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-85whw" (UID: "b826c4f0-64f0-45ef-9a39-2b56774f783d") : secret "cluster-monitoring-operator-tls" not found
Jul 28 10:08:50.172140 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.172109    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gkjrn"]
Jul 28 10:08:50.174685 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.174671    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:08:50.176778 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.176755    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 10:08:50.176917 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.176879    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vsm7x\""
Jul 28 10:08:50.177001 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.176987    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 10:08:50.177627 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.177604    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 10:08:50.177714 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.177648    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 10:08:50.189073 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.189009    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gkjrn"]
Jul 28 10:08:50.276974 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.276939    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/172a1903-cc50-48f2-b03c-0e682df09ea2-data-volume\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:08:50.277129 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.277003    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8v2np\" (UniqueName: \"kubernetes.io/projected/172a1903-cc50-48f2-b03c-0e682df09ea2-kube-api-access-8v2np\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:08:50.277129 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.277046    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/172a1903-cc50-48f2-b03c-0e682df09ea2-crio-socket\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:08:50.277129 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.277063    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/172a1903-cc50-48f2-b03c-0e682df09ea2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:08:50.277235 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.277158    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/172a1903-cc50-48f2-b03c-0e682df09ea2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:08:50.377895 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.377858    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8v2np\" (UniqueName: \"kubernetes.io/projected/172a1903-cc50-48f2-b03c-0e682df09ea2-kube-api-access-8v2np\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:08:50.378264 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.377910    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/172a1903-cc50-48f2-b03c-0e682df09ea2-crio-socket\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:08:50.378264 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.377928    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/172a1903-cc50-48f2-b03c-0e682df09ea2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:08:50.378264 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.378003    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/172a1903-cc50-48f2-b03c-0e682df09ea2-crio-socket\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:08:50.378264 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:50.378012    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 10:08:50.378264 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:50.378083    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/172a1903-cc50-48f2-b03c-0e682df09ea2-insights-runtime-extractor-tls podName:172a1903-cc50-48f2-b03c-0e682df09ea2 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:50.878065836 +0000 UTC m=+64.280304213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/172a1903-cc50-48f2-b03c-0e682df09ea2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gkjrn" (UID: "172a1903-cc50-48f2-b03c-0e682df09ea2") : secret "insights-runtime-extractor-tls" not found
Jul 28 10:08:50.378264 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.378113    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/172a1903-cc50-48f2-b03c-0e682df09ea2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:08:50.378264 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.378134    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/172a1903-cc50-48f2-b03c-0e682df09ea2-data-volume\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:08:50.378264 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:50.378185    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 10:08:50.378264 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:50.378264    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/172a1903-cc50-48f2-b03c-0e682df09ea2-kube-rbac-proxy-cm podName:172a1903-cc50-48f2-b03c-0e682df09ea2 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:50.878247437 +0000 UTC m=+64.280485814 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/172a1903-cc50-48f2-b03c-0e682df09ea2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gkjrn" (UID: "172a1903-cc50-48f2-b03c-0e682df09ea2") : configmap "kube-rbac-proxy" not found
Jul 28 10:08:50.378540 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.378379    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/172a1903-cc50-48f2-b03c-0e682df09ea2-data-volume\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:08:50.389437 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.389407    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8v2np\" (UniqueName: \"kubernetes.io/projected/172a1903-cc50-48f2-b03c-0e682df09ea2-kube-api-access-8v2np\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:08:50.882384 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.882355    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/172a1903-cc50-48f2-b03c-0e682df09ea2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:08:50.882538 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:50.882420    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/172a1903-cc50-48f2-b03c-0e682df09ea2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:08:50.882538 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:50.882477    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 10:08:50.882538 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:50.882528    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 10:08:50.882639 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:50.882562    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/172a1903-cc50-48f2-b03c-0e682df09ea2-kube-rbac-proxy-cm podName:172a1903-cc50-48f2-b03c-0e682df09ea2 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:51.882543926 +0000 UTC m=+65.284782306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/172a1903-cc50-48f2-b03c-0e682df09ea2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gkjrn" (UID: "172a1903-cc50-48f2-b03c-0e682df09ea2") : configmap "kube-rbac-proxy" not found
Jul 28 10:08:50.882639 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:50.882580    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/172a1903-cc50-48f2-b03c-0e682df09ea2-insights-runtime-extractor-tls podName:172a1903-cc50-48f2-b03c-0e682df09ea2 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:51.882569977 +0000 UTC m=+65.284808354 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/172a1903-cc50-48f2-b03c-0e682df09ea2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gkjrn" (UID: "172a1903-cc50-48f2-b03c-0e682df09ea2") : secret "insights-runtime-extractor-tls" not found
Jul 28 10:08:51.890005 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:51.889969    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/172a1903-cc50-48f2-b03c-0e682df09ea2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:08:51.890383 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:51.890052    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/172a1903-cc50-48f2-b03c-0e682df09ea2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:08:51.890383 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:51.890121    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 10:08:51.890383 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:51.890134    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 10:08:51.890383 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:51.890185    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/172a1903-cc50-48f2-b03c-0e682df09ea2-insights-runtime-extractor-tls podName:172a1903-cc50-48f2-b03c-0e682df09ea2 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:53.890169626 +0000 UTC m=+67.292408002 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/172a1903-cc50-48f2-b03c-0e682df09ea2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gkjrn" (UID: "172a1903-cc50-48f2-b03c-0e682df09ea2") : secret "insights-runtime-extractor-tls" not found
Jul 28 10:08:51.890383 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:51.890200    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/172a1903-cc50-48f2-b03c-0e682df09ea2-kube-rbac-proxy-cm podName:172a1903-cc50-48f2-b03c-0e682df09ea2 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:53.890193091 +0000 UTC m=+67.292431467 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/172a1903-cc50-48f2-b03c-0e682df09ea2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gkjrn" (UID: "172a1903-cc50-48f2-b03c-0e682df09ea2") : configmap "kube-rbac-proxy" not found
Jul 28 10:08:52.059522 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:52.059494    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g59wc_166cc762-9ac9-414d-bc70-1cc5d7a9d718/dns-node-resolver/0.log"
Jul 28 10:08:52.696289 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:52.696252    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret\") pod \"global-pull-secret-syncer-v26n5\" (UID: \"5536a6cc-73fa-4449-8a5c-d3798c359de8\") " pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:08:52.699126 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:52.699102    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 10:08:52.709123 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:52.709099    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5536a6cc-73fa-4449-8a5c-d3798c359de8-original-pull-secret\") pod \"global-pull-secret-syncer-v26n5\" (UID: \"5536a6cc-73fa-4449-8a5c-d3798c359de8\") " pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:08:52.764528 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:52.764488    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v26n5"
Jul 28 10:08:52.797456 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:52.797429    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs\") pod \"network-metrics-daemon-8dw4k\" (UID: \"af1264bf-57b1-45a9-8753-f359fe2f0b65\") " pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:08:52.799882 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:52.799864    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 10:08:52.807676 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:52.807643    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 28 10:08:52.807868 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:52.807729    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs podName:af1264bf-57b1-45a9-8753-f359fe2f0b65 nodeName:}" failed. No retries permitted until 2026-07-28 10:09:56.807705444 +0000 UTC m=+130.209943822 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs") pod "network-metrics-daemon-8dw4k" (UID: "af1264bf-57b1-45a9-8753-f359fe2f0b65") : secret "metrics-daemon-secret" not found
Jul 28 10:08:52.898789 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:52.898758    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqshz\" (UniqueName: \"kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz\") pod \"network-check-target-rj8l7\" (UID: \"0b17897e-d028-4f8b-ba02-5f5a0de532e7\") " pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:08:52.901017 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:52.900999    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 10:08:52.902737 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:52.902715    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v26n5"]
Jul 28 10:08:52.906721 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:08:52.906698    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5536a6cc_73fa_4449_8a5c_d3798c359de8.slice/crio-d9b313a1a54ebab761518f308169834336d9a0c4f88d96aea232b0ddbf665591 WatchSource:0}: Error finding container d9b313a1a54ebab761518f308169834336d9a0c4f88d96aea232b0ddbf665591: Status 404 returned error can't find the container with id d9b313a1a54ebab761518f308169834336d9a0c4f88d96aea232b0ddbf665591
Jul 28 10:08:52.911718 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:52.911696    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 10:08:52.922750 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:52.922723    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqshz\" (UniqueName: \"kubernetes.io/projected/0b17897e-d028-4f8b-ba02-5f5a0de532e7-kube-api-access-wqshz\") pod \"network-check-target-rj8l7\" (UID: \"0b17897e-d028-4f8b-ba02-5f5a0de532e7\") " pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:08:53.054194 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:53.054168    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nwnjm\""
Jul 28 10:08:53.057912 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:53.057891    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k7rg8_d7b8d225-6dc7-4a2b-9201-a47e73ffe254/node-ca/0.log"
Jul 28 10:08:53.063096 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:53.063079    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:08:53.191539 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:53.191510    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rj8l7"]
Jul 28 10:08:53.194715 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:08:53.194683    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b17897e_d028_4f8b_ba02_5f5a0de532e7.slice/crio-e63c22be1dd541ef0023c8ae896c5563c6f5954a9b0f8362dfcb9a4badc3eaf3 WatchSource:0}: Error finding container e63c22be1dd541ef0023c8ae896c5563c6f5954a9b0f8362dfcb9a4badc3eaf3: Status 404 returned error can't find the container with id e63c22be1dd541ef0023c8ae896c5563c6f5954a9b0f8362dfcb9a4badc3eaf3
Jul 28 10:08:53.202441 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:53.202421    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:08:53.202588 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:53.202572    2577 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 10:08:53.202653 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:53.202592    2577 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-b55955d75-mh9fw: secret "image-registry-tls" not found
Jul 28 10:08:53.202653 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:53.202651    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls podName:4aa30efc-6e3a-4303-98e2-966b1268902f nodeName:}" failed. No retries permitted until 2026-07-28 10:09:25.20263182 +0000 UTC m=+98.604870201 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls") pod "image-registry-b55955d75-mh9fw" (UID: "4aa30efc-6e3a-4303-98e2-966b1268902f") : secret "image-registry-tls" not found
Jul 28 10:08:53.271364 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:53.271330    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rj8l7" event={"ID":"0b17897e-d028-4f8b-ba02-5f5a0de532e7","Type":"ContainerStarted","Data":"e63c22be1dd541ef0023c8ae896c5563c6f5954a9b0f8362dfcb9a4badc3eaf3"}
Jul 28 10:08:53.272472 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:53.272442    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v26n5" event={"ID":"5536a6cc-73fa-4449-8a5c-d3798c359de8","Type":"ContainerStarted","Data":"d9b313a1a54ebab761518f308169834336d9a0c4f88d96aea232b0ddbf665591"}
Jul 28 10:08:53.302931 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:53.302909    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls\") pod \"dns-default-j5k8g\" (UID: \"4d8c1a3b-efee-4b30-9022-087775f8ea49\") " pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:08:53.303093 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:53.303075    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 10:08:53.303156 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:53.303146    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls podName:4d8c1a3b-efee-4b30-9022-087775f8ea49 nodeName:}" failed. No retries permitted until 2026-07-28 10:09:25.303127093 +0000 UTC m=+98.705365468 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls") pod "dns-default-j5k8g" (UID: "4d8c1a3b-efee-4b30-9022-087775f8ea49") : secret "dns-default-metrics-tls" not found
Jul 28 10:08:53.404228 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:53.404135    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b826c4f0-64f0-45ef-9a39-2b56774f783d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-85whw\" (UID: \"b826c4f0-64f0-45ef-9a39-2b56774f783d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw"
Jul 28 10:08:53.404388 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:53.404310    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 10:08:53.404442 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:53.404389    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b826c4f0-64f0-45ef-9a39-2b56774f783d-cluster-monitoring-operator-tls podName:b826c4f0-64f0-45ef-9a39-2b56774f783d nodeName:}" failed. No retries permitted until 2026-07-28 10:09:01.4043668 +0000 UTC m=+74.806605176 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b826c4f0-64f0-45ef-9a39-2b56774f783d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-85whw" (UID: "b826c4f0-64f0-45ef-9a39-2b56774f783d") : secret "cluster-monitoring-operator-tls" not found
Jul 28 10:08:53.858457 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:53.858295    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r2sgh_c70e4831-8e62-4e7c-8fd3-fb6404548c26/serve-healthcheck-canary/0.log"
Jul 28 10:08:53.908503 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:53.908475    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/172a1903-cc50-48f2-b03c-0e682df09ea2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:08:53.909002 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:53.908595    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/172a1903-cc50-48f2-b03c-0e682df09ea2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:08:53.909002 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:53.908625    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 10:08:53.909002 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:53.908712    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/172a1903-cc50-48f2-b03c-0e682df09ea2-kube-rbac-proxy-cm podName:172a1903-cc50-48f2-b03c-0e682df09ea2 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:57.908688151 +0000 UTC m=+71.310926541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/172a1903-cc50-48f2-b03c-0e682df09ea2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gkjrn" (UID: "172a1903-cc50-48f2-b03c-0e682df09ea2") : configmap "kube-rbac-proxy" not found
Jul 28 10:08:53.909002 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:53.908776    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 10:08:53.909002 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:53.908834    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/172a1903-cc50-48f2-b03c-0e682df09ea2-insights-runtime-extractor-tls podName:172a1903-cc50-48f2-b03c-0e682df09ea2 nodeName:}" failed. No retries permitted until 2026-07-28 10:08:57.908818766 +0000 UTC m=+71.311057145 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/172a1903-cc50-48f2-b03c-0e682df09ea2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gkjrn" (UID: "172a1903-cc50-48f2-b03c-0e682df09ea2") : secret "insights-runtime-extractor-tls" not found
Jul 28 10:08:57.950380 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:57.950269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/172a1903-cc50-48f2-b03c-0e682df09ea2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:08:57.950380 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:57.950358    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/172a1903-cc50-48f2-b03c-0e682df09ea2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:08:57.950770 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:57.950418    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 10:08:57.950770 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:57.950495    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/172a1903-cc50-48f2-b03c-0e682df09ea2-insights-runtime-extractor-tls podName:172a1903-cc50-48f2-b03c-0e682df09ea2 nodeName:}" failed. No retries permitted until 2026-07-28 10:09:05.950472007 +0000 UTC m=+79.352710382 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/172a1903-cc50-48f2-b03c-0e682df09ea2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gkjrn" (UID: "172a1903-cc50-48f2-b03c-0e682df09ea2") : secret "insights-runtime-extractor-tls" not found
Jul 28 10:08:57.950770 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:57.950423    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 10:08:57.950770 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:08:57.950555    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/172a1903-cc50-48f2-b03c-0e682df09ea2-kube-rbac-proxy-cm podName:172a1903-cc50-48f2-b03c-0e682df09ea2 nodeName:}" failed. No retries permitted until 2026-07-28 10:09:05.950542292 +0000 UTC m=+79.352780687 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/172a1903-cc50-48f2-b03c-0e682df09ea2-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gkjrn" (UID: "172a1903-cc50-48f2-b03c-0e682df09ea2") : configmap "kube-rbac-proxy" not found
Jul 28 10:08:58.287889 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:58.287834    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rj8l7" event={"ID":"0b17897e-d028-4f8b-ba02-5f5a0de532e7","Type":"ContainerStarted","Data":"0de1a0928a375a6c40aeae21f2aedf6989958e1efc585df40ee1f23e45daa536"}
Jul 28 10:08:58.288087 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:58.287968    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:08:58.289173 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:58.289152    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v26n5" event={"ID":"5536a6cc-73fa-4449-8a5c-d3798c359de8","Type":"ContainerStarted","Data":"fc3b3518483510c37f6d431b7d5e2f6551b43946f9a44f37871617f6ba0c8666"}
Jul 28 10:08:58.305747 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:58.305710    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rj8l7" podStartSLOduration=66.949165446 podStartE2EDuration="1m11.305698426s" totalImagesPullingTime="4.35653298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:58.30488787 +0000 UTC m=+71.707126268" watchObservedRunningTime="2026-07-28 10:08:58.305698426 +0000 UTC m=+71.707936823"
Jul 28 10:08:58.320142 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:08:58.320103    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-v26n5" podStartSLOduration=66.672281934 podStartE2EDuration="1m11.320091848s" totalImagesPullingTime="4.647809914s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:08:58.319665397 +0000 UTC m=+71.721903796" watchObservedRunningTime="2026-07-28 10:08:58.320091848 +0000 UTC m=+71.722330245"
Jul 28 10:09:01.478322 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:01.478269    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b826c4f0-64f0-45ef-9a39-2b56774f783d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-85whw\" (UID: \"b826c4f0-64f0-45ef-9a39-2b56774f783d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw"
Jul 28 10:09:01.478720 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:09:01.478429    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 10:09:01.478720 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:09:01.478496    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b826c4f0-64f0-45ef-9a39-2b56774f783d-cluster-monitoring-operator-tls podName:b826c4f0-64f0-45ef-9a39-2b56774f783d nodeName:}" failed. No retries permitted until 2026-07-28 10:09:17.478480026 +0000 UTC m=+90.880718402 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b826c4f0-64f0-45ef-9a39-2b56774f783d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-85whw" (UID: "b826c4f0-64f0-45ef-9a39-2b56774f783d") : secret "cluster-monitoring-operator-tls" not found
Jul 28 10:09:03.371749 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:03.371718    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-7xnmn"]
Jul 28 10:09:03.373397 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:03.373383    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-7xnmn"
Jul 28 10:09:03.381261 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:03.381242    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 28 10:09:03.381359 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:03.381297    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 28 10:09:03.381416 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:03.381399    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 28 10:09:03.382094 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:03.382081    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 28 10:09:03.382141 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:03.382113    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xj69b\""
Jul 28 10:09:03.389686 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:03.389665    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-7xnmn"]
Jul 28 10:09:03.495317 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:03.495286    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng589\" (UniqueName: \"kubernetes.io/projected/3da8d957-f482-40fa-a729-a5e9a370e997-kube-api-access-ng589\") pod \"service-ca-658d7b7c78-7xnmn\" (UID: \"3da8d957-f482-40fa-a729-a5e9a370e997\") " pod="openshift-service-ca/service-ca-658d7b7c78-7xnmn"
Jul 28 10:09:03.495478 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:03.495335    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3da8d957-f482-40fa-a729-a5e9a370e997-signing-cabundle\") pod \"service-ca-658d7b7c78-7xnmn\" (UID: \"3da8d957-f482-40fa-a729-a5e9a370e997\") " pod="openshift-service-ca/service-ca-658d7b7c78-7xnmn"
Jul 28 10:09:03.495478 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:03.495371    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3da8d957-f482-40fa-a729-a5e9a370e997-signing-key\") pod \"service-ca-658d7b7c78-7xnmn\" (UID: \"3da8d957-f482-40fa-a729-a5e9a370e997\") " pod="openshift-service-ca/service-ca-658d7b7c78-7xnmn"
Jul 28 10:09:03.595855 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:03.595804    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng589\" (UniqueName: \"kubernetes.io/projected/3da8d957-f482-40fa-a729-a5e9a370e997-kube-api-access-ng589\") pod \"service-ca-658d7b7c78-7xnmn\" (UID: \"3da8d957-f482-40fa-a729-a5e9a370e997\") " pod="openshift-service-ca/service-ca-658d7b7c78-7xnmn"
Jul 28 10:09:03.595923 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:03.595878    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3da8d957-f482-40fa-a729-a5e9a370e997-signing-cabundle\") pod \"service-ca-658d7b7c78-7xnmn\" (UID: \"3da8d957-f482-40fa-a729-a5e9a370e997\") " pod="openshift-service-ca/service-ca-658d7b7c78-7xnmn"
Jul 28 10:09:03.595923 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:03.595919    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3da8d957-f482-40fa-a729-a5e9a370e997-signing-key\") pod \"service-ca-658d7b7c78-7xnmn\" (UID: \"3da8d957-f482-40fa-a729-a5e9a370e997\") " pod="openshift-service-ca/service-ca-658d7b7c78-7xnmn"
Jul 28 10:09:03.596572 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:03.596547    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3da8d957-f482-40fa-a729-a5e9a370e997-signing-cabundle\") pod \"service-ca-658d7b7c78-7xnmn\" (UID: \"3da8d957-f482-40fa-a729-a5e9a370e997\") " pod="openshift-service-ca/service-ca-658d7b7c78-7xnmn"
Jul 28 10:09:03.598360 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:03.598333    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3da8d957-f482-40fa-a729-a5e9a370e997-signing-key\") pod \"service-ca-658d7b7c78-7xnmn\" (UID: \"3da8d957-f482-40fa-a729-a5e9a370e997\") " pod="openshift-service-ca/service-ca-658d7b7c78-7xnmn"
Jul 28 10:09:03.612262 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:03.612237    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng589\" (UniqueName: \"kubernetes.io/projected/3da8d957-f482-40fa-a729-a5e9a370e997-kube-api-access-ng589\") pod \"service-ca-658d7b7c78-7xnmn\" (UID: \"3da8d957-f482-40fa-a729-a5e9a370e997\") " pod="openshift-service-ca/service-ca-658d7b7c78-7xnmn"
Jul 28 10:09:03.682288 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:03.682213    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-7xnmn"
Jul 28 10:09:03.810788 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:03.810745    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-7xnmn"]
Jul 28 10:09:03.813206 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:09:03.813178    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3da8d957_f482_40fa_a729_a5e9a370e997.slice/crio-36f6281f082192c50d45346bef96f4d7ee32d9af0a2d8b2f38720b25c20dbb41 WatchSource:0}: Error finding container 36f6281f082192c50d45346bef96f4d7ee32d9af0a2d8b2f38720b25c20dbb41: Status 404 returned error can't find the container with id 36f6281f082192c50d45346bef96f4d7ee32d9af0a2d8b2f38720b25c20dbb41
Jul 28 10:09:04.304382 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:04.304350    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-7xnmn" event={"ID":"3da8d957-f482-40fa-a729-a5e9a370e997","Type":"ContainerStarted","Data":"36f6281f082192c50d45346bef96f4d7ee32d9af0a2d8b2f38720b25c20dbb41"}
Jul 28 10:09:06.014725 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:06.014694    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/172a1903-cc50-48f2-b03c-0e682df09ea2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:09:06.015093 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:06.014760    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/172a1903-cc50-48f2-b03c-0e682df09ea2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:09:06.015093 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:09:06.014909    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 10:09:06.015093 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:09:06.014967    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/172a1903-cc50-48f2-b03c-0e682df09ea2-insights-runtime-extractor-tls podName:172a1903-cc50-48f2-b03c-0e682df09ea2 nodeName:}" failed. No retries permitted until 2026-07-28 10:09:22.014950849 +0000 UTC m=+95.417189231 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/172a1903-cc50-48f2-b03c-0e682df09ea2-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gkjrn" (UID: "172a1903-cc50-48f2-b03c-0e682df09ea2") : secret "insights-runtime-extractor-tls" not found
Jul 28 10:09:06.015298 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:06.015278    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/172a1903-cc50-48f2-b03c-0e682df09ea2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:09:06.311594 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:06.311560    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-7xnmn" event={"ID":"3da8d957-f482-40fa-a729-a5e9a370e997","Type":"ContainerStarted","Data":"9411d61b8a6be5d89f01692ae13403ee81d017973ff3a659a8d554ccdcf5d28b"}
Jul 28 10:09:06.328080 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:06.328029    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-7xnmn" podStartSLOduration=1.208094218 podStartE2EDuration="3.328012178s" totalImagesPullingTime="2.11991796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:09:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:06.327386007 +0000 UTC m=+79.729624406" watchObservedRunningTime="2026-07-28 10:09:06.328012178 +0000 UTC m=+79.730250597"
Jul 28 10:09:17.511524 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:17.511403    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b826c4f0-64f0-45ef-9a39-2b56774f783d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-85whw\" (UID: \"b826c4f0-64f0-45ef-9a39-2b56774f783d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw"
Jul 28 10:09:17.513977 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:17.513954    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b826c4f0-64f0-45ef-9a39-2b56774f783d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-85whw\" (UID: \"b826c4f0-64f0-45ef-9a39-2b56774f783d\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw"
Jul 28 10:09:17.680136 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:17.680103    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qrrkm\""
Jul 28 10:09:17.687736 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:17.687721    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw"
Jul 28 10:09:17.809933 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:17.809899    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw"]
Jul 28 10:09:17.812938 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:09:17.812914    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb826c4f0_64f0_45ef_9a39_2b56774f783d.slice/crio-dfe55cb65b2917bb77bb980f5bfe171c5e12fab57136bce35cc1355a9e9bd3c3 WatchSource:0}: Error finding container dfe55cb65b2917bb77bb980f5bfe171c5e12fab57136bce35cc1355a9e9bd3c3: Status 404 returned error can't find the container with id dfe55cb65b2917bb77bb980f5bfe171c5e12fab57136bce35cc1355a9e9bd3c3
Jul 28 10:09:18.344638 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:18.344606    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw" event={"ID":"b826c4f0-64f0-45ef-9a39-2b56774f783d","Type":"ContainerStarted","Data":"dfe55cb65b2917bb77bb980f5bfe171c5e12fab57136bce35cc1355a9e9bd3c3"}
Jul 28 10:09:20.351447 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:20.351414    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw" event={"ID":"b826c4f0-64f0-45ef-9a39-2b56774f783d","Type":"ContainerStarted","Data":"34c79996f89251ebee6335d3594a1adc1013e69d78065ea7dbeec84350ce7d05"}
Jul 28 10:09:20.373338 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:20.373290    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-85whw" podStartSLOduration=33.66946276 podStartE2EDuration="35.373274755s" totalImagesPullingTime="1.703811995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:08:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:20.371747745 +0000 UTC m=+93.773986142" watchObservedRunningTime="2026-07-28 10:09:20.373274755 +0000 UTC m=+93.775513153"
Jul 28 10:09:22.026019 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.025986    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7856dc8857-j2fl6"]
Jul 28 10:09:22.027818 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.027793    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7856dc8857-j2fl6"
Jul 28 10:09:22.030951 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.030928    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 28 10:09:22.032162 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.032129    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 28 10:09:22.032162 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.032155    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 28 10:09:22.032343 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.032239    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 28 10:09:22.043067 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.043046    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7856dc8857-j2fl6"]
Jul 28 10:09:22.046991 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.046972    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/172a1903-cc50-48f2-b03c-0e682df09ea2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:09:22.049325 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.049295    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/172a1903-cc50-48f2-b03c-0e682df09ea2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gkjrn\" (UID: \"172a1903-cc50-48f2-b03c-0e682df09ea2\") " pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:09:22.118394 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.118359    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jlvkz"]
Jul 28 10:09:22.120169 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.120149    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jlvkz"
Jul 28 10:09:22.122030 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.121948    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-8z9xm"]
Jul 28 10:09:22.122345 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.122329    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 28 10:09:22.123050 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.123030    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-h86qr\""
Jul 28 10:09:22.123895 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.123877    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-7dwzh"]
Jul 28 10:09:22.124006 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.123989    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-8z9xm"
Jul 28 10:09:22.125528 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.125510    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-29c9r"]
Jul 28 10:09:22.125620 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.125607    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-7dwzh"
Jul 28 10:09:22.127183 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.127079    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-29c9r"
Jul 28 10:09:22.129028 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.129005    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-9qs48\""
Jul 28 10:09:22.129118 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.129038    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 28 10:09:22.129169 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.129128    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 28 10:09:22.129225 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.129210    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 28 10:09:22.129654 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.129641    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 28 10:09:22.129699 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.129675    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-g8kz9\""
Jul 28 10:09:22.129699 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.129681    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-sljpl\""
Jul 28 10:09:22.135417 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.135396    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jlvkz"]
Jul 28 10:09:22.136589 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.136569    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-7dwzh"]
Jul 28 10:09:22.139366 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.139343    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-8z9xm"]
Jul 28 10:09:22.147356 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.147335    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl2xm\" (UniqueName: \"kubernetes.io/projected/4d877c60-171a-4df1-8d1f-835ecd7c578c-kube-api-access-rl2xm\") pod \"klusterlet-addon-workmgr-7856dc8857-j2fl6\" (UID: \"4d877c60-171a-4df1-8d1f-835ecd7c578c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7856dc8857-j2fl6"
Jul 28 10:09:22.147445 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.147369    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d877c60-171a-4df1-8d1f-835ecd7c578c-tmp\") pod \"klusterlet-addon-workmgr-7856dc8857-j2fl6\" (UID: \"4d877c60-171a-4df1-8d1f-835ecd7c578c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7856dc8857-j2fl6"
Jul 28 10:09:22.147546 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.147532    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4d877c60-171a-4df1-8d1f-835ecd7c578c-klusterlet-config\") pod \"klusterlet-addon-workmgr-7856dc8857-j2fl6\" (UID: \"4d877c60-171a-4df1-8d1f-835ecd7c578c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7856dc8857-j2fl6"
Jul 28 10:09:22.150760 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.150738    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-29c9r"]
Jul 28 10:09:22.248017 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.247986    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bddaba43-f333-4c89-b522-c21055cca710-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-jlvkz\" (UID: \"bddaba43-f333-4c89-b522-c21055cca710\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jlvkz"
Jul 28 10:09:22.248017 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.248022    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/32f6e4c4-f599-4f50-a1c4-8e57158cd792-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-7dwzh\" (UID: \"32f6e4c4-f599-4f50-a1c4-8e57158cd792\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7dwzh"
Jul 28 10:09:22.248269 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.248057    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32f6e4c4-f599-4f50-a1c4-8e57158cd792-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-7dwzh\" (UID: \"32f6e4c4-f599-4f50-a1c4-8e57158cd792\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7dwzh"
Jul 28 10:09:22.248269 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.248110    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl2xm\" (UniqueName: \"kubernetes.io/projected/4d877c60-171a-4df1-8d1f-835ecd7c578c-kube-api-access-rl2xm\") pod \"klusterlet-addon-workmgr-7856dc8857-j2fl6\" (UID: \"4d877c60-171a-4df1-8d1f-835ecd7c578c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7856dc8857-j2fl6"
Jul 28 10:09:22.248269 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.248145    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r56m\" (UniqueName: \"kubernetes.io/projected/e054c3a6-e305-4d49-8d17-f0218dc1874a-kube-api-access-8r56m\") pod \"network-check-source-7d88cb55d8-29c9r\" (UID: \"e054c3a6-e305-4d49-8d17-f0218dc1874a\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-29c9r"
Jul 28 10:09:22.248269 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.248177    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d877c60-171a-4df1-8d1f-835ecd7c578c-tmp\") pod \"klusterlet-addon-workmgr-7856dc8857-j2fl6\" (UID: \"4d877c60-171a-4df1-8d1f-835ecd7c578c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7856dc8857-j2fl6"
Jul 28 10:09:22.248269 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.248207    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzb52\" (UniqueName: \"kubernetes.io/projected/d5abb0c1-8a9a-4ff4-b53c-6f617855af87-kube-api-access-vzb52\") pod \"downloads-7c97dc4555-8z9xm\" (UID: \"d5abb0c1-8a9a-4ff4-b53c-6f617855af87\") " pod="openshift-console/downloads-7c97dc4555-8z9xm"
Jul 28 10:09:22.248511 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.248288    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4d877c60-171a-4df1-8d1f-835ecd7c578c-klusterlet-config\") pod \"klusterlet-addon-workmgr-7856dc8857-j2fl6\" (UID: \"4d877c60-171a-4df1-8d1f-835ecd7c578c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7856dc8857-j2fl6"
Jul 28 10:09:22.248566 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.248538    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d877c60-171a-4df1-8d1f-835ecd7c578c-tmp\") pod \"klusterlet-addon-workmgr-7856dc8857-j2fl6\" (UID: \"4d877c60-171a-4df1-8d1f-835ecd7c578c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7856dc8857-j2fl6"
Jul 28 10:09:22.250947 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.250925    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4d877c60-171a-4df1-8d1f-835ecd7c578c-klusterlet-config\") pod \"klusterlet-addon-workmgr-7856dc8857-j2fl6\" (UID: \"4d877c60-171a-4df1-8d1f-835ecd7c578c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7856dc8857-j2fl6"
Jul 28 10:09:22.259116 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.259096    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl2xm\" (UniqueName: \"kubernetes.io/projected/4d877c60-171a-4df1-8d1f-835ecd7c578c-kube-api-access-rl2xm\") pod \"klusterlet-addon-workmgr-7856dc8857-j2fl6\" (UID: \"4d877c60-171a-4df1-8d1f-835ecd7c578c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7856dc8857-j2fl6"
Jul 28 10:09:22.283801 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.283744    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gkjrn"
Jul 28 10:09:22.340879 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.340835    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7856dc8857-j2fl6"
Jul 28 10:09:22.348868 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.348828    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bddaba43-f333-4c89-b522-c21055cca710-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-jlvkz\" (UID: \"bddaba43-f333-4c89-b522-c21055cca710\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jlvkz"
Jul 28 10:09:22.349233 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.349207    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/32f6e4c4-f599-4f50-a1c4-8e57158cd792-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-7dwzh\" (UID: \"32f6e4c4-f599-4f50-a1c4-8e57158cd792\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7dwzh"
Jul 28 10:09:22.349285 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.349273    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32f6e4c4-f599-4f50-a1c4-8e57158cd792-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-7dwzh\" (UID: \"32f6e4c4-f599-4f50-a1c4-8e57158cd792\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7dwzh"
Jul 28 10:09:22.349322 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.349305    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r56m\" (UniqueName: \"kubernetes.io/projected/e054c3a6-e305-4d49-8d17-f0218dc1874a-kube-api-access-8r56m\") pod \"network-check-source-7d88cb55d8-29c9r\" (UID: \"e054c3a6-e305-4d49-8d17-f0218dc1874a\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-29c9r"
Jul 28 10:09:22.349354 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.349343    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzb52\" (UniqueName: \"kubernetes.io/projected/d5abb0c1-8a9a-4ff4-b53c-6f617855af87-kube-api-access-vzb52\") pod \"downloads-7c97dc4555-8z9xm\" (UID: \"d5abb0c1-8a9a-4ff4-b53c-6f617855af87\") " pod="openshift-console/downloads-7c97dc4555-8z9xm"
Jul 28 10:09:22.349920 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.349880    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/32f6e4c4-f599-4f50-a1c4-8e57158cd792-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-7dwzh\" (UID: \"32f6e4c4-f599-4f50-a1c4-8e57158cd792\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7dwzh"
Jul 28 10:09:22.351568 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.351544    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/32f6e4c4-f599-4f50-a1c4-8e57158cd792-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-7dwzh\" (UID: \"32f6e4c4-f599-4f50-a1c4-8e57158cd792\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7dwzh"
Jul 28 10:09:22.351997 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.351978    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/bddaba43-f333-4c89-b522-c21055cca710-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-jlvkz\" (UID: \"bddaba43-f333-4c89-b522-c21055cca710\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jlvkz"
Jul 28 10:09:22.361383 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.361355    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzb52\" (UniqueName: \"kubernetes.io/projected/d5abb0c1-8a9a-4ff4-b53c-6f617855af87-kube-api-access-vzb52\") pod \"downloads-7c97dc4555-8z9xm\" (UID: \"d5abb0c1-8a9a-4ff4-b53c-6f617855af87\") " pod="openshift-console/downloads-7c97dc4555-8z9xm"
Jul 28 10:09:22.361536 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.361471    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r56m\" (UniqueName: \"kubernetes.io/projected/e054c3a6-e305-4d49-8d17-f0218dc1874a-kube-api-access-8r56m\") pod \"network-check-source-7d88cb55d8-29c9r\" (UID: \"e054c3a6-e305-4d49-8d17-f0218dc1874a\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-29c9r"
Jul 28 10:09:22.417586 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.417563    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gkjrn"]
Jul 28 10:09:22.419724 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:09:22.419679    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod172a1903_cc50_48f2_b03c_0e682df09ea2.slice/crio-3bcaef5febe3ac9239cea530189eccdd52a6f0fd21d1439752a7ec7ff9e1da3e WatchSource:0}: Error finding container 3bcaef5febe3ac9239cea530189eccdd52a6f0fd21d1439752a7ec7ff9e1da3e: Status 404 returned error can't find the container with id 3bcaef5febe3ac9239cea530189eccdd52a6f0fd21d1439752a7ec7ff9e1da3e
Jul 28 10:09:22.430761 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.430736    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jlvkz"
Jul 28 10:09:22.437274 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.437247    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-8z9xm"
Jul 28 10:09:22.444441 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.444416    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-7dwzh"
Jul 28 10:09:22.449560 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.449538    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-29c9r"
Jul 28 10:09:22.474410 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.474361    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7856dc8857-j2fl6"]
Jul 28 10:09:22.478259 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:09:22.478153    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d877c60_171a_4df1_8d1f_835ecd7c578c.slice/crio-fc2f2b680f10ad136708458a2fdd4661cd3d82317f02223e928989d0ca447491 WatchSource:0}: Error finding container fc2f2b680f10ad136708458a2fdd4661cd3d82317f02223e928989d0ca447491: Status 404 returned error can't find the container with id fc2f2b680f10ad136708458a2fdd4661cd3d82317f02223e928989d0ca447491
Jul 28 10:09:22.586130 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.586051    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jlvkz"]
Jul 28 10:09:22.590711 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:09:22.590685    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbddaba43_f333_4c89_b522_c21055cca710.slice/crio-7a474a631b22211be1bd27da973171d353c7176af0938856f1d138d11d99c5cc WatchSource:0}: Error finding container 7a474a631b22211be1bd27da973171d353c7176af0938856f1d138d11d99c5cc: Status 404 returned error can't find the container with id 7a474a631b22211be1bd27da973171d353c7176af0938856f1d138d11d99c5cc
Jul 28 10:09:22.600421 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.600394    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-29c9r"]
Jul 28 10:09:22.604476 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:09:22.604450    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode054c3a6_e305_4d49_8d17_f0218dc1874a.slice/crio-b38bbde8d2bc0ded03fee045712ecbe227045044bb343f0adb596a946fe095e7 WatchSource:0}: Error finding container b38bbde8d2bc0ded03fee045712ecbe227045044bb343f0adb596a946fe095e7: Status 404 returned error can't find the container with id b38bbde8d2bc0ded03fee045712ecbe227045044bb343f0adb596a946fe095e7
Jul 28 10:09:22.828835 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.828766    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-8z9xm"]
Jul 28 10:09:22.831709 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:22.831681    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-7dwzh"]
Jul 28 10:09:22.832891 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:09:22.832866    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5abb0c1_8a9a_4ff4_b53c_6f617855af87.slice/crio-9b1cc60f8292a4ac2396d9491c1a30f7b052019ccd4e1f41f551b3d3fd9f23e4 WatchSource:0}: Error finding container 9b1cc60f8292a4ac2396d9491c1a30f7b052019ccd4e1f41f551b3d3fd9f23e4: Status 404 returned error can't find the container with id 9b1cc60f8292a4ac2396d9491c1a30f7b052019ccd4e1f41f551b3d3fd9f23e4
Jul 28 10:09:22.836761 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:09:22.836740    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32f6e4c4_f599_4f50_a1c4_8e57158cd792.slice/crio-aee656a9b6f1e20f4994153b45413a9f5b4464e5be0a155d7103b2d3387e78b8 WatchSource:0}: Error finding container aee656a9b6f1e20f4994153b45413a9f5b4464e5be0a155d7103b2d3387e78b8: Status 404 returned error can't find the container with id aee656a9b6f1e20f4994153b45413a9f5b4464e5be0a155d7103b2d3387e78b8
Jul 28 10:09:23.371979 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:23.371646    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-29c9r" event={"ID":"e054c3a6-e305-4d49-8d17-f0218dc1874a","Type":"ContainerStarted","Data":"b6a5ffd5e7b056af8ca69c5438a558cc0411f0e04a4af6c5846a7a56b376d678"}
Jul 28 10:09:23.371979 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:23.371706    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-29c9r" event={"ID":"e054c3a6-e305-4d49-8d17-f0218dc1874a","Type":"ContainerStarted","Data":"b38bbde8d2bc0ded03fee045712ecbe227045044bb343f0adb596a946fe095e7"}
Jul 28 10:09:23.375515 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:23.375453    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jlvkz" event={"ID":"bddaba43-f333-4c89-b522-c21055cca710","Type":"ContainerStarted","Data":"7a474a631b22211be1bd27da973171d353c7176af0938856f1d138d11d99c5cc"}
Jul 28 10:09:23.376824 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:23.376799    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7856dc8857-j2fl6" event={"ID":"4d877c60-171a-4df1-8d1f-835ecd7c578c","Type":"ContainerStarted","Data":"fc2f2b680f10ad136708458a2fdd4661cd3d82317f02223e928989d0ca447491"}
Jul 28 10:09:23.378339 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:23.378312    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-7dwzh" event={"ID":"32f6e4c4-f599-4f50-a1c4-8e57158cd792","Type":"ContainerStarted","Data":"aee656a9b6f1e20f4994153b45413a9f5b4464e5be0a155d7103b2d3387e78b8"}
Jul 28 10:09:23.381932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:23.381901    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-8z9xm" event={"ID":"d5abb0c1-8a9a-4ff4-b53c-6f617855af87","Type":"ContainerStarted","Data":"9b1cc60f8292a4ac2396d9491c1a30f7b052019ccd4e1f41f551b3d3fd9f23e4"}
Jul 28 10:09:23.383356 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:23.383333    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gkjrn" event={"ID":"172a1903-cc50-48f2-b03c-0e682df09ea2","Type":"ContainerStarted","Data":"3bcaef5febe3ac9239cea530189eccdd52a6f0fd21d1439752a7ec7ff9e1da3e"}
Jul 28 10:09:23.388732 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:23.388589    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-29c9r" podStartSLOduration=1.38857048 podStartE2EDuration="1.38857048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:09:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:23.38828756 +0000 UTC m=+96.790525959" watchObservedRunningTime="2026-07-28 10:09:23.38857048 +0000 UTC m=+96.790808863"
Jul 28 10:09:25.278422 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:25.278166    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:09:25.281276 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:25.281251    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls\") pod \"image-registry-b55955d75-mh9fw\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") " pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:09:25.302593 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:25.302564    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bcfzv\""
Jul 28 10:09:25.310672 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:25.310413    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:09:25.379298 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:25.378789    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls\") pod \"dns-default-j5k8g\" (UID: \"4d8c1a3b-efee-4b30-9022-087775f8ea49\") " pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:09:25.382231 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:25.382185    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d8c1a3b-efee-4b30-9022-087775f8ea49-metrics-tls\") pod \"dns-default-j5k8g\" (UID: \"4d8c1a3b-efee-4b30-9022-087775f8ea49\") " pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:09:25.394747 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:25.393704    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jlvkz" event={"ID":"bddaba43-f333-4c89-b522-c21055cca710","Type":"ContainerStarted","Data":"3557c61edb6b088670a7124c4fcfaae3423a50a0d6e19f56b2ae8ed801cb81d7"}
Jul 28 10:09:25.394747 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:25.394685    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jlvkz"
Jul 28 10:09:25.397306 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:25.397277    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-7dwzh" event={"ID":"32f6e4c4-f599-4f50-a1c4-8e57158cd792","Type":"ContainerStarted","Data":"da3792487ea70d0928d84447b028d25c3519bd45bebb32e23c7a5f359daccb34"}
Jul 28 10:09:25.400720 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:25.400696    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jlvkz"
Jul 28 10:09:25.410562 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:25.410443    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-jlvkz" podStartSLOduration=1.122994271 podStartE2EDuration="3.410423476s" totalImagesPullingTime="2.287429205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:25.410173067 +0000 UTC m=+98.812411466" watchObservedRunningTime="2026-07-28 10:09:25.410423476 +0000 UTC m=+98.812661874"
Jul 28 10:09:25.441160 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:25.440781    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-7dwzh" podStartSLOduration=1.398957157 podStartE2EDuration="3.440758806s" totalImagesPullingTime="2.041801649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:25.440367466 +0000 UTC m=+98.842605864" watchObservedRunningTime="2026-07-28 10:09:25.440758806 +0000 UTC m=+98.842997183"
Jul 28 10:09:25.476898 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:25.476493    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-b55955d75-mh9fw"]
Jul 28 10:09:25.481983 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:09:25.481957    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aa30efc_6e3a_4303_98e2_966b1268902f.slice/crio-42ba8889dfd2e6a57ced50ed44dfd9080e10a0e1109f5070c1ed4cb8f72767db WatchSource:0}: Error finding container 42ba8889dfd2e6a57ced50ed44dfd9080e10a0e1109f5070c1ed4cb8f72767db: Status 404 returned error can't find the container with id 42ba8889dfd2e6a57ced50ed44dfd9080e10a0e1109f5070c1ed4cb8f72767db
Jul 28 10:09:25.619637 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:25.619602    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kvgz4\""
Jul 28 10:09:25.628536 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:25.628508    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:09:25.806003 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:25.805866    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-j5k8g"]
Jul 28 10:09:26.403301 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:26.403269    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b55955d75-mh9fw" event={"ID":"4aa30efc-6e3a-4303-98e2-966b1268902f","Type":"ContainerStarted","Data":"ec81c77e336f611a6d60f376aba0e42f55b654adb0c32530f24a6a23e703c6c6"}
Jul 28 10:09:26.403752 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:26.403323    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b55955d75-mh9fw" event={"ID":"4aa30efc-6e3a-4303-98e2-966b1268902f","Type":"ContainerStarted","Data":"42ba8889dfd2e6a57ced50ed44dfd9080e10a0e1109f5070c1ed4cb8f72767db"}
Jul 28 10:09:26.403752 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:26.403559    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:09:26.426170 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:26.426101    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-b55955d75-mh9fw" podStartSLOduration=99.426082013 podStartE2EDuration="1m39.426082013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:07:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:26.424067299 +0000 UTC m=+99.826305697" watchObservedRunningTime="2026-07-28 10:09:26.426082013 +0000 UTC m=+99.828320409"
Jul 28 10:09:28.245722 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.245691    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f56fc947b-gr9sz"]
Jul 28 10:09:28.350458 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.350426    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f56fc947b-gr9sz"]
Jul 28 10:09:28.350628 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.350560    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:09:28.352794 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.352772    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 28 10:09:28.352965 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.352858    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 28 10:09:28.352965 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.352922    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-m9p49\""
Jul 28 10:09:28.352965 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.352943    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 28 10:09:28.353139 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.353026    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 28 10:09:28.353683 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.353662    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 28 10:09:28.395103 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:09:28.395072    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d8c1a3b_efee_4b30_9022_087775f8ea49.slice/crio-8337df6d05f1848e0895540510288b24e34226b701c9792783a6fde329255443 WatchSource:0}: Error finding container 8337df6d05f1848e0895540510288b24e34226b701c9792783a6fde329255443: Status 404 returned error can't find the container with id 8337df6d05f1848e0895540510288b24e34226b701c9792783a6fde329255443
Jul 28 10:09:28.411968 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.411937    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j5k8g" event={"ID":"4d8c1a3b-efee-4b30-9022-087775f8ea49","Type":"ContainerStarted","Data":"8337df6d05f1848e0895540510288b24e34226b701c9792783a6fde329255443"}
Jul 28 10:09:28.506592 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.506505    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/742061c7-0353-44d4-88c8-9cdfb50088a8-service-ca\") pod \"console-6f56fc947b-gr9sz\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") " pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:09:28.506773 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.506599    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/742061c7-0353-44d4-88c8-9cdfb50088a8-oauth-serving-cert\") pod \"console-6f56fc947b-gr9sz\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") " pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:09:28.506773 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.506651    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jjvd\" (UniqueName: \"kubernetes.io/projected/742061c7-0353-44d4-88c8-9cdfb50088a8-kube-api-access-7jjvd\") pod \"console-6f56fc947b-gr9sz\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") " pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:09:28.506773 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.506708    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/742061c7-0353-44d4-88c8-9cdfb50088a8-console-config\") pod \"console-6f56fc947b-gr9sz\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") " pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:09:28.506773 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.506763    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/742061c7-0353-44d4-88c8-9cdfb50088a8-console-serving-cert\") pod \"console-6f56fc947b-gr9sz\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") " pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:09:28.507019 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.506794    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/742061c7-0353-44d4-88c8-9cdfb50088a8-console-oauth-config\") pod \"console-6f56fc947b-gr9sz\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") " pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:09:28.607403 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.607370    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/742061c7-0353-44d4-88c8-9cdfb50088a8-oauth-serving-cert\") pod \"console-6f56fc947b-gr9sz\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") " pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:09:28.607565 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.607414    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jjvd\" (UniqueName: \"kubernetes.io/projected/742061c7-0353-44d4-88c8-9cdfb50088a8-kube-api-access-7jjvd\") pod \"console-6f56fc947b-gr9sz\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") " pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:09:28.607565 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.607458    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/742061c7-0353-44d4-88c8-9cdfb50088a8-console-config\") pod \"console-6f56fc947b-gr9sz\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") " pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:09:28.607565 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.607501    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/742061c7-0353-44d4-88c8-9cdfb50088a8-console-serving-cert\") pod \"console-6f56fc947b-gr9sz\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") " pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:09:28.607565 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.607531    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/742061c7-0353-44d4-88c8-9cdfb50088a8-console-oauth-config\") pod \"console-6f56fc947b-gr9sz\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") " pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:09:28.607788 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.607590    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/742061c7-0353-44d4-88c8-9cdfb50088a8-service-ca\") pod \"console-6f56fc947b-gr9sz\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") " pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:09:28.608692 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.608164    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/742061c7-0353-44d4-88c8-9cdfb50088a8-oauth-serving-cert\") pod \"console-6f56fc947b-gr9sz\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") " pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:09:28.608692 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.608227    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/742061c7-0353-44d4-88c8-9cdfb50088a8-service-ca\") pod \"console-6f56fc947b-gr9sz\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") " pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:09:28.608692 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.608659    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/742061c7-0353-44d4-88c8-9cdfb50088a8-console-config\") pod \"console-6f56fc947b-gr9sz\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") " pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:09:28.611607 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.611586    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/742061c7-0353-44d4-88c8-9cdfb50088a8-console-serving-cert\") pod \"console-6f56fc947b-gr9sz\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") " pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:09:28.613161 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.613118    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/742061c7-0353-44d4-88c8-9cdfb50088a8-console-oauth-config\") pod \"console-6f56fc947b-gr9sz\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") " pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:09:28.620110 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.620066    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jjvd\" (UniqueName: \"kubernetes.io/projected/742061c7-0353-44d4-88c8-9cdfb50088a8-kube-api-access-7jjvd\") pod \"console-6f56fc947b-gr9sz\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") " pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:09:28.661339 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:28.661297    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:09:29.295908 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:29.295117    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rj8l7"
Jul 28 10:09:29.967023 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:29.966657    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f56fc947b-gr9sz"]
Jul 28 10:09:30.136727 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:09:30.136597    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod742061c7_0353_44d4_88c8_9cdfb50088a8.slice/crio-dffd47577b369273e75739b38d7a920a33ef29db731ad765045aa07328f732a2 WatchSource:0}: Error finding container dffd47577b369273e75739b38d7a920a33ef29db731ad765045aa07328f732a2: Status 404 returned error can't find the container with id dffd47577b369273e75739b38d7a920a33ef29db731ad765045aa07328f732a2
Jul 28 10:09:30.423301 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:30.423196    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f56fc947b-gr9sz" event={"ID":"742061c7-0353-44d4-88c8-9cdfb50088a8","Type":"ContainerStarted","Data":"dffd47577b369273e75739b38d7a920a33ef29db731ad765045aa07328f732a2"}
Jul 28 10:09:30.426400 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:30.426349    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gkjrn" event={"ID":"172a1903-cc50-48f2-b03c-0e682df09ea2","Type":"ContainerStarted","Data":"f2ef4522cfb27dff5a73dcda732f4985f4f856eabec46c80319944549e20e1af"}
Jul 28 10:09:31.478862 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.478729    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"]
Jul 28 10:09:31.482145 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.481265    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"
Jul 28 10:09:31.485779 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.484295    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 28 10:09:31.485779 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.484516    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 28 10:09:31.486683 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.486662    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 10:09:31.488036 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.486876    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 28 10:09:31.488036 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.487092    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-vg67m\""
Jul 28 10:09:31.492419 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.491867    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"]
Jul 28 10:09:31.507756 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.506170    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dh2q2"]
Jul 28 10:09:31.510088 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.509222    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.512208 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.512184    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 10:09:31.512500 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.512481    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nvjpc\""
Jul 28 10:09:31.512672 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.512656    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 10:09:31.512825 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.512810    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 10:09:31.535496 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.534908    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b7e7cc68-479b-4724-9f4d-59662bd3143e-node-exporter-textfile\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.535496 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.534942    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmv6b\" (UniqueName: \"kubernetes.io/projected/b7e7cc68-479b-4724-9f4d-59662bd3143e-kube-api-access-fmv6b\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.535496 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.534971    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b7e7cc68-479b-4724-9f4d-59662bd3143e-root\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.535496 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.534999    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dfc4cbca-04de-476f-a117-145e21376e75-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-mg5rh\" (UID: \"dfc4cbca-04de-476f-a117-145e21376e75\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"
Jul 28 10:09:31.535496 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.535029    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7e7cc68-479b-4724-9f4d-59662bd3143e-metrics-client-ca\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.535496 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.535053    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7e7cc68-479b-4724-9f4d-59662bd3143e-sys\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.535496 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.535079    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9vpb\" (UniqueName: \"kubernetes.io/projected/dfc4cbca-04de-476f-a117-145e21376e75-kube-api-access-w9vpb\") pod \"kube-state-metrics-56d9f944b4-mg5rh\" (UID: \"dfc4cbca-04de-476f-a117-145e21376e75\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"
Jul 28 10:09:31.535496 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.535101    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b7e7cc68-479b-4724-9f4d-59662bd3143e-node-exporter-tls\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.535496 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.535147    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7e7cc68-479b-4724-9f4d-59662bd3143e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.535496 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.535187    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfc4cbca-04de-476f-a117-145e21376e75-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-mg5rh\" (UID: \"dfc4cbca-04de-476f-a117-145e21376e75\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"
Jul 28 10:09:31.535496 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.535217    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b7e7cc68-479b-4724-9f4d-59662bd3143e-node-exporter-accelerators-collector-config\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.535496 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.535249    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dfc4cbca-04de-476f-a117-145e21376e75-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-mg5rh\" (UID: \"dfc4cbca-04de-476f-a117-145e21376e75\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"
Jul 28 10:09:31.535496 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.535276    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfc4cbca-04de-476f-a117-145e21376e75-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-mg5rh\" (UID: \"dfc4cbca-04de-476f-a117-145e21376e75\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"
Jul 28 10:09:31.535496 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.535308    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfc4cbca-04de-476f-a117-145e21376e75-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-mg5rh\" (UID: \"dfc4cbca-04de-476f-a117-145e21376e75\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"
Jul 28 10:09:31.535496 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.535335    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b7e7cc68-479b-4724-9f4d-59662bd3143e-node-exporter-wtmp\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.635932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.635728    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7e7cc68-479b-4724-9f4d-59662bd3143e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.635932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.635785    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfc4cbca-04de-476f-a117-145e21376e75-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-mg5rh\" (UID: \"dfc4cbca-04de-476f-a117-145e21376e75\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"
Jul 28 10:09:31.635932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.635816    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b7e7cc68-479b-4724-9f4d-59662bd3143e-node-exporter-accelerators-collector-config\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.635932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.635862    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dfc4cbca-04de-476f-a117-145e21376e75-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-mg5rh\" (UID: \"dfc4cbca-04de-476f-a117-145e21376e75\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"
Jul 28 10:09:31.635932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.635906    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfc4cbca-04de-476f-a117-145e21376e75-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-mg5rh\" (UID: \"dfc4cbca-04de-476f-a117-145e21376e75\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"
Jul 28 10:09:31.635932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.635935    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfc4cbca-04de-476f-a117-145e21376e75-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-mg5rh\" (UID: \"dfc4cbca-04de-476f-a117-145e21376e75\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"
Jul 28 10:09:31.636377 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.635961    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b7e7cc68-479b-4724-9f4d-59662bd3143e-node-exporter-wtmp\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.636377 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.635990    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b7e7cc68-479b-4724-9f4d-59662bd3143e-node-exporter-textfile\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.636377 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.636012    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmv6b\" (UniqueName: \"kubernetes.io/projected/b7e7cc68-479b-4724-9f4d-59662bd3143e-kube-api-access-fmv6b\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.636377 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.636043    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b7e7cc68-479b-4724-9f4d-59662bd3143e-root\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.636377 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.636071    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dfc4cbca-04de-476f-a117-145e21376e75-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-mg5rh\" (UID: \"dfc4cbca-04de-476f-a117-145e21376e75\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"
Jul 28 10:09:31.636377 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.636103    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7e7cc68-479b-4724-9f4d-59662bd3143e-metrics-client-ca\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.636377 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.636127    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7e7cc68-479b-4724-9f4d-59662bd3143e-sys\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.636377 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.636152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9vpb\" (UniqueName: \"kubernetes.io/projected/dfc4cbca-04de-476f-a117-145e21376e75-kube-api-access-w9vpb\") pod \"kube-state-metrics-56d9f944b4-mg5rh\" (UID: \"dfc4cbca-04de-476f-a117-145e21376e75\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"
Jul 28 10:09:31.636377 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.636174    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b7e7cc68-479b-4724-9f4d-59662bd3143e-node-exporter-tls\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.636377 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:09:31.636356    2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 28 10:09:31.636927 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:09:31.636417    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7e7cc68-479b-4724-9f4d-59662bd3143e-node-exporter-tls podName:b7e7cc68-479b-4724-9f4d-59662bd3143e nodeName:}" failed. No retries permitted until 2026-07-28 10:09:32.136397438 +0000 UTC m=+105.538635819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b7e7cc68-479b-4724-9f4d-59662bd3143e-node-exporter-tls") pod "node-exporter-dh2q2" (UID: "b7e7cc68-479b-4724-9f4d-59662bd3143e") : secret "node-exporter-tls" not found
Jul 28 10:09:31.640883 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.637292    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b7e7cc68-479b-4724-9f4d-59662bd3143e-node-exporter-textfile\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.640883 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.638379    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dfc4cbca-04de-476f-a117-145e21376e75-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-mg5rh\" (UID: \"dfc4cbca-04de-476f-a117-145e21376e75\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"
Jul 28 10:09:31.640883 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.639040    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b7e7cc68-479b-4724-9f4d-59662bd3143e-node-exporter-accelerators-collector-config\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.640883 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.639312    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dfc4cbca-04de-476f-a117-145e21376e75-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-mg5rh\" (UID: \"dfc4cbca-04de-476f-a117-145e21376e75\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"
Jul 28 10:09:31.640883 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.639750    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7e7cc68-479b-4724-9f4d-59662bd3143e-metrics-client-ca\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.640883 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.640091    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b7e7cc68-479b-4724-9f4d-59662bd3143e-root\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.640883 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.640672    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dfc4cbca-04de-476f-a117-145e21376e75-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-mg5rh\" (UID: \"dfc4cbca-04de-476f-a117-145e21376e75\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"
Jul 28 10:09:31.640883 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:09:31.640741    2577 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 28 10:09:31.640883 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:09:31.640780    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dfc4cbca-04de-476f-a117-145e21376e75-kube-state-metrics-tls podName:dfc4cbca-04de-476f-a117-145e21376e75 nodeName:}" failed. No retries permitted until 2026-07-28 10:09:32.14076851 +0000 UTC m=+105.543006886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/dfc4cbca-04de-476f-a117-145e21376e75-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-mg5rh" (UID: "dfc4cbca-04de-476f-a117-145e21376e75") : secret "kube-state-metrics-tls" not found
Jul 28 10:09:31.641428 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.641035    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b7e7cc68-479b-4724-9f4d-59662bd3143e-sys\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.641428 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.641162    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b7e7cc68-479b-4724-9f4d-59662bd3143e-node-exporter-wtmp\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.641560 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.641540    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7e7cc68-479b-4724-9f4d-59662bd3143e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:31.642352 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.642315    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dfc4cbca-04de-476f-a117-145e21376e75-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-mg5rh\" (UID: \"dfc4cbca-04de-476f-a117-145e21376e75\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"
Jul 28 10:09:31.652126 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.652102    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9vpb\" (UniqueName: \"kubernetes.io/projected/dfc4cbca-04de-476f-a117-145e21376e75-kube-api-access-w9vpb\") pod \"kube-state-metrics-56d9f944b4-mg5rh\" (UID: \"dfc4cbca-04de-476f-a117-145e21376e75\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"
Jul 28 10:09:31.652901 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:31.652861    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmv6b\" (UniqueName: \"kubernetes.io/projected/b7e7cc68-479b-4724-9f4d-59662bd3143e-kube-api-access-fmv6b\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:32.142063 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.142028    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfc4cbca-04de-476f-a117-145e21376e75-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-mg5rh\" (UID: \"dfc4cbca-04de-476f-a117-145e21376e75\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"
Jul 28 10:09:32.142220 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.142120    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b7e7cc68-479b-4724-9f4d-59662bd3143e-node-exporter-tls\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:32.147196 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.147167    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dfc4cbca-04de-476f-a117-145e21376e75-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-mg5rh\" (UID: \"dfc4cbca-04de-476f-a117-145e21376e75\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"
Jul 28 10:09:32.147469 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.147446    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b7e7cc68-479b-4724-9f4d-59662bd3143e-node-exporter-tls\") pod \"node-exporter-dh2q2\" (UID: \"b7e7cc68-479b-4724-9f4d-59662bd3143e\") " pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:32.403811 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.403619    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"
Jul 28 10:09:32.430329 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.430046    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dh2q2"
Jul 28 10:09:32.593575 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.592923    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 10:09:32.598386 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.597489    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.599939 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.599913    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 28 10:09:32.600867 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.600344    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 28 10:09:32.600952 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.600938    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cwrr9\""
Jul 28 10:09:32.601027 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.600974    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 28 10:09:32.602304 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.601145    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 28 10:09:32.602304 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.601175    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 28 10:09:32.602304 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.601197    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 28 10:09:32.602304 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.601411    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 28 10:09:32.602304 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.601517    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 28 10:09:32.602304 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.601641    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 28 10:09:32.614761 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.614736    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 10:09:32.747260 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.747221    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49e3b951-6ea1-431e-835d-c857aa58d06b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.747435 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.747279    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.747435 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.747319    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.747435 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.747346    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.747435 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.747379    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-config-volume\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.747435 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.747405    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49e3b951-6ea1-431e-835d-c857aa58d06b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.747435 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.747431    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/49e3b951-6ea1-431e-835d-c857aa58d06b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.747744 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.747458    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/49e3b951-6ea1-431e-835d-c857aa58d06b-config-out\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.747744 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.747485    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-web-config\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.747744 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.747514    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.747744 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.747543    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.747744 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.747568    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/49e3b951-6ea1-431e-835d-c857aa58d06b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.747744 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.747617    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4km67\" (UniqueName: \"kubernetes.io/projected/49e3b951-6ea1-431e-835d-c857aa58d06b-kube-api-access-4km67\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.848725 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.848678    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.848987 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.848747    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.848987 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.848791    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-config-volume\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.848987 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.848823    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49e3b951-6ea1-431e-835d-c857aa58d06b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.848987 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.848872    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/49e3b951-6ea1-431e-835d-c857aa58d06b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.848987 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.848901    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/49e3b951-6ea1-431e-835d-c857aa58d06b-config-out\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.848987 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.848929    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-web-config\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.848987 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.848958    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.849342 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.848991    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.849342 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.849019    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/49e3b951-6ea1-431e-835d-c857aa58d06b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.849342 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.849066    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4km67\" (UniqueName: \"kubernetes.io/projected/49e3b951-6ea1-431e-835d-c857aa58d06b-kube-api-access-4km67\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.849342 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.849114    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49e3b951-6ea1-431e-835d-c857aa58d06b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.849342 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.849148    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.850423 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.850396    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/49e3b951-6ea1-431e-835d-c857aa58d06b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.850539 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.850513    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49e3b951-6ea1-431e-835d-c857aa58d06b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.850606 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:09:32.850519    2577 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 28 10:09:32.850658 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:09:32.850613    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-main-tls podName:49e3b951-6ea1-431e-835d-c857aa58d06b nodeName:}" failed. No retries permitted until 2026-07-28 10:09:33.35059359 +0000 UTC m=+106.752831971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "49e3b951-6ea1-431e-835d-c857aa58d06b") : secret "alertmanager-main-tls" not found
Jul 28 10:09:32.852482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.852453    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49e3b951-6ea1-431e-835d-c857aa58d06b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.857641 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.857595    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.864911 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.861037    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-web-config\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.864911 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.863789    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/49e3b951-6ea1-431e-835d-c857aa58d06b-config-out\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.864911 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.864182    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.865682 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.865655    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.866131 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.866031    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.866901 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.866417    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/49e3b951-6ea1-431e-835d-c857aa58d06b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.867141 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.867105    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4km67\" (UniqueName: \"kubernetes.io/projected/49e3b951-6ea1-431e-835d-c857aa58d06b-kube-api-access-4km67\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:32.867588 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:32.867553    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-config-volume\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:33.357096 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:33.356522    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:33.361722 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:33.360988    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:33.515376 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:33.515339    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:09:34.068691 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:09:34.068646    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7e7cc68_479b_4724_9f4d_59662bd3143e.slice/crio-5ffa72b6a906b69ed9cec167f696e627f69b41e19e10842549f27011c8be1bdc WatchSource:0}: Error finding container 5ffa72b6a906b69ed9cec167f696e627f69b41e19e10842549f27011c8be1bdc: Status 404 returned error can't find the container with id 5ffa72b6a906b69ed9cec167f696e627f69b41e19e10842549f27011c8be1bdc
Jul 28 10:09:34.260401 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:34.260369    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 10:09:34.270291 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:34.270139    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh"]
Jul 28 10:09:34.458176 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:34.458091    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dh2q2" event={"ID":"b7e7cc68-479b-4724-9f4d-59662bd3143e","Type":"ContainerStarted","Data":"5ffa72b6a906b69ed9cec167f696e627f69b41e19e10842549f27011c8be1bdc"}
Jul 28 10:09:35.798154 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:09:35.798125    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfc4cbca_04de_476f_a117_145e21376e75.slice/crio-0e42a6a7c7022d0338514967500130aaaa447465e6b011f9311376f14d6493be WatchSource:0}: Error finding container 0e42a6a7c7022d0338514967500130aaaa447465e6b011f9311376f14d6493be: Status 404 returned error can't find the container with id 0e42a6a7c7022d0338514967500130aaaa447465e6b011f9311376f14d6493be
Jul 28 10:09:35.799140 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:09:35.799061    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49e3b951_6ea1_431e_835d_c857aa58d06b.slice/crio-a90647283d911b5019eb36133d3cb3a2f191075eb20654b6ecfe1e57c8c7caea WatchSource:0}: Error finding container a90647283d911b5019eb36133d3cb3a2f191075eb20654b6ecfe1e57c8c7caea: Status 404 returned error can't find the container with id a90647283d911b5019eb36133d3cb3a2f191075eb20654b6ecfe1e57c8c7caea
Jul 28 10:09:35.859918 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.859888    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-746cb6d799-rm4sl"]
Jul 28 10:09:35.864731 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.864709    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:35.867661 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.867636    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-x8drj\""
Jul 28 10:09:35.868276 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.868244    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 28 10:09:35.868408 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.868383    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 28 10:09:35.868465 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.868430    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 28 10:09:35.869115 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.869090    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cc15bcdon5nq9\""
Jul 28 10:09:35.869212 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.869105    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 28 10:09:35.878425 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.878398    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-746cb6d799-rm4sl"]
Jul 28 10:09:35.879812 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.879792    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9076ee5-943a-4700-a8f9-de88c6706428-client-ca-bundle\") pod \"metrics-server-746cb6d799-rm4sl\" (UID: \"b9076ee5-943a-4700-a8f9-de88c6706428\") " pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:35.879939 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.879855    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b9076ee5-943a-4700-a8f9-de88c6706428-metrics-server-audit-profiles\") pod \"metrics-server-746cb6d799-rm4sl\" (UID: \"b9076ee5-943a-4700-a8f9-de88c6706428\") " pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:35.879939 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.879893    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9076ee5-943a-4700-a8f9-de88c6706428-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-746cb6d799-rm4sl\" (UID: \"b9076ee5-943a-4700-a8f9-de88c6706428\") " pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:35.879939 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.879923    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b9076ee5-943a-4700-a8f9-de88c6706428-audit-log\") pod \"metrics-server-746cb6d799-rm4sl\" (UID: \"b9076ee5-943a-4700-a8f9-de88c6706428\") " pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:35.880096 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.879986    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsh89\" (UniqueName: \"kubernetes.io/projected/b9076ee5-943a-4700-a8f9-de88c6706428-kube-api-access-tsh89\") pod \"metrics-server-746cb6d799-rm4sl\" (UID: \"b9076ee5-943a-4700-a8f9-de88c6706428\") " pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:35.880096 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.880049    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b9076ee5-943a-4700-a8f9-de88c6706428-secret-metrics-server-client-certs\") pod \"metrics-server-746cb6d799-rm4sl\" (UID: \"b9076ee5-943a-4700-a8f9-de88c6706428\") " pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:35.880190 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.880095    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b9076ee5-943a-4700-a8f9-de88c6706428-secret-metrics-server-tls\") pod \"metrics-server-746cb6d799-rm4sl\" (UID: \"b9076ee5-943a-4700-a8f9-de88c6706428\") " pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:35.981373 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.981322    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b9076ee5-943a-4700-a8f9-de88c6706428-audit-log\") pod \"metrics-server-746cb6d799-rm4sl\" (UID: \"b9076ee5-943a-4700-a8f9-de88c6706428\") " pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:35.981563 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.981396    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsh89\" (UniqueName: \"kubernetes.io/projected/b9076ee5-943a-4700-a8f9-de88c6706428-kube-api-access-tsh89\") pod \"metrics-server-746cb6d799-rm4sl\" (UID: \"b9076ee5-943a-4700-a8f9-de88c6706428\") " pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:35.981563 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.981442    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b9076ee5-943a-4700-a8f9-de88c6706428-secret-metrics-server-client-certs\") pod \"metrics-server-746cb6d799-rm4sl\" (UID: \"b9076ee5-943a-4700-a8f9-de88c6706428\") " pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:35.981563 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.981484    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b9076ee5-943a-4700-a8f9-de88c6706428-secret-metrics-server-tls\") pod \"metrics-server-746cb6d799-rm4sl\" (UID: \"b9076ee5-943a-4700-a8f9-de88c6706428\") " pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:35.981563 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.981519    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9076ee5-943a-4700-a8f9-de88c6706428-client-ca-bundle\") pod \"metrics-server-746cb6d799-rm4sl\" (UID: \"b9076ee5-943a-4700-a8f9-de88c6706428\") " pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:35.981563 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.981552    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b9076ee5-943a-4700-a8f9-de88c6706428-metrics-server-audit-profiles\") pod \"metrics-server-746cb6d799-rm4sl\" (UID: \"b9076ee5-943a-4700-a8f9-de88c6706428\") " pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:35.981807 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.981583    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9076ee5-943a-4700-a8f9-de88c6706428-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-746cb6d799-rm4sl\" (UID: \"b9076ee5-943a-4700-a8f9-de88c6706428\") " pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:35.982498 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.982471    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9076ee5-943a-4700-a8f9-de88c6706428-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-746cb6d799-rm4sl\" (UID: \"b9076ee5-943a-4700-a8f9-de88c6706428\") " pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:35.982619 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.982608    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b9076ee5-943a-4700-a8f9-de88c6706428-audit-log\") pod \"metrics-server-746cb6d799-rm4sl\" (UID: \"b9076ee5-943a-4700-a8f9-de88c6706428\") " pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:35.982902 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.982880    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b9076ee5-943a-4700-a8f9-de88c6706428-metrics-server-audit-profiles\") pod \"metrics-server-746cb6d799-rm4sl\" (UID: \"b9076ee5-943a-4700-a8f9-de88c6706428\") " pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:35.985355 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.985313    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b9076ee5-943a-4700-a8f9-de88c6706428-secret-metrics-server-client-certs\") pod \"metrics-server-746cb6d799-rm4sl\" (UID: \"b9076ee5-943a-4700-a8f9-de88c6706428\") " pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:35.985760 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.985738    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b9076ee5-943a-4700-a8f9-de88c6706428-secret-metrics-server-tls\") pod \"metrics-server-746cb6d799-rm4sl\" (UID: \"b9076ee5-943a-4700-a8f9-de88c6706428\") " pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:35.987409 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.987366    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b9076ee5-943a-4700-a8f9-de88c6706428-client-ca-bundle\") pod \"metrics-server-746cb6d799-rm4sl\" (UID: \"b9076ee5-943a-4700-a8f9-de88c6706428\") " pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:35.991636 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:35.991611    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsh89\" (UniqueName: \"kubernetes.io/projected/b9076ee5-943a-4700-a8f9-de88c6706428-kube-api-access-tsh89\") pod \"metrics-server-746cb6d799-rm4sl\" (UID: \"b9076ee5-943a-4700-a8f9-de88c6706428\") " pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:36.176648 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:36.176561    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:36.467470 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:36.467385    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh" event={"ID":"dfc4cbca-04de-476f-a117-145e21376e75","Type":"ContainerStarted","Data":"0e42a6a7c7022d0338514967500130aaaa447465e6b011f9311376f14d6493be"}
Jul 28 10:09:36.468780 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:36.468753    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e3b951-6ea1-431e-835d-c857aa58d06b","Type":"ContainerStarted","Data":"a90647283d911b5019eb36133d3cb3a2f191075eb20654b6ecfe1e57c8c7caea"}
Jul 28 10:09:45.973738 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:45.973703    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-746cb6d799-rm4sl"]
Jul 28 10:09:46.373455 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:46.373421    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b55955d75-mh9fw"]
Jul 28 10:09:46.377594 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:46.377571    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:09:46.741213 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:09:46.741183    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9076ee5_943a_4700_a8f9_de88c6706428.slice/crio-4af13618eb5e2eee4216fe4be63c0ade4d992580a2f4ebd243cd951861cd95fc WatchSource:0}: Error finding container 4af13618eb5e2eee4216fe4be63c0ade4d992580a2f4ebd243cd951861cd95fc: Status 404 returned error can't find the container with id 4af13618eb5e2eee4216fe4be63c0ade4d992580a2f4ebd243cd951861cd95fc
Jul 28 10:09:47.149513 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:47.149485    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f56fc947b-gr9sz"]
Jul 28 10:09:47.513565 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:47.513533    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gkjrn" event={"ID":"172a1903-cc50-48f2-b03c-0e682df09ea2","Type":"ContainerStarted","Data":"72a791f19bb14f4fef197e5b8c9253640d2f02463ca0d32338f492acb165ac05"}
Jul 28 10:09:47.516241 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:47.516212    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j5k8g" event={"ID":"4d8c1a3b-efee-4b30-9022-087775f8ea49","Type":"ContainerStarted","Data":"651de045aa9aaee6e29359a7ec0bc155ee11c4494caa474ed6417c78de3d28a5"}
Jul 28 10:09:47.516396 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:47.516263    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-j5k8g" event={"ID":"4d8c1a3b-efee-4b30-9022-087775f8ea49","Type":"ContainerStarted","Data":"7cdc19fe9d6309b0a1eedfbad1533043111e0c6afb3504d734eae674f7b40481"}
Jul 28 10:09:47.516498 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:47.516480    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:09:47.518505 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:47.518478    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh" event={"ID":"dfc4cbca-04de-476f-a117-145e21376e75","Type":"ContainerStarted","Data":"4d1a2663c1287b72aa03ca6fe23ff0756466723eb0adc3c096f4096fdf9d74c5"}
Jul 28 10:09:47.520945 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:47.520873    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl" event={"ID":"b9076ee5-943a-4700-a8f9-de88c6706428","Type":"ContainerStarted","Data":"4af13618eb5e2eee4216fe4be63c0ade4d992580a2f4ebd243cd951861cd95fc"}
Jul 28 10:09:47.524122 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:47.523672    2577 generic.go:356] "Generic (PLEG): container finished" podID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerID="66bbb5d0721f7a80469420af624d9fe15e69ff2a07b9dcda2b326ea34d53ab0d" exitCode=0
Jul 28 10:09:47.524122 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:47.523754    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e3b951-6ea1-431e-835d-c857aa58d06b","Type":"ContainerDied","Data":"66bbb5d0721f7a80469420af624d9fe15e69ff2a07b9dcda2b326ea34d53ab0d"}
Jul 28 10:09:47.527181 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:47.527107    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7856dc8857-j2fl6" event={"ID":"4d877c60-171a-4df1-8d1f-835ecd7c578c","Type":"ContainerStarted","Data":"0b83ab3ff4b553992ccf11e9c6fe4a7ff21d88d220343793152ac0dac98fa4a3"}
Jul 28 10:09:47.527475 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:47.527432    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7856dc8857-j2fl6"
Jul 28 10:09:47.529307 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:47.529288    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7856dc8857-j2fl6"
Jul 28 10:09:47.529673 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:47.529653    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f56fc947b-gr9sz" event={"ID":"742061c7-0353-44d4-88c8-9cdfb50088a8","Type":"ContainerStarted","Data":"0dd4267d337f2e8cd595ad7e04a6f2f8b60e30dc4370ad367b39fc19201ed644"}
Jul 28 10:09:47.532311 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:47.532049    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-8z9xm" event={"ID":"d5abb0c1-8a9a-4ff4-b53c-6f617855af87","Type":"ContainerStarted","Data":"cdc05e5cf8b6f0d3764801ff11699c494d447b1251c588d2657a467b99d13aa8"}
Jul 28 10:09:47.532416 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:47.532308    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-8z9xm"
Jul 28 10:09:47.533958 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:47.533443    2577 patch_prober.go:28] interesting pod/downloads-7c97dc4555-8z9xm container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.132.0.14:8080/\": dial tcp 10.132.0.14:8080: connect: connection refused" start-of-body=
Jul 28 10:09:47.533958 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:47.533489    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7c97dc4555-8z9xm" podUID="d5abb0c1-8a9a-4ff4-b53c-6f617855af87" containerName="download-server" probeResult="failure" output="Get \"http://10.132.0.14:8080/\": dial tcp 10.132.0.14:8080: connect: connection refused"
Jul 28 10:09:47.534116 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:47.534011    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dh2q2" event={"ID":"b7e7cc68-479b-4724-9f4d-59662bd3143e","Type":"ContainerStarted","Data":"18470e71c6c2dba2fc8b58ab0d6a98e1155077cb613499ca2aa2fd23a3037c44"}
Jul 28 10:09:47.543919 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:47.543876    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-j5k8g" podStartSLOduration=80.875598659 podStartE2EDuration="1m26.543834854s" totalImagesPullingTime="5.668236195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:08:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:47.542896311 +0000 UTC m=+120.945134710" watchObservedRunningTime="2026-07-28 10:09:47.543834854 +0000 UTC m=+120.946073253"
Jul 28 10:09:47.582003 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:47.581951    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7856dc8857-j2fl6" podStartSLOduration=3.840280751 podStartE2EDuration="25.581928872s" totalImagesPullingTime="21.741648121s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:47.580464864 +0000 UTC m=+120.982703267" watchObservedRunningTime="2026-07-28 10:09:47.581928872 +0000 UTC m=+120.984167275"
Jul 28 10:09:47.602657 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:47.602527    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f56fc947b-gr9sz" podStartSLOduration=2.818087467 podStartE2EDuration="19.602506327s" totalImagesPullingTime="16.78441886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:47.598048823 +0000 UTC m=+121.000287224" watchObservedRunningTime="2026-07-28 10:09:47.602506327 +0000 UTC m=+121.004744726"
Jul 28 10:09:47.614979 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:47.614924    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-8z9xm" podStartSLOduration=1.312826096 podStartE2EDuration="25.614905152s" totalImagesPullingTime="24.302079056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:09:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:47.614396718 +0000 UTC m=+121.016635118" watchObservedRunningTime="2026-07-28 10:09:47.614905152 +0000 UTC m=+121.017143550"
Jul 28 10:09:48.546340 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:48.546297    2577 generic.go:356] "Generic (PLEG): container finished" podID="b7e7cc68-479b-4724-9f4d-59662bd3143e" containerID="18470e71c6c2dba2fc8b58ab0d6a98e1155077cb613499ca2aa2fd23a3037c44" exitCode=0
Jul 28 10:09:48.546906 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:48.546419    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dh2q2" event={"ID":"b7e7cc68-479b-4724-9f4d-59662bd3143e","Type":"ContainerDied","Data":"18470e71c6c2dba2fc8b58ab0d6a98e1155077cb613499ca2aa2fd23a3037c44"}
Jul 28 10:09:48.552251 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:48.552128    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh" event={"ID":"dfc4cbca-04de-476f-a117-145e21376e75","Type":"ContainerStarted","Data":"5c8b3b35cbc630e03d6984153498e6ab8f404e6c0c1564268a840979b7324285"}
Jul 28 10:09:48.552251 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:48.552191    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh" event={"ID":"dfc4cbca-04de-476f-a117-145e21376e75","Type":"ContainerStarted","Data":"d61c27d4fb47bbe8103ba8cfca38829643790bce563223f9e5a95f14966fd31d"}
Jul 28 10:09:48.565346 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:48.565286    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-8z9xm"
Jul 28 10:09:48.616357 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:48.616287    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mg5rh" podStartSLOduration=6.250569287 podStartE2EDuration="17.616265291s" totalImagesPullingTime="11.365696004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:48.61509813 +0000 UTC m=+122.017336530" watchObservedRunningTime="2026-07-28 10:09:48.616265291 +0000 UTC m=+122.018503690"
Jul 28 10:09:48.662651 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:48.662572    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:09:49.562628 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:49.562591    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dh2q2" event={"ID":"b7e7cc68-479b-4724-9f4d-59662bd3143e","Type":"ContainerStarted","Data":"bfe678428d7814f0a7185f2c33ca0b5cbc3ddd09a8c33bae66793ba708fda925"}
Jul 28 10:09:53.583477 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:53.583448    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dh2q2" event={"ID":"b7e7cc68-479b-4724-9f4d-59662bd3143e","Type":"ContainerStarted","Data":"61dd70b39790a83679119e1fdabf84e59780d2eb79e768d54a47910b52dfd5fb"}
Jul 28 10:09:53.586122 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:53.586095    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gkjrn" event={"ID":"172a1903-cc50-48f2-b03c-0e682df09ea2","Type":"ContainerStarted","Data":"e5aeb47d073bd3b4c218029ad13e45ffc1fa98db7e99ce1f8da99e622826e409"}
Jul 28 10:09:53.589030 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:53.588031    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl" event={"ID":"b9076ee5-943a-4700-a8f9-de88c6706428","Type":"ContainerStarted","Data":"bdcbdbef621747cb6efa312991f386b0aa7d7832fa924a2fabeaf897e71f6218"}
Jul 28 10:09:53.592704 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:53.591964    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e3b951-6ea1-431e-835d-c857aa58d06b","Type":"ContainerStarted","Data":"ebeb331d382246265a10148767114d2c418c818774adca90cd9cd6b949c8403f"}
Jul 28 10:09:53.592704 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:53.592029    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e3b951-6ea1-431e-835d-c857aa58d06b","Type":"ContainerStarted","Data":"8b854dbe6210e1aafa2cbf053bf5009e8c8dc2ef1c4c1c9a3bd0730b06af403b"}
Jul 28 10:09:53.592704 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:53.592073    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e3b951-6ea1-431e-835d-c857aa58d06b","Type":"ContainerStarted","Data":"f7639a72e95b4a6e4b95297204a5c1f97ba7ba019edd5ab9fdd91c76bc565c32"}
Jul 28 10:09:53.592704 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:53.592112    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e3b951-6ea1-431e-835d-c857aa58d06b","Type":"ContainerStarted","Data":"4855b2a755bab6076b8ea85fd8a73f63ffb8a265861886777afefe9db7569620"}
Jul 28 10:09:53.604334 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:53.604129    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dh2q2" podStartSLOduration=9.381496276 podStartE2EDuration="22.60411279s" totalImagesPullingTime="13.095117447s" totalInitContainerRuntime="127.499067ms" isStatefulPod=true podCreationTimestamp="2026-07-28 10:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:53.601812764 +0000 UTC m=+127.004051161" watchObservedRunningTime="2026-07-28 10:09:53.60411279 +0000 UTC m=+127.006351192"
Jul 28 10:09:53.620267 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:53.620218    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gkjrn" podStartSLOduration=33.148470557 podStartE2EDuration="1m3.62020441s" totalImagesPullingTime="30.471733853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:08:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:53.619103655 +0000 UTC m=+127.021342054" watchObservedRunningTime="2026-07-28 10:09:53.62020441 +0000 UTC m=+127.022442808"
Jul 28 10:09:53.637637 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:53.637599    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl" podStartSLOduration=12.987686541 podStartE2EDuration="18.63758427s" totalImagesPullingTime="5.649897729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:09:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:53.637300256 +0000 UTC m=+127.039538681" watchObservedRunningTime="2026-07-28 10:09:53.63758427 +0000 UTC m=+127.039822740"
Jul 28 10:09:54.600922 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:54.600881    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e3b951-6ea1-431e-835d-c857aa58d06b","Type":"ContainerStarted","Data":"375c488b12fa8da04d03b910423e60fa4759b05853575e9e16907352b59ca02e"}
Jul 28 10:09:56.177433 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:56.177402    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:56.177768 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:56.177477    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:09:56.612429 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:56.612399    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e3b951-6ea1-431e-835d-c857aa58d06b","Type":"ContainerStarted","Data":"17e1ec8e2cf250ef16856cf8e021e79e2c3d0d1b0c05f84daa39693aa75edbdb"}
Jul 28 10:09:56.637957 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:56.637914    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.518765689 podStartE2EDuration="24.637899571s" totalImagesPullingTime="19.097472239s" totalInitContainerRuntime="21.661643ms" isStatefulPod=false podCreationTimestamp="2026-07-28 10:09:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:09:56.636497369 +0000 UTC m=+130.038735767" watchObservedRunningTime="2026-07-28 10:09:56.637899571 +0000 UTC m=+130.040137971"
Jul 28 10:09:56.896704 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:56.896615    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs\") pod \"network-metrics-daemon-8dw4k\" (UID: \"af1264bf-57b1-45a9-8753-f359fe2f0b65\") " pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:09:56.899160 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:56.899141    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/af1264bf-57b1-45a9-8753-f359fe2f0b65-metrics-certs\") pod \"network-metrics-daemon-8dw4k\" (UID: \"af1264bf-57b1-45a9-8753-f359fe2f0b65\") " pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:09:56.960454 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:56.960420    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tgfjj\""
Jul 28 10:09:56.968311 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:56.968286    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8dw4k"
Jul 28 10:09:57.117798 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:57.117768    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8dw4k"]
Jul 28 10:09:57.120769 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:09:57.120740    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf1264bf_57b1_45a9_8753_f359fe2f0b65.slice/crio-ee367f46f2798449dde9dc2eda078d754bb936c4fbdbb85319815f63490774f6 WatchSource:0}: Error finding container ee367f46f2798449dde9dc2eda078d754bb936c4fbdbb85319815f63490774f6: Status 404 returned error can't find the container with id ee367f46f2798449dde9dc2eda078d754bb936c4fbdbb85319815f63490774f6
Jul 28 10:09:57.555574 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:57.555546    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-j5k8g"
Jul 28 10:09:57.617277 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:09:57.617246    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8dw4k" event={"ID":"af1264bf-57b1-45a9-8753-f359fe2f0b65","Type":"ContainerStarted","Data":"ee367f46f2798449dde9dc2eda078d754bb936c4fbdbb85319815f63490774f6"}
Jul 28 10:10:00.630651 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:00.630612    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8dw4k" event={"ID":"af1264bf-57b1-45a9-8753-f359fe2f0b65","Type":"ContainerStarted","Data":"5fcc8b4fe914f03e32b94d6bec9cd85bdd6a74494fd7cfbaa1d81a43fe017d3e"}
Jul 28 10:10:00.631098 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:00.630674    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8dw4k" event={"ID":"af1264bf-57b1-45a9-8753-f359fe2f0b65","Type":"ContainerStarted","Data":"5d5d7691b65bc3968b017b617cc6a3de5f6f2fb6cfe6848cba460dc29537ac5f"}
Jul 28 10:10:00.647986 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:00.647935    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8dw4k" podStartSLOduration=130.911478875 podStartE2EDuration="2m13.647916518s" totalImagesPullingTime="2.736437643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:07:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:10:00.647049939 +0000 UTC m=+134.049288338" watchObservedRunningTime="2026-07-28 10:10:00.647916518 +0000 UTC m=+134.050154922"
Jul 28 10:10:11.392587 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.392529    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-b55955d75-mh9fw" podUID="4aa30efc-6e3a-4303-98e2-966b1268902f" containerName="registry" containerID="cri-o://ec81c77e336f611a6d60f376aba0e42f55b654adb0c32530f24a6a23e703c6c6" gracePeriod=30
Jul 28 10:10:11.662661 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.662585    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:10:11.671060 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.671031    2577 generic.go:356] "Generic (PLEG): container finished" podID="4aa30efc-6e3a-4303-98e2-966b1268902f" containerID="ec81c77e336f611a6d60f376aba0e42f55b654adb0c32530f24a6a23e703c6c6" exitCode=0
Jul 28 10:10:11.671211 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.671086    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-b55955d75-mh9fw"
Jul 28 10:10:11.671211 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.671097    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b55955d75-mh9fw" event={"ID":"4aa30efc-6e3a-4303-98e2-966b1268902f","Type":"ContainerDied","Data":"ec81c77e336f611a6d60f376aba0e42f55b654adb0c32530f24a6a23e703c6c6"}
Jul 28 10:10:11.671211 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.671138    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-b55955d75-mh9fw" event={"ID":"4aa30efc-6e3a-4303-98e2-966b1268902f","Type":"ContainerDied","Data":"42ba8889dfd2e6a57ced50ed44dfd9080e10a0e1109f5070c1ed4cb8f72767db"}
Jul 28 10:10:11.671211 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.671168    2577 scope.go:117] "RemoveContainer" containerID="ec81c77e336f611a6d60f376aba0e42f55b654adb0c32530f24a6a23e703c6c6"
Jul 28 10:10:11.679287 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.679263    2577 scope.go:117] "RemoveContainer" containerID="ec81c77e336f611a6d60f376aba0e42f55b654adb0c32530f24a6a23e703c6c6"
Jul 28 10:10:11.679555 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:10:11.679537    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec81c77e336f611a6d60f376aba0e42f55b654adb0c32530f24a6a23e703c6c6\": container with ID starting with ec81c77e336f611a6d60f376aba0e42f55b654adb0c32530f24a6a23e703c6c6 not found: ID does not exist" containerID="ec81c77e336f611a6d60f376aba0e42f55b654adb0c32530f24a6a23e703c6c6"
Jul 28 10:10:11.679623 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.679563    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec81c77e336f611a6d60f376aba0e42f55b654adb0c32530f24a6a23e703c6c6"} err="failed to get container status \"ec81c77e336f611a6d60f376aba0e42f55b654adb0c32530f24a6a23e703c6c6\": rpc error: code = NotFound desc = could not find container \"ec81c77e336f611a6d60f376aba0e42f55b654adb0c32530f24a6a23e703c6c6\": container with ID starting with ec81c77e336f611a6d60f376aba0e42f55b654adb0c32530f24a6a23e703c6c6 not found: ID does not exist"
Jul 28 10:10:11.833007 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.832973    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4aa30efc-6e3a-4303-98e2-966b1268902f-installation-pull-secrets\") pod \"4aa30efc-6e3a-4303-98e2-966b1268902f\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") "
Jul 28 10:10:11.833201 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.833048    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-bound-sa-token\") pod \"4aa30efc-6e3a-4303-98e2-966b1268902f\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") "
Jul 28 10:10:11.833201 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.833071    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls\") pod \"4aa30efc-6e3a-4303-98e2-966b1268902f\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") "
Jul 28 10:10:11.833201 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.833098    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9g926\" (UniqueName: \"kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-kube-api-access-9g926\") pod \"4aa30efc-6e3a-4303-98e2-966b1268902f\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") "
Jul 28 10:10:11.833201 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.833135    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4aa30efc-6e3a-4303-98e2-966b1268902f-trusted-ca\") pod \"4aa30efc-6e3a-4303-98e2-966b1268902f\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") "
Jul 28 10:10:11.833201 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.833186    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4aa30efc-6e3a-4303-98e2-966b1268902f-image-registry-private-configuration\") pod \"4aa30efc-6e3a-4303-98e2-966b1268902f\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") "
Jul 28 10:10:11.833478 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.833212    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-certificates\") pod \"4aa30efc-6e3a-4303-98e2-966b1268902f\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") "
Jul 28 10:10:11.833478 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.833288    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4aa30efc-6e3a-4303-98e2-966b1268902f-ca-trust-extracted\") pod \"4aa30efc-6e3a-4303-98e2-966b1268902f\" (UID: \"4aa30efc-6e3a-4303-98e2-966b1268902f\") "
Jul 28 10:10:11.833818 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.833748    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4aa30efc-6e3a-4303-98e2-966b1268902f" (UID: "4aa30efc-6e3a-4303-98e2-966b1268902f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:10:11.833972 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.833824    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aa30efc-6e3a-4303-98e2-966b1268902f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4aa30efc-6e3a-4303-98e2-966b1268902f" (UID: "4aa30efc-6e3a-4303-98e2-966b1268902f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:10:11.836282 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.836247    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4aa30efc-6e3a-4303-98e2-966b1268902f" (UID: "4aa30efc-6e3a-4303-98e2-966b1268902f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 10:10:11.836282 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.836254    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aa30efc-6e3a-4303-98e2-966b1268902f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4aa30efc-6e3a-4303-98e2-966b1268902f" (UID: "4aa30efc-6e3a-4303-98e2-966b1268902f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:10:11.836506 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.836282    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4aa30efc-6e3a-4303-98e2-966b1268902f" (UID: "4aa30efc-6e3a-4303-98e2-966b1268902f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 10:10:11.836506 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.836353    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-kube-api-access-9g926" (OuterVolumeSpecName: "kube-api-access-9g926") pod "4aa30efc-6e3a-4303-98e2-966b1268902f" (UID: "4aa30efc-6e3a-4303-98e2-966b1268902f"). InnerVolumeSpecName "kube-api-access-9g926". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 10:10:11.836506 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.836353    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aa30efc-6e3a-4303-98e2-966b1268902f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4aa30efc-6e3a-4303-98e2-966b1268902f" (UID: "4aa30efc-6e3a-4303-98e2-966b1268902f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:10:11.842554 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.842528    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4aa30efc-6e3a-4303-98e2-966b1268902f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4aa30efc-6e3a-4303-98e2-966b1268902f" (UID: "4aa30efc-6e3a-4303-98e2-966b1268902f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 10:10:11.934000 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.933921    2577 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-bound-sa-token\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:11.934000 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.933948    2577 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-tls\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:11.934000 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.933957    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9g926\" (UniqueName: \"kubernetes.io/projected/4aa30efc-6e3a-4303-98e2-966b1268902f-kube-api-access-9g926\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:11.934000 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.933966    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4aa30efc-6e3a-4303-98e2-966b1268902f-trusted-ca\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:11.934000 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.933975    2577 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4aa30efc-6e3a-4303-98e2-966b1268902f-image-registry-private-configuration\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:11.934000 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.933984    2577 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4aa30efc-6e3a-4303-98e2-966b1268902f-registry-certificates\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:11.934000 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.933993    2577 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4aa30efc-6e3a-4303-98e2-966b1268902f-ca-trust-extracted\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:11.934000 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.934003    2577 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4aa30efc-6e3a-4303-98e2-966b1268902f-installation-pull-secrets\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:11.994657 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.994625    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-b55955d75-mh9fw"]
Jul 28 10:10:11.998896 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:11.998868    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-b55955d75-mh9fw"]
Jul 28 10:10:12.552809 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:12.552763    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f56fc947b-gr9sz" podUID="742061c7-0353-44d4-88c8-9cdfb50088a8" containerName="console" containerID="cri-o://0dd4267d337f2e8cd595ad7e04a6f2f8b60e30dc4370ad367b39fc19201ed644" gracePeriod=15
Jul 28 10:10:12.676913 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:12.676873    2577 generic.go:356] "Generic (PLEG): container finished" podID="742061c7-0353-44d4-88c8-9cdfb50088a8" containerID="0dd4267d337f2e8cd595ad7e04a6f2f8b60e30dc4370ad367b39fc19201ed644" exitCode=0
Jul 28 10:10:12.677062 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:12.676940    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f56fc947b-gr9sz" event={"ID":"742061c7-0353-44d4-88c8-9cdfb50088a8","Type":"ContainerDied","Data":"0dd4267d337f2e8cd595ad7e04a6f2f8b60e30dc4370ad367b39fc19201ed644"}
Jul 28 10:10:12.850701 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:12.850672    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:10:12.941922 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:12.941894    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jjvd\" (UniqueName: \"kubernetes.io/projected/742061c7-0353-44d4-88c8-9cdfb50088a8-kube-api-access-7jjvd\") pod \"742061c7-0353-44d4-88c8-9cdfb50088a8\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") "
Jul 28 10:10:12.941922 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:12.941930    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/742061c7-0353-44d4-88c8-9cdfb50088a8-oauth-serving-cert\") pod \"742061c7-0353-44d4-88c8-9cdfb50088a8\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") "
Jul 28 10:10:12.942165 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:12.941964    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/742061c7-0353-44d4-88c8-9cdfb50088a8-service-ca\") pod \"742061c7-0353-44d4-88c8-9cdfb50088a8\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") "
Jul 28 10:10:12.942165 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:12.941989    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/742061c7-0353-44d4-88c8-9cdfb50088a8-console-serving-cert\") pod \"742061c7-0353-44d4-88c8-9cdfb50088a8\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") "
Jul 28 10:10:12.942165 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:12.942048    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/742061c7-0353-44d4-88c8-9cdfb50088a8-console-oauth-config\") pod \"742061c7-0353-44d4-88c8-9cdfb50088a8\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") "
Jul 28 10:10:12.942365 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:12.942343    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/742061c7-0353-44d4-88c8-9cdfb50088a8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "742061c7-0353-44d4-88c8-9cdfb50088a8" (UID: "742061c7-0353-44d4-88c8-9cdfb50088a8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:10:12.942433 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:12.942413    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/742061c7-0353-44d4-88c8-9cdfb50088a8-service-ca" (OuterVolumeSpecName: "service-ca") pod "742061c7-0353-44d4-88c8-9cdfb50088a8" (UID: "742061c7-0353-44d4-88c8-9cdfb50088a8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:10:12.944377 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:12.944353    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/742061c7-0353-44d4-88c8-9cdfb50088a8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "742061c7-0353-44d4-88c8-9cdfb50088a8" (UID: "742061c7-0353-44d4-88c8-9cdfb50088a8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:10:12.944466 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:12.944414    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/742061c7-0353-44d4-88c8-9cdfb50088a8-kube-api-access-7jjvd" (OuterVolumeSpecName: "kube-api-access-7jjvd") pod "742061c7-0353-44d4-88c8-9cdfb50088a8" (UID: "742061c7-0353-44d4-88c8-9cdfb50088a8"). InnerVolumeSpecName "kube-api-access-7jjvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 10:10:12.944466 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:12.944420    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/742061c7-0353-44d4-88c8-9cdfb50088a8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "742061c7-0353-44d4-88c8-9cdfb50088a8" (UID: "742061c7-0353-44d4-88c8-9cdfb50088a8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:10:13.042995 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:13.042958    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/742061c7-0353-44d4-88c8-9cdfb50088a8-console-config\") pod \"742061c7-0353-44d4-88c8-9cdfb50088a8\" (UID: \"742061c7-0353-44d4-88c8-9cdfb50088a8\") "
Jul 28 10:10:13.043185 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:13.043153    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/742061c7-0353-44d4-88c8-9cdfb50088a8-service-ca\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:13.043185 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:13.043171    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/742061c7-0353-44d4-88c8-9cdfb50088a8-console-serving-cert\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:13.043185 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:13.043184    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/742061c7-0353-44d4-88c8-9cdfb50088a8-console-oauth-config\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:13.043315 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:13.043197    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jjvd\" (UniqueName: \"kubernetes.io/projected/742061c7-0353-44d4-88c8-9cdfb50088a8-kube-api-access-7jjvd\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:13.043315 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:13.043212    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/742061c7-0353-44d4-88c8-9cdfb50088a8-oauth-serving-cert\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:13.043375 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:13.043315    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/742061c7-0353-44d4-88c8-9cdfb50088a8-console-config" (OuterVolumeSpecName: "console-config") pod "742061c7-0353-44d4-88c8-9cdfb50088a8" (UID: "742061c7-0353-44d4-88c8-9cdfb50088a8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:10:13.044003 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:13.043983    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4aa30efc-6e3a-4303-98e2-966b1268902f" path="/var/lib/kubelet/pods/4aa30efc-6e3a-4303-98e2-966b1268902f/volumes"
Jul 28 10:10:13.144342 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:13.144257    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/742061c7-0353-44d4-88c8-9cdfb50088a8-console-config\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:13.682216 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:13.682179    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f56fc947b-gr9sz" event={"ID":"742061c7-0353-44d4-88c8-9cdfb50088a8","Type":"ContainerDied","Data":"dffd47577b369273e75739b38d7a920a33ef29db731ad765045aa07328f732a2"}
Jul 28 10:10:13.682216 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:13.682198    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f56fc947b-gr9sz"
Jul 28 10:10:13.682724 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:13.682241    2577 scope.go:117] "RemoveContainer" containerID="0dd4267d337f2e8cd595ad7e04a6f2f8b60e30dc4370ad367b39fc19201ed644"
Jul 28 10:10:13.699732 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:13.699712    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f56fc947b-gr9sz"]
Jul 28 10:10:13.703611 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:13.703589    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f56fc947b-gr9sz"]
Jul 28 10:10:15.043950 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:15.043918    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="742061c7-0353-44d4-88c8-9cdfb50088a8" path="/var/lib/kubelet/pods/742061c7-0353-44d4-88c8-9cdfb50088a8/volumes"
Jul 28 10:10:16.182224 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:16.182195    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:10:16.186025 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:16.186004    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-746cb6d799-rm4sl"
Jul 28 10:10:51.793691 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:51.793651    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 10:10:51.794160 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:51.793963    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="alertmanager" containerID="cri-o://4855b2a755bab6076b8ea85fd8a73f63ffb8a265861886777afefe9db7569620" gracePeriod=120
Jul 28 10:10:51.794160 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:51.794044    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="kube-rbac-proxy-web" containerID="cri-o://8b854dbe6210e1aafa2cbf053bf5009e8c8dc2ef1c4c1c9a3bd0730b06af403b" gracePeriod=120
Jul 28 10:10:51.794160 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:51.794044    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="kube-rbac-proxy-metric" containerID="cri-o://375c488b12fa8da04d03b910423e60fa4759b05853575e9e16907352b59ca02e" gracePeriod=120
Jul 28 10:10:51.794160 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:51.794079    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="prom-label-proxy" containerID="cri-o://17e1ec8e2cf250ef16856cf8e021e79e2c3d0d1b0c05f84daa39693aa75edbdb" gracePeriod=120
Jul 28 10:10:51.794382 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:51.794165    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="kube-rbac-proxy" containerID="cri-o://ebeb331d382246265a10148767114d2c418c818774adca90cd9cd6b949c8403f" gracePeriod=120
Jul 28 10:10:51.794382 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:51.794109    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="config-reloader" containerID="cri-o://f7639a72e95b4a6e4b95297204a5c1f97ba7ba019edd5ab9fdd91c76bc565c32" gracePeriod=120
Jul 28 10:10:52.830350 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:52.830321    2577 generic.go:356] "Generic (PLEG): container finished" podID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerID="17e1ec8e2cf250ef16856cf8e021e79e2c3d0d1b0c05f84daa39693aa75edbdb" exitCode=0
Jul 28 10:10:52.830350 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:52.830344    2577 generic.go:356] "Generic (PLEG): container finished" podID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerID="375c488b12fa8da04d03b910423e60fa4759b05853575e9e16907352b59ca02e" exitCode=0
Jul 28 10:10:52.830350 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:52.830352    2577 generic.go:356] "Generic (PLEG): container finished" podID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerID="ebeb331d382246265a10148767114d2c418c818774adca90cd9cd6b949c8403f" exitCode=0
Jul 28 10:10:52.830350 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:52.830357    2577 generic.go:356] "Generic (PLEG): container finished" podID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerID="f7639a72e95b4a6e4b95297204a5c1f97ba7ba019edd5ab9fdd91c76bc565c32" exitCode=0
Jul 28 10:10:52.830808 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:52.830362    2577 generic.go:356] "Generic (PLEG): container finished" podID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerID="4855b2a755bab6076b8ea85fd8a73f63ffb8a265861886777afefe9db7569620" exitCode=0
Jul 28 10:10:52.830808 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:52.830371    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e3b951-6ea1-431e-835d-c857aa58d06b","Type":"ContainerDied","Data":"17e1ec8e2cf250ef16856cf8e021e79e2c3d0d1b0c05f84daa39693aa75edbdb"}
Jul 28 10:10:52.830808 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:52.830463    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e3b951-6ea1-431e-835d-c857aa58d06b","Type":"ContainerDied","Data":"375c488b12fa8da04d03b910423e60fa4759b05853575e9e16907352b59ca02e"}
Jul 28 10:10:52.830808 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:52.830490    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e3b951-6ea1-431e-835d-c857aa58d06b","Type":"ContainerDied","Data":"ebeb331d382246265a10148767114d2c418c818774adca90cd9cd6b949c8403f"}
Jul 28 10:10:52.830808 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:52.830515    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e3b951-6ea1-431e-835d-c857aa58d06b","Type":"ContainerDied","Data":"f7639a72e95b4a6e4b95297204a5c1f97ba7ba019edd5ab9fdd91c76bc565c32"}
Jul 28 10:10:52.830808 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:52.830537    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e3b951-6ea1-431e-835d-c857aa58d06b","Type":"ContainerDied","Data":"4855b2a755bab6076b8ea85fd8a73f63ffb8a265861886777afefe9db7569620"}
Jul 28 10:10:53.136316 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.136285    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:53.261644 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.261614    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-web-config\") pod \"49e3b951-6ea1-431e-835d-c857aa58d06b\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") "
Jul 28 10:10:53.261812 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.261651    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-cluster-tls-config\") pod \"49e3b951-6ea1-431e-835d-c857aa58d06b\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") "
Jul 28 10:10:53.261812 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.261700    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4km67\" (UniqueName: \"kubernetes.io/projected/49e3b951-6ea1-431e-835d-c857aa58d06b-kube-api-access-4km67\") pod \"49e3b951-6ea1-431e-835d-c857aa58d06b\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") "
Jul 28 10:10:53.261812 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.261728    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-config-volume\") pod \"49e3b951-6ea1-431e-835d-c857aa58d06b\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") "
Jul 28 10:10:53.261812 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.261753    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49e3b951-6ea1-431e-835d-c857aa58d06b-metrics-client-ca\") pod \"49e3b951-6ea1-431e-835d-c857aa58d06b\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") "
Jul 28 10:10:53.261812 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.261780    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/49e3b951-6ea1-431e-835d-c857aa58d06b-tls-assets\") pod \"49e3b951-6ea1-431e-835d-c857aa58d06b\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") "
Jul 28 10:10:53.261812 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.261806    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/49e3b951-6ea1-431e-835d-c857aa58d06b-alertmanager-main-db\") pod \"49e3b951-6ea1-431e-835d-c857aa58d06b\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") "
Jul 28 10:10:53.262146 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.261856    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-kube-rbac-proxy\") pod \"49e3b951-6ea1-431e-835d-c857aa58d06b\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") "
Jul 28 10:10:53.262146 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.261882    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-main-tls\") pod \"49e3b951-6ea1-431e-835d-c857aa58d06b\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") "
Jul 28 10:10:53.262146 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.261914    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/49e3b951-6ea1-431e-835d-c857aa58d06b-config-out\") pod \"49e3b951-6ea1-431e-835d-c857aa58d06b\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") "
Jul 28 10:10:53.262146 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.261952    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-kube-rbac-proxy-web\") pod \"49e3b951-6ea1-431e-835d-c857aa58d06b\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") "
Jul 28 10:10:53.262146 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.261981    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"49e3b951-6ea1-431e-835d-c857aa58d06b\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") "
Jul 28 10:10:53.262146 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.262050    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49e3b951-6ea1-431e-835d-c857aa58d06b-alertmanager-trusted-ca-bundle\") pod \"49e3b951-6ea1-431e-835d-c857aa58d06b\" (UID: \"49e3b951-6ea1-431e-835d-c857aa58d06b\") "
Jul 28 10:10:53.262483 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.262235    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49e3b951-6ea1-431e-835d-c857aa58d06b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "49e3b951-6ea1-431e-835d-c857aa58d06b" (UID: "49e3b951-6ea1-431e-835d-c857aa58d06b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 10:10:53.262662 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.262578    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49e3b951-6ea1-431e-835d-c857aa58d06b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "49e3b951-6ea1-431e-835d-c857aa58d06b" (UID: "49e3b951-6ea1-431e-835d-c857aa58d06b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:10:53.262662 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.262584    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49e3b951-6ea1-431e-835d-c857aa58d06b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "49e3b951-6ea1-431e-835d-c857aa58d06b" (UID: "49e3b951-6ea1-431e-835d-c857aa58d06b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:10:53.265913 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.265659    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "49e3b951-6ea1-431e-835d-c857aa58d06b" (UID: "49e3b951-6ea1-431e-835d-c857aa58d06b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:10:53.265913 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.265862    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "49e3b951-6ea1-431e-835d-c857aa58d06b" (UID: "49e3b951-6ea1-431e-835d-c857aa58d06b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:10:53.265913 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.265875    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "49e3b951-6ea1-431e-835d-c857aa58d06b" (UID: "49e3b951-6ea1-431e-835d-c857aa58d06b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:10:53.266412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.266365    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49e3b951-6ea1-431e-835d-c857aa58d06b-kube-api-access-4km67" (OuterVolumeSpecName: "kube-api-access-4km67") pod "49e3b951-6ea1-431e-835d-c857aa58d06b" (UID: "49e3b951-6ea1-431e-835d-c857aa58d06b"). InnerVolumeSpecName "kube-api-access-4km67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 10:10:53.266569 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.266517    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "49e3b951-6ea1-431e-835d-c857aa58d06b" (UID: "49e3b951-6ea1-431e-835d-c857aa58d06b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:10:53.267277 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.267257    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49e3b951-6ea1-431e-835d-c857aa58d06b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "49e3b951-6ea1-431e-835d-c857aa58d06b" (UID: "49e3b951-6ea1-431e-835d-c857aa58d06b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 10:10:53.267463 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.267432    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49e3b951-6ea1-431e-835d-c857aa58d06b-config-out" (OuterVolumeSpecName: "config-out") pod "49e3b951-6ea1-431e-835d-c857aa58d06b" (UID: "49e3b951-6ea1-431e-835d-c857aa58d06b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 10:10:53.268409 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.268372    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-config-volume" (OuterVolumeSpecName: "config-volume") pod "49e3b951-6ea1-431e-835d-c857aa58d06b" (UID: "49e3b951-6ea1-431e-835d-c857aa58d06b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:10:53.269600 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.269581    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "49e3b951-6ea1-431e-835d-c857aa58d06b" (UID: "49e3b951-6ea1-431e-835d-c857aa58d06b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:10:53.275995 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.275971    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-web-config" (OuterVolumeSpecName: "web-config") pod "49e3b951-6ea1-431e-835d-c857aa58d06b" (UID: "49e3b951-6ea1-431e-835d-c857aa58d06b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:10:53.362807 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.362777    2577 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/49e3b951-6ea1-431e-835d-c857aa58d06b-config-out\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:53.362807 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.362807    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:53.363021 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.362817    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:53.363021 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.362829    2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49e3b951-6ea1-431e-835d-c857aa58d06b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:53.363021 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.362882    2577 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-web-config\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:53.363021 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.362893    2577 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-cluster-tls-config\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:53.363021 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.362901    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4km67\" (UniqueName: \"kubernetes.io/projected/49e3b951-6ea1-431e-835d-c857aa58d06b-kube-api-access-4km67\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:53.363021 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.362910    2577 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-config-volume\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:53.363021 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.362918    2577 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49e3b951-6ea1-431e-835d-c857aa58d06b-metrics-client-ca\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:53.363021 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.362925    2577 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/49e3b951-6ea1-431e-835d-c857aa58d06b-tls-assets\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:53.363021 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.362934    2577 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/49e3b951-6ea1-431e-835d-c857aa58d06b-alertmanager-main-db\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:53.363021 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.362941    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:53.363021 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.362950    2577 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/49e3b951-6ea1-431e-835d-c857aa58d06b-secret-alertmanager-main-tls\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:10:53.837789 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.837749    2577 generic.go:356] "Generic (PLEG): container finished" podID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerID="8b854dbe6210e1aafa2cbf053bf5009e8c8dc2ef1c4c1c9a3bd0730b06af403b" exitCode=0
Jul 28 10:10:53.838214 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.837823    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:53.838214 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.837823    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e3b951-6ea1-431e-835d-c857aa58d06b","Type":"ContainerDied","Data":"8b854dbe6210e1aafa2cbf053bf5009e8c8dc2ef1c4c1c9a3bd0730b06af403b"}
Jul 28 10:10:53.838214 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.837909    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"49e3b951-6ea1-431e-835d-c857aa58d06b","Type":"ContainerDied","Data":"a90647283d911b5019eb36133d3cb3a2f191075eb20654b6ecfe1e57c8c7caea"}
Jul 28 10:10:53.838214 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.837944    2577 scope.go:117] "RemoveContainer" containerID="17e1ec8e2cf250ef16856cf8e021e79e2c3d0d1b0c05f84daa39693aa75edbdb"
Jul 28 10:10:53.846335 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.846317    2577 scope.go:117] "RemoveContainer" containerID="375c488b12fa8da04d03b910423e60fa4759b05853575e9e16907352b59ca02e"
Jul 28 10:10:53.853223 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.853206    2577 scope.go:117] "RemoveContainer" containerID="ebeb331d382246265a10148767114d2c418c818774adca90cd9cd6b949c8403f"
Jul 28 10:10:53.859995 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.859979    2577 scope.go:117] "RemoveContainer" containerID="8b854dbe6210e1aafa2cbf053bf5009e8c8dc2ef1c4c1c9a3bd0730b06af403b"
Jul 28 10:10:53.865138 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.865117    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 10:10:53.867211 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.867190    2577 scope.go:117] "RemoveContainer" containerID="f7639a72e95b4a6e4b95297204a5c1f97ba7ba019edd5ab9fdd91c76bc565c32"
Jul 28 10:10:53.870225 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.870203    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 10:10:53.874338 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.874322    2577 scope.go:117] "RemoveContainer" containerID="4855b2a755bab6076b8ea85fd8a73f63ffb8a265861886777afefe9db7569620"
Jul 28 10:10:53.881296 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.881281    2577 scope.go:117] "RemoveContainer" containerID="66bbb5d0721f7a80469420af624d9fe15e69ff2a07b9dcda2b326ea34d53ab0d"
Jul 28 10:10:53.887768 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.887752    2577 scope.go:117] "RemoveContainer" containerID="17e1ec8e2cf250ef16856cf8e021e79e2c3d0d1b0c05f84daa39693aa75edbdb"
Jul 28 10:10:53.888047 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:10:53.888022    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17e1ec8e2cf250ef16856cf8e021e79e2c3d0d1b0c05f84daa39693aa75edbdb\": container with ID starting with 17e1ec8e2cf250ef16856cf8e021e79e2c3d0d1b0c05f84daa39693aa75edbdb not found: ID does not exist" containerID="17e1ec8e2cf250ef16856cf8e021e79e2c3d0d1b0c05f84daa39693aa75edbdb"
Jul 28 10:10:53.888104 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.888049    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17e1ec8e2cf250ef16856cf8e021e79e2c3d0d1b0c05f84daa39693aa75edbdb"} err="failed to get container status \"17e1ec8e2cf250ef16856cf8e021e79e2c3d0d1b0c05f84daa39693aa75edbdb\": rpc error: code = NotFound desc = could not find container \"17e1ec8e2cf250ef16856cf8e021e79e2c3d0d1b0c05f84daa39693aa75edbdb\": container with ID starting with 17e1ec8e2cf250ef16856cf8e021e79e2c3d0d1b0c05f84daa39693aa75edbdb not found: ID does not exist"
Jul 28 10:10:53.888104 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.888067    2577 scope.go:117] "RemoveContainer" containerID="375c488b12fa8da04d03b910423e60fa4759b05853575e9e16907352b59ca02e"
Jul 28 10:10:53.888276 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:10:53.888257    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"375c488b12fa8da04d03b910423e60fa4759b05853575e9e16907352b59ca02e\": container with ID starting with 375c488b12fa8da04d03b910423e60fa4759b05853575e9e16907352b59ca02e not found: ID does not exist" containerID="375c488b12fa8da04d03b910423e60fa4759b05853575e9e16907352b59ca02e"
Jul 28 10:10:53.888323 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.888283    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"375c488b12fa8da04d03b910423e60fa4759b05853575e9e16907352b59ca02e"} err="failed to get container status \"375c488b12fa8da04d03b910423e60fa4759b05853575e9e16907352b59ca02e\": rpc error: code = NotFound desc = could not find container \"375c488b12fa8da04d03b910423e60fa4759b05853575e9e16907352b59ca02e\": container with ID starting with 375c488b12fa8da04d03b910423e60fa4759b05853575e9e16907352b59ca02e not found: ID does not exist"
Jul 28 10:10:53.888323 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.888308    2577 scope.go:117] "RemoveContainer" containerID="ebeb331d382246265a10148767114d2c418c818774adca90cd9cd6b949c8403f"
Jul 28 10:10:53.888552 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:10:53.888535    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebeb331d382246265a10148767114d2c418c818774adca90cd9cd6b949c8403f\": container with ID starting with ebeb331d382246265a10148767114d2c418c818774adca90cd9cd6b949c8403f not found: ID does not exist" containerID="ebeb331d382246265a10148767114d2c418c818774adca90cd9cd6b949c8403f"
Jul 28 10:10:53.888606 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.888557    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebeb331d382246265a10148767114d2c418c818774adca90cd9cd6b949c8403f"} err="failed to get container status \"ebeb331d382246265a10148767114d2c418c818774adca90cd9cd6b949c8403f\": rpc error: code = NotFound desc = could not find container \"ebeb331d382246265a10148767114d2c418c818774adca90cd9cd6b949c8403f\": container with ID starting with ebeb331d382246265a10148767114d2c418c818774adca90cd9cd6b949c8403f not found: ID does not exist"
Jul 28 10:10:53.888606 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.888571    2577 scope.go:117] "RemoveContainer" containerID="8b854dbe6210e1aafa2cbf053bf5009e8c8dc2ef1c4c1c9a3bd0730b06af403b"
Jul 28 10:10:53.888814 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:10:53.888799    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b854dbe6210e1aafa2cbf053bf5009e8c8dc2ef1c4c1c9a3bd0730b06af403b\": container with ID starting with 8b854dbe6210e1aafa2cbf053bf5009e8c8dc2ef1c4c1c9a3bd0730b06af403b not found: ID does not exist" containerID="8b854dbe6210e1aafa2cbf053bf5009e8c8dc2ef1c4c1c9a3bd0730b06af403b"
Jul 28 10:10:53.888876 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.888818    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b854dbe6210e1aafa2cbf053bf5009e8c8dc2ef1c4c1c9a3bd0730b06af403b"} err="failed to get container status \"8b854dbe6210e1aafa2cbf053bf5009e8c8dc2ef1c4c1c9a3bd0730b06af403b\": rpc error: code = NotFound desc = could not find container \"8b854dbe6210e1aafa2cbf053bf5009e8c8dc2ef1c4c1c9a3bd0730b06af403b\": container with ID starting with 8b854dbe6210e1aafa2cbf053bf5009e8c8dc2ef1c4c1c9a3bd0730b06af403b not found: ID does not exist"
Jul 28 10:10:53.888876 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.888833    2577 scope.go:117] "RemoveContainer" containerID="f7639a72e95b4a6e4b95297204a5c1f97ba7ba019edd5ab9fdd91c76bc565c32"
Jul 28 10:10:53.889094 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:10:53.889077    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7639a72e95b4a6e4b95297204a5c1f97ba7ba019edd5ab9fdd91c76bc565c32\": container with ID starting with f7639a72e95b4a6e4b95297204a5c1f97ba7ba019edd5ab9fdd91c76bc565c32 not found: ID does not exist" containerID="f7639a72e95b4a6e4b95297204a5c1f97ba7ba019edd5ab9fdd91c76bc565c32"
Jul 28 10:10:53.889140 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.889098    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7639a72e95b4a6e4b95297204a5c1f97ba7ba019edd5ab9fdd91c76bc565c32"} err="failed to get container status \"f7639a72e95b4a6e4b95297204a5c1f97ba7ba019edd5ab9fdd91c76bc565c32\": rpc error: code = NotFound desc = could not find container \"f7639a72e95b4a6e4b95297204a5c1f97ba7ba019edd5ab9fdd91c76bc565c32\": container with ID starting with f7639a72e95b4a6e4b95297204a5c1f97ba7ba019edd5ab9fdd91c76bc565c32 not found: ID does not exist"
Jul 28 10:10:53.889140 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.889112    2577 scope.go:117] "RemoveContainer" containerID="4855b2a755bab6076b8ea85fd8a73f63ffb8a265861886777afefe9db7569620"
Jul 28 10:10:53.889328 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:10:53.889311    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4855b2a755bab6076b8ea85fd8a73f63ffb8a265861886777afefe9db7569620\": container with ID starting with 4855b2a755bab6076b8ea85fd8a73f63ffb8a265861886777afefe9db7569620 not found: ID does not exist" containerID="4855b2a755bab6076b8ea85fd8a73f63ffb8a265861886777afefe9db7569620"
Jul 28 10:10:53.889363 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.889333    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4855b2a755bab6076b8ea85fd8a73f63ffb8a265861886777afefe9db7569620"} err="failed to get container status \"4855b2a755bab6076b8ea85fd8a73f63ffb8a265861886777afefe9db7569620\": rpc error: code = NotFound desc = could not find container \"4855b2a755bab6076b8ea85fd8a73f63ffb8a265861886777afefe9db7569620\": container with ID starting with 4855b2a755bab6076b8ea85fd8a73f63ffb8a265861886777afefe9db7569620 not found: ID does not exist"
Jul 28 10:10:53.889363 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.889347    2577 scope.go:117] "RemoveContainer" containerID="66bbb5d0721f7a80469420af624d9fe15e69ff2a07b9dcda2b326ea34d53ab0d"
Jul 28 10:10:53.889567 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:10:53.889552    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66bbb5d0721f7a80469420af624d9fe15e69ff2a07b9dcda2b326ea34d53ab0d\": container with ID starting with 66bbb5d0721f7a80469420af624d9fe15e69ff2a07b9dcda2b326ea34d53ab0d not found: ID does not exist" containerID="66bbb5d0721f7a80469420af624d9fe15e69ff2a07b9dcda2b326ea34d53ab0d"
Jul 28 10:10:53.889605 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.889571    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66bbb5d0721f7a80469420af624d9fe15e69ff2a07b9dcda2b326ea34d53ab0d"} err="failed to get container status \"66bbb5d0721f7a80469420af624d9fe15e69ff2a07b9dcda2b326ea34d53ab0d\": rpc error: code = NotFound desc = could not find container \"66bbb5d0721f7a80469420af624d9fe15e69ff2a07b9dcda2b326ea34d53ab0d\": container with ID starting with 66bbb5d0721f7a80469420af624d9fe15e69ff2a07b9dcda2b326ea34d53ab0d not found: ID does not exist"
Jul 28 10:10:53.902047 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902019    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 10:10:53.902301 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902289    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="prom-label-proxy"
Jul 28 10:10:53.902342 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902305    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="prom-label-proxy"
Jul 28 10:10:53.902342 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902318    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="kube-rbac-proxy-web"
Jul 28 10:10:53.902342 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902327    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="kube-rbac-proxy-web"
Jul 28 10:10:53.902342 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902335    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aa30efc-6e3a-4303-98e2-966b1268902f" containerName="registry"
Jul 28 10:10:53.902342 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902340    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aa30efc-6e3a-4303-98e2-966b1268902f" containerName="registry"
Jul 28 10:10:53.902482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902345    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="kube-rbac-proxy-metric"
Jul 28 10:10:53.902482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902351    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="kube-rbac-proxy-metric"
Jul 28 10:10:53.902482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902361    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="config-reloader"
Jul 28 10:10:53.902482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902365    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="config-reloader"
Jul 28 10:10:53.902482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902371    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="kube-rbac-proxy"
Jul 28 10:10:53.902482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902377    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="kube-rbac-proxy"
Jul 28 10:10:53.902482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902383    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="742061c7-0353-44d4-88c8-9cdfb50088a8" containerName="console"
Jul 28 10:10:53.902482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902388    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="742061c7-0353-44d4-88c8-9cdfb50088a8" containerName="console"
Jul 28 10:10:53.902482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902396    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="init-config-reloader"
Jul 28 10:10:53.902482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902404    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="init-config-reloader"
Jul 28 10:10:53.902482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902409    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="alertmanager"
Jul 28 10:10:53.902482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902414    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="alertmanager"
Jul 28 10:10:53.902482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902455    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="742061c7-0353-44d4-88c8-9cdfb50088a8" containerName="console"
Jul 28 10:10:53.902482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902462    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="alertmanager"
Jul 28 10:10:53.902482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902473    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="prom-label-proxy"
Jul 28 10:10:53.902482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902483    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="config-reloader"
Jul 28 10:10:53.902929 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902490    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="kube-rbac-proxy"
Jul 28 10:10:53.902929 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902495    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="kube-rbac-proxy-web"
Jul 28 10:10:53.902929 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902501    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4aa30efc-6e3a-4303-98e2-966b1268902f" containerName="registry"
Jul 28 10:10:53.902929 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.902506    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" containerName="kube-rbac-proxy-metric"
Jul 28 10:10:53.905920 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.905905    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:53.908763 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.908737    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 28 10:10:53.909245 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.909222    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 28 10:10:53.909245 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.909229    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 28 10:10:53.909537 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.909501    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cwrr9\""
Jul 28 10:10:53.909537 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.909515    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 28 10:10:53.909676 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.909516    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 28 10:10:53.909676 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.909521    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 28 10:10:53.909676 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.909600    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 28 10:10:53.909802 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.909777    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 28 10:10:53.914777 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.914752    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 28 10:10:53.923290 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:53.923272    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 10:10:54.067451 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.067414    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-web-config\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.067451 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.067454    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xks6w\" (UniqueName: \"kubernetes.io/projected/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-kube-api-access-xks6w\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.067651 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.067473    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-config-volume\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.067651 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.067500    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.067651 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.067559    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-config-out\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.067651 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.067592    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.067651 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.067616    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.067651 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.067634    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.067822 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.067669    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.067822 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.067690    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.067822 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.067747    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.067822 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.067788    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.067822 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.067805    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.169078 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.168986    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.169078 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.169017    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.169078 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.169043    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.169078 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.169075    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.169391 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.169105    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.169391 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.169142    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.169391 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.169164    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.169391 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.169195    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-web-config\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.169391 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.169218    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xks6w\" (UniqueName: \"kubernetes.io/projected/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-kube-api-access-xks6w\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.169391 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.169238    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-config-volume\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.169391 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.169266    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.169391 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.169308    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-config-out\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.169391 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.169334    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.169859 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.169677    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.169859 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.169825    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.171111 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.171083    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.172696 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.172389    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.172696 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.172659    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-config-out\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.173586 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.173045    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.173586 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.173154    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.173586 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.173501    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.173994 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.173968    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.174232 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.174205    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.174499 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.174481    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-config-volume\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.174892 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.174863    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-web-config\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.180176 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.180153    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xks6w\" (UniqueName: \"kubernetes.io/projected/dc2d385b-1b90-467d-b3a9-837efd9fdc1f-kube-api-access-xks6w\") pod \"alertmanager-main-0\" (UID: \"dc2d385b-1b90-467d-b3a9-837efd9fdc1f\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.215164 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.215125    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 28 10:10:54.355988 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.355958    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 28 10:10:54.358784 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:10:54.358754    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc2d385b_1b90_467d_b3a9_837efd9fdc1f.slice/crio-47fddf5811b51986019c76e9277af55f967bfcce9a5a3b6317cdb8df31c506e2 WatchSource:0}: Error finding container 47fddf5811b51986019c76e9277af55f967bfcce9a5a3b6317cdb8df31c506e2: Status 404 returned error can't find the container with id 47fddf5811b51986019c76e9277af55f967bfcce9a5a3b6317cdb8df31c506e2
Jul 28 10:10:54.843685 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.843654    2577 generic.go:356] "Generic (PLEG): container finished" podID="dc2d385b-1b90-467d-b3a9-837efd9fdc1f" containerID="4d2a21086ab3774d8a6e861e95bf1af8e92926f660d7c12172b474c54a90ad86" exitCode=0
Jul 28 10:10:54.844093 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.843701    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc2d385b-1b90-467d-b3a9-837efd9fdc1f","Type":"ContainerDied","Data":"4d2a21086ab3774d8a6e861e95bf1af8e92926f660d7c12172b474c54a90ad86"}
Jul 28 10:10:54.844093 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:54.843749    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc2d385b-1b90-467d-b3a9-837efd9fdc1f","Type":"ContainerStarted","Data":"47fddf5811b51986019c76e9277af55f967bfcce9a5a3b6317cdb8df31c506e2"}
Jul 28 10:10:55.045985 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.045960    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49e3b951-6ea1-431e-835d-c857aa58d06b" path="/var/lib/kubelet/pods/49e3b951-6ea1-431e-835d-c857aa58d06b/volumes"
Jul 28 10:10:55.824563 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.824527    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"]
Jul 28 10:10:55.826775 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.826753    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:55.829273 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.829251    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 28 10:10:55.829557 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.829501    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-st54d\""
Jul 28 10:10:55.829664 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.829508    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 28 10:10:55.829746 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.829730    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 28 10:10:55.829813 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.829800    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 28 10:10:55.829894 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.829877    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 28 10:10:55.836866 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.836824    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 28 10:10:55.844331 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.844301    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"]
Jul 28 10:10:55.851792 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.851767    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc2d385b-1b90-467d-b3a9-837efd9fdc1f","Type":"ContainerStarted","Data":"be69d129f2ab7c82fcc6048d57113c13218327b5545cf6a17bb291d7b2bfa30f"}
Jul 28 10:10:55.851993 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.851854    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc2d385b-1b90-467d-b3a9-837efd9fdc1f","Type":"ContainerStarted","Data":"7e6a099b310df6ee6f62a932724dceb0ac53227a20915edb9fd4a3f7e3505c5e"}
Jul 28 10:10:55.851993 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.851900    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc2d385b-1b90-467d-b3a9-837efd9fdc1f","Type":"ContainerStarted","Data":"4127713c4ac504897117e66d186664212750b38127ae0d1a32a1cd6cefb185a5"}
Jul 28 10:10:55.851993 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.851932    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc2d385b-1b90-467d-b3a9-837efd9fdc1f","Type":"ContainerStarted","Data":"ed33621845f94a3159e89c43a2f19bf4d2a446e54fc1a7b9fc7007ab56457cdd"}
Jul 28 10:10:55.851993 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.851957    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc2d385b-1b90-467d-b3a9-837efd9fdc1f","Type":"ContainerStarted","Data":"ed92ab3b4d18fc6e637ae30da31f3d6fdef4a6427b0434f9f88b92ebee99fd86"}
Jul 28 10:10:55.851993 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.851980    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"dc2d385b-1b90-467d-b3a9-837efd9fdc1f","Type":"ContainerStarted","Data":"c3c5593ee94a04f3142cc68c8636c462232b2e9d7d03410827fd205009ed4c70"}
Jul 28 10:10:55.896767 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.896713    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.8801433039999997 podStartE2EDuration="2.89669868s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.555376ms" isStatefulPod=false podCreationTimestamp="2026-07-28 10:10:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:10:55.895005861 +0000 UTC m=+189.297244289" watchObservedRunningTime="2026-07-28 10:10:55.89669868 +0000 UTC m=+189.298937077"
Jul 28 10:10:55.985483 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.985444    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b4fb7b0f-07e2-416b-ae3f-f160d136e619-federate-client-tls\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:55.985670 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.985499    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4fb7b0f-07e2-416b-ae3f-f160d136e619-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:55.985670 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.985523    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b4fb7b0f-07e2-416b-ae3f-f160d136e619-secret-telemeter-client\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:55.985670 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.985662    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhxs4\" (UniqueName: \"kubernetes.io/projected/b4fb7b0f-07e2-416b-ae3f-f160d136e619-kube-api-access-zhxs4\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:55.985914 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.985733    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b4fb7b0f-07e2-416b-ae3f-f160d136e619-telemeter-client-tls\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:55.985914 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.985781    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4fb7b0f-07e2-416b-ae3f-f160d136e619-telemeter-trusted-ca-bundle\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:55.985914 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.985808    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4fb7b0f-07e2-416b-ae3f-f160d136e619-metrics-client-ca\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:55.986072 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:55.985964    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4fb7b0f-07e2-416b-ae3f-f160d136e619-serving-certs-ca-bundle\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:56.087269 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:56.087165    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b4fb7b0f-07e2-416b-ae3f-f160d136e619-federate-client-tls\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:56.087269 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:56.087210    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4fb7b0f-07e2-416b-ae3f-f160d136e619-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:56.087269 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:56.087245    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b4fb7b0f-07e2-416b-ae3f-f160d136e619-secret-telemeter-client\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:56.087542 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:56.087292    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhxs4\" (UniqueName: \"kubernetes.io/projected/b4fb7b0f-07e2-416b-ae3f-f160d136e619-kube-api-access-zhxs4\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:56.087542 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:56.087324    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b4fb7b0f-07e2-416b-ae3f-f160d136e619-telemeter-client-tls\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:56.087542 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:56.087353    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4fb7b0f-07e2-416b-ae3f-f160d136e619-telemeter-trusted-ca-bundle\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:56.087542 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:56.087377    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4fb7b0f-07e2-416b-ae3f-f160d136e619-metrics-client-ca\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:56.087542 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:56.087427    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4fb7b0f-07e2-416b-ae3f-f160d136e619-serving-certs-ca-bundle\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:56.088257 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:56.088213    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b4fb7b0f-07e2-416b-ae3f-f160d136e619-metrics-client-ca\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:56.088257 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:56.088248    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4fb7b0f-07e2-416b-ae3f-f160d136e619-telemeter-trusted-ca-bundle\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:56.088468 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:56.088398    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b4fb7b0f-07e2-416b-ae3f-f160d136e619-serving-certs-ca-bundle\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:56.089979 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:56.089955    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b4fb7b0f-07e2-416b-ae3f-f160d136e619-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:56.090161 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:56.090143    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/b4fb7b0f-07e2-416b-ae3f-f160d136e619-telemeter-client-tls\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:56.090494 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:56.090472    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/b4fb7b0f-07e2-416b-ae3f-f160d136e619-secret-telemeter-client\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:56.090553 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:56.090488    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/b4fb7b0f-07e2-416b-ae3f-f160d136e619-federate-client-tls\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:56.096168 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:56.096146    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhxs4\" (UniqueName: \"kubernetes.io/projected/b4fb7b0f-07e2-416b-ae3f-f160d136e619-kube-api-access-zhxs4\") pod \"telemeter-client-db5d75cc7-wvx9s\" (UID: \"b4fb7b0f-07e2-416b-ae3f-f160d136e619\") " pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:56.136203 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:56.136171    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"
Jul 28 10:10:56.275279 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:56.275256    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-db5d75cc7-wvx9s"]
Jul 28 10:10:56.277487 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:10:56.277463    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4fb7b0f_07e2_416b_ae3f_f160d136e619.slice/crio-9503ea60ed6460b0f10669ba25b0e80395e60c8e8995ac3532c460de4c193fa9 WatchSource:0}: Error finding container 9503ea60ed6460b0f10669ba25b0e80395e60c8e8995ac3532c460de4c193fa9: Status 404 returned error can't find the container with id 9503ea60ed6460b0f10669ba25b0e80395e60c8e8995ac3532c460de4c193fa9
Jul 28 10:10:56.858638 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:56.858603    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s" event={"ID":"b4fb7b0f-07e2-416b-ae3f-f160d136e619","Type":"ContainerStarted","Data":"9503ea60ed6460b0f10669ba25b0e80395e60c8e8995ac3532c460de4c193fa9"}
Jul 28 10:10:58.868874 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:58.868826    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s" event={"ID":"b4fb7b0f-07e2-416b-ae3f-f160d136e619","Type":"ContainerStarted","Data":"2a98621d2506364a67c89de96a64f5467aa399fd4b8ec59e51b4359b2528def6"}
Jul 28 10:10:58.869259 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:58.868894    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s" event={"ID":"b4fb7b0f-07e2-416b-ae3f-f160d136e619","Type":"ContainerStarted","Data":"f79729f668f9f9f254b754097b781e8ff944b2f77ca6ec251973aafb73ab3a73"}
Jul 28 10:10:58.869259 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:58.868914    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s" event={"ID":"b4fb7b0f-07e2-416b-ae3f-f160d136e619","Type":"ContainerStarted","Data":"76b63941a236b59ed084b9803e70b83945fd9a30c8ff835170c0d5b5b8b02ba4"}
Jul 28 10:10:58.896834 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:58.896780    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-db5d75cc7-wvx9s" podStartSLOduration=2.335484755 podStartE2EDuration="3.896763697s" totalImagesPullingTime="1.561278942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:10:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:10:58.894974517 +0000 UTC m=+192.297212915" watchObservedRunningTime="2026-07-28 10:10:58.896763697 +0000 UTC m=+192.299002094"
Jul 28 10:10:59.855944 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:59.855905    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d6c8f89c5-26tf5"]
Jul 28 10:10:59.858146 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:59.858123    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:10:59.860523 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:59.860497    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 28 10:10:59.860523 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:59.860497    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 28 10:10:59.861363 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:59.861346    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-m9p49\""
Jul 28 10:10:59.861643 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:59.861627    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 28 10:10:59.861713 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:59.861632    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 28 10:10:59.863182 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:59.863164    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 28 10:10:59.867485 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:59.867466    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 28 10:10:59.872422 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:10:59.872403    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d6c8f89c5-26tf5"]
Jul 28 10:11:00.023213 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.023177    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43931b13-5b61-4227-9d93-27bd37cc2a30-console-serving-cert\") pod \"console-d6c8f89c5-26tf5\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") " pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:00.023409 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.023242    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43931b13-5b61-4227-9d93-27bd37cc2a30-console-oauth-config\") pod \"console-d6c8f89c5-26tf5\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") " pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:00.023409 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.023270    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-trusted-ca-bundle\") pod \"console-d6c8f89c5-26tf5\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") " pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:00.023409 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.023345    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5d2t\" (UniqueName: \"kubernetes.io/projected/43931b13-5b61-4227-9d93-27bd37cc2a30-kube-api-access-r5d2t\") pod \"console-d6c8f89c5-26tf5\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") " pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:00.023685 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.023656    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-console-config\") pod \"console-d6c8f89c5-26tf5\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") " pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:00.023753 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.023717    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-oauth-serving-cert\") pod \"console-d6c8f89c5-26tf5\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") " pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:00.023810 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.023757    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-service-ca\") pod \"console-d6c8f89c5-26tf5\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") " pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:00.124225 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.124152    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5d2t\" (UniqueName: \"kubernetes.io/projected/43931b13-5b61-4227-9d93-27bd37cc2a30-kube-api-access-r5d2t\") pod \"console-d6c8f89c5-26tf5\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") " pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:00.124225 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.124203    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-console-config\") pod \"console-d6c8f89c5-26tf5\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") " pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:00.124429 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.124228    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-oauth-serving-cert\") pod \"console-d6c8f89c5-26tf5\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") " pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:00.124429 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.124257    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-service-ca\") pod \"console-d6c8f89c5-26tf5\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") " pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:00.124429 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.124296    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43931b13-5b61-4227-9d93-27bd37cc2a30-console-serving-cert\") pod \"console-d6c8f89c5-26tf5\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") " pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:00.124429 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.124325    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43931b13-5b61-4227-9d93-27bd37cc2a30-console-oauth-config\") pod \"console-d6c8f89c5-26tf5\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") " pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:00.124429 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.124350    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-trusted-ca-bundle\") pod \"console-d6c8f89c5-26tf5\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") " pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:00.125017 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.124989    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-console-config\") pod \"console-d6c8f89c5-26tf5\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") " pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:00.125119 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.125023    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-oauth-serving-cert\") pod \"console-d6c8f89c5-26tf5\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") " pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:00.125119 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.125044    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-service-ca\") pod \"console-d6c8f89c5-26tf5\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") " pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:00.125436 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.125417    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-trusted-ca-bundle\") pod \"console-d6c8f89c5-26tf5\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") " pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:00.126885 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.126865    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43931b13-5b61-4227-9d93-27bd37cc2a30-console-serving-cert\") pod \"console-d6c8f89c5-26tf5\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") " pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:00.126958 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.126905    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43931b13-5b61-4227-9d93-27bd37cc2a30-console-oauth-config\") pod \"console-d6c8f89c5-26tf5\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") " pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:00.133399 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.133379    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5d2t\" (UniqueName: \"kubernetes.io/projected/43931b13-5b61-4227-9d93-27bd37cc2a30-kube-api-access-r5d2t\") pod \"console-d6c8f89c5-26tf5\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") " pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:00.167951 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.167922    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:00.295779 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.295628    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d6c8f89c5-26tf5"]
Jul 28 10:11:00.298391 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:11:00.298365    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43931b13_5b61_4227_9d93_27bd37cc2a30.slice/crio-ae0a34bba43b1dc2dce2856c8f2d117d5394b63aa7f833d60047005bfd2c3115 WatchSource:0}: Error finding container ae0a34bba43b1dc2dce2856c8f2d117d5394b63aa7f833d60047005bfd2c3115: Status 404 returned error can't find the container with id ae0a34bba43b1dc2dce2856c8f2d117d5394b63aa7f833d60047005bfd2c3115
Jul 28 10:11:00.877785 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.877753    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6c8f89c5-26tf5" event={"ID":"43931b13-5b61-4227-9d93-27bd37cc2a30","Type":"ContainerStarted","Data":"b632db1460a9da938b0e53931d8cf5c9d80605744bb48f143f35e5fcf3b49c69"}
Jul 28 10:11:00.878250 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.877814    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6c8f89c5-26tf5" event={"ID":"43931b13-5b61-4227-9d93-27bd37cc2a30","Type":"ContainerStarted","Data":"ae0a34bba43b1dc2dce2856c8f2d117d5394b63aa7f833d60047005bfd2c3115"}
Jul 28 10:11:00.901987 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:00.901938    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d6c8f89c5-26tf5" podStartSLOduration=1.9019204539999999 podStartE2EDuration="1.901920454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:10:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:11:00.901273778 +0000 UTC m=+194.303512188" watchObservedRunningTime="2026-07-28 10:11:00.901920454 +0000 UTC m=+194.304158924"
Jul 28 10:11:10.168802 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:10.168769    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:10.169257 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:10.168823    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:10.173543 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:10.173518    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:11:10.924091 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:11:10.924061    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:12:19.545113 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.545038    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65bbb7cdd7-q75m4"]
Jul 28 10:12:19.548200 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.548184    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.561487 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.561461    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65bbb7cdd7-q75m4"]
Jul 28 10:12:19.580429 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.580399    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-console-serving-cert\") pod \"console-65bbb7cdd7-q75m4\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") " pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.580572 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.580443    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-console-oauth-config\") pod \"console-65bbb7cdd7-q75m4\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") " pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.580572 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.580507    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-console-config\") pod \"console-65bbb7cdd7-q75m4\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") " pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.580572 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.580537    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmn25\" (UniqueName: \"kubernetes.io/projected/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-kube-api-access-dmn25\") pod \"console-65bbb7cdd7-q75m4\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") " pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.580572 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.580561    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-trusted-ca-bundle\") pod \"console-65bbb7cdd7-q75m4\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") " pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.580748 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.580586    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-service-ca\") pod \"console-65bbb7cdd7-q75m4\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") " pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.580748 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.580608    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-oauth-serving-cert\") pod \"console-65bbb7cdd7-q75m4\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") " pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.681917 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.681886    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-console-oauth-config\") pod \"console-65bbb7cdd7-q75m4\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") " pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.682089 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.681933    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-console-config\") pod \"console-65bbb7cdd7-q75m4\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") " pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.682089 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.681954    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmn25\" (UniqueName: \"kubernetes.io/projected/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-kube-api-access-dmn25\") pod \"console-65bbb7cdd7-q75m4\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") " pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.682089 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.682011    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-trusted-ca-bundle\") pod \"console-65bbb7cdd7-q75m4\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") " pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.682089 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.682047    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-service-ca\") pod \"console-65bbb7cdd7-q75m4\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") " pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.682089 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.682064    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-oauth-serving-cert\") pod \"console-65bbb7cdd7-q75m4\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") " pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.682371 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.682230    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-console-serving-cert\") pod \"console-65bbb7cdd7-q75m4\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") " pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.682688 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.682654    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-oauth-serving-cert\") pod \"console-65bbb7cdd7-q75m4\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") " pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.682819 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.682700    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-console-config\") pod \"console-65bbb7cdd7-q75m4\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") " pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.682931 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.682821    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-service-ca\") pod \"console-65bbb7cdd7-q75m4\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") " pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.682988 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.682930    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-trusted-ca-bundle\") pod \"console-65bbb7cdd7-q75m4\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") " pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.684601 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.684581    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-console-oauth-config\") pod \"console-65bbb7cdd7-q75m4\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") " pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.684770 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.684753    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-console-serving-cert\") pod \"console-65bbb7cdd7-q75m4\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") " pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.691090 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.691059    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmn25\" (UniqueName: \"kubernetes.io/projected/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-kube-api-access-dmn25\") pod \"console-65bbb7cdd7-q75m4\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") " pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.856898 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.856798    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:19.991084 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:19.991050    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65bbb7cdd7-q75m4"]
Jul 28 10:12:19.993991 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:12:19.993953    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29f21a62_e8fc_4df7_8898_66ff0f2b3ced.slice/crio-39cab01e796ea870cfd82631e89795703ae2dcd869c9012ac1d8f872372b4348 WatchSource:0}: Error finding container 39cab01e796ea870cfd82631e89795703ae2dcd869c9012ac1d8f872372b4348: Status 404 returned error can't find the container with id 39cab01e796ea870cfd82631e89795703ae2dcd869c9012ac1d8f872372b4348
Jul 28 10:12:20.185471 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:20.185381    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65bbb7cdd7-q75m4" event={"ID":"29f21a62-e8fc-4df7-8898-66ff0f2b3ced","Type":"ContainerStarted","Data":"1e479999ff20c5ac1b45ce504c9ad87107e5ddde285d90779e545550983dd92b"}
Jul 28 10:12:20.185471 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:20.185456    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65bbb7cdd7-q75m4" event={"ID":"29f21a62-e8fc-4df7-8898-66ff0f2b3ced","Type":"ContainerStarted","Data":"39cab01e796ea870cfd82631e89795703ae2dcd869c9012ac1d8f872372b4348"}
Jul 28 10:12:20.203437 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:20.203391    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65bbb7cdd7-q75m4" podStartSLOduration=1.203377533 podStartE2EDuration="1.203377533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:12:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:12:20.20236967 +0000 UTC m=+273.604608069" watchObservedRunningTime="2026-07-28 10:12:20.203377533 +0000 UTC m=+273.605615930"
Jul 28 10:12:29.857576 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:29.857539    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:29.858015 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:29.857702    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:29.862311 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:29.862288    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:30.228061 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:30.228022    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:12:30.276938 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:30.276908    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d6c8f89c5-26tf5"]
Jul 28 10:12:46.908318 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:46.908285    2577 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 10:12:55.302152 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.302083    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-d6c8f89c5-26tf5" podUID="43931b13-5b61-4227-9d93-27bd37cc2a30" containerName="console" containerID="cri-o://b632db1460a9da938b0e53931d8cf5c9d80605744bb48f143f35e5fcf3b49c69" gracePeriod=15
Jul 28 10:12:55.542547 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.542521    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:12:55.679474 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.679377    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-service-ca\") pod \"43931b13-5b61-4227-9d93-27bd37cc2a30\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") "
Jul 28 10:12:55.679474 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.679425    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43931b13-5b61-4227-9d93-27bd37cc2a30-console-serving-cert\") pod \"43931b13-5b61-4227-9d93-27bd37cc2a30\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") "
Jul 28 10:12:55.679474 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.679459    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-oauth-serving-cert\") pod \"43931b13-5b61-4227-9d93-27bd37cc2a30\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") "
Jul 28 10:12:55.679742 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.679484    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43931b13-5b61-4227-9d93-27bd37cc2a30-console-oauth-config\") pod \"43931b13-5b61-4227-9d93-27bd37cc2a30\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") "
Jul 28 10:12:55.679742 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.679547    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5d2t\" (UniqueName: \"kubernetes.io/projected/43931b13-5b61-4227-9d93-27bd37cc2a30-kube-api-access-r5d2t\") pod \"43931b13-5b61-4227-9d93-27bd37cc2a30\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") "
Jul 28 10:12:55.679742 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.679593    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-console-config\") pod \"43931b13-5b61-4227-9d93-27bd37cc2a30\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") "
Jul 28 10:12:55.679742 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.679620    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-trusted-ca-bundle\") pod \"43931b13-5b61-4227-9d93-27bd37cc2a30\" (UID: \"43931b13-5b61-4227-9d93-27bd37cc2a30\") "
Jul 28 10:12:55.679964 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.679916    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-service-ca" (OuterVolumeSpecName: "service-ca") pod "43931b13-5b61-4227-9d93-27bd37cc2a30" (UID: "43931b13-5b61-4227-9d93-27bd37cc2a30"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:12:55.680125 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.680082    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-console-config" (OuterVolumeSpecName: "console-config") pod "43931b13-5b61-4227-9d93-27bd37cc2a30" (UID: "43931b13-5b61-4227-9d93-27bd37cc2a30"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:12:55.680125 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.680097    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "43931b13-5b61-4227-9d93-27bd37cc2a30" (UID: "43931b13-5b61-4227-9d93-27bd37cc2a30"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:12:55.680251 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.680158    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "43931b13-5b61-4227-9d93-27bd37cc2a30" (UID: "43931b13-5b61-4227-9d93-27bd37cc2a30"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:12:55.681808 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.681784    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43931b13-5b61-4227-9d93-27bd37cc2a30-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "43931b13-5b61-4227-9d93-27bd37cc2a30" (UID: "43931b13-5b61-4227-9d93-27bd37cc2a30"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:12:55.682251 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.682229    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43931b13-5b61-4227-9d93-27bd37cc2a30-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "43931b13-5b61-4227-9d93-27bd37cc2a30" (UID: "43931b13-5b61-4227-9d93-27bd37cc2a30"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:12:55.682299 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.682246    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43931b13-5b61-4227-9d93-27bd37cc2a30-kube-api-access-r5d2t" (OuterVolumeSpecName: "kube-api-access-r5d2t") pod "43931b13-5b61-4227-9d93-27bd37cc2a30" (UID: "43931b13-5b61-4227-9d93-27bd37cc2a30"). InnerVolumeSpecName "kube-api-access-r5d2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 10:12:55.780367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.780326    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5d2t\" (UniqueName: \"kubernetes.io/projected/43931b13-5b61-4227-9d93-27bd37cc2a30-kube-api-access-r5d2t\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:12:55.780367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.780363    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-console-config\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:12:55.780367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.780376    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-trusted-ca-bundle\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:12:55.780593 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.780387    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-service-ca\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:12:55.780593 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.780399    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/43931b13-5b61-4227-9d93-27bd37cc2a30-console-serving-cert\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:12:55.780593 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.780410    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/43931b13-5b61-4227-9d93-27bd37cc2a30-oauth-serving-cert\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:12:55.780593 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:55.780420    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/43931b13-5b61-4227-9d93-27bd37cc2a30-console-oauth-config\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:12:56.323803 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:56.323767    2577 generic.go:356] "Generic (PLEG): container finished" podID="43931b13-5b61-4227-9d93-27bd37cc2a30" containerID="b632db1460a9da938b0e53931d8cf5c9d80605744bb48f143f35e5fcf3b49c69" exitCode=0
Jul 28 10:12:56.323803 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:56.323806    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d6c8f89c5-26tf5"
Jul 28 10:12:56.324326 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:56.323882    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6c8f89c5-26tf5" event={"ID":"43931b13-5b61-4227-9d93-27bd37cc2a30","Type":"ContainerDied","Data":"b632db1460a9da938b0e53931d8cf5c9d80605744bb48f143f35e5fcf3b49c69"}
Jul 28 10:12:56.324326 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:56.323928    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d6c8f89c5-26tf5" event={"ID":"43931b13-5b61-4227-9d93-27bd37cc2a30","Type":"ContainerDied","Data":"ae0a34bba43b1dc2dce2856c8f2d117d5394b63aa7f833d60047005bfd2c3115"}
Jul 28 10:12:56.324326 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:56.323948    2577 scope.go:117] "RemoveContainer" containerID="b632db1460a9da938b0e53931d8cf5c9d80605744bb48f143f35e5fcf3b49c69"
Jul 28 10:12:56.332902 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:56.332887    2577 scope.go:117] "RemoveContainer" containerID="b632db1460a9da938b0e53931d8cf5c9d80605744bb48f143f35e5fcf3b49c69"
Jul 28 10:12:56.333147 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:12:56.333128    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b632db1460a9da938b0e53931d8cf5c9d80605744bb48f143f35e5fcf3b49c69\": container with ID starting with b632db1460a9da938b0e53931d8cf5c9d80605744bb48f143f35e5fcf3b49c69 not found: ID does not exist" containerID="b632db1460a9da938b0e53931d8cf5c9d80605744bb48f143f35e5fcf3b49c69"
Jul 28 10:12:56.333188 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:56.333156    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b632db1460a9da938b0e53931d8cf5c9d80605744bb48f143f35e5fcf3b49c69"} err="failed to get container status \"b632db1460a9da938b0e53931d8cf5c9d80605744bb48f143f35e5fcf3b49c69\": rpc error: code = NotFound desc = could not find container \"b632db1460a9da938b0e53931d8cf5c9d80605744bb48f143f35e5fcf3b49c69\": container with ID starting with b632db1460a9da938b0e53931d8cf5c9d80605744bb48f143f35e5fcf3b49c69 not found: ID does not exist"
Jul 28 10:12:56.347604 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:56.347576    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-d6c8f89c5-26tf5"]
Jul 28 10:12:56.358723 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:56.358693    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-d6c8f89c5-26tf5"]
Jul 28 10:12:57.044293 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:12:57.044260    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43931b13-5b61-4227-9d93-27bd37cc2a30" path="/var/lib/kubelet/pods/43931b13-5b61-4227-9d93-27bd37cc2a30/volumes"
Jul 28 10:14:36.824362 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:36.824331    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx"]
Jul 28 10:14:36.824777 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:36.824648    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43931b13-5b61-4227-9d93-27bd37cc2a30" containerName="console"
Jul 28 10:14:36.824777 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:36.824658    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="43931b13-5b61-4227-9d93-27bd37cc2a30" containerName="console"
Jul 28 10:14:36.824777 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:36.824715    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="43931b13-5b61-4227-9d93-27bd37cc2a30" containerName="console"
Jul 28 10:14:36.827631 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:36.827616    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx"
Jul 28 10:14:36.830217 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:36.830194    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 28 10:14:36.830333 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:36.830195    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 28 10:14:36.830333 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:36.830262    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-djm9s\""
Jul 28 10:14:36.848784 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:36.848753    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx"]
Jul 28 10:14:36.891886 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:36.891855    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c3c67be-8a02-4d51-97f6-cfecc020faf4-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx\" (UID: \"0c3c67be-8a02-4d51-97f6-cfecc020faf4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx"
Jul 28 10:14:36.892025 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:36.891896    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c3c67be-8a02-4d51-97f6-cfecc020faf4-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx\" (UID: \"0c3c67be-8a02-4d51-97f6-cfecc020faf4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx"
Jul 28 10:14:36.892025 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:36.891954    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz552\" (UniqueName: \"kubernetes.io/projected/0c3c67be-8a02-4d51-97f6-cfecc020faf4-kube-api-access-jz552\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx\" (UID: \"0c3c67be-8a02-4d51-97f6-cfecc020faf4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx"
Jul 28 10:14:36.993212 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:36.993154    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz552\" (UniqueName: \"kubernetes.io/projected/0c3c67be-8a02-4d51-97f6-cfecc020faf4-kube-api-access-jz552\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx\" (UID: \"0c3c67be-8a02-4d51-97f6-cfecc020faf4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx"
Jul 28 10:14:36.993383 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:36.993236    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c3c67be-8a02-4d51-97f6-cfecc020faf4-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx\" (UID: \"0c3c67be-8a02-4d51-97f6-cfecc020faf4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx"
Jul 28 10:14:36.993383 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:36.993276    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c3c67be-8a02-4d51-97f6-cfecc020faf4-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx\" (UID: \"0c3c67be-8a02-4d51-97f6-cfecc020faf4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx"
Jul 28 10:14:36.993601 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:36.993582    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c3c67be-8a02-4d51-97f6-cfecc020faf4-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx\" (UID: \"0c3c67be-8a02-4d51-97f6-cfecc020faf4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx"
Jul 28 10:14:36.993696 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:36.993675    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c3c67be-8a02-4d51-97f6-cfecc020faf4-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx\" (UID: \"0c3c67be-8a02-4d51-97f6-cfecc020faf4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx"
Jul 28 10:14:37.002733 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:37.002709    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz552\" (UniqueName: \"kubernetes.io/projected/0c3c67be-8a02-4d51-97f6-cfecc020faf4-kube-api-access-jz552\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx\" (UID: \"0c3c67be-8a02-4d51-97f6-cfecc020faf4\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx"
Jul 28 10:14:37.136629 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:37.136549    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx"
Jul 28 10:14:37.268740 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:37.268688    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx"]
Jul 28 10:14:37.271171 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:14:37.271129    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c3c67be_8a02_4d51_97f6_cfecc020faf4.slice/crio-e334aeb25d607680eb812da2b5b83769b092c4ae7dad9ffc85d67dcf528bc98c WatchSource:0}: Error finding container e334aeb25d607680eb812da2b5b83769b092c4ae7dad9ffc85d67dcf528bc98c: Status 404 returned error can't find the container with id e334aeb25d607680eb812da2b5b83769b092c4ae7dad9ffc85d67dcf528bc98c
Jul 28 10:14:37.273433 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:37.273416    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 10:14:37.706395 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:37.706359    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx" event={"ID":"0c3c67be-8a02-4d51-97f6-cfecc020faf4","Type":"ContainerStarted","Data":"e334aeb25d607680eb812da2b5b83769b092c4ae7dad9ffc85d67dcf528bc98c"}
Jul 28 10:14:43.734277 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:43.734240    2577 generic.go:356] "Generic (PLEG): container finished" podID="0c3c67be-8a02-4d51-97f6-cfecc020faf4" containerID="fb022e84c2be6ba1af63aacccbc0f1b3ec68513873fdd2c70fc2cfeae567df39" exitCode=0
Jul 28 10:14:43.734641 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:43.734308    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx" event={"ID":"0c3c67be-8a02-4d51-97f6-cfecc020faf4","Type":"ContainerDied","Data":"fb022e84c2be6ba1af63aacccbc0f1b3ec68513873fdd2c70fc2cfeae567df39"}
Jul 28 10:14:45.745001 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:45.744964    2577 generic.go:356] "Generic (PLEG): container finished" podID="0c3c67be-8a02-4d51-97f6-cfecc020faf4" containerID="ee86bf64945061da6ce4e968595870a4252ae47638a2459de74770662a42f735" exitCode=0
Jul 28 10:14:45.745471 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:45.745028    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx" event={"ID":"0c3c67be-8a02-4d51-97f6-cfecc020faf4","Type":"ContainerDied","Data":"ee86bf64945061da6ce4e968595870a4252ae47638a2459de74770662a42f735"}
Jul 28 10:14:52.777007 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:52.776967    2577 generic.go:356] "Generic (PLEG): container finished" podID="0c3c67be-8a02-4d51-97f6-cfecc020faf4" containerID="e6d063b9246d2df52f4d791395d60b24c5d84c72b42b334e44577c8072d93660" exitCode=0
Jul 28 10:14:52.777397 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:52.777039    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx" event={"ID":"0c3c67be-8a02-4d51-97f6-cfecc020faf4","Type":"ContainerDied","Data":"e6d063b9246d2df52f4d791395d60b24c5d84c72b42b334e44577c8072d93660"}
Jul 28 10:14:53.914231 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:53.914206    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx"
Jul 28 10:14:54.050437 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:54.050350    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz552\" (UniqueName: \"kubernetes.io/projected/0c3c67be-8a02-4d51-97f6-cfecc020faf4-kube-api-access-jz552\") pod \"0c3c67be-8a02-4d51-97f6-cfecc020faf4\" (UID: \"0c3c67be-8a02-4d51-97f6-cfecc020faf4\") "
Jul 28 10:14:54.050581 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:54.050441    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c3c67be-8a02-4d51-97f6-cfecc020faf4-util\") pod \"0c3c67be-8a02-4d51-97f6-cfecc020faf4\" (UID: \"0c3c67be-8a02-4d51-97f6-cfecc020faf4\") "
Jul 28 10:14:54.050581 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:54.050481    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c3c67be-8a02-4d51-97f6-cfecc020faf4-bundle\") pod \"0c3c67be-8a02-4d51-97f6-cfecc020faf4\" (UID: \"0c3c67be-8a02-4d51-97f6-cfecc020faf4\") "
Jul 28 10:14:54.051216 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:54.051141    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c3c67be-8a02-4d51-97f6-cfecc020faf4-bundle" (OuterVolumeSpecName: "bundle") pod "0c3c67be-8a02-4d51-97f6-cfecc020faf4" (UID: "0c3c67be-8a02-4d51-97f6-cfecc020faf4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 10:14:54.052719 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:54.052697    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c3c67be-8a02-4d51-97f6-cfecc020faf4-kube-api-access-jz552" (OuterVolumeSpecName: "kube-api-access-jz552") pod "0c3c67be-8a02-4d51-97f6-cfecc020faf4" (UID: "0c3c67be-8a02-4d51-97f6-cfecc020faf4"). InnerVolumeSpecName "kube-api-access-jz552". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 10:14:54.054727 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:54.054703    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c3c67be-8a02-4d51-97f6-cfecc020faf4-util" (OuterVolumeSpecName: "util") pod "0c3c67be-8a02-4d51-97f6-cfecc020faf4" (UID: "0c3c67be-8a02-4d51-97f6-cfecc020faf4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 10:14:54.151323 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:54.151264    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz552\" (UniqueName: \"kubernetes.io/projected/0c3c67be-8a02-4d51-97f6-cfecc020faf4-kube-api-access-jz552\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:14:54.151323 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:54.151314    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0c3c67be-8a02-4d51-97f6-cfecc020faf4-util\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:14:54.151323 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:54.151327    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0c3c67be-8a02-4d51-97f6-cfecc020faf4-bundle\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:14:54.785540 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:54.785515    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx"
Jul 28 10:14:54.785683 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:54.785516    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5gzgwx" event={"ID":"0c3c67be-8a02-4d51-97f6-cfecc020faf4","Type":"ContainerDied","Data":"e334aeb25d607680eb812da2b5b83769b092c4ae7dad9ffc85d67dcf528bc98c"}
Jul 28 10:14:54.785683 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:54.785630    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e334aeb25d607680eb812da2b5b83769b092c4ae7dad9ffc85d67dcf528bc98c"
Jul 28 10:14:59.862405 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:59.862374    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-x74kb"]
Jul 28 10:14:59.863019 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:59.862794    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c3c67be-8a02-4d51-97f6-cfecc020faf4" containerName="pull"
Jul 28 10:14:59.863019 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:59.862810    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c3c67be-8a02-4d51-97f6-cfecc020faf4" containerName="pull"
Jul 28 10:14:59.863019 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:59.862824    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c3c67be-8a02-4d51-97f6-cfecc020faf4" containerName="extract"
Jul 28 10:14:59.863019 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:59.862831    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c3c67be-8a02-4d51-97f6-cfecc020faf4" containerName="extract"
Jul 28 10:14:59.863019 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:59.862864    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c3c67be-8a02-4d51-97f6-cfecc020faf4" containerName="util"
Jul 28 10:14:59.863019 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:59.862872    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c3c67be-8a02-4d51-97f6-cfecc020faf4" containerName="util"
Jul 28 10:14:59.863019 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:59.862968    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c3c67be-8a02-4d51-97f6-cfecc020faf4" containerName="extract"
Jul 28 10:14:59.902437 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:59.902401    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-x74kb"]
Jul 28 10:14:59.902579 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:59.902515    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-x74kb"
Jul 28 10:14:59.905025 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:59.904990    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-62tm6\""
Jul 28 10:14:59.905179 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:59.905126    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jul 28 10:14:59.905257 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:59.905183    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 28 10:14:59.905257 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:14:59.905187    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 28 10:15:00.002367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:00.002332    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z69ct\" (UniqueName: \"kubernetes.io/projected/d9a620c4-9c8b-4d93-abc2-367617f85609-kube-api-access-z69ct\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-x74kb\" (UID: \"d9a620c4-9c8b-4d93-abc2-367617f85609\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-x74kb"
Jul 28 10:15:00.002539 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:00.002401    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/d9a620c4-9c8b-4d93-abc2-367617f85609-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-x74kb\" (UID: \"d9a620c4-9c8b-4d93-abc2-367617f85609\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-x74kb"
Jul 28 10:15:00.103812 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:00.103775    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/d9a620c4-9c8b-4d93-abc2-367617f85609-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-x74kb\" (UID: \"d9a620c4-9c8b-4d93-abc2-367617f85609\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-x74kb"
Jul 28 10:15:00.103997 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:00.103859    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z69ct\" (UniqueName: \"kubernetes.io/projected/d9a620c4-9c8b-4d93-abc2-367617f85609-kube-api-access-z69ct\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-x74kb\" (UID: \"d9a620c4-9c8b-4d93-abc2-367617f85609\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-x74kb"
Jul 28 10:15:00.106379 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:00.106354    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/d9a620c4-9c8b-4d93-abc2-367617f85609-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-x74kb\" (UID: \"d9a620c4-9c8b-4d93-abc2-367617f85609\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-x74kb"
Jul 28 10:15:00.121461 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:00.121402    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z69ct\" (UniqueName: \"kubernetes.io/projected/d9a620c4-9c8b-4d93-abc2-367617f85609-kube-api-access-z69ct\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-x74kb\" (UID: \"d9a620c4-9c8b-4d93-abc2-367617f85609\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-x74kb"
Jul 28 10:15:00.212449 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:00.212408    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-x74kb"
Jul 28 10:15:00.370497 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:00.370467    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-x74kb"]
Jul 28 10:15:00.373895 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:15:00.373866    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9a620c4_9c8b_4d93_abc2_367617f85609.slice/crio-4db77a19830f3a5122173df4b1797b7aec858c7a3bbdc423212931aa2d3695be WatchSource:0}: Error finding container 4db77a19830f3a5122173df4b1797b7aec858c7a3bbdc423212931aa2d3695be: Status 404 returned error can't find the container with id 4db77a19830f3a5122173df4b1797b7aec858c7a3bbdc423212931aa2d3695be
Jul 28 10:15:00.809793 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:00.809757    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-x74kb" event={"ID":"d9a620c4-9c8b-4d93-abc2-367617f85609","Type":"ContainerStarted","Data":"4db77a19830f3a5122173df4b1797b7aec858c7a3bbdc423212931aa2d3695be"}
Jul 28 10:15:03.826983 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:03.826948    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-x74kb" event={"ID":"d9a620c4-9c8b-4d93-abc2-367617f85609","Type":"ContainerStarted","Data":"fd3a6eb76e8ab05ad7daf2e56aca28398348b5cbd24a54d5162d756cb87a5ace"}
Jul 28 10:15:03.827439 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:03.827152    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-x74kb"
Jul 28 10:15:03.848385 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:03.848324    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-x74kb" podStartSLOduration=1.773672719 podStartE2EDuration="4.848308461s" totalImagesPullingTime="3.074635742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:14:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:15:03.847413207 +0000 UTC m=+437.249651604" watchObservedRunningTime="2026-07-28 10:15:03.848308461 +0000 UTC m=+437.250546859"
Jul 28 10:15:04.282463 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.282425    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-5s8qd"]
Jul 28 10:15:04.301951 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.301925    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-5s8qd"]
Jul 28 10:15:04.302115 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.302016    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-5s8qd"
Jul 28 10:15:04.304226 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.304203    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Jul 28 10:15:04.304226 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.304203    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 28 10:15:04.304550 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.304527    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-j7v8q\""
Jul 28 10:15:04.441907 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.441822    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f3e25d80-aede-462e-b89b-40f1a71c97f4-certificates\") pod \"keda-operator-77f648d694-5s8qd\" (UID: \"f3e25d80-aede-462e-b89b-40f1a71c97f4\") " pod="openshift-keda/keda-operator-77f648d694-5s8qd"
Jul 28 10:15:04.442098 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.441961    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd4lv\" (UniqueName: \"kubernetes.io/projected/f3e25d80-aede-462e-b89b-40f1a71c97f4-kube-api-access-pd4lv\") pod \"keda-operator-77f648d694-5s8qd\" (UID: \"f3e25d80-aede-462e-b89b-40f1a71c97f4\") " pod="openshift-keda/keda-operator-77f648d694-5s8qd"
Jul 28 10:15:04.442098 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.442016    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/f3e25d80-aede-462e-b89b-40f1a71c97f4-cabundle0\") pod \"keda-operator-77f648d694-5s8qd\" (UID: \"f3e25d80-aede-462e-b89b-40f1a71c97f4\") " pod="openshift-keda/keda-operator-77f648d694-5s8qd"
Jul 28 10:15:04.543055 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.542967    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f3e25d80-aede-462e-b89b-40f1a71c97f4-certificates\") pod \"keda-operator-77f648d694-5s8qd\" (UID: \"f3e25d80-aede-462e-b89b-40f1a71c97f4\") " pod="openshift-keda/keda-operator-77f648d694-5s8qd"
Jul 28 10:15:04.543055 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.543016    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd4lv\" (UniqueName: \"kubernetes.io/projected/f3e25d80-aede-462e-b89b-40f1a71c97f4-kube-api-access-pd4lv\") pod \"keda-operator-77f648d694-5s8qd\" (UID: \"f3e25d80-aede-462e-b89b-40f1a71c97f4\") " pod="openshift-keda/keda-operator-77f648d694-5s8qd"
Jul 28 10:15:04.543283 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:15:04.543131    2577 secret.go:281] references non-existent secret key: ca.crt
Jul 28 10:15:04.543283 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.543137    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/f3e25d80-aede-462e-b89b-40f1a71c97f4-cabundle0\") pod \"keda-operator-77f648d694-5s8qd\" (UID: \"f3e25d80-aede-462e-b89b-40f1a71c97f4\") " pod="openshift-keda/keda-operator-77f648d694-5s8qd"
Jul 28 10:15:04.543283 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:15:04.543153    2577 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jul 28 10:15:04.543283 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:15:04.543164    2577 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-5s8qd: references non-existent secret key: ca.crt
Jul 28 10:15:04.543283 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:15:04.543220    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3e25d80-aede-462e-b89b-40f1a71c97f4-certificates podName:f3e25d80-aede-462e-b89b-40f1a71c97f4 nodeName:}" failed. No retries permitted until 2026-07-28 10:15:05.04320135 +0000 UTC m=+438.445439740 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/f3e25d80-aede-462e-b89b-40f1a71c97f4-certificates") pod "keda-operator-77f648d694-5s8qd" (UID: "f3e25d80-aede-462e-b89b-40f1a71c97f4") : references non-existent secret key: ca.crt
Jul 28 10:15:04.543736 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.543718    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/f3e25d80-aede-462e-b89b-40f1a71c97f4-cabundle0\") pod \"keda-operator-77f648d694-5s8qd\" (UID: \"f3e25d80-aede-462e-b89b-40f1a71c97f4\") " pod="openshift-keda/keda-operator-77f648d694-5s8qd"
Jul 28 10:15:04.553961 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.553939    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd4lv\" (UniqueName: \"kubernetes.io/projected/f3e25d80-aede-462e-b89b-40f1a71c97f4-kube-api-access-pd4lv\") pod \"keda-operator-77f648d694-5s8qd\" (UID: \"f3e25d80-aede-462e-b89b-40f1a71c97f4\") " pod="openshift-keda/keda-operator-77f648d694-5s8qd"
Jul 28 10:15:04.699211 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.699175    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-nc4vd"]
Jul 28 10:15:04.722293 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.722261    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-nc4vd"]
Jul 28 10:15:04.722452 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.722385    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-nc4vd"
Jul 28 10:15:04.724716 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.724695    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Jul 28 10:15:04.846291 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.846216    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d3db9c1e-ab96-4e7e-85c8-fcb209166833-certificates\") pod \"keda-metrics-apiserver-55557df8c-nc4vd\" (UID: \"d3db9c1e-ab96-4e7e-85c8-fcb209166833\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-nc4vd"
Jul 28 10:15:04.846291 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.846283    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/d3db9c1e-ab96-4e7e-85c8-fcb209166833-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-nc4vd\" (UID: \"d3db9c1e-ab96-4e7e-85c8-fcb209166833\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-nc4vd"
Jul 28 10:15:04.846680 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.846358    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n75fk\" (UniqueName: \"kubernetes.io/projected/d3db9c1e-ab96-4e7e-85c8-fcb209166833-kube-api-access-n75fk\") pod \"keda-metrics-apiserver-55557df8c-nc4vd\" (UID: \"d3db9c1e-ab96-4e7e-85c8-fcb209166833\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-nc4vd"
Jul 28 10:15:04.873317 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.873287    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-9jzql"]
Jul 28 10:15:04.895398 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.895361    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-9jzql"]
Jul 28 10:15:04.895549 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.895483    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-9jzql"
Jul 28 10:15:04.897699 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.897681    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Jul 28 10:15:04.947682 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.947650    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d3db9c1e-ab96-4e7e-85c8-fcb209166833-certificates\") pod \"keda-metrics-apiserver-55557df8c-nc4vd\" (UID: \"d3db9c1e-ab96-4e7e-85c8-fcb209166833\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-nc4vd"
Jul 28 10:15:04.947863 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.947742    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/d3db9c1e-ab96-4e7e-85c8-fcb209166833-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-nc4vd\" (UID: \"d3db9c1e-ab96-4e7e-85c8-fcb209166833\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-nc4vd"
Jul 28 10:15:04.947863 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.947768    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n75fk\" (UniqueName: \"kubernetes.io/projected/d3db9c1e-ab96-4e7e-85c8-fcb209166833-kube-api-access-n75fk\") pod \"keda-metrics-apiserver-55557df8c-nc4vd\" (UID: \"d3db9c1e-ab96-4e7e-85c8-fcb209166833\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-nc4vd"
Jul 28 10:15:04.948226 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.948208    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/d3db9c1e-ab96-4e7e-85c8-fcb209166833-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-nc4vd\" (UID: \"d3db9c1e-ab96-4e7e-85c8-fcb209166833\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-nc4vd"
Jul 28 10:15:04.950514 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.950496    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/d3db9c1e-ab96-4e7e-85c8-fcb209166833-certificates\") pod \"keda-metrics-apiserver-55557df8c-nc4vd\" (UID: \"d3db9c1e-ab96-4e7e-85c8-fcb209166833\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-nc4vd"
Jul 28 10:15:04.957456 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:04.957437    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n75fk\" (UniqueName: \"kubernetes.io/projected/d3db9c1e-ab96-4e7e-85c8-fcb209166833-kube-api-access-n75fk\") pod \"keda-metrics-apiserver-55557df8c-nc4vd\" (UID: \"d3db9c1e-ab96-4e7e-85c8-fcb209166833\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-nc4vd"
Jul 28 10:15:05.034411 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:05.034376    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-nc4vd"
Jul 28 10:15:05.048659 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:05.048635    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnnlh\" (UniqueName: \"kubernetes.io/projected/ecccb9c4-eb01-422a-b3cf-2d79953038f7-kube-api-access-cnnlh\") pod \"keda-admission-56f9798bb4-9jzql\" (UID: \"ecccb9c4-eb01-422a-b3cf-2d79953038f7\") " pod="openshift-keda/keda-admission-56f9798bb4-9jzql"
Jul 28 10:15:05.048822 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:05.048693    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ecccb9c4-eb01-422a-b3cf-2d79953038f7-certificates\") pod \"keda-admission-56f9798bb4-9jzql\" (UID: \"ecccb9c4-eb01-422a-b3cf-2d79953038f7\") " pod="openshift-keda/keda-admission-56f9798bb4-9jzql"
Jul 28 10:15:05.048822 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:05.048733    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f3e25d80-aede-462e-b89b-40f1a71c97f4-certificates\") pod \"keda-operator-77f648d694-5s8qd\" (UID: \"f3e25d80-aede-462e-b89b-40f1a71c97f4\") " pod="openshift-keda/keda-operator-77f648d694-5s8qd"
Jul 28 10:15:05.051321 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:05.051294    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f3e25d80-aede-462e-b89b-40f1a71c97f4-certificates\") pod \"keda-operator-77f648d694-5s8qd\" (UID: \"f3e25d80-aede-462e-b89b-40f1a71c97f4\") " pod="openshift-keda/keda-operator-77f648d694-5s8qd"
Jul 28 10:15:05.149210 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:05.149178    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ecccb9c4-eb01-422a-b3cf-2d79953038f7-certificates\") pod \"keda-admission-56f9798bb4-9jzql\" (UID: \"ecccb9c4-eb01-422a-b3cf-2d79953038f7\") " pod="openshift-keda/keda-admission-56f9798bb4-9jzql"
Jul 28 10:15:05.149386 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:05.149301    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnnlh\" (UniqueName: \"kubernetes.io/projected/ecccb9c4-eb01-422a-b3cf-2d79953038f7-kube-api-access-cnnlh\") pod \"keda-admission-56f9798bb4-9jzql\" (UID: \"ecccb9c4-eb01-422a-b3cf-2d79953038f7\") " pod="openshift-keda/keda-admission-56f9798bb4-9jzql"
Jul 28 10:15:05.152503 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:05.152478    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/ecccb9c4-eb01-422a-b3cf-2d79953038f7-certificates\") pod \"keda-admission-56f9798bb4-9jzql\" (UID: \"ecccb9c4-eb01-422a-b3cf-2d79953038f7\") " pod="openshift-keda/keda-admission-56f9798bb4-9jzql"
Jul 28 10:15:05.158410 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:05.158378    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnnlh\" (UniqueName: \"kubernetes.io/projected/ecccb9c4-eb01-422a-b3cf-2d79953038f7-kube-api-access-cnnlh\") pod \"keda-admission-56f9798bb4-9jzql\" (UID: \"ecccb9c4-eb01-422a-b3cf-2d79953038f7\") " pod="openshift-keda/keda-admission-56f9798bb4-9jzql"
Jul 28 10:15:05.198549 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:05.198526    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-nc4vd"]
Jul 28 10:15:05.201899 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:15:05.201871    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3db9c1e_ab96_4e7e_85c8_fcb209166833.slice/crio-f14deb5bd65905e410bea8e47366f86ee49221b0f05d5f16f51bbba5a340bdba WatchSource:0}: Error finding container f14deb5bd65905e410bea8e47366f86ee49221b0f05d5f16f51bbba5a340bdba: Status 404 returned error can't find the container with id f14deb5bd65905e410bea8e47366f86ee49221b0f05d5f16f51bbba5a340bdba
Jul 28 10:15:05.205786 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:05.205758    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-9jzql"
Jul 28 10:15:05.211940 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:05.211918    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-5s8qd"
Jul 28 10:15:05.366911 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:05.366890    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-9jzql"]
Jul 28 10:15:05.369329 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:15:05.369304    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecccb9c4_eb01_422a_b3cf_2d79953038f7.slice/crio-c82e2eea0253b4aa288f99c52d1f6190e195175a3e9c168519ec4b2bc7b9c5ff WatchSource:0}: Error finding container c82e2eea0253b4aa288f99c52d1f6190e195175a3e9c168519ec4b2bc7b9c5ff: Status 404 returned error can't find the container with id c82e2eea0253b4aa288f99c52d1f6190e195175a3e9c168519ec4b2bc7b9c5ff
Jul 28 10:15:05.383221 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:05.383197    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-5s8qd"]
Jul 28 10:15:05.385505 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:15:05.385483    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3e25d80_aede_462e_b89b_40f1a71c97f4.slice/crio-57795eb7db9c1073fb8f317d05fc747bb449b70aa8103fd06c844319099a24c5 WatchSource:0}: Error finding container 57795eb7db9c1073fb8f317d05fc747bb449b70aa8103fd06c844319099a24c5: Status 404 returned error can't find the container with id 57795eb7db9c1073fb8f317d05fc747bb449b70aa8103fd06c844319099a24c5
Jul 28 10:15:05.836814 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:05.836783    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-nc4vd" event={"ID":"d3db9c1e-ab96-4e7e-85c8-fcb209166833","Type":"ContainerStarted","Data":"f14deb5bd65905e410bea8e47366f86ee49221b0f05d5f16f51bbba5a340bdba"}
Jul 28 10:15:05.838100 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:05.838075    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-5s8qd" event={"ID":"f3e25d80-aede-462e-b89b-40f1a71c97f4","Type":"ContainerStarted","Data":"57795eb7db9c1073fb8f317d05fc747bb449b70aa8103fd06c844319099a24c5"}
Jul 28 10:15:05.839129 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:05.839105    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-9jzql" event={"ID":"ecccb9c4-eb01-422a-b3cf-2d79953038f7","Type":"ContainerStarted","Data":"c82e2eea0253b4aa288f99c52d1f6190e195175a3e9c168519ec4b2bc7b9c5ff"}
Jul 28 10:15:07.851946 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:07.851860    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-9jzql" event={"ID":"ecccb9c4-eb01-422a-b3cf-2d79953038f7","Type":"ContainerStarted","Data":"118a96cff0ca8223522c29a22310b3e8b13efa4c31007c75674f0064996bb2bd"}
Jul 28 10:15:07.852444 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:07.851996    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-9jzql"
Jul 28 10:15:07.870959 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:07.870898    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-9jzql" podStartSLOduration=2.447050361 podStartE2EDuration="3.870880637s" totalImagesPullingTime="1.423830276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:15:07.869077704 +0000 UTC m=+441.271316104" watchObservedRunningTime="2026-07-28 10:15:07.870880637 +0000 UTC m=+441.273119036"
Jul 28 10:15:09.864681 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:09.864640    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-nc4vd" event={"ID":"d3db9c1e-ab96-4e7e-85c8-fcb209166833","Type":"ContainerStarted","Data":"425e599dfc1d88e0ac44478b2542712927d7c082d6b8bb05fac84e8c81ab71d4"}
Jul 28 10:15:09.865158 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:09.864727    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-nc4vd"
Jul 28 10:15:09.866222 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:09.866197    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-5s8qd" event={"ID":"f3e25d80-aede-462e-b89b-40f1a71c97f4","Type":"ContainerStarted","Data":"7d64fa3ca09f91f7f46a4e1e76603e2933519f273bb32324ef586036c77fab1f"}
Jul 28 10:15:09.866334 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:09.866275    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-5s8qd"
Jul 28 10:15:09.883661 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:09.883594    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-nc4vd" podStartSLOduration=1.879261324 podStartE2EDuration="5.883575076s" totalImagesPullingTime="4.004313752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:15:09.882574362 +0000 UTC m=+443.284812782" watchObservedRunningTime="2026-07-28 10:15:09.883575076 +0000 UTC m=+443.285813475"
Jul 28 10:15:09.902961 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:09.902911    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-5s8qd" podStartSLOduration=2.077275234 podStartE2EDuration="5.902896145s" totalImagesPullingTime="3.825620911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:15:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:15:09.902064935 +0000 UTC m=+443.304303334" watchObservedRunningTime="2026-07-28 10:15:09.902896145 +0000 UTC m=+443.305134543"
Jul 28 10:15:20.875286 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:20.875259    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-nc4vd"
Jul 28 10:15:24.835142 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:24.835112    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-x74kb"
Jul 28 10:15:28.861331 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:28.861300    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-9jzql"
Jul 28 10:15:30.873798 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:15:30.873769    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-5s8qd"
Jul 28 10:16:02.940919 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:02.940889    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b9b789b64-tjkt8"]
Jul 28 10:16:02.944682 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:02.944662    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:02.958550 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:02.958507    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b9b789b64-tjkt8"]
Jul 28 10:16:03.034013 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.033983    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxtb4\" (UniqueName: \"kubernetes.io/projected/d4ecab8b-5d77-4348-bda7-166cd4faf701-kube-api-access-kxtb4\") pod \"console-5b9b789b64-tjkt8\" (UID: \"d4ecab8b-5d77-4348-bda7-166cd4faf701\") " pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:03.034194 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.034021    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ecab8b-5d77-4348-bda7-166cd4faf701-trusted-ca-bundle\") pod \"console-5b9b789b64-tjkt8\" (UID: \"d4ecab8b-5d77-4348-bda7-166cd4faf701\") " pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:03.034194 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.034045    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ecab8b-5d77-4348-bda7-166cd4faf701-service-ca\") pod \"console-5b9b789b64-tjkt8\" (UID: \"d4ecab8b-5d77-4348-bda7-166cd4faf701\") " pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:03.034194 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.034094    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ecab8b-5d77-4348-bda7-166cd4faf701-oauth-serving-cert\") pod \"console-5b9b789b64-tjkt8\" (UID: \"d4ecab8b-5d77-4348-bda7-166cd4faf701\") " pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:03.034194 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.034117    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ecab8b-5d77-4348-bda7-166cd4faf701-console-oauth-config\") pod \"console-5b9b789b64-tjkt8\" (UID: \"d4ecab8b-5d77-4348-bda7-166cd4faf701\") " pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:03.034330 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.034206    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ecab8b-5d77-4348-bda7-166cd4faf701-console-serving-cert\") pod \"console-5b9b789b64-tjkt8\" (UID: \"d4ecab8b-5d77-4348-bda7-166cd4faf701\") " pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:03.034330 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.034321    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ecab8b-5d77-4348-bda7-166cd4faf701-console-config\") pod \"console-5b9b789b64-tjkt8\" (UID: \"d4ecab8b-5d77-4348-bda7-166cd4faf701\") " pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:03.135277 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.135242    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ecab8b-5d77-4348-bda7-166cd4faf701-console-config\") pod \"console-5b9b789b64-tjkt8\" (UID: \"d4ecab8b-5d77-4348-bda7-166cd4faf701\") " pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:03.135482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.135300    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxtb4\" (UniqueName: \"kubernetes.io/projected/d4ecab8b-5d77-4348-bda7-166cd4faf701-kube-api-access-kxtb4\") pod \"console-5b9b789b64-tjkt8\" (UID: \"d4ecab8b-5d77-4348-bda7-166cd4faf701\") " pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:03.135482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.135334    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ecab8b-5d77-4348-bda7-166cd4faf701-trusted-ca-bundle\") pod \"console-5b9b789b64-tjkt8\" (UID: \"d4ecab8b-5d77-4348-bda7-166cd4faf701\") " pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:03.135482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.135360    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ecab8b-5d77-4348-bda7-166cd4faf701-service-ca\") pod \"console-5b9b789b64-tjkt8\" (UID: \"d4ecab8b-5d77-4348-bda7-166cd4faf701\") " pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:03.135482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.135399    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ecab8b-5d77-4348-bda7-166cd4faf701-oauth-serving-cert\") pod \"console-5b9b789b64-tjkt8\" (UID: \"d4ecab8b-5d77-4348-bda7-166cd4faf701\") " pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:03.135482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.135429    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ecab8b-5d77-4348-bda7-166cd4faf701-console-oauth-config\") pod \"console-5b9b789b64-tjkt8\" (UID: \"d4ecab8b-5d77-4348-bda7-166cd4faf701\") " pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:03.135482 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.135459    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ecab8b-5d77-4348-bda7-166cd4faf701-console-serving-cert\") pod \"console-5b9b789b64-tjkt8\" (UID: \"d4ecab8b-5d77-4348-bda7-166cd4faf701\") " pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:03.136722 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.136594    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d4ecab8b-5d77-4348-bda7-166cd4faf701-oauth-serving-cert\") pod \"console-5b9b789b64-tjkt8\" (UID: \"d4ecab8b-5d77-4348-bda7-166cd4faf701\") " pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:03.136722 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.136645    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d4ecab8b-5d77-4348-bda7-166cd4faf701-service-ca\") pod \"console-5b9b789b64-tjkt8\" (UID: \"d4ecab8b-5d77-4348-bda7-166cd4faf701\") " pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:03.136722 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.136647    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d4ecab8b-5d77-4348-bda7-166cd4faf701-trusted-ca-bundle\") pod \"console-5b9b789b64-tjkt8\" (UID: \"d4ecab8b-5d77-4348-bda7-166cd4faf701\") " pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:03.137010 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.136981    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d4ecab8b-5d77-4348-bda7-166cd4faf701-console-config\") pod \"console-5b9b789b64-tjkt8\" (UID: \"d4ecab8b-5d77-4348-bda7-166cd4faf701\") " pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:03.143194 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.143171    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d4ecab8b-5d77-4348-bda7-166cd4faf701-console-serving-cert\") pod \"console-5b9b789b64-tjkt8\" (UID: \"d4ecab8b-5d77-4348-bda7-166cd4faf701\") " pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:03.143675 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.143653    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d4ecab8b-5d77-4348-bda7-166cd4faf701-console-oauth-config\") pod \"console-5b9b789b64-tjkt8\" (UID: \"d4ecab8b-5d77-4348-bda7-166cd4faf701\") " pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:03.148606 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.148583    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxtb4\" (UniqueName: \"kubernetes.io/projected/d4ecab8b-5d77-4348-bda7-166cd4faf701-kube-api-access-kxtb4\") pod \"console-5b9b789b64-tjkt8\" (UID: \"d4ecab8b-5d77-4348-bda7-166cd4faf701\") " pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:03.256874 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.256732    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:03.434748 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:03.434724    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b9b789b64-tjkt8"]
Jul 28 10:16:03.437344 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:16:03.437320    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4ecab8b_5d77_4348_bda7_166cd4faf701.slice/crio-5a140e8dc664a4590fe40be6f92223158fc71644e53594cadfa2201c09c8fc77 WatchSource:0}: Error finding container 5a140e8dc664a4590fe40be6f92223158fc71644e53594cadfa2201c09c8fc77: Status 404 returned error can't find the container with id 5a140e8dc664a4590fe40be6f92223158fc71644e53594cadfa2201c09c8fc77
Jul 28 10:16:04.098226 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:04.098191    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b9b789b64-tjkt8" event={"ID":"d4ecab8b-5d77-4348-bda7-166cd4faf701","Type":"ContainerStarted","Data":"63bef859062b6cc0ebcb867e64db5df9bc312d0b414bcabec75b27d88e6a5a7d"}
Jul 28 10:16:04.098603 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:04.098239    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b9b789b64-tjkt8" event={"ID":"d4ecab8b-5d77-4348-bda7-166cd4faf701","Type":"ContainerStarted","Data":"5a140e8dc664a4590fe40be6f92223158fc71644e53594cadfa2201c09c8fc77"}
Jul 28 10:16:04.138764 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:04.138712    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b9b789b64-tjkt8" podStartSLOduration=2.138693671 podStartE2EDuration="2.138693671s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:16:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:16:04.135355345 +0000 UTC m=+497.537593759" watchObservedRunningTime="2026-07-28 10:16:04.138693671 +0000 UTC m=+497.540932068"
Jul 28 10:16:13.257275 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:13.257238    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:13.257677 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:13.257292    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:13.262392 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:13.262368    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:14.146932 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:14.146907    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b9b789b64-tjkt8"
Jul 28 10:16:14.198684 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:14.194828    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65bbb7cdd7-q75m4"]
Jul 28 10:16:19.554101 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:19.554070    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-zw4cs"]
Jul 28 10:16:19.557393 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:19.557356    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-zw4cs"
Jul 28 10:16:19.559601 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:19.559583    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Jul 28 10:16:19.559743 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:19.559667    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 28 10:16:19.559743 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:19.559724    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-2hmfz\""
Jul 28 10:16:19.568612 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:19.568590    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 28 10:16:19.568920 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:19.568705    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0663d54e-972e-4aa6-9b0a-6c58621ed73a-cert\") pod \"llmisvc-controller-manager-654c557856-zw4cs\" (UID: \"0663d54e-972e-4aa6-9b0a-6c58621ed73a\") " pod="kserve/llmisvc-controller-manager-654c557856-zw4cs"
Jul 28 10:16:19.569268 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:19.569245    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9wrg\" (UniqueName: \"kubernetes.io/projected/0663d54e-972e-4aa6-9b0a-6c58621ed73a-kube-api-access-t9wrg\") pod \"llmisvc-controller-manager-654c557856-zw4cs\" (UID: \"0663d54e-972e-4aa6-9b0a-6c58621ed73a\") " pod="kserve/llmisvc-controller-manager-654c557856-zw4cs"
Jul 28 10:16:19.577485 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:19.577462    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-zw4cs"]
Jul 28 10:16:19.669776 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:19.669740    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9wrg\" (UniqueName: \"kubernetes.io/projected/0663d54e-972e-4aa6-9b0a-6c58621ed73a-kube-api-access-t9wrg\") pod \"llmisvc-controller-manager-654c557856-zw4cs\" (UID: \"0663d54e-972e-4aa6-9b0a-6c58621ed73a\") " pod="kserve/llmisvc-controller-manager-654c557856-zw4cs"
Jul 28 10:16:19.669961 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:19.669793    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0663d54e-972e-4aa6-9b0a-6c58621ed73a-cert\") pod \"llmisvc-controller-manager-654c557856-zw4cs\" (UID: \"0663d54e-972e-4aa6-9b0a-6c58621ed73a\") " pod="kserve/llmisvc-controller-manager-654c557856-zw4cs"
Jul 28 10:16:19.669961 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:16:19.669926    2577 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 28 10:16:19.670103 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:16:19.669990    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0663d54e-972e-4aa6-9b0a-6c58621ed73a-cert podName:0663d54e-972e-4aa6-9b0a-6c58621ed73a nodeName:}" failed. No retries permitted until 2026-07-28 10:16:20.169973386 +0000 UTC m=+513.572211763 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0663d54e-972e-4aa6-9b0a-6c58621ed73a-cert") pod "llmisvc-controller-manager-654c557856-zw4cs" (UID: "0663d54e-972e-4aa6-9b0a-6c58621ed73a") : secret "llmisvc-webhook-server-cert" not found
Jul 28 10:16:19.682161 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:19.682131    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9wrg\" (UniqueName: \"kubernetes.io/projected/0663d54e-972e-4aa6-9b0a-6c58621ed73a-kube-api-access-t9wrg\") pod \"llmisvc-controller-manager-654c557856-zw4cs\" (UID: \"0663d54e-972e-4aa6-9b0a-6c58621ed73a\") " pod="kserve/llmisvc-controller-manager-654c557856-zw4cs"
Jul 28 10:16:20.174253 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:20.174220    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0663d54e-972e-4aa6-9b0a-6c58621ed73a-cert\") pod \"llmisvc-controller-manager-654c557856-zw4cs\" (UID: \"0663d54e-972e-4aa6-9b0a-6c58621ed73a\") " pod="kserve/llmisvc-controller-manager-654c557856-zw4cs"
Jul 28 10:16:20.176735 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:20.176701    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0663d54e-972e-4aa6-9b0a-6c58621ed73a-cert\") pod \"llmisvc-controller-manager-654c557856-zw4cs\" (UID: \"0663d54e-972e-4aa6-9b0a-6c58621ed73a\") " pod="kserve/llmisvc-controller-manager-654c557856-zw4cs"
Jul 28 10:16:20.178613 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:20.178598    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-zw4cs"
Jul 28 10:16:20.312745 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:20.312705    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-zw4cs"]
Jul 28 10:16:20.315423 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:16:20.315395    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0663d54e_972e_4aa6_9b0a_6c58621ed73a.slice/crio-150f10d1f6cbfb5586e4b032485ad11fbd1bb2c8ac495a7313bf5afb6fc275e3 WatchSource:0}: Error finding container 150f10d1f6cbfb5586e4b032485ad11fbd1bb2c8ac495a7313bf5afb6fc275e3: Status 404 returned error can't find the container with id 150f10d1f6cbfb5586e4b032485ad11fbd1bb2c8ac495a7313bf5afb6fc275e3
Jul 28 10:16:21.175140 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:21.175112    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-zw4cs" event={"ID":"0663d54e-972e-4aa6-9b0a-6c58621ed73a","Type":"ContainerStarted","Data":"150f10d1f6cbfb5586e4b032485ad11fbd1bb2c8ac495a7313bf5afb6fc275e3"}
Jul 28 10:16:23.186383 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:23.186351    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-zw4cs" event={"ID":"0663d54e-972e-4aa6-9b0a-6c58621ed73a","Type":"ContainerStarted","Data":"44e70e437996badc15ffc4bbba7d6c239ee63981d11044b2e1b2814cb84d0a03"}
Jul 28 10:16:23.186758 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:23.186439    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-zw4cs"
Jul 28 10:16:23.207273 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:23.207214    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-654c557856-zw4cs" podStartSLOduration=1.8861896740000001 podStartE2EDuration="4.207194007s" totalImagesPullingTime="2.321004333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:16:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:16:23.204704874 +0000 UTC m=+516.606943273" watchObservedRunningTime="2026-07-28 10:16:23.207194007 +0000 UTC m=+516.609432406"
Jul 28 10:16:39.218865 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.218751    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65bbb7cdd7-q75m4" podUID="29f21a62-e8fc-4df7-8898-66ff0f2b3ced" containerName="console" containerID="cri-o://1e479999ff20c5ac1b45ce504c9ad87107e5ddde285d90779e545550983dd92b" gracePeriod=15
Jul 28 10:16:39.461789 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.461765    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:16:39.538883 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.538778    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmn25\" (UniqueName: \"kubernetes.io/projected/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-kube-api-access-dmn25\") pod \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") "
Jul 28 10:16:39.538883 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.538814    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-console-config\") pod \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") "
Jul 28 10:16:39.538883 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.538866    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-trusted-ca-bundle\") pod \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") "
Jul 28 10:16:39.538883 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.538885    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-console-serving-cert\") pod \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") "
Jul 28 10:16:39.539201 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.538929    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-oauth-serving-cert\") pod \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") "
Jul 28 10:16:39.539201 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.538955    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-console-oauth-config\") pod \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") "
Jul 28 10:16:39.539201 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.539103    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-service-ca\") pod \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\" (UID: \"29f21a62-e8fc-4df7-8898-66ff0f2b3ced\") "
Jul 28 10:16:39.539356 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.539297    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-console-config" (OuterVolumeSpecName: "console-config") pod "29f21a62-e8fc-4df7-8898-66ff0f2b3ced" (UID: "29f21a62-e8fc-4df7-8898-66ff0f2b3ced"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:16:39.539409 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.539366    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "29f21a62-e8fc-4df7-8898-66ff0f2b3ced" (UID: "29f21a62-e8fc-4df7-8898-66ff0f2b3ced"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:16:39.539409 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.539372    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "29f21a62-e8fc-4df7-8898-66ff0f2b3ced" (UID: "29f21a62-e8fc-4df7-8898-66ff0f2b3ced"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:16:39.539591 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.539570    2577 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-trusted-ca-bundle\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:16:39.539660 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.539597    2577 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-oauth-serving-cert\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:16:39.539660 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.539613    2577 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-console-config\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:16:39.539806 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.539783    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-service-ca" (OuterVolumeSpecName: "service-ca") pod "29f21a62-e8fc-4df7-8898-66ff0f2b3ced" (UID: "29f21a62-e8fc-4df7-8898-66ff0f2b3ced"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:16:39.541229 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.541202    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "29f21a62-e8fc-4df7-8898-66ff0f2b3ced" (UID: "29f21a62-e8fc-4df7-8898-66ff0f2b3ced"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:16:39.541328 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.541229    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-kube-api-access-dmn25" (OuterVolumeSpecName: "kube-api-access-dmn25") pod "29f21a62-e8fc-4df7-8898-66ff0f2b3ced" (UID: "29f21a62-e8fc-4df7-8898-66ff0f2b3ced"). InnerVolumeSpecName "kube-api-access-dmn25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 10:16:39.541328 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.541257    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "29f21a62-e8fc-4df7-8898-66ff0f2b3ced" (UID: "29f21a62-e8fc-4df7-8898-66ff0f2b3ced"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:16:39.640973 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.640940    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmn25\" (UniqueName: \"kubernetes.io/projected/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-kube-api-access-dmn25\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:16:39.640973 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.640969    2577 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-console-serving-cert\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:16:39.640973 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.640979    2577 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-console-oauth-config\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:16:39.641214 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:39.640989    2577 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/29f21a62-e8fc-4df7-8898-66ff0f2b3ced-service-ca\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:16:40.266742 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:40.266708    2577 generic.go:356] "Generic (PLEG): container finished" podID="29f21a62-e8fc-4df7-8898-66ff0f2b3ced" containerID="1e479999ff20c5ac1b45ce504c9ad87107e5ddde285d90779e545550983dd92b" exitCode=0
Jul 28 10:16:40.267175 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:40.266755    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65bbb7cdd7-q75m4"
Jul 28 10:16:40.267175 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:40.266766    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65bbb7cdd7-q75m4" event={"ID":"29f21a62-e8fc-4df7-8898-66ff0f2b3ced","Type":"ContainerDied","Data":"1e479999ff20c5ac1b45ce504c9ad87107e5ddde285d90779e545550983dd92b"}
Jul 28 10:16:40.267175 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:40.266815    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65bbb7cdd7-q75m4" event={"ID":"29f21a62-e8fc-4df7-8898-66ff0f2b3ced","Type":"ContainerDied","Data":"39cab01e796ea870cfd82631e89795703ae2dcd869c9012ac1d8f872372b4348"}
Jul 28 10:16:40.267175 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:40.266869    2577 scope.go:117] "RemoveContainer" containerID="1e479999ff20c5ac1b45ce504c9ad87107e5ddde285d90779e545550983dd92b"
Jul 28 10:16:40.275807 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:40.275787    2577 scope.go:117] "RemoveContainer" containerID="1e479999ff20c5ac1b45ce504c9ad87107e5ddde285d90779e545550983dd92b"
Jul 28 10:16:40.276137 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:16:40.276118    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e479999ff20c5ac1b45ce504c9ad87107e5ddde285d90779e545550983dd92b\": container with ID starting with 1e479999ff20c5ac1b45ce504c9ad87107e5ddde285d90779e545550983dd92b not found: ID does not exist" containerID="1e479999ff20c5ac1b45ce504c9ad87107e5ddde285d90779e545550983dd92b"
Jul 28 10:16:40.276201 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:40.276147    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e479999ff20c5ac1b45ce504c9ad87107e5ddde285d90779e545550983dd92b"} err="failed to get container status \"1e479999ff20c5ac1b45ce504c9ad87107e5ddde285d90779e545550983dd92b\": rpc error: code = NotFound desc = could not find container \"1e479999ff20c5ac1b45ce504c9ad87107e5ddde285d90779e545550983dd92b\": container with ID starting with 1e479999ff20c5ac1b45ce504c9ad87107e5ddde285d90779e545550983dd92b not found: ID does not exist"
Jul 28 10:16:40.289068 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:40.289047    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65bbb7cdd7-q75m4"]
Jul 28 10:16:40.293817 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:40.293796    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65bbb7cdd7-q75m4"]
Jul 28 10:16:41.044568 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:41.044537    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29f21a62-e8fc-4df7-8898-66ff0f2b3ced" path="/var/lib/kubelet/pods/29f21a62-e8fc-4df7-8898-66ff0f2b3ced/volumes"
Jul 28 10:16:54.193407 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:16:54.193381    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-654c557856-zw4cs"
Jul 28 10:17:34.927652 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:17:34.927618    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-7b954ffc95-gh4f6"]
Jul 28 10:17:34.928150 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:17:34.928134    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29f21a62-e8fc-4df7-8898-66ff0f2b3ced" containerName="console"
Jul 28 10:17:34.928218 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:17:34.928153    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="29f21a62-e8fc-4df7-8898-66ff0f2b3ced" containerName="console"
Jul 28 10:17:34.928269 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:17:34.928240    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="29f21a62-e8fc-4df7-8898-66ff0f2b3ced" containerName="console"
Jul 28 10:17:34.931655 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:17:34.931633    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-gh4f6"
Jul 28 10:17:34.933894 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:17:34.933873    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\""
Jul 28 10:17:34.934023 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:17:34.933930    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-hcpzn\""
Jul 28 10:17:34.941302 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:17:34.941275    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-gh4f6"]
Jul 28 10:17:35.011462 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:17:35.011413    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65d4c03a-6652-40c1-86b9-aeb06708e9ac-tls-certs\") pod \"model-serving-api-7b954ffc95-gh4f6\" (UID: \"65d4c03a-6652-40c1-86b9-aeb06708e9ac\") " pod="kserve/model-serving-api-7b954ffc95-gh4f6"
Jul 28 10:17:35.011462 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:17:35.011465    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gb8k\" (UniqueName: \"kubernetes.io/projected/65d4c03a-6652-40c1-86b9-aeb06708e9ac-kube-api-access-8gb8k\") pod \"model-serving-api-7b954ffc95-gh4f6\" (UID: \"65d4c03a-6652-40c1-86b9-aeb06708e9ac\") " pod="kserve/model-serving-api-7b954ffc95-gh4f6"
Jul 28 10:17:35.112650 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:17:35.112619    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65d4c03a-6652-40c1-86b9-aeb06708e9ac-tls-certs\") pod \"model-serving-api-7b954ffc95-gh4f6\" (UID: \"65d4c03a-6652-40c1-86b9-aeb06708e9ac\") " pod="kserve/model-serving-api-7b954ffc95-gh4f6"
Jul 28 10:17:35.112650 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:17:35.112651    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gb8k\" (UniqueName: \"kubernetes.io/projected/65d4c03a-6652-40c1-86b9-aeb06708e9ac-kube-api-access-8gb8k\") pod \"model-serving-api-7b954ffc95-gh4f6\" (UID: \"65d4c03a-6652-40c1-86b9-aeb06708e9ac\") " pod="kserve/model-serving-api-7b954ffc95-gh4f6"
Jul 28 10:17:35.115280 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:17:35.115256    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65d4c03a-6652-40c1-86b9-aeb06708e9ac-tls-certs\") pod \"model-serving-api-7b954ffc95-gh4f6\" (UID: \"65d4c03a-6652-40c1-86b9-aeb06708e9ac\") " pod="kserve/model-serving-api-7b954ffc95-gh4f6"
Jul 28 10:17:35.123068 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:17:35.123049    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gb8k\" (UniqueName: \"kubernetes.io/projected/65d4c03a-6652-40c1-86b9-aeb06708e9ac-kube-api-access-8gb8k\") pod \"model-serving-api-7b954ffc95-gh4f6\" (UID: \"65d4c03a-6652-40c1-86b9-aeb06708e9ac\") " pod="kserve/model-serving-api-7b954ffc95-gh4f6"
Jul 28 10:17:35.244708 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:17:35.244669    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-7b954ffc95-gh4f6"
Jul 28 10:17:35.377385 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:17:35.377361    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-7b954ffc95-gh4f6"]
Jul 28 10:17:35.379957 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:17:35.379927    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65d4c03a_6652_40c1_86b9_aeb06708e9ac.slice/crio-81bbe1d3cd5d55c4ad0ad79513012164014a5c511bcf638473f4704b06a230fe WatchSource:0}: Error finding container 81bbe1d3cd5d55c4ad0ad79513012164014a5c511bcf638473f4704b06a230fe: Status 404 returned error can't find the container with id 81bbe1d3cd5d55c4ad0ad79513012164014a5c511bcf638473f4704b06a230fe
Jul 28 10:17:35.507176 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:17:35.507087    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-gh4f6" event={"ID":"65d4c03a-6652-40c1-86b9-aeb06708e9ac","Type":"ContainerStarted","Data":"81bbe1d3cd5d55c4ad0ad79513012164014a5c511bcf638473f4704b06a230fe"}
Jul 28 10:17:38.522590 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:17:38.522553    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-7b954ffc95-gh4f6" event={"ID":"65d4c03a-6652-40c1-86b9-aeb06708e9ac","Type":"ContainerStarted","Data":"d49fe20e6f8db078449af78b837783c50b6cafd4fe710b1ea76d16d39d8c9727"}
Jul 28 10:17:38.523088 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:17:38.522689    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-7b954ffc95-gh4f6"
Jul 28 10:17:38.543504 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:17:38.543455    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-7b954ffc95-gh4f6" podStartSLOduration=2.267150579 podStartE2EDuration="4.543440374s" totalImagesPullingTime="2.276289795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:17:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:17:38.540991624 +0000 UTC m=+591.943230023" watchObservedRunningTime="2026-07-28 10:17:38.543440374 +0000 UTC m=+591.945678770"
Jul 28 10:17:49.531364 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:17:49.531336    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-7b954ffc95-gh4f6"
Jul 28 10:19:20.981279 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:20.981249    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"]
Jul 28 10:19:20.985018 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:20.984997    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:19:20.987872 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:20.987833    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\""
Jul 28 10:19:20.988154 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:20.988131    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\""
Jul 28 10:19:20.988262 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:20.988201    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-lvvzp\""
Jul 28 10:19:20.988474 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:20.988458    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\""
Jul 28 10:19:20.988881 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:20.988864    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\""
Jul 28 10:19:20.988989 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:20.988961    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 28 10:19:20.989048 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:20.989040    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\""
Jul 28 10:19:20.997919 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:20.997898    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"]
Jul 28 10:19:21.130340 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:21.130298    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6h7nv\" (UniqueName: \"kubernetes.io/projected/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-kube-api-access-6h7nv\") pod \"isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb\" (UID: \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:19:21.130550 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:21.130347    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb\" (UID: \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:19:21.130550 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:21.130450    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb\" (UID: \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:19:21.130550 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:21.130473    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb\" (UID: \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:19:21.130712 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:21.130576    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb\" (UID: \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:19:21.231457 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:21.231371    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb\" (UID: \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:19:21.231617 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:21.231512    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb\" (UID: \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:19:21.231617 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:21.231543    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb\" (UID: \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:19:21.231617 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:21.231612    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb\" (UID: \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:19:21.231776 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:21.231653    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6h7nv\" (UniqueName: \"kubernetes.io/projected/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-kube-api-access-6h7nv\") pod \"isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb\" (UID: \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:19:21.231776 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:19:21.231671    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-serving-cert: secret "isvc-sklearn-graph-2-predictor-serving-cert" not found
Jul 28 10:19:21.231776 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:19:21.231739    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-proxy-tls podName:9cf6bd77-fe36-46d8-a45e-88ffc15f53ff nodeName:}" failed. No retries permitted until 2026-07-28 10:19:21.731719605 +0000 UTC m=+695.133957988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-proxy-tls") pod "isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" (UID: "9cf6bd77-fe36-46d8-a45e-88ffc15f53ff") : secret "isvc-sklearn-graph-2-predictor-serving-cert" not found
Jul 28 10:19:21.232038 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:21.232014    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb\" (UID: \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:19:21.232169 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:21.232152    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb\" (UID: \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:19:21.232218 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:21.232203    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb\" (UID: \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:19:21.241476 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:21.241455    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6h7nv\" (UniqueName: \"kubernetes.io/projected/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-kube-api-access-6h7nv\") pod \"isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb\" (UID: \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:19:21.736868 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:21.736787    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb\" (UID: \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:19:21.739333 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:21.739302    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb\" (UID: \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:19:21.897256 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:21.897219    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:19:22.052971 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:19:22.052939    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cf6bd77_fe36_46d8_a45e_88ffc15f53ff.slice/crio-f997a6e3eb221550ad15829f7ef491f456dbe231958579601a2d076cd182693e WatchSource:0}: Error finding container f997a6e3eb221550ad15829f7ef491f456dbe231958579601a2d076cd182693e: Status 404 returned error can't find the container with id f997a6e3eb221550ad15829f7ef491f456dbe231958579601a2d076cd182693e
Jul 28 10:19:22.053363 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:22.053341    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"]
Jul 28 10:19:22.999477 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:22.999355    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" event={"ID":"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff","Type":"ContainerStarted","Data":"f997a6e3eb221550ad15829f7ef491f456dbe231958579601a2d076cd182693e"}
Jul 28 10:19:26.019481 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:26.019441    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" event={"ID":"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff","Type":"ContainerStarted","Data":"b0b2cbe28f83dddfc0948a18f829189bc7bb687e3a18b0dc1b43b5480e05262b"}
Jul 28 10:19:30.037426 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:30.037393    2577 generic.go:356] "Generic (PLEG): container finished" podID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerID="b0b2cbe28f83dddfc0948a18f829189bc7bb687e3a18b0dc1b43b5480e05262b" exitCode=0
Jul 28 10:19:30.037801 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:30.037466    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" event={"ID":"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff","Type":"ContainerDied","Data":"b0b2cbe28f83dddfc0948a18f829189bc7bb687e3a18b0dc1b43b5480e05262b"}
Jul 28 10:19:42.868729 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:42.868705    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 10:19:43.121342 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:43.121247    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" event={"ID":"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff","Type":"ContainerStarted","Data":"bb26f62c289bc74945bfe63a77d93929b1a818abdc925a01221c9d8dc0f5557e"}
Jul 28 10:19:45.134192 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:45.134163    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" event={"ID":"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff","Type":"ContainerStarted","Data":"0f0f6c1b4fbb1149c55057626a5d5087fc95ca918ba16731e14ba0bf30596449"}
Jul 28 10:19:45.134592 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:45.134313    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:19:45.170459 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:45.170412    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" podStartSLOduration=3.068279204 podStartE2EDuration="25.170395883s" totalImagesPullingTime="18.35124898s" totalInitContainerRuntime="3.750867699s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:19:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:19:45.169690696 +0000 UTC m=+718.571929095" watchObservedRunningTime="2026-07-28 10:19:45.170395883 +0000 UTC m=+718.572634281"
Jul 28 10:19:46.139907 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:46.139874    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:19:46.141152 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:46.141128    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" podUID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 28 10:19:47.143692 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:47.143652    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" podUID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 28 10:19:52.148302 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:52.148265    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:19:52.148970 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:19:52.148942    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" podUID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 28 10:20:02.149343 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:02.149307    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" podUID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 28 10:20:12.149794 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:12.149755    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" podUID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 28 10:20:22.149576 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:22.149539    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" podUID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 28 10:20:32.148822 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:32.148781    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" podUID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 28 10:20:40.160185 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:40.160145    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps"]
Jul 28 10:20:40.163962 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:40.163942    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps"
Jul 28 10:20:40.166298 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:40.166274    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-717c3-kube-rbac-proxy-sar-config\""
Jul 28 10:20:40.166298 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:40.166285    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-717c3-serving-cert\""
Jul 28 10:20:40.171909 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:40.171885    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps"]
Jul 28 10:20:40.228139 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:40.228098    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/484d7d3d-b078-424d-8463-35b214f2adb0-openshift-service-ca-bundle\") pod \"switch-graph-717c3-b69fd89f-9mwps\" (UID: \"484d7d3d-b078-424d-8463-35b214f2adb0\") " pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps"
Jul 28 10:20:40.228323 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:40.228184    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/484d7d3d-b078-424d-8463-35b214f2adb0-proxy-tls\") pod \"switch-graph-717c3-b69fd89f-9mwps\" (UID: \"484d7d3d-b078-424d-8463-35b214f2adb0\") " pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps"
Jul 28 10:20:40.328796 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:40.328760    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/484d7d3d-b078-424d-8463-35b214f2adb0-proxy-tls\") pod \"switch-graph-717c3-b69fd89f-9mwps\" (UID: \"484d7d3d-b078-424d-8463-35b214f2adb0\") " pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps"
Jul 28 10:20:40.329063 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:40.328922    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/484d7d3d-b078-424d-8463-35b214f2adb0-openshift-service-ca-bundle\") pod \"switch-graph-717c3-b69fd89f-9mwps\" (UID: \"484d7d3d-b078-424d-8463-35b214f2adb0\") " pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps"
Jul 28 10:20:40.329578 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:40.329557    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/484d7d3d-b078-424d-8463-35b214f2adb0-openshift-service-ca-bundle\") pod \"switch-graph-717c3-b69fd89f-9mwps\" (UID: \"484d7d3d-b078-424d-8463-35b214f2adb0\") " pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps"
Jul 28 10:20:40.331456 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:40.331431    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/484d7d3d-b078-424d-8463-35b214f2adb0-proxy-tls\") pod \"switch-graph-717c3-b69fd89f-9mwps\" (UID: \"484d7d3d-b078-424d-8463-35b214f2adb0\") " pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps"
Jul 28 10:20:40.475359 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:40.475327    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps"
Jul 28 10:20:40.605277 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:40.605253    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps"]
Jul 28 10:20:40.608137 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:20:40.608109    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod484d7d3d_b078_424d_8463_35b214f2adb0.slice/crio-de4f58712e1c3fe4dc688716a1707dacdd5deced6ff97512631f6e5fe9955dcd WatchSource:0}: Error finding container de4f58712e1c3fe4dc688716a1707dacdd5deced6ff97512631f6e5fe9955dcd: Status 404 returned error can't find the container with id de4f58712e1c3fe4dc688716a1707dacdd5deced6ff97512631f6e5fe9955dcd
Jul 28 10:20:41.396413 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:41.396345    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps" event={"ID":"484d7d3d-b078-424d-8463-35b214f2adb0","Type":"ContainerStarted","Data":"de4f58712e1c3fe4dc688716a1707dacdd5deced6ff97512631f6e5fe9955dcd"}
Jul 28 10:20:42.149017 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:42.148958    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" podUID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 28 10:20:43.406648 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:43.406610    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps" event={"ID":"484d7d3d-b078-424d-8463-35b214f2adb0","Type":"ContainerStarted","Data":"24da6ccbb9445c24527ad7f83c6e9bd825d07baf0a133ce31d189171fdbba20c"}
Jul 28 10:20:43.407057 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:43.406723    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps"
Jul 28 10:20:43.427430 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:43.427379    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps" podStartSLOduration=1.610367423 podStartE2EDuration="3.427364988s" totalImagesPullingTime="1.816997565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:20:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:20:43.426131354 +0000 UTC m=+776.828369752" watchObservedRunningTime="2026-07-28 10:20:43.427364988 +0000 UTC m=+776.829603385"
Jul 28 10:20:49.416494 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:49.416466    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps"
Jul 28 10:20:50.264652 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:50.264615    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps"]
Jul 28 10:20:50.264830 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:50.264809    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps" podUID="484d7d3d-b078-424d-8463-35b214f2adb0" containerName="switch-graph-717c3" containerID="cri-o://24da6ccbb9445c24527ad7f83c6e9bd825d07baf0a133ce31d189171fdbba20c" gracePeriod=30
Jul 28 10:20:52.149528 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:52.149495    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" podUID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 28 10:20:54.414858 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:54.414809    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps" podUID="484d7d3d-b078-424d-8463-35b214f2adb0" containerName="switch-graph-717c3" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:20:59.415298 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:20:59.415251    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps" podUID="484d7d3d-b078-424d-8463-35b214f2adb0" containerName="switch-graph-717c3" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:21:02.150567 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:02.150540    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:21:04.415303 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:04.415265    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps" podUID="484d7d3d-b078-424d-8463-35b214f2adb0" containerName="switch-graph-717c3" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:21:04.415791 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:04.415379    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps"
Jul 28 10:21:09.415452 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:09.415363    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps" podUID="484d7d3d-b078-424d-8463-35b214f2adb0" containerName="switch-graph-717c3" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:21:14.415063 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:14.415028    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps" podUID="484d7d3d-b078-424d-8463-35b214f2adb0" containerName="switch-graph-717c3" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:21:19.414765 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:19.414726    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps" podUID="484d7d3d-b078-424d-8463-35b214f2adb0" containerName="switch-graph-717c3" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:21:20.418154 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:20.418128    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps"
Jul 28 10:21:20.483065 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:20.483029    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/484d7d3d-b078-424d-8463-35b214f2adb0-proxy-tls\") pod \"484d7d3d-b078-424d-8463-35b214f2adb0\" (UID: \"484d7d3d-b078-424d-8463-35b214f2adb0\") "
Jul 28 10:21:20.483211 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:20.483135    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/484d7d3d-b078-424d-8463-35b214f2adb0-openshift-service-ca-bundle\") pod \"484d7d3d-b078-424d-8463-35b214f2adb0\" (UID: \"484d7d3d-b078-424d-8463-35b214f2adb0\") "
Jul 28 10:21:20.483477 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:20.483454    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/484d7d3d-b078-424d-8463-35b214f2adb0-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "484d7d3d-b078-424d-8463-35b214f2adb0" (UID: "484d7d3d-b078-424d-8463-35b214f2adb0"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:21:20.485401 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:20.485376    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/484d7d3d-b078-424d-8463-35b214f2adb0-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "484d7d3d-b078-424d-8463-35b214f2adb0" (UID: "484d7d3d-b078-424d-8463-35b214f2adb0"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:21:20.581692 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:20.581614    2577 generic.go:356] "Generic (PLEG): container finished" podID="484d7d3d-b078-424d-8463-35b214f2adb0" containerID="24da6ccbb9445c24527ad7f83c6e9bd825d07baf0a133ce31d189171fdbba20c" exitCode=0
Jul 28 10:21:20.581692 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:20.581664    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps"
Jul 28 10:21:20.581886 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:20.581701    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps" event={"ID":"484d7d3d-b078-424d-8463-35b214f2adb0","Type":"ContainerDied","Data":"24da6ccbb9445c24527ad7f83c6e9bd825d07baf0a133ce31d189171fdbba20c"}
Jul 28 10:21:20.581886 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:20.581755    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps" event={"ID":"484d7d3d-b078-424d-8463-35b214f2adb0","Type":"ContainerDied","Data":"de4f58712e1c3fe4dc688716a1707dacdd5deced6ff97512631f6e5fe9955dcd"}
Jul 28 10:21:20.581886 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:20.581778    2577 scope.go:117] "RemoveContainer" containerID="24da6ccbb9445c24527ad7f83c6e9bd825d07baf0a133ce31d189171fdbba20c"
Jul 28 10:21:20.584314 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:20.584290    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/484d7d3d-b078-424d-8463-35b214f2adb0-proxy-tls\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:21:20.584449 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:20.584315    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/484d7d3d-b078-424d-8463-35b214f2adb0-openshift-service-ca-bundle\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:21:20.590667 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:20.590651    2577 scope.go:117] "RemoveContainer" containerID="24da6ccbb9445c24527ad7f83c6e9bd825d07baf0a133ce31d189171fdbba20c"
Jul 28 10:21:20.591043 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:21:20.591025    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24da6ccbb9445c24527ad7f83c6e9bd825d07baf0a133ce31d189171fdbba20c\": container with ID starting with 24da6ccbb9445c24527ad7f83c6e9bd825d07baf0a133ce31d189171fdbba20c not found: ID does not exist" containerID="24da6ccbb9445c24527ad7f83c6e9bd825d07baf0a133ce31d189171fdbba20c"
Jul 28 10:21:20.591091 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:20.591052    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24da6ccbb9445c24527ad7f83c6e9bd825d07baf0a133ce31d189171fdbba20c"} err="failed to get container status \"24da6ccbb9445c24527ad7f83c6e9bd825d07baf0a133ce31d189171fdbba20c\": rpc error: code = NotFound desc = could not find container \"24da6ccbb9445c24527ad7f83c6e9bd825d07baf0a133ce31d189171fdbba20c\": container with ID starting with 24da6ccbb9445c24527ad7f83c6e9bd825d07baf0a133ce31d189171fdbba20c not found: ID does not exist"
Jul 28 10:21:20.606645 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:20.606618    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps"]
Jul 28 10:21:20.609363 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:20.609342    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-717c3-b69fd89f-9mwps"]
Jul 28 10:21:21.045910 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:21.045876    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="484d7d3d-b078-424d-8463-35b214f2adb0" path="/var/lib/kubelet/pods/484d7d3d-b078-424d-8463-35b214f2adb0/volumes"
Jul 28 10:21:30.169829 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:30.169797    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv"]
Jul 28 10:21:30.170337 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:30.170322    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="484d7d3d-b078-424d-8463-35b214f2adb0" containerName="switch-graph-717c3"
Jul 28 10:21:30.170386 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:30.170341    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="484d7d3d-b078-424d-8463-35b214f2adb0" containerName="switch-graph-717c3"
Jul 28 10:21:30.170447 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:30.170437    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="484d7d3d-b078-424d-8463-35b214f2adb0" containerName="switch-graph-717c3"
Jul 28 10:21:30.175506 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:30.175485    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv"
Jul 28 10:21:30.177561 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:30.177539    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-serving-cert\""
Jul 28 10:21:30.177712 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:30.177694    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-kube-rbac-proxy-sar-config\""
Jul 28 10:21:30.181325 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:30.181302    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv"]
Jul 28 10:21:30.266097 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:30.266063    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6e8e8838-a79f-43e0-b034-beaba3d794e3-proxy-tls\") pod \"model-chainer-5595dc65c9-w4vhv\" (UID: \"6e8e8838-a79f-43e0-b034-beaba3d794e3\") " pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv"
Jul 28 10:21:30.266259 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:30.266111    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e8e8838-a79f-43e0-b034-beaba3d794e3-openshift-service-ca-bundle\") pod \"model-chainer-5595dc65c9-w4vhv\" (UID: \"6e8e8838-a79f-43e0-b034-beaba3d794e3\") " pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv"
Jul 28 10:21:30.366898 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:30.366865    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6e8e8838-a79f-43e0-b034-beaba3d794e3-proxy-tls\") pod \"model-chainer-5595dc65c9-w4vhv\" (UID: \"6e8e8838-a79f-43e0-b034-beaba3d794e3\") " pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv"
Jul 28 10:21:30.367063 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:30.366934    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e8e8838-a79f-43e0-b034-beaba3d794e3-openshift-service-ca-bundle\") pod \"model-chainer-5595dc65c9-w4vhv\" (UID: \"6e8e8838-a79f-43e0-b034-beaba3d794e3\") " pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv"
Jul 28 10:21:30.367063 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:21:30.366964    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/model-chainer-serving-cert: secret "model-chainer-serving-cert" not found
Jul 28 10:21:30.367063 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:21:30.367036    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e8e8838-a79f-43e0-b034-beaba3d794e3-proxy-tls podName:6e8e8838-a79f-43e0-b034-beaba3d794e3 nodeName:}" failed. No retries permitted until 2026-07-28 10:21:30.867017472 +0000 UTC m=+824.269255854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/6e8e8838-a79f-43e0-b034-beaba3d794e3-proxy-tls") pod "model-chainer-5595dc65c9-w4vhv" (UID: "6e8e8838-a79f-43e0-b034-beaba3d794e3") : secret "model-chainer-serving-cert" not found
Jul 28 10:21:30.367602 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:30.367579    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e8e8838-a79f-43e0-b034-beaba3d794e3-openshift-service-ca-bundle\") pod \"model-chainer-5595dc65c9-w4vhv\" (UID: \"6e8e8838-a79f-43e0-b034-beaba3d794e3\") " pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv"
Jul 28 10:21:30.871430 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:30.871390    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6e8e8838-a79f-43e0-b034-beaba3d794e3-proxy-tls\") pod \"model-chainer-5595dc65c9-w4vhv\" (UID: \"6e8e8838-a79f-43e0-b034-beaba3d794e3\") " pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv"
Jul 28 10:21:30.873993 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:30.873972    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6e8e8838-a79f-43e0-b034-beaba3d794e3-proxy-tls\") pod \"model-chainer-5595dc65c9-w4vhv\" (UID: \"6e8e8838-a79f-43e0-b034-beaba3d794e3\") " pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv"
Jul 28 10:21:31.087909 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:31.087875    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv"
Jul 28 10:21:31.219592 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:31.219568    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv"]
Jul 28 10:21:31.221438 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:21:31.221409    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e8e8838_a79f_43e0_b034_beaba3d794e3.slice/crio-bbde9c444ab0d2fece6a881503c5a1d412e5d038dba4a1f78c35280047cdf01d WatchSource:0}: Error finding container bbde9c444ab0d2fece6a881503c5a1d412e5d038dba4a1f78c35280047cdf01d: Status 404 returned error can't find the container with id bbde9c444ab0d2fece6a881503c5a1d412e5d038dba4a1f78c35280047cdf01d
Jul 28 10:21:31.633159 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:31.633125    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv" event={"ID":"6e8e8838-a79f-43e0-b034-beaba3d794e3","Type":"ContainerStarted","Data":"1db423e5e72f9581f72f8efb2fd0580b5fc97b2b3b23d61f294f9b50a9d36062"}
Jul 28 10:21:31.633331 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:31.633175    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv" event={"ID":"6e8e8838-a79f-43e0-b034-beaba3d794e3","Type":"ContainerStarted","Data":"bbde9c444ab0d2fece6a881503c5a1d412e5d038dba4a1f78c35280047cdf01d"}
Jul 28 10:21:31.633331 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:31.633250    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv"
Jul 28 10:21:31.650906 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:31.650860    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv" podStartSLOduration=1.6508265199999999 podStartE2EDuration="1.65082652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:21:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:21:31.649156799 +0000 UTC m=+825.051395199" watchObservedRunningTime="2026-07-28 10:21:31.65082652 +0000 UTC m=+825.053064917"
Jul 28 10:21:37.642981 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:37.642946    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv"
Jul 28 10:21:40.259305 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:40.259268    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv"]
Jul 28 10:21:40.259765 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:40.259490    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv" podUID="6e8e8838-a79f-43e0-b034-beaba3d794e3" containerName="model-chainer" containerID="cri-o://1db423e5e72f9581f72f8efb2fd0580b5fc97b2b3b23d61f294f9b50a9d36062" gracePeriod=30
Jul 28 10:21:40.396296 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:40.396263    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"]
Jul 28 10:21:40.396607 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:40.396577    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" podUID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerName="kserve-container" containerID="cri-o://bb26f62c289bc74945bfe63a77d93929b1a818abdc925a01221c9d8dc0f5557e" gracePeriod=30
Jul 28 10:21:40.398169 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:40.397743    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" podUID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerName="kube-rbac-proxy" containerID="cri-o://0f0f6c1b4fbb1149c55057626a5d5087fc95ca918ba16731e14ba0bf30596449" gracePeriod=30
Jul 28 10:21:40.683165 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:40.683131    2577 generic.go:356] "Generic (PLEG): container finished" podID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerID="0f0f6c1b4fbb1149c55057626a5d5087fc95ca918ba16731e14ba0bf30596449" exitCode=2
Jul 28 10:21:40.683365 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:40.683210    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" event={"ID":"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff","Type":"ContainerDied","Data":"0f0f6c1b4fbb1149c55057626a5d5087fc95ca918ba16731e14ba0bf30596449"}
Jul 28 10:21:42.144833 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:42.144792    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" podUID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.132.0.33:8643/healthz\": dial tcp 10.132.0.33:8643: connect: connection refused"
Jul 28 10:21:42.149131 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:42.149110    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" podUID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerName="kserve-container" probeResult="failure" output="dial tcp 10.132.0.33:8080: connect: connection refused"
Jul 28 10:21:42.641729 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:42.641687    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv" podUID="6e8e8838-a79f-43e0-b034-beaba3d794e3" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:21:45.352357 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.352334    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:21:45.491779 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.491748    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-proxy-tls\") pod \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\" (UID: \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\") "
Jul 28 10:21:45.491984 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.491811    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-kserve-provision-location\") pod \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\" (UID: \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\") "
Jul 28 10:21:45.491984 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.491869    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6h7nv\" (UniqueName: \"kubernetes.io/projected/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-kube-api-access-6h7nv\") pod \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\" (UID: \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\") "
Jul 28 10:21:45.491984 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.491973    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-cabundle-cert\") pod \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\" (UID: \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\") "
Jul 28 10:21:45.492159 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.492027    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-kube-rbac-proxy-sar-config\") pod \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\" (UID: \"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff\") "
Jul 28 10:21:45.492293 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.492188    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" (UID: "9cf6bd77-fe36-46d8-a45e-88ffc15f53ff"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 10:21:45.492357 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.492339    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" (UID: "9cf6bd77-fe36-46d8-a45e-88ffc15f53ff"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:21:45.492412 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.492384    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" (UID: "9cf6bd77-fe36-46d8-a45e-88ffc15f53ff"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:21:45.494092 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.494068    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" (UID: "9cf6bd77-fe36-46d8-a45e-88ffc15f53ff"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:21:45.494184 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.494106    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-kube-api-access-6h7nv" (OuterVolumeSpecName: "kube-api-access-6h7nv") pod "9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" (UID: "9cf6bd77-fe36-46d8-a45e-88ffc15f53ff"). InnerVolumeSpecName "kube-api-access-6h7nv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 10:21:45.593022 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.592992    2577 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-cabundle-cert\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:21:45.593022 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.593019    2577 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-kube-rbac-proxy-sar-config\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:21:45.593022 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.593029    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-proxy-tls\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:21:45.593253 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.593038    2577 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-kserve-provision-location\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:21:45.593253 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.593048    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6h7nv\" (UniqueName: \"kubernetes.io/projected/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff-kube-api-access-6h7nv\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:21:45.708005 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.707963    2577 generic.go:356] "Generic (PLEG): container finished" podID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerID="bb26f62c289bc74945bfe63a77d93929b1a818abdc925a01221c9d8dc0f5557e" exitCode=0
Jul 28 10:21:45.708164 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.708032    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"
Jul 28 10:21:45.708164 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.708043    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" event={"ID":"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff","Type":"ContainerDied","Data":"bb26f62c289bc74945bfe63a77d93929b1a818abdc925a01221c9d8dc0f5557e"}
Jul 28 10:21:45.708164 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.708107    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb" event={"ID":"9cf6bd77-fe36-46d8-a45e-88ffc15f53ff","Type":"ContainerDied","Data":"f997a6e3eb221550ad15829f7ef491f456dbe231958579601a2d076cd182693e"}
Jul 28 10:21:45.708164 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.708133    2577 scope.go:117] "RemoveContainer" containerID="0f0f6c1b4fbb1149c55057626a5d5087fc95ca918ba16731e14ba0bf30596449"
Jul 28 10:21:45.717270 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.717252    2577 scope.go:117] "RemoveContainer" containerID="bb26f62c289bc74945bfe63a77d93929b1a818abdc925a01221c9d8dc0f5557e"
Jul 28 10:21:45.725167 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.725151    2577 scope.go:117] "RemoveContainer" containerID="b0b2cbe28f83dddfc0948a18f829189bc7bb687e3a18b0dc1b43b5480e05262b"
Jul 28 10:21:45.730628 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.730608    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"]
Jul 28 10:21:45.733297 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.733271    2577 scope.go:117] "RemoveContainer" containerID="0f0f6c1b4fbb1149c55057626a5d5087fc95ca918ba16731e14ba0bf30596449"
Jul 28 10:21:45.733659 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:21:45.733638    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f0f6c1b4fbb1149c55057626a5d5087fc95ca918ba16731e14ba0bf30596449\": container with ID starting with 0f0f6c1b4fbb1149c55057626a5d5087fc95ca918ba16731e14ba0bf30596449 not found: ID does not exist" containerID="0f0f6c1b4fbb1149c55057626a5d5087fc95ca918ba16731e14ba0bf30596449"
Jul 28 10:21:45.733736 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.733668    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f0f6c1b4fbb1149c55057626a5d5087fc95ca918ba16731e14ba0bf30596449"} err="failed to get container status \"0f0f6c1b4fbb1149c55057626a5d5087fc95ca918ba16731e14ba0bf30596449\": rpc error: code = NotFound desc = could not find container \"0f0f6c1b4fbb1149c55057626a5d5087fc95ca918ba16731e14ba0bf30596449\": container with ID starting with 0f0f6c1b4fbb1149c55057626a5d5087fc95ca918ba16731e14ba0bf30596449 not found: ID does not exist"
Jul 28 10:21:45.733736 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.733692    2577 scope.go:117] "RemoveContainer" containerID="bb26f62c289bc74945bfe63a77d93929b1a818abdc925a01221c9d8dc0f5557e"
Jul 28 10:21:45.734103 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:21:45.734064    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb26f62c289bc74945bfe63a77d93929b1a818abdc925a01221c9d8dc0f5557e\": container with ID starting with bb26f62c289bc74945bfe63a77d93929b1a818abdc925a01221c9d8dc0f5557e not found: ID does not exist" containerID="bb26f62c289bc74945bfe63a77d93929b1a818abdc925a01221c9d8dc0f5557e"
Jul 28 10:21:45.734212 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.734097    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb26f62c289bc74945bfe63a77d93929b1a818abdc925a01221c9d8dc0f5557e"} err="failed to get container status \"bb26f62c289bc74945bfe63a77d93929b1a818abdc925a01221c9d8dc0f5557e\": rpc error: code = NotFound desc = could not find container \"bb26f62c289bc74945bfe63a77d93929b1a818abdc925a01221c9d8dc0f5557e\": container with ID starting with bb26f62c289bc74945bfe63a77d93929b1a818abdc925a01221c9d8dc0f5557e not found: ID does not exist"
Jul 28 10:21:45.734212 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.734119    2577 scope.go:117] "RemoveContainer" containerID="b0b2cbe28f83dddfc0948a18f829189bc7bb687e3a18b0dc1b43b5480e05262b"
Jul 28 10:21:45.734412 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:21:45.734395    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0b2cbe28f83dddfc0948a18f829189bc7bb687e3a18b0dc1b43b5480e05262b\": container with ID starting with b0b2cbe28f83dddfc0948a18f829189bc7bb687e3a18b0dc1b43b5480e05262b not found: ID does not exist" containerID="b0b2cbe28f83dddfc0948a18f829189bc7bb687e3a18b0dc1b43b5480e05262b"
Jul 28 10:21:45.734467 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.734420    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0b2cbe28f83dddfc0948a18f829189bc7bb687e3a18b0dc1b43b5480e05262b"} err="failed to get container status \"b0b2cbe28f83dddfc0948a18f829189bc7bb687e3a18b0dc1b43b5480e05262b\": rpc error: code = NotFound desc = could not find container \"b0b2cbe28f83dddfc0948a18f829189bc7bb687e3a18b0dc1b43b5480e05262b\": container with ID starting with b0b2cbe28f83dddfc0948a18f829189bc7bb687e3a18b0dc1b43b5480e05262b not found: ID does not exist"
Jul 28 10:21:45.735366 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:45.735351    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-5bcddb87c8-46rgb"]
Jul 28 10:21:47.045303 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:47.045269    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" path="/var/lib/kubelet/pods/9cf6bd77-fe36-46d8-a45e-88ffc15f53ff/volumes"
Jul 28 10:21:47.641212 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:47.641173    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv" podUID="6e8e8838-a79f-43e0-b034-beaba3d794e3" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:21:50.505718 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:50.505675    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh"]
Jul 28 10:21:50.506109 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:50.506042    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerName="kserve-container"
Jul 28 10:21:50.506109 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:50.506055    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerName="kserve-container"
Jul 28 10:21:50.506109 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:50.506068    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerName="kube-rbac-proxy"
Jul 28 10:21:50.506109 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:50.506073    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerName="kube-rbac-proxy"
Jul 28 10:21:50.506109 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:50.506081    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerName="storage-initializer"
Jul 28 10:21:50.506109 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:50.506086    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerName="storage-initializer"
Jul 28 10:21:50.506295 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:50.506155    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerName="kserve-container"
Jul 28 10:21:50.506295 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:50.506165    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cf6bd77-fe36-46d8-a45e-88ffc15f53ff" containerName="kube-rbac-proxy"
Jul 28 10:21:50.510866 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:50.510832    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh"
Jul 28 10:21:50.513066 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:50.513039    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-e92a5-serving-cert\""
Jul 28 10:21:50.513198 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:50.513108    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-e92a5-kube-rbac-proxy-sar-config\""
Jul 28 10:21:50.517565 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:50.517540    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh"]
Jul 28 10:21:50.636109 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:50.636072    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2-proxy-tls\") pod \"switch-graph-e92a5-6d7f7969cc-8q5zh\" (UID: \"a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2\") " pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh"
Jul 28 10:21:50.636289 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:50.636149    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2-openshift-service-ca-bundle\") pod \"switch-graph-e92a5-6d7f7969cc-8q5zh\" (UID: \"a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2\") " pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh"
Jul 28 10:21:50.737294 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:50.737267    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2-openshift-service-ca-bundle\") pod \"switch-graph-e92a5-6d7f7969cc-8q5zh\" (UID: \"a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2\") " pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh"
Jul 28 10:21:50.737505 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:50.737359    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2-proxy-tls\") pod \"switch-graph-e92a5-6d7f7969cc-8q5zh\" (UID: \"a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2\") " pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh"
Jul 28 10:21:50.737505 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:21:50.737500    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-e92a5-serving-cert: secret "switch-graph-e92a5-serving-cert" not found
Jul 28 10:21:50.737632 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:21:50.737573    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2-proxy-tls podName:a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2 nodeName:}" failed. No retries permitted until 2026-07-28 10:21:51.237550114 +0000 UTC m=+844.639788489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2-proxy-tls") pod "switch-graph-e92a5-6d7f7969cc-8q5zh" (UID: "a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2") : secret "switch-graph-e92a5-serving-cert" not found
Jul 28 10:21:50.737957 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:50.737933    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2-openshift-service-ca-bundle\") pod \"switch-graph-e92a5-6d7f7969cc-8q5zh\" (UID: \"a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2\") " pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh"
Jul 28 10:21:51.242070 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:51.242031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2-proxy-tls\") pod \"switch-graph-e92a5-6d7f7969cc-8q5zh\" (UID: \"a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2\") " pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh"
Jul 28 10:21:51.244659 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:51.244641    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2-proxy-tls\") pod \"switch-graph-e92a5-6d7f7969cc-8q5zh\" (UID: \"a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2\") " pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh"
Jul 28 10:21:51.421738 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:51.421702    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh"
Jul 28 10:21:51.553681 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:51.553646    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh"]
Jul 28 10:21:51.556794 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:21:51.556767    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8b66e0e_90c6_4d4f_83ba_d7f49ea327d2.slice/crio-bd784999c2e9c5131aab219397365569eaf0edf6b3cac6e5149a3b16fa04b716 WatchSource:0}: Error finding container bd784999c2e9c5131aab219397365569eaf0edf6b3cac6e5149a3b16fa04b716: Status 404 returned error can't find the container with id bd784999c2e9c5131aab219397365569eaf0edf6b3cac6e5149a3b16fa04b716
Jul 28 10:21:51.739393 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:51.739357    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh" event={"ID":"a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2","Type":"ContainerStarted","Data":"7ef8bd4f661b95f934d36ef019ec4903948cd8bddfc4d87939d3e0006fc26f71"}
Jul 28 10:21:51.739578 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:51.739418    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh" event={"ID":"a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2","Type":"ContainerStarted","Data":"bd784999c2e9c5131aab219397365569eaf0edf6b3cac6e5149a3b16fa04b716"}
Jul 28 10:21:51.739578 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:51.739464    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh"
Jul 28 10:21:51.757714 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:51.757618    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh" podStartSLOduration=1.757603129 podStartE2EDuration="1.757603129s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:21:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:21:51.756007878 +0000 UTC m=+845.158246276" watchObservedRunningTime="2026-07-28 10:21:51.757603129 +0000 UTC m=+845.159841527"
Jul 28 10:21:52.641658 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:52.641624    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv" podUID="6e8e8838-a79f-43e0-b034-beaba3d794e3" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:21:52.642060 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:52.641724    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv"
Jul 28 10:21:57.641610 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:57.641571    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv" podUID="6e8e8838-a79f-43e0-b034-beaba3d794e3" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:21:57.750715 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:21:57.750686    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh"
Jul 28 10:22:02.642120 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:02.642081    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv" podUID="6e8e8838-a79f-43e0-b034-beaba3d794e3" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:22:07.642175 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:07.642139    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv" podUID="6e8e8838-a79f-43e0-b034-beaba3d794e3" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:22:10.411350 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:10.411326    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv"
Jul 28 10:22:10.509391 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:10.509359    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e8e8838-a79f-43e0-b034-beaba3d794e3-openshift-service-ca-bundle\") pod \"6e8e8838-a79f-43e0-b034-beaba3d794e3\" (UID: \"6e8e8838-a79f-43e0-b034-beaba3d794e3\") "
Jul 28 10:22:10.509555 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:10.509432    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6e8e8838-a79f-43e0-b034-beaba3d794e3-proxy-tls\") pod \"6e8e8838-a79f-43e0-b034-beaba3d794e3\" (UID: \"6e8e8838-a79f-43e0-b034-beaba3d794e3\") "
Jul 28 10:22:10.509714 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:10.509690    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e8e8838-a79f-43e0-b034-beaba3d794e3-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "6e8e8838-a79f-43e0-b034-beaba3d794e3" (UID: "6e8e8838-a79f-43e0-b034-beaba3d794e3"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:22:10.511576 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:10.511552    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e8e8838-a79f-43e0-b034-beaba3d794e3-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "6e8e8838-a79f-43e0-b034-beaba3d794e3" (UID: "6e8e8838-a79f-43e0-b034-beaba3d794e3"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:22:10.610863 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:10.610803    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6e8e8838-a79f-43e0-b034-beaba3d794e3-proxy-tls\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:22:10.610863 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:10.610834    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6e8e8838-a79f-43e0-b034-beaba3d794e3-openshift-service-ca-bundle\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:22:10.824599 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:10.824514    2577 generic.go:356] "Generic (PLEG): container finished" podID="6e8e8838-a79f-43e0-b034-beaba3d794e3" containerID="1db423e5e72f9581f72f8efb2fd0580b5fc97b2b3b23d61f294f9b50a9d36062" exitCode=0
Jul 28 10:22:10.824599 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:10.824555    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv"
Jul 28 10:22:10.824599 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:10.824570    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv" event={"ID":"6e8e8838-a79f-43e0-b034-beaba3d794e3","Type":"ContainerDied","Data":"1db423e5e72f9581f72f8efb2fd0580b5fc97b2b3b23d61f294f9b50a9d36062"}
Jul 28 10:22:10.824808 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:10.824626    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv" event={"ID":"6e8e8838-a79f-43e0-b034-beaba3d794e3","Type":"ContainerDied","Data":"bbde9c444ab0d2fece6a881503c5a1d412e5d038dba4a1f78c35280047cdf01d"}
Jul 28 10:22:10.824808 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:10.824651    2577 scope.go:117] "RemoveContainer" containerID="1db423e5e72f9581f72f8efb2fd0580b5fc97b2b3b23d61f294f9b50a9d36062"
Jul 28 10:22:10.833611 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:10.833592    2577 scope.go:117] "RemoveContainer" containerID="1db423e5e72f9581f72f8efb2fd0580b5fc97b2b3b23d61f294f9b50a9d36062"
Jul 28 10:22:10.833899 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:22:10.833875    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1db423e5e72f9581f72f8efb2fd0580b5fc97b2b3b23d61f294f9b50a9d36062\": container with ID starting with 1db423e5e72f9581f72f8efb2fd0580b5fc97b2b3b23d61f294f9b50a9d36062 not found: ID does not exist" containerID="1db423e5e72f9581f72f8efb2fd0580b5fc97b2b3b23d61f294f9b50a9d36062"
Jul 28 10:22:10.834017 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:10.833904    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1db423e5e72f9581f72f8efb2fd0580b5fc97b2b3b23d61f294f9b50a9d36062"} err="failed to get container status \"1db423e5e72f9581f72f8efb2fd0580b5fc97b2b3b23d61f294f9b50a9d36062\": rpc error: code = NotFound desc = could not find container \"1db423e5e72f9581f72f8efb2fd0580b5fc97b2b3b23d61f294f9b50a9d36062\": container with ID starting with 1db423e5e72f9581f72f8efb2fd0580b5fc97b2b3b23d61f294f9b50a9d36062 not found: ID does not exist"
Jul 28 10:22:10.847245 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:10.847219    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv"]
Jul 28 10:22:10.851561 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:10.851538    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-5595dc65c9-w4vhv"]
Jul 28 10:22:11.044858 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:11.044819    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e8e8838-a79f-43e0-b034-beaba3d794e3" path="/var/lib/kubelet/pods/6e8e8838-a79f-43e0-b034-beaba3d794e3/volumes"
Jul 28 10:22:40.469084 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:40.469004    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps"]
Jul 28 10:22:40.469739 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:40.469716    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e8e8838-a79f-43e0-b034-beaba3d794e3" containerName="model-chainer"
Jul 28 10:22:40.469739 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:40.469738    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e8e8838-a79f-43e0-b034-beaba3d794e3" containerName="model-chainer"
Jul 28 10:22:40.469940 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:40.469863    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e8e8838-a79f-43e0-b034-beaba3d794e3" containerName="model-chainer"
Jul 28 10:22:40.472971 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:40.472951    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps"
Jul 28 10:22:40.475319 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:40.475296    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-0b9d4-kube-rbac-proxy-sar-config\""
Jul 28 10:22:40.475422 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:40.475319    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-0b9d4-serving-cert\""
Jul 28 10:22:40.480469 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:40.480445    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps"]
Jul 28 10:22:40.570211 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:40.570184    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6c7d158e-7c07-49af-97b1-121a8e688748-proxy-tls\") pod \"sequence-graph-0b9d4-7db5cc7799-hgsps\" (UID: \"6c7d158e-7c07-49af-97b1-121a8e688748\") " pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps"
Jul 28 10:22:40.570360 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:40.570233    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c7d158e-7c07-49af-97b1-121a8e688748-openshift-service-ca-bundle\") pod \"sequence-graph-0b9d4-7db5cc7799-hgsps\" (UID: \"6c7d158e-7c07-49af-97b1-121a8e688748\") " pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps"
Jul 28 10:22:40.671545 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:40.671508    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6c7d158e-7c07-49af-97b1-121a8e688748-proxy-tls\") pod \"sequence-graph-0b9d4-7db5cc7799-hgsps\" (UID: \"6c7d158e-7c07-49af-97b1-121a8e688748\") " pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps"
Jul 28 10:22:40.671733 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:40.671568    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c7d158e-7c07-49af-97b1-121a8e688748-openshift-service-ca-bundle\") pod \"sequence-graph-0b9d4-7db5cc7799-hgsps\" (UID: \"6c7d158e-7c07-49af-97b1-121a8e688748\") " pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps"
Jul 28 10:22:40.671733 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:22:40.671656    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-0b9d4-serving-cert: secret "sequence-graph-0b9d4-serving-cert" not found
Jul 28 10:22:40.671733 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:22:40.671721    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c7d158e-7c07-49af-97b1-121a8e688748-proxy-tls podName:6c7d158e-7c07-49af-97b1-121a8e688748 nodeName:}" failed. No retries permitted until 2026-07-28 10:22:41.171704985 +0000 UTC m=+894.573943364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/6c7d158e-7c07-49af-97b1-121a8e688748-proxy-tls") pod "sequence-graph-0b9d4-7db5cc7799-hgsps" (UID: "6c7d158e-7c07-49af-97b1-121a8e688748") : secret "sequence-graph-0b9d4-serving-cert" not found
Jul 28 10:22:40.672187 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:40.672168    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c7d158e-7c07-49af-97b1-121a8e688748-openshift-service-ca-bundle\") pod \"sequence-graph-0b9d4-7db5cc7799-hgsps\" (UID: \"6c7d158e-7c07-49af-97b1-121a8e688748\") " pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps"
Jul 28 10:22:41.176149 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:41.176119    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6c7d158e-7c07-49af-97b1-121a8e688748-proxy-tls\") pod \"sequence-graph-0b9d4-7db5cc7799-hgsps\" (UID: \"6c7d158e-7c07-49af-97b1-121a8e688748\") " pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps"
Jul 28 10:22:41.178663 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:41.178645    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6c7d158e-7c07-49af-97b1-121a8e688748-proxy-tls\") pod \"sequence-graph-0b9d4-7db5cc7799-hgsps\" (UID: \"6c7d158e-7c07-49af-97b1-121a8e688748\") " pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps"
Jul 28 10:22:41.400018 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:41.399987    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps"
Jul 28 10:22:41.531961 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:41.531933    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps"]
Jul 28 10:22:41.534191 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:22:41.534153    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c7d158e_7c07_49af_97b1_121a8e688748.slice/crio-973effe36d2051351cf3030c2d1b5182ea75f63db18d644d3e75a3a95faf7b99 WatchSource:0}: Error finding container 973effe36d2051351cf3030c2d1b5182ea75f63db18d644d3e75a3a95faf7b99: Status 404 returned error can't find the container with id 973effe36d2051351cf3030c2d1b5182ea75f63db18d644d3e75a3a95faf7b99
Jul 28 10:22:41.964369 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:41.964333    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps" event={"ID":"6c7d158e-7c07-49af-97b1-121a8e688748","Type":"ContainerStarted","Data":"b1bd7aee221160a06dcd18c32af19ecbad8ed3124588d91af3c64dd5b8979101"}
Jul 28 10:22:41.964545 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:41.964389    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps" event={"ID":"6c7d158e-7c07-49af-97b1-121a8e688748","Type":"ContainerStarted","Data":"973effe36d2051351cf3030c2d1b5182ea75f63db18d644d3e75a3a95faf7b99"}
Jul 28 10:22:41.964545 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:41.964419    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps"
Jul 28 10:22:41.986116 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:41.980811    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps" podStartSLOduration=1.980770199 podStartE2EDuration="1.980770199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:22:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:22:41.979988469 +0000 UTC m=+895.382226868" watchObservedRunningTime="2026-07-28 10:22:41.980770199 +0000 UTC m=+895.383008598"
Jul 28 10:22:47.975181 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:22:47.975149    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps"
Jul 28 10:30:05.139961 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:05.139926    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh"]
Jul 28 10:30:05.142336 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:05.140109    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh" podUID="a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2" containerName="switch-graph-e92a5" containerID="cri-o://7ef8bd4f661b95f934d36ef019ec4903948cd8bddfc4d87939d3e0006fc26f71" gracePeriod=30
Jul 28 10:30:07.749093 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:07.749054    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh" podUID="a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2" containerName="switch-graph-e92a5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:30:12.748705 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:12.748667    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh" podUID="a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2" containerName="switch-graph-e92a5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:30:17.749386 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:17.749335    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh" podUID="a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2" containerName="switch-graph-e92a5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:30:17.749785 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:17.749446    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh"
Jul 28 10:30:22.749571 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:22.749534    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh" podUID="a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2" containerName="switch-graph-e92a5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:30:27.748641 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:27.748605    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh" podUID="a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2" containerName="switch-graph-e92a5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:30:32.749594 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:32.749558    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh" podUID="a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2" containerName="switch-graph-e92a5" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:30:35.338770 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:35.338744    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh"
Jul 28 10:30:35.412182 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:35.412100    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2-openshift-service-ca-bundle\") pod \"a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2\" (UID: \"a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2\") "
Jul 28 10:30:35.412182 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:35.412152    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2-proxy-tls\") pod \"a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2\" (UID: \"a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2\") "
Jul 28 10:30:35.412468 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:35.412442    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2" (UID: "a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:30:35.414427 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:35.414403    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2" (UID: "a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:30:35.513148 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:35.513113    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2-openshift-service-ca-bundle\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:30:35.513148 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:35.513142    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2-proxy-tls\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:30:36.082484 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:36.082451    2577 generic.go:356] "Generic (PLEG): container finished" podID="a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2" containerID="7ef8bd4f661b95f934d36ef019ec4903948cd8bddfc4d87939d3e0006fc26f71" exitCode=0
Jul 28 10:30:36.082720 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:36.082495    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh"
Jul 28 10:30:36.082720 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:36.082538    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh" event={"ID":"a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2","Type":"ContainerDied","Data":"7ef8bd4f661b95f934d36ef019ec4903948cd8bddfc4d87939d3e0006fc26f71"}
Jul 28 10:30:36.082720 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:36.082586    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh" event={"ID":"a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2","Type":"ContainerDied","Data":"bd784999c2e9c5131aab219397365569eaf0edf6b3cac6e5149a3b16fa04b716"}
Jul 28 10:30:36.082720 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:36.082612    2577 scope.go:117] "RemoveContainer" containerID="7ef8bd4f661b95f934d36ef019ec4903948cd8bddfc4d87939d3e0006fc26f71"
Jul 28 10:30:36.091308 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:36.091289    2577 scope.go:117] "RemoveContainer" containerID="7ef8bd4f661b95f934d36ef019ec4903948cd8bddfc4d87939d3e0006fc26f71"
Jul 28 10:30:36.091541 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:30:36.091523    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ef8bd4f661b95f934d36ef019ec4903948cd8bddfc4d87939d3e0006fc26f71\": container with ID starting with 7ef8bd4f661b95f934d36ef019ec4903948cd8bddfc4d87939d3e0006fc26f71 not found: ID does not exist" containerID="7ef8bd4f661b95f934d36ef019ec4903948cd8bddfc4d87939d3e0006fc26f71"
Jul 28 10:30:36.091601 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:36.091554    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ef8bd4f661b95f934d36ef019ec4903948cd8bddfc4d87939d3e0006fc26f71"} err="failed to get container status \"7ef8bd4f661b95f934d36ef019ec4903948cd8bddfc4d87939d3e0006fc26f71\": rpc error: code = NotFound desc = could not find container \"7ef8bd4f661b95f934d36ef019ec4903948cd8bddfc4d87939d3e0006fc26f71\": container with ID starting with 7ef8bd4f661b95f934d36ef019ec4903948cd8bddfc4d87939d3e0006fc26f71 not found: ID does not exist"
Jul 28 10:30:36.104367 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:36.104347    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh"]
Jul 28 10:30:36.110752 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:36.110733    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-e92a5-6d7f7969cc-8q5zh"]
Jul 28 10:30:37.045547 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:37.045509    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2" path="/var/lib/kubelet/pods/a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2/volumes"
Jul 28 10:30:55.003632 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:55.003596    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps"]
Jul 28 10:30:55.004054 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:55.003830    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps" podUID="6c7d158e-7c07-49af-97b1-121a8e688748" containerName="sequence-graph-0b9d4" containerID="cri-o://b1bd7aee221160a06dcd18c32af19ecbad8ed3124588d91af3c64dd5b8979101" gracePeriod=30
Jul 28 10:30:57.973630 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:30:57.973586    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps" podUID="6c7d158e-7c07-49af-97b1-121a8e688748" containerName="sequence-graph-0b9d4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:31:02.973941 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:02.973895    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps" podUID="6c7d158e-7c07-49af-97b1-121a8e688748" containerName="sequence-graph-0b9d4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:31:05.388954 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:05.386921    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc"]
Jul 28 10:31:05.388954 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:05.387754    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2" containerName="switch-graph-e92a5"
Jul 28 10:31:05.388954 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:05.387777    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2" containerName="switch-graph-e92a5"
Jul 28 10:31:05.388954 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:05.387998    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8b66e0e-90c6-4d4f-83ba-d7f49ea327d2" containerName="switch-graph-e92a5"
Jul 28 10:31:05.393661 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:05.393630    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc"
Jul 28 10:31:05.396276 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:05.396227    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-af89d-kube-rbac-proxy-sar-config\""
Jul 28 10:31:05.397207 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:05.397181    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-af89d-serving-cert\""
Jul 28 10:31:05.398600 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:05.398574    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc"]
Jul 28 10:31:05.473133 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:05.473099    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451-openshift-service-ca-bundle\") pod \"ensemble-graph-af89d-db7874558-kldsc\" (UID: \"e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451\") " pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc"
Jul 28 10:31:05.473283 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:05.473172    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451-proxy-tls\") pod \"ensemble-graph-af89d-db7874558-kldsc\" (UID: \"e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451\") " pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc"
Jul 28 10:31:05.573852 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:05.573800    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451-openshift-service-ca-bundle\") pod \"ensemble-graph-af89d-db7874558-kldsc\" (UID: \"e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451\") " pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc"
Jul 28 10:31:05.574020 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:05.573892    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451-proxy-tls\") pod \"ensemble-graph-af89d-db7874558-kldsc\" (UID: \"e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451\") " pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc"
Jul 28 10:31:05.574491 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:05.574472    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451-openshift-service-ca-bundle\") pod \"ensemble-graph-af89d-db7874558-kldsc\" (UID: \"e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451\") " pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc"
Jul 28 10:31:05.576436 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:05.576414    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451-proxy-tls\") pod \"ensemble-graph-af89d-db7874558-kldsc\" (UID: \"e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451\") " pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc"
Jul 28 10:31:05.706410 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:05.706323    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc"
Jul 28 10:31:05.838107 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:05.838071    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc"]
Jul 28 10:31:05.840302 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:31:05.840280    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d9dc0a_bc22_4fe6_b7c6_79a291a7b451.slice/crio-706764cc621cc0aced700303b1cc8cdd9316f29cd9ac16e1d15b733393d77406 WatchSource:0}: Error finding container 706764cc621cc0aced700303b1cc8cdd9316f29cd9ac16e1d15b733393d77406: Status 404 returned error can't find the container with id 706764cc621cc0aced700303b1cc8cdd9316f29cd9ac16e1d15b733393d77406
Jul 28 10:31:06.218805 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:06.218768    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc" event={"ID":"e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451","Type":"ContainerStarted","Data":"a0fe9431221d5e56e87cbef085a047931eaadd06233c4496b8502be03509a619"}
Jul 28 10:31:06.218997 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:06.218822    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc" event={"ID":"e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451","Type":"ContainerStarted","Data":"706764cc621cc0aced700303b1cc8cdd9316f29cd9ac16e1d15b733393d77406"}
Jul 28 10:31:06.218997 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:06.218868    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc"
Jul 28 10:31:06.236237 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:06.236178    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc" podStartSLOduration=1.236164373 podStartE2EDuration="1.236164373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:31:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:31:06.234827351 +0000 UTC m=+1399.637065752" watchObservedRunningTime="2026-07-28 10:31:06.236164373 +0000 UTC m=+1399.638402771"
Jul 28 10:31:07.973325 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:07.973282    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps" podUID="6c7d158e-7c07-49af-97b1-121a8e688748" containerName="sequence-graph-0b9d4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:31:07.973773 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:07.973379    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps"
Jul 28 10:31:12.229293 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:12.229262    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc"
Jul 28 10:31:12.973621 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:12.973579    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps" podUID="6c7d158e-7c07-49af-97b1-121a8e688748" containerName="sequence-graph-0b9d4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:31:15.452776 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:15.452689    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc"]
Jul 28 10:31:15.453207 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:15.452895    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc" podUID="e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451" containerName="ensemble-graph-af89d" containerID="cri-o://a0fe9431221d5e56e87cbef085a047931eaadd06233c4496b8502be03509a619" gracePeriod=30
Jul 28 10:31:17.227640 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:17.227603    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc" podUID="e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451" containerName="ensemble-graph-af89d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:31:17.973330 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:17.973290    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps" podUID="6c7d158e-7c07-49af-97b1-121a8e688748" containerName="sequence-graph-0b9d4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:31:22.227325 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:22.227287    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc" podUID="e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451" containerName="ensemble-graph-af89d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:31:22.973715 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:22.973669    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps" podUID="6c7d158e-7c07-49af-97b1-121a8e688748" containerName="sequence-graph-0b9d4" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:31:25.157206 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:25.157183    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps"
Jul 28 10:31:25.239382 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:25.239353    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c7d158e-7c07-49af-97b1-121a8e688748-openshift-service-ca-bundle\") pod \"6c7d158e-7c07-49af-97b1-121a8e688748\" (UID: \"6c7d158e-7c07-49af-97b1-121a8e688748\") "
Jul 28 10:31:25.239543 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:25.239419    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6c7d158e-7c07-49af-97b1-121a8e688748-proxy-tls\") pod \"6c7d158e-7c07-49af-97b1-121a8e688748\" (UID: \"6c7d158e-7c07-49af-97b1-121a8e688748\") "
Jul 28 10:31:25.239745 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:25.239723    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c7d158e-7c07-49af-97b1-121a8e688748-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "6c7d158e-7c07-49af-97b1-121a8e688748" (UID: "6c7d158e-7c07-49af-97b1-121a8e688748"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:31:25.241567 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:25.241548    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c7d158e-7c07-49af-97b1-121a8e688748-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "6c7d158e-7c07-49af-97b1-121a8e688748" (UID: "6c7d158e-7c07-49af-97b1-121a8e688748"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:31:25.303791 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:25.303712    2577 generic.go:356] "Generic (PLEG): container finished" podID="6c7d158e-7c07-49af-97b1-121a8e688748" containerID="b1bd7aee221160a06dcd18c32af19ecbad8ed3124588d91af3c64dd5b8979101" exitCode=0
Jul 28 10:31:25.303791 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:25.303760    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps"
Jul 28 10:31:25.303791 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:25.303782    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps" event={"ID":"6c7d158e-7c07-49af-97b1-121a8e688748","Type":"ContainerDied","Data":"b1bd7aee221160a06dcd18c32af19ecbad8ed3124588d91af3c64dd5b8979101"}
Jul 28 10:31:25.303997 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:25.303834    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps" event={"ID":"6c7d158e-7c07-49af-97b1-121a8e688748","Type":"ContainerDied","Data":"973effe36d2051351cf3030c2d1b5182ea75f63db18d644d3e75a3a95faf7b99"}
Jul 28 10:31:25.303997 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:25.303894    2577 scope.go:117] "RemoveContainer" containerID="b1bd7aee221160a06dcd18c32af19ecbad8ed3124588d91af3c64dd5b8979101"
Jul 28 10:31:25.312522 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:25.312507    2577 scope.go:117] "RemoveContainer" containerID="b1bd7aee221160a06dcd18c32af19ecbad8ed3124588d91af3c64dd5b8979101"
Jul 28 10:31:25.312813 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:31:25.312793    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1bd7aee221160a06dcd18c32af19ecbad8ed3124588d91af3c64dd5b8979101\": container with ID starting with b1bd7aee221160a06dcd18c32af19ecbad8ed3124588d91af3c64dd5b8979101 not found: ID does not exist" containerID="b1bd7aee221160a06dcd18c32af19ecbad8ed3124588d91af3c64dd5b8979101"
Jul 28 10:31:25.312944 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:25.312818    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1bd7aee221160a06dcd18c32af19ecbad8ed3124588d91af3c64dd5b8979101"} err="failed to get container status \"b1bd7aee221160a06dcd18c32af19ecbad8ed3124588d91af3c64dd5b8979101\": rpc error: code = NotFound desc = could not find container \"b1bd7aee221160a06dcd18c32af19ecbad8ed3124588d91af3c64dd5b8979101\": container with ID starting with b1bd7aee221160a06dcd18c32af19ecbad8ed3124588d91af3c64dd5b8979101 not found: ID does not exist"
Jul 28 10:31:25.326199 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:25.326179    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps"]
Jul 28 10:31:25.330804 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:25.330777    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-0b9d4-7db5cc7799-hgsps"]
Jul 28 10:31:25.340503 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:25.340478    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6c7d158e-7c07-49af-97b1-121a8e688748-openshift-service-ca-bundle\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:31:25.340572 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:25.340503    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6c7d158e-7c07-49af-97b1-121a8e688748-proxy-tls\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:31:27.045087 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:27.045055    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c7d158e-7c07-49af-97b1-121a8e688748" path="/var/lib/kubelet/pods/6c7d158e-7c07-49af-97b1-121a8e688748/volumes"
Jul 28 10:31:27.228232 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:27.228193    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc" podUID="e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451" containerName="ensemble-graph-af89d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:31:27.228430 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:27.228309    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc"
Jul 28 10:31:32.227515 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:32.227480    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc" podUID="e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451" containerName="ensemble-graph-af89d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:31:37.227762 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:37.227721    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc" podUID="e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451" containerName="ensemble-graph-af89d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:31:42.228173 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:42.228090    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc" podUID="e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451" containerName="ensemble-graph-af89d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:31:45.631357 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:45.631334    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc"
Jul 28 10:31:45.704222 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:45.704189    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451-openshift-service-ca-bundle\") pod \"e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451\" (UID: \"e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451\") "
Jul 28 10:31:45.704423 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:45.704283    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451-proxy-tls\") pod \"e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451\" (UID: \"e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451\") "
Jul 28 10:31:45.704630 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:45.704603    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451" (UID: "e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:31:45.706458 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:45.706436    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451" (UID: "e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:31:45.805114 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:45.805077    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451-openshift-service-ca-bundle\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:31:45.805114 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:45.805109    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451-proxy-tls\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:31:46.401098 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:46.401065    2577 generic.go:356] "Generic (PLEG): container finished" podID="e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451" containerID="a0fe9431221d5e56e87cbef085a047931eaadd06233c4496b8502be03509a619" exitCode=0
Jul 28 10:31:46.401279 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:46.401142    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc"
Jul 28 10:31:46.401279 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:46.401141    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc" event={"ID":"e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451","Type":"ContainerDied","Data":"a0fe9431221d5e56e87cbef085a047931eaadd06233c4496b8502be03509a619"}
Jul 28 10:31:46.401279 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:46.401255    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc" event={"ID":"e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451","Type":"ContainerDied","Data":"706764cc621cc0aced700303b1cc8cdd9316f29cd9ac16e1d15b733393d77406"}
Jul 28 10:31:46.401279 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:46.401280    2577 scope.go:117] "RemoveContainer" containerID="a0fe9431221d5e56e87cbef085a047931eaadd06233c4496b8502be03509a619"
Jul 28 10:31:46.410406 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:46.410389    2577 scope.go:117] "RemoveContainer" containerID="a0fe9431221d5e56e87cbef085a047931eaadd06233c4496b8502be03509a619"
Jul 28 10:31:46.410677 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:31:46.410660    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0fe9431221d5e56e87cbef085a047931eaadd06233c4496b8502be03509a619\": container with ID starting with a0fe9431221d5e56e87cbef085a047931eaadd06233c4496b8502be03509a619 not found: ID does not exist" containerID="a0fe9431221d5e56e87cbef085a047931eaadd06233c4496b8502be03509a619"
Jul 28 10:31:46.410719 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:46.410688    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0fe9431221d5e56e87cbef085a047931eaadd06233c4496b8502be03509a619"} err="failed to get container status \"a0fe9431221d5e56e87cbef085a047931eaadd06233c4496b8502be03509a619\": rpc error: code = NotFound desc = could not find container \"a0fe9431221d5e56e87cbef085a047931eaadd06233c4496b8502be03509a619\": container with ID starting with a0fe9431221d5e56e87cbef085a047931eaadd06233c4496b8502be03509a619 not found: ID does not exist"
Jul 28 10:31:46.423390 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:46.423365    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc"]
Jul 28 10:31:46.427897 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:46.427876    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-af89d-db7874558-kldsc"]
Jul 28 10:31:47.045276 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:31:47.045240    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451" path="/var/lib/kubelet/pods/e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451/volumes"
Jul 28 10:32:05.211674 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:05.211643    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl"]
Jul 28 10:32:05.212266 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:05.212037    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c7d158e-7c07-49af-97b1-121a8e688748" containerName="sequence-graph-0b9d4"
Jul 28 10:32:05.212266 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:05.212054    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c7d158e-7c07-49af-97b1-121a8e688748" containerName="sequence-graph-0b9d4"
Jul 28 10:32:05.212266 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:05.212076    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451" containerName="ensemble-graph-af89d"
Jul 28 10:32:05.212266 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:05.212084    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451" containerName="ensemble-graph-af89d"
Jul 28 10:32:05.212266 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:05.212166    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c7d158e-7c07-49af-97b1-121a8e688748" containerName="sequence-graph-0b9d4"
Jul 28 10:32:05.212266 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:05.212176    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4d9dc0a-bc22-4fe6-b7c6-79a291a7b451" containerName="ensemble-graph-af89d"
Jul 28 10:32:05.216355 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:05.216334    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl"
Jul 28 10:32:05.218691 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:05.218665    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-222a3-kube-rbac-proxy-sar-config\""
Jul 28 10:32:05.219036 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:05.219002    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 28 10:32:05.219455 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:05.219420    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-222a3-serving-cert\""
Jul 28 10:32:05.219455 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:05.219435    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-lvvzp\""
Jul 28 10:32:05.225502 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:05.225477    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl"]
Jul 28 10:32:05.275204 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:05.275165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d475df7-d3a4-4237-8b78-08843f4ef33b-openshift-service-ca-bundle\") pod \"sequence-graph-222a3-5f5974b4b4-bb4dl\" (UID: \"4d475df7-d3a4-4237-8b78-08843f4ef33b\") " pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl"
Jul 28 10:32:05.275204 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:05.275207    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4d475df7-d3a4-4237-8b78-08843f4ef33b-proxy-tls\") pod \"sequence-graph-222a3-5f5974b4b4-bb4dl\" (UID: \"4d475df7-d3a4-4237-8b78-08843f4ef33b\") " pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl"
Jul 28 10:32:05.376682 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:05.376636    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d475df7-d3a4-4237-8b78-08843f4ef33b-openshift-service-ca-bundle\") pod \"sequence-graph-222a3-5f5974b4b4-bb4dl\" (UID: \"4d475df7-d3a4-4237-8b78-08843f4ef33b\") " pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl"
Jul 28 10:32:05.376682 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:05.376682    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4d475df7-d3a4-4237-8b78-08843f4ef33b-proxy-tls\") pod \"sequence-graph-222a3-5f5974b4b4-bb4dl\" (UID: \"4d475df7-d3a4-4237-8b78-08843f4ef33b\") " pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl"
Jul 28 10:32:05.376993 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:32:05.376825    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-222a3-serving-cert: secret "sequence-graph-222a3-serving-cert" not found
Jul 28 10:32:05.376993 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:32:05.376910    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4d475df7-d3a4-4237-8b78-08843f4ef33b-proxy-tls podName:4d475df7-d3a4-4237-8b78-08843f4ef33b nodeName:}" failed. No retries permitted until 2026-07-28 10:32:05.876894807 +0000 UTC m=+1459.279133184 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/4d475df7-d3a4-4237-8b78-08843f4ef33b-proxy-tls") pod "sequence-graph-222a3-5f5974b4b4-bb4dl" (UID: "4d475df7-d3a4-4237-8b78-08843f4ef33b") : secret "sequence-graph-222a3-serving-cert" not found
Jul 28 10:32:05.377305 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:05.377283    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d475df7-d3a4-4237-8b78-08843f4ef33b-openshift-service-ca-bundle\") pod \"sequence-graph-222a3-5f5974b4b4-bb4dl\" (UID: \"4d475df7-d3a4-4237-8b78-08843f4ef33b\") " pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl"
Jul 28 10:32:05.881428 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:05.881382    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4d475df7-d3a4-4237-8b78-08843f4ef33b-proxy-tls\") pod \"sequence-graph-222a3-5f5974b4b4-bb4dl\" (UID: \"4d475df7-d3a4-4237-8b78-08843f4ef33b\") " pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl"
Jul 28 10:32:05.884043 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:05.884011    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4d475df7-d3a4-4237-8b78-08843f4ef33b-proxy-tls\") pod \"sequence-graph-222a3-5f5974b4b4-bb4dl\" (UID: \"4d475df7-d3a4-4237-8b78-08843f4ef33b\") " pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl"
Jul 28 10:32:06.128005 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:06.127973    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl"
Jul 28 10:32:06.258339 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:06.258315    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl"]
Jul 28 10:32:06.260615 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:32:06.260585    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d475df7_d3a4_4237_8b78_08843f4ef33b.slice/crio-88e229cebd2278d7b0ab04e4edec65ebbcc5de46ab1b18199aefd753cb13c4b1 WatchSource:0}: Error finding container 88e229cebd2278d7b0ab04e4edec65ebbcc5de46ab1b18199aefd753cb13c4b1: Status 404 returned error can't find the container with id 88e229cebd2278d7b0ab04e4edec65ebbcc5de46ab1b18199aefd753cb13c4b1
Jul 28 10:32:06.493728 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:06.493696    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl" event={"ID":"4d475df7-d3a4-4237-8b78-08843f4ef33b","Type":"ContainerStarted","Data":"3e7ebfce7de696913d721330551311945be6243d554364bda7f7418ef7eae74b"}
Jul 28 10:32:06.493940 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:06.493744    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl" event={"ID":"4d475df7-d3a4-4237-8b78-08843f4ef33b","Type":"ContainerStarted","Data":"88e229cebd2278d7b0ab04e4edec65ebbcc5de46ab1b18199aefd753cb13c4b1"}
Jul 28 10:32:06.493940 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:06.493891    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl"
Jul 28 10:32:06.509168 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:06.509095    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl" podStartSLOduration=1.5090765830000001 podStartE2EDuration="1.509076583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:32:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:32:06.508494487 +0000 UTC m=+1459.910732884" watchObservedRunningTime="2026-07-28 10:32:06.509076583 +0000 UTC m=+1459.911314981"
Jul 28 10:32:12.505038 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:12.505007    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl"
Jul 28 10:32:15.336606 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:15.336571    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl"]
Jul 28 10:32:15.337110 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:15.336799    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl" podUID="4d475df7-d3a4-4237-8b78-08843f4ef33b" containerName="sequence-graph-222a3" containerID="cri-o://3e7ebfce7de696913d721330551311945be6243d554364bda7f7418ef7eae74b" gracePeriod=30
Jul 28 10:32:15.689648 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:15.689612    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r"]
Jul 28 10:32:15.693036 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:15.693018    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r"
Jul 28 10:32:15.695310 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:15.695276    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-4e070-kube-rbac-proxy-sar-config\""
Jul 28 10:32:15.695310 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:15.695275    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-4e070-serving-cert\""
Jul 28 10:32:15.702938 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:15.702900    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r"]
Jul 28 10:32:15.764158 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:15.764122    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b7062d-bf7e-449a-8cef-c4a14fffbd99-openshift-service-ca-bundle\") pod \"ensemble-graph-4e070-57b477589f-dnp8r\" (UID: \"f0b7062d-bf7e-449a-8cef-c4a14fffbd99\") " pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r"
Jul 28 10:32:15.764374 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:15.764249    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f0b7062d-bf7e-449a-8cef-c4a14fffbd99-proxy-tls\") pod \"ensemble-graph-4e070-57b477589f-dnp8r\" (UID: \"f0b7062d-bf7e-449a-8cef-c4a14fffbd99\") " pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r"
Jul 28 10:32:15.864787 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:15.864751    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f0b7062d-bf7e-449a-8cef-c4a14fffbd99-proxy-tls\") pod \"ensemble-graph-4e070-57b477589f-dnp8r\" (UID: \"f0b7062d-bf7e-449a-8cef-c4a14fffbd99\") " pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r"
Jul 28 10:32:15.864990 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:15.864802    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b7062d-bf7e-449a-8cef-c4a14fffbd99-openshift-service-ca-bundle\") pod \"ensemble-graph-4e070-57b477589f-dnp8r\" (UID: \"f0b7062d-bf7e-449a-8cef-c4a14fffbd99\") " pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r"
Jul 28 10:32:15.865450 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:15.865430    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b7062d-bf7e-449a-8cef-c4a14fffbd99-openshift-service-ca-bundle\") pod \"ensemble-graph-4e070-57b477589f-dnp8r\" (UID: \"f0b7062d-bf7e-449a-8cef-c4a14fffbd99\") " pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r"
Jul 28 10:32:15.867602 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:15.867578    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f0b7062d-bf7e-449a-8cef-c4a14fffbd99-proxy-tls\") pod \"ensemble-graph-4e070-57b477589f-dnp8r\" (UID: \"f0b7062d-bf7e-449a-8cef-c4a14fffbd99\") " pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r"
Jul 28 10:32:16.007938 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:16.007898    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r"
Jul 28 10:32:16.150095 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:16.149907    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r"]
Jul 28 10:32:16.152677 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:32:16.152653    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0b7062d_bf7e_449a_8cef_c4a14fffbd99.slice/crio-72a968d4d1dab27450962318b4a88d8fb86fbf3f5884833379a964f467ca824f WatchSource:0}: Error finding container 72a968d4d1dab27450962318b4a88d8fb86fbf3f5884833379a964f467ca824f: Status 404 returned error can't find the container with id 72a968d4d1dab27450962318b4a88d8fb86fbf3f5884833379a964f467ca824f
Jul 28 10:32:16.545326 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:16.545293    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r" event={"ID":"f0b7062d-bf7e-449a-8cef-c4a14fffbd99","Type":"ContainerStarted","Data":"4ac7c572dba7cf39d58963a1af8d7efbef0d28c4d5edb1b2d94403bc8c4ed6d9"}
Jul 28 10:32:16.545734 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:16.545453    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r"
Jul 28 10:32:16.545734 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:16.545497    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r" event={"ID":"f0b7062d-bf7e-449a-8cef-c4a14fffbd99","Type":"ContainerStarted","Data":"72a968d4d1dab27450962318b4a88d8fb86fbf3f5884833379a964f467ca824f"}
Jul 28 10:32:16.562262 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:16.562212    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r" podStartSLOduration=1.562195875 podStartE2EDuration="1.562195875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:32:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:32:16.561280498 +0000 UTC m=+1469.963518930" watchObservedRunningTime="2026-07-28 10:32:16.562195875 +0000 UTC m=+1469.964434272"
Jul 28 10:32:17.502220 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:17.502185    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl" podUID="4d475df7-d3a4-4237-8b78-08843f4ef33b" containerName="sequence-graph-222a3" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:32:22.502391 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:22.502350    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl" podUID="4d475df7-d3a4-4237-8b78-08843f4ef33b" containerName="sequence-graph-222a3" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:32:22.556023 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:22.555990    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r"
Jul 28 10:32:27.502148 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:27.502110    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl" podUID="4d475df7-d3a4-4237-8b78-08843f4ef33b" containerName="sequence-graph-222a3" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:32:27.502623 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:27.502207    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl"
Jul 28 10:32:32.502625 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:32.502581    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl" podUID="4d475df7-d3a4-4237-8b78-08843f4ef33b" containerName="sequence-graph-222a3" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:32:37.502630 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:37.502588    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl" podUID="4d475df7-d3a4-4237-8b78-08843f4ef33b" containerName="sequence-graph-222a3" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:32:42.502307 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:42.502270    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl" podUID="4d475df7-d3a4-4237-8b78-08843f4ef33b" containerName="sequence-graph-222a3" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:32:45.496507 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:45.496479    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl"
Jul 28 10:32:45.513479 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:45.513460    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4d475df7-d3a4-4237-8b78-08843f4ef33b-proxy-tls\") pod \"4d475df7-d3a4-4237-8b78-08843f4ef33b\" (UID: \"4d475df7-d3a4-4237-8b78-08843f4ef33b\") "
Jul 28 10:32:45.513606 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:45.513496    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d475df7-d3a4-4237-8b78-08843f4ef33b-openshift-service-ca-bundle\") pod \"4d475df7-d3a4-4237-8b78-08843f4ef33b\" (UID: \"4d475df7-d3a4-4237-8b78-08843f4ef33b\") "
Jul 28 10:32:45.513937 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:45.513914    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d475df7-d3a4-4237-8b78-08843f4ef33b-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "4d475df7-d3a4-4237-8b78-08843f4ef33b" (UID: "4d475df7-d3a4-4237-8b78-08843f4ef33b"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:32:45.516115 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:45.516092    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d475df7-d3a4-4237-8b78-08843f4ef33b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4d475df7-d3a4-4237-8b78-08843f4ef33b" (UID: "4d475df7-d3a4-4237-8b78-08843f4ef33b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:32:45.614618 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:45.614530    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4d475df7-d3a4-4237-8b78-08843f4ef33b-openshift-service-ca-bundle\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:32:45.614618 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:45.614561    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4d475df7-d3a4-4237-8b78-08843f4ef33b-proxy-tls\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:32:45.675748 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:45.675712    2577 generic.go:356] "Generic (PLEG): container finished" podID="4d475df7-d3a4-4237-8b78-08843f4ef33b" containerID="3e7ebfce7de696913d721330551311945be6243d554364bda7f7418ef7eae74b" exitCode=0
Jul 28 10:32:45.675976 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:45.675758    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl"
Jul 28 10:32:45.675976 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:45.675760    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl" event={"ID":"4d475df7-d3a4-4237-8b78-08843f4ef33b","Type":"ContainerDied","Data":"3e7ebfce7de696913d721330551311945be6243d554364bda7f7418ef7eae74b"}
Jul 28 10:32:45.675976 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:45.675900    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl" event={"ID":"4d475df7-d3a4-4237-8b78-08843f4ef33b","Type":"ContainerDied","Data":"88e229cebd2278d7b0ab04e4edec65ebbcc5de46ab1b18199aefd753cb13c4b1"}
Jul 28 10:32:45.675976 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:45.675930    2577 scope.go:117] "RemoveContainer" containerID="3e7ebfce7de696913d721330551311945be6243d554364bda7f7418ef7eae74b"
Jul 28 10:32:45.684869 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:45.684829    2577 scope.go:117] "RemoveContainer" containerID="3e7ebfce7de696913d721330551311945be6243d554364bda7f7418ef7eae74b"
Jul 28 10:32:45.685139 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:32:45.685120    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e7ebfce7de696913d721330551311945be6243d554364bda7f7418ef7eae74b\": container with ID starting with 3e7ebfce7de696913d721330551311945be6243d554364bda7f7418ef7eae74b not found: ID does not exist" containerID="3e7ebfce7de696913d721330551311945be6243d554364bda7f7418ef7eae74b"
Jul 28 10:32:45.685196 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:45.685152    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e7ebfce7de696913d721330551311945be6243d554364bda7f7418ef7eae74b"} err="failed to get container status \"3e7ebfce7de696913d721330551311945be6243d554364bda7f7418ef7eae74b\": rpc error: code = NotFound desc = could not find container \"3e7ebfce7de696913d721330551311945be6243d554364bda7f7418ef7eae74b\": container with ID starting with 3e7ebfce7de696913d721330551311945be6243d554364bda7f7418ef7eae74b not found: ID does not exist"
Jul 28 10:32:45.698250 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:45.698224    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl"]
Jul 28 10:32:45.702703 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:45.702682    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-222a3-5f5974b4b4-bb4dl"]
Jul 28 10:32:47.045808 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:32:47.045774    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d475df7-d3a4-4237-8b78-08843f4ef33b" path="/var/lib/kubelet/pods/4d475df7-d3a4-4237-8b78-08843f4ef33b/volumes"
Jul 28 10:33:15.561059 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:15.561027    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8"]
Jul 28 10:33:15.561534 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:15.561415    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d475df7-d3a4-4237-8b78-08843f4ef33b" containerName="sequence-graph-222a3"
Jul 28 10:33:15.561534 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:15.561428    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d475df7-d3a4-4237-8b78-08843f4ef33b" containerName="sequence-graph-222a3"
Jul 28 10:33:15.561534 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:15.561494    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d475df7-d3a4-4237-8b78-08843f4ef33b" containerName="sequence-graph-222a3"
Jul 28 10:33:15.565811 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:15.565790    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8"
Jul 28 10:33:15.568094 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:15.568062    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-8d409-serving-cert\""
Jul 28 10:33:15.568094 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:15.568064    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-8d409-kube-rbac-proxy-sar-config\""
Jul 28 10:33:15.573011 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:15.572990    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8"]
Jul 28 10:33:15.690970 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:15.690929    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4cdd871e-21d2-4659-ac46-94c67c2d8b66-proxy-tls\") pod \"sequence-graph-8d409-85cbb7d94-dp7l8\" (UID: \"4cdd871e-21d2-4659-ac46-94c67c2d8b66\") " pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8"
Jul 28 10:33:15.691158 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:15.691034    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cdd871e-21d2-4659-ac46-94c67c2d8b66-openshift-service-ca-bundle\") pod \"sequence-graph-8d409-85cbb7d94-dp7l8\" (UID: \"4cdd871e-21d2-4659-ac46-94c67c2d8b66\") " pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8"
Jul 28 10:33:15.792374 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:15.792335    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cdd871e-21d2-4659-ac46-94c67c2d8b66-openshift-service-ca-bundle\") pod \"sequence-graph-8d409-85cbb7d94-dp7l8\" (UID: \"4cdd871e-21d2-4659-ac46-94c67c2d8b66\") " pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8"
Jul 28 10:33:15.792553 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:15.792429    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4cdd871e-21d2-4659-ac46-94c67c2d8b66-proxy-tls\") pod \"sequence-graph-8d409-85cbb7d94-dp7l8\" (UID: \"4cdd871e-21d2-4659-ac46-94c67c2d8b66\") " pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8"
Jul 28 10:33:15.792608 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:33:15.792586    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-8d409-serving-cert: secret "sequence-graph-8d409-serving-cert" not found
Jul 28 10:33:15.792702 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:33:15.792689    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cdd871e-21d2-4659-ac46-94c67c2d8b66-proxy-tls podName:4cdd871e-21d2-4659-ac46-94c67c2d8b66 nodeName:}" failed. No retries permitted until 2026-07-28 10:33:16.292665625 +0000 UTC m=+1529.694904004 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/4cdd871e-21d2-4659-ac46-94c67c2d8b66-proxy-tls") pod "sequence-graph-8d409-85cbb7d94-dp7l8" (UID: "4cdd871e-21d2-4659-ac46-94c67c2d8b66") : secret "sequence-graph-8d409-serving-cert" not found
Jul 28 10:33:15.793133 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:15.793113    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cdd871e-21d2-4659-ac46-94c67c2d8b66-openshift-service-ca-bundle\") pod \"sequence-graph-8d409-85cbb7d94-dp7l8\" (UID: \"4cdd871e-21d2-4659-ac46-94c67c2d8b66\") " pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8"
Jul 28 10:33:16.297901 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:16.297855    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4cdd871e-21d2-4659-ac46-94c67c2d8b66-proxy-tls\") pod \"sequence-graph-8d409-85cbb7d94-dp7l8\" (UID: \"4cdd871e-21d2-4659-ac46-94c67c2d8b66\") " pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8"
Jul 28 10:33:16.298101 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:33:16.297992    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/sequence-graph-8d409-serving-cert: secret "sequence-graph-8d409-serving-cert" not found
Jul 28 10:33:16.298101 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:33:16.298054    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cdd871e-21d2-4659-ac46-94c67c2d8b66-proxy-tls podName:4cdd871e-21d2-4659-ac46-94c67c2d8b66 nodeName:}" failed. No retries permitted until 2026-07-28 10:33:17.298038712 +0000 UTC m=+1530.700277088 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/4cdd871e-21d2-4659-ac46-94c67c2d8b66-proxy-tls") pod "sequence-graph-8d409-85cbb7d94-dp7l8" (UID: "4cdd871e-21d2-4659-ac46-94c67c2d8b66") : secret "sequence-graph-8d409-serving-cert" not found
Jul 28 10:33:17.306873 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:17.306813    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4cdd871e-21d2-4659-ac46-94c67c2d8b66-proxy-tls\") pod \"sequence-graph-8d409-85cbb7d94-dp7l8\" (UID: \"4cdd871e-21d2-4659-ac46-94c67c2d8b66\") " pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8"
Jul 28 10:33:17.309466 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:17.309440    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4cdd871e-21d2-4659-ac46-94c67c2d8b66-proxy-tls\") pod \"sequence-graph-8d409-85cbb7d94-dp7l8\" (UID: \"4cdd871e-21d2-4659-ac46-94c67c2d8b66\") " pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8"
Jul 28 10:33:17.378174 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:17.378146    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8"
Jul 28 10:33:17.510946 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:17.510920    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8"]
Jul 28 10:33:17.513669 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:33:17.513640    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cdd871e_21d2_4659_ac46_94c67c2d8b66.slice/crio-2cb3d482b7956769de4e65b72f7c3135379240fbde23dab142f72efb21c0b54c WatchSource:0}: Error finding container 2cb3d482b7956769de4e65b72f7c3135379240fbde23dab142f72efb21c0b54c: Status 404 returned error can't find the container with id 2cb3d482b7956769de4e65b72f7c3135379240fbde23dab142f72efb21c0b54c
Jul 28 10:33:17.815984 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:17.815888    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8" event={"ID":"4cdd871e-21d2-4659-ac46-94c67c2d8b66","Type":"ContainerStarted","Data":"9dfc27283d6c7b6bb0144da1aea50cbc2a5d1c3387cfb0be3683e013bdc9a4e9"}
Jul 28 10:33:17.815984 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:17.815942    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8" event={"ID":"4cdd871e-21d2-4659-ac46-94c67c2d8b66","Type":"ContainerStarted","Data":"2cb3d482b7956769de4e65b72f7c3135379240fbde23dab142f72efb21c0b54c"}
Jul 28 10:33:17.815984 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:17.815972    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8"
Jul 28 10:33:17.836251 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:17.836201    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8" podStartSLOduration=2.836185843 podStartE2EDuration="2.836185843s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:33:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:33:17.835140469 +0000 UTC m=+1531.237378878" watchObservedRunningTime="2026-07-28 10:33:17.836185843 +0000 UTC m=+1531.238424241"
Jul 28 10:33:23.826942 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:33:23.826914    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8"
Jul 28 10:40:30.374809 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:40:30.374780    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r"]
Jul 28 10:40:30.377135 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:40:30.375038    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r" podUID="f0b7062d-bf7e-449a-8cef-c4a14fffbd99" containerName="ensemble-graph-4e070" containerID="cri-o://4ac7c572dba7cf39d58963a1af8d7efbef0d28c4d5edb1b2d94403bc8c4ed6d9" gracePeriod=30
Jul 28 10:40:32.554012 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:40:32.553969    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r" podUID="f0b7062d-bf7e-449a-8cef-c4a14fffbd99" containerName="ensemble-graph-4e070" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:40:37.554183 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:40:37.554143    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r" podUID="f0b7062d-bf7e-449a-8cef-c4a14fffbd99" containerName="ensemble-graph-4e070" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:40:42.553754 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:40:42.553712    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r" podUID="f0b7062d-bf7e-449a-8cef-c4a14fffbd99" containerName="ensemble-graph-4e070" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:40:42.554245 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:40:42.553832    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r"
Jul 28 10:40:47.554337 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:40:47.554291    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r" podUID="f0b7062d-bf7e-449a-8cef-c4a14fffbd99" containerName="ensemble-graph-4e070" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:40:52.554060 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:40:52.554019    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r" podUID="f0b7062d-bf7e-449a-8cef-c4a14fffbd99" containerName="ensemble-graph-4e070" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:40:57.553925 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:40:57.553877    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r" podUID="f0b7062d-bf7e-449a-8cef-c4a14fffbd99" containerName="ensemble-graph-4e070" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:41:00.526063 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:00.526034    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r"
Jul 28 10:41:00.611954 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:00.611923    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b7062d-bf7e-449a-8cef-c4a14fffbd99-openshift-service-ca-bundle\") pod \"f0b7062d-bf7e-449a-8cef-c4a14fffbd99\" (UID: \"f0b7062d-bf7e-449a-8cef-c4a14fffbd99\") "
Jul 28 10:41:00.612119 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:00.612048    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f0b7062d-bf7e-449a-8cef-c4a14fffbd99-proxy-tls\") pod \"f0b7062d-bf7e-449a-8cef-c4a14fffbd99\" (UID: \"f0b7062d-bf7e-449a-8cef-c4a14fffbd99\") "
Jul 28 10:41:00.612309 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:00.612282    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f0b7062d-bf7e-449a-8cef-c4a14fffbd99-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "f0b7062d-bf7e-449a-8cef-c4a14fffbd99" (UID: "f0b7062d-bf7e-449a-8cef-c4a14fffbd99"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:41:00.614284 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:00.614253    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f0b7062d-bf7e-449a-8cef-c4a14fffbd99-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "f0b7062d-bf7e-449a-8cef-c4a14fffbd99" (UID: "f0b7062d-bf7e-449a-8cef-c4a14fffbd99"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:41:00.713634 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:00.713556    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f0b7062d-bf7e-449a-8cef-c4a14fffbd99-openshift-service-ca-bundle\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:41:00.713634 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:00.713583    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/f0b7062d-bf7e-449a-8cef-c4a14fffbd99-proxy-tls\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:41:00.878003 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:00.877966    2577 generic.go:356] "Generic (PLEG): container finished" podID="f0b7062d-bf7e-449a-8cef-c4a14fffbd99" containerID="4ac7c572dba7cf39d58963a1af8d7efbef0d28c4d5edb1b2d94403bc8c4ed6d9" exitCode=0
Jul 28 10:41:00.878168 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:00.878002    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r" event={"ID":"f0b7062d-bf7e-449a-8cef-c4a14fffbd99","Type":"ContainerDied","Data":"4ac7c572dba7cf39d58963a1af8d7efbef0d28c4d5edb1b2d94403bc8c4ed6d9"}
Jul 28 10:41:00.878168 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:00.878055    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r" event={"ID":"f0b7062d-bf7e-449a-8cef-c4a14fffbd99","Type":"ContainerDied","Data":"72a968d4d1dab27450962318b4a88d8fb86fbf3f5884833379a964f467ca824f"}
Jul 28 10:41:00.878168 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:00.878013    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r"
Jul 28 10:41:00.878168 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:00.878077    2577 scope.go:117] "RemoveContainer" containerID="4ac7c572dba7cf39d58963a1af8d7efbef0d28c4d5edb1b2d94403bc8c4ed6d9"
Jul 28 10:41:00.886863 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:00.886825    2577 scope.go:117] "RemoveContainer" containerID="4ac7c572dba7cf39d58963a1af8d7efbef0d28c4d5edb1b2d94403bc8c4ed6d9"
Jul 28 10:41:00.887120 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:41:00.887098    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ac7c572dba7cf39d58963a1af8d7efbef0d28c4d5edb1b2d94403bc8c4ed6d9\": container with ID starting with 4ac7c572dba7cf39d58963a1af8d7efbef0d28c4d5edb1b2d94403bc8c4ed6d9 not found: ID does not exist" containerID="4ac7c572dba7cf39d58963a1af8d7efbef0d28c4d5edb1b2d94403bc8c4ed6d9"
Jul 28 10:41:00.887215 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:00.887126    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ac7c572dba7cf39d58963a1af8d7efbef0d28c4d5edb1b2d94403bc8c4ed6d9"} err="failed to get container status \"4ac7c572dba7cf39d58963a1af8d7efbef0d28c4d5edb1b2d94403bc8c4ed6d9\": rpc error: code = NotFound desc = could not find container \"4ac7c572dba7cf39d58963a1af8d7efbef0d28c4d5edb1b2d94403bc8c4ed6d9\": container with ID starting with 4ac7c572dba7cf39d58963a1af8d7efbef0d28c4d5edb1b2d94403bc8c4ed6d9 not found: ID does not exist"
Jul 28 10:41:00.900723 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:00.900697    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r"]
Jul 28 10:41:00.907450 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:00.907424    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-4e070-57b477589f-dnp8r"]
Jul 28 10:41:01.044651 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:01.044616    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0b7062d-bf7e-449a-8cef-c4a14fffbd99" path="/var/lib/kubelet/pods/f0b7062d-bf7e-449a-8cef-c4a14fffbd99/volumes"
Jul 28 10:41:30.030931 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:30.030900    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8"]
Jul 28 10:41:30.031421 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:30.031115    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8" podUID="4cdd871e-21d2-4659-ac46-94c67c2d8b66" containerName="sequence-graph-8d409" containerID="cri-o://9dfc27283d6c7b6bb0144da1aea50cbc2a5d1c3387cfb0be3683e013bdc9a4e9" gracePeriod=30
Jul 28 10:41:30.589287 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:30.589257    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf"]
Jul 28 10:41:30.589638 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:30.589626    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0b7062d-bf7e-449a-8cef-c4a14fffbd99" containerName="ensemble-graph-4e070"
Jul 28 10:41:30.589682 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:30.589639    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0b7062d-bf7e-449a-8cef-c4a14fffbd99" containerName="ensemble-graph-4e070"
Jul 28 10:41:30.589716 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:30.589709    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0b7062d-bf7e-449a-8cef-c4a14fffbd99" containerName="ensemble-graph-4e070"
Jul 28 10:41:30.592608 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:30.592580    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf"
Jul 28 10:41:30.594710 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:30.594678    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-e803a-serving-cert\""
Jul 28 10:41:30.594824 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:30.594678    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-e803a-kube-rbac-proxy-sar-config\""
Jul 28 10:41:30.603294 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:30.603265    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf"]
Jul 28 10:41:30.676059 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:30.676016    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5fabe5e-9258-4f06-be3a-2c511f06620c-openshift-service-ca-bundle\") pod \"splitter-graph-e803a-55fbf78854-lnmxf\" (UID: \"e5fabe5e-9258-4f06-be3a-2c511f06620c\") " pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf"
Jul 28 10:41:30.676059 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:30.676067    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e5fabe5e-9258-4f06-be3a-2c511f06620c-proxy-tls\") pod \"splitter-graph-e803a-55fbf78854-lnmxf\" (UID: \"e5fabe5e-9258-4f06-be3a-2c511f06620c\") " pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf"
Jul 28 10:41:30.776716 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:30.776682    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5fabe5e-9258-4f06-be3a-2c511f06620c-openshift-service-ca-bundle\") pod \"splitter-graph-e803a-55fbf78854-lnmxf\" (UID: \"e5fabe5e-9258-4f06-be3a-2c511f06620c\") " pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf"
Jul 28 10:41:30.776921 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:30.776752    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e5fabe5e-9258-4f06-be3a-2c511f06620c-proxy-tls\") pod \"splitter-graph-e803a-55fbf78854-lnmxf\" (UID: \"e5fabe5e-9258-4f06-be3a-2c511f06620c\") " pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf"
Jul 28 10:41:30.777385 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:30.777357    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5fabe5e-9258-4f06-be3a-2c511f06620c-openshift-service-ca-bundle\") pod \"splitter-graph-e803a-55fbf78854-lnmxf\" (UID: \"e5fabe5e-9258-4f06-be3a-2c511f06620c\") " pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf"
Jul 28 10:41:30.779291 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:30.779271    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e5fabe5e-9258-4f06-be3a-2c511f06620c-proxy-tls\") pod \"splitter-graph-e803a-55fbf78854-lnmxf\" (UID: \"e5fabe5e-9258-4f06-be3a-2c511f06620c\") " pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf"
Jul 28 10:41:30.904947 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:30.904863    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf"
Jul 28 10:41:31.038038 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:31.038015    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf"]
Jul 28 10:41:31.040641 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:41:31.040610    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5fabe5e_9258_4f06_be3a_2c511f06620c.slice/crio-9938f1501503dffb629e43b66f906f48360fd78b98d624e98d0fdcf93fd326dd WatchSource:0}: Error finding container 9938f1501503dffb629e43b66f906f48360fd78b98d624e98d0fdcf93fd326dd: Status 404 returned error can't find the container with id 9938f1501503dffb629e43b66f906f48360fd78b98d624e98d0fdcf93fd326dd
Jul 28 10:41:32.018981 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:32.018940    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf" event={"ID":"e5fabe5e-9258-4f06-be3a-2c511f06620c","Type":"ContainerStarted","Data":"6b60ff8dc8ad0e07c02f7e5ac723fb04704a1a24ab3c2a14a4490c4fcf1d079f"}
Jul 28 10:41:32.019177 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:32.018993    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf" event={"ID":"e5fabe5e-9258-4f06-be3a-2c511f06620c","Type":"ContainerStarted","Data":"9938f1501503dffb629e43b66f906f48360fd78b98d624e98d0fdcf93fd326dd"}
Jul 28 10:41:32.019177 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:32.019018    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf"
Jul 28 10:41:32.039903 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:32.037480    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf" podStartSLOduration=2.037461135 podStartE2EDuration="2.037461135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:41:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:41:32.035632452 +0000 UTC m=+2025.437870851" watchObservedRunningTime="2026-07-28 10:41:32.037461135 +0000 UTC m=+2025.439699534"
Jul 28 10:41:33.825314 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:33.825273    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8" podUID="4cdd871e-21d2-4659-ac46-94c67c2d8b66" containerName="sequence-graph-8d409" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:41:38.030082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:38.030048    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf"
Jul 28 10:41:38.825375 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:38.825327    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8" podUID="4cdd871e-21d2-4659-ac46-94c67c2d8b66" containerName="sequence-graph-8d409" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:41:40.661803 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:40.661722    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf"]
Jul 28 10:41:40.662201 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:40.661953    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf" podUID="e5fabe5e-9258-4f06-be3a-2c511f06620c" containerName="splitter-graph-e803a" containerID="cri-o://6b60ff8dc8ad0e07c02f7e5ac723fb04704a1a24ab3c2a14a4490c4fcf1d079f" gracePeriod=30
Jul 28 10:41:43.027702 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:43.027657    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf" podUID="e5fabe5e-9258-4f06-be3a-2c511f06620c" containerName="splitter-graph-e803a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:41:43.825788 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:43.825747    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8" podUID="4cdd871e-21d2-4659-ac46-94c67c2d8b66" containerName="sequence-graph-8d409" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:41:43.826019 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:43.825896    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8"
Jul 28 10:41:48.028526 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:48.028489    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf" podUID="e5fabe5e-9258-4f06-be3a-2c511f06620c" containerName="splitter-graph-e803a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:41:48.825664 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:48.825625    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8" podUID="4cdd871e-21d2-4659-ac46-94c67c2d8b66" containerName="sequence-graph-8d409" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:41:53.028285 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:53.028238    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf" podUID="e5fabe5e-9258-4f06-be3a-2c511f06620c" containerName="splitter-graph-e803a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:41:53.028729 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:53.028365    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf"
Jul 28 10:41:53.825463 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:53.825422    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8" podUID="4cdd871e-21d2-4659-ac46-94c67c2d8b66" containerName="sequence-graph-8d409" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:41:58.027542 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:58.027505    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf" podUID="e5fabe5e-9258-4f06-be3a-2c511f06620c" containerName="splitter-graph-e803a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:41:58.825815 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:41:58.825775    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8" podUID="4cdd871e-21d2-4659-ac46-94c67c2d8b66" containerName="sequence-graph-8d409" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:42:00.142755 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:00.142722    2577 generic.go:356] "Generic (PLEG): container finished" podID="4cdd871e-21d2-4659-ac46-94c67c2d8b66" containerID="9dfc27283d6c7b6bb0144da1aea50cbc2a5d1c3387cfb0be3683e013bdc9a4e9" exitCode=0
Jul 28 10:42:00.143183 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:00.142797    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8" event={"ID":"4cdd871e-21d2-4659-ac46-94c67c2d8b66","Type":"ContainerDied","Data":"9dfc27283d6c7b6bb0144da1aea50cbc2a5d1c3387cfb0be3683e013bdc9a4e9"}
Jul 28 10:42:00.188078 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:00.188052    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8"
Jul 28 10:42:00.331018 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:00.330933    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cdd871e-21d2-4659-ac46-94c67c2d8b66-openshift-service-ca-bundle\") pod \"4cdd871e-21d2-4659-ac46-94c67c2d8b66\" (UID: \"4cdd871e-21d2-4659-ac46-94c67c2d8b66\") "
Jul 28 10:42:00.331018 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:00.330978    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4cdd871e-21d2-4659-ac46-94c67c2d8b66-proxy-tls\") pod \"4cdd871e-21d2-4659-ac46-94c67c2d8b66\" (UID: \"4cdd871e-21d2-4659-ac46-94c67c2d8b66\") "
Jul 28 10:42:00.331310 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:00.331287    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cdd871e-21d2-4659-ac46-94c67c2d8b66-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "4cdd871e-21d2-4659-ac46-94c67c2d8b66" (UID: "4cdd871e-21d2-4659-ac46-94c67c2d8b66"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:42:00.333179 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:00.333157    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cdd871e-21d2-4659-ac46-94c67c2d8b66-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4cdd871e-21d2-4659-ac46-94c67c2d8b66" (UID: "4cdd871e-21d2-4659-ac46-94c67c2d8b66"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:42:00.432075 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:00.432040    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cdd871e-21d2-4659-ac46-94c67c2d8b66-openshift-service-ca-bundle\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:42:00.432075 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:00.432072    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4cdd871e-21d2-4659-ac46-94c67c2d8b66-proxy-tls\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:42:01.148242 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:01.148212    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8"
Jul 28 10:42:01.148794 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:01.148244    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8" event={"ID":"4cdd871e-21d2-4659-ac46-94c67c2d8b66","Type":"ContainerDied","Data":"2cb3d482b7956769de4e65b72f7c3135379240fbde23dab142f72efb21c0b54c"}
Jul 28 10:42:01.148794 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:01.148318    2577 scope.go:117] "RemoveContainer" containerID="9dfc27283d6c7b6bb0144da1aea50cbc2a5d1c3387cfb0be3683e013bdc9a4e9"
Jul 28 10:42:01.166329 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:01.166304    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8"]
Jul 28 10:42:01.171341 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:01.171319    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8d409-85cbb7d94-dp7l8"]
Jul 28 10:42:03.028191 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:03.028154    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf" podUID="e5fabe5e-9258-4f06-be3a-2c511f06620c" containerName="splitter-graph-e803a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:42:03.045103 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:03.045074    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cdd871e-21d2-4659-ac46-94c67c2d8b66" path="/var/lib/kubelet/pods/4cdd871e-21d2-4659-ac46-94c67c2d8b66/volumes"
Jul 28 10:42:08.028137 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:08.028088    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf" podUID="e5fabe5e-9258-4f06-be3a-2c511f06620c" containerName="splitter-graph-e803a" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:42:10.810204 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:10.810175    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf"
Jul 28 10:42:10.918726 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:10.918631    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e5fabe5e-9258-4f06-be3a-2c511f06620c-proxy-tls\") pod \"e5fabe5e-9258-4f06-be3a-2c511f06620c\" (UID: \"e5fabe5e-9258-4f06-be3a-2c511f06620c\") "
Jul 28 10:42:10.918726 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:10.918705    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5fabe5e-9258-4f06-be3a-2c511f06620c-openshift-service-ca-bundle\") pod \"e5fabe5e-9258-4f06-be3a-2c511f06620c\" (UID: \"e5fabe5e-9258-4f06-be3a-2c511f06620c\") "
Jul 28 10:42:10.919070 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:10.919047    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5fabe5e-9258-4f06-be3a-2c511f06620c-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "e5fabe5e-9258-4f06-be3a-2c511f06620c" (UID: "e5fabe5e-9258-4f06-be3a-2c511f06620c"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:42:10.920989 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:10.920952    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5fabe5e-9258-4f06-be3a-2c511f06620c-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "e5fabe5e-9258-4f06-be3a-2c511f06620c" (UID: "e5fabe5e-9258-4f06-be3a-2c511f06620c"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:42:11.019567 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:11.019515    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e5fabe5e-9258-4f06-be3a-2c511f06620c-proxy-tls\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:42:11.019567 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:11.019561    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5fabe5e-9258-4f06-be3a-2c511f06620c-openshift-service-ca-bundle\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:42:11.196876 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:11.196766    2577 generic.go:356] "Generic (PLEG): container finished" podID="e5fabe5e-9258-4f06-be3a-2c511f06620c" containerID="6b60ff8dc8ad0e07c02f7e5ac723fb04704a1a24ab3c2a14a4490c4fcf1d079f" exitCode=0
Jul 28 10:42:11.196876 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:11.196811    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf"
Jul 28 10:42:11.197073 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:11.196870    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf" event={"ID":"e5fabe5e-9258-4f06-be3a-2c511f06620c","Type":"ContainerDied","Data":"6b60ff8dc8ad0e07c02f7e5ac723fb04704a1a24ab3c2a14a4490c4fcf1d079f"}
Jul 28 10:42:11.197073 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:11.196916    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf" event={"ID":"e5fabe5e-9258-4f06-be3a-2c511f06620c","Type":"ContainerDied","Data":"9938f1501503dffb629e43b66f906f48360fd78b98d624e98d0fdcf93fd326dd"}
Jul 28 10:42:11.197073 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:11.196937    2577 scope.go:117] "RemoveContainer" containerID="6b60ff8dc8ad0e07c02f7e5ac723fb04704a1a24ab3c2a14a4490c4fcf1d079f"
Jul 28 10:42:11.205316 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:11.205292    2577 scope.go:117] "RemoveContainer" containerID="6b60ff8dc8ad0e07c02f7e5ac723fb04704a1a24ab3c2a14a4490c4fcf1d079f"
Jul 28 10:42:11.205578 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:42:11.205559    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b60ff8dc8ad0e07c02f7e5ac723fb04704a1a24ab3c2a14a4490c4fcf1d079f\": container with ID starting with 6b60ff8dc8ad0e07c02f7e5ac723fb04704a1a24ab3c2a14a4490c4fcf1d079f not found: ID does not exist" containerID="6b60ff8dc8ad0e07c02f7e5ac723fb04704a1a24ab3c2a14a4490c4fcf1d079f"
Jul 28 10:42:11.205672 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:11.205588    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b60ff8dc8ad0e07c02f7e5ac723fb04704a1a24ab3c2a14a4490c4fcf1d079f"} err="failed to get container status \"6b60ff8dc8ad0e07c02f7e5ac723fb04704a1a24ab3c2a14a4490c4fcf1d079f\": rpc error: code = NotFound desc = could not find container \"6b60ff8dc8ad0e07c02f7e5ac723fb04704a1a24ab3c2a14a4490c4fcf1d079f\": container with ID starting with 6b60ff8dc8ad0e07c02f7e5ac723fb04704a1a24ab3c2a14a4490c4fcf1d079f not found: ID does not exist"
Jul 28 10:42:11.215692 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:11.215668    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf"]
Jul 28 10:42:11.219961 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:11.219940    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-e803a-55fbf78854-lnmxf"]
Jul 28 10:42:13.044677 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:13.044640    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5fabe5e-9258-4f06-be3a-2c511f06620c" path="/var/lib/kubelet/pods/e5fabe5e-9258-4f06-be3a-2c511f06620c/volumes"
Jul 28 10:42:30.272139 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:30.272109    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7"]
Jul 28 10:42:30.272598 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:30.272453    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5fabe5e-9258-4f06-be3a-2c511f06620c" containerName="splitter-graph-e803a"
Jul 28 10:42:30.272598 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:30.272464    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5fabe5e-9258-4f06-be3a-2c511f06620c" containerName="splitter-graph-e803a"
Jul 28 10:42:30.272598 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:30.272506    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cdd871e-21d2-4659-ac46-94c67c2d8b66" containerName="sequence-graph-8d409"
Jul 28 10:42:30.272598 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:30.272511    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cdd871e-21d2-4659-ac46-94c67c2d8b66" containerName="sequence-graph-8d409"
Jul 28 10:42:30.272598 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:30.272560    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5fabe5e-9258-4f06-be3a-2c511f06620c" containerName="splitter-graph-e803a"
Jul 28 10:42:30.272598 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:30.272571    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cdd871e-21d2-4659-ac46-94c67c2d8b66" containerName="sequence-graph-8d409"
Jul 28 10:42:30.275415 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:30.275390    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7"
Jul 28 10:42:30.277799 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:30.277778    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-lvvzp\""
Jul 28 10:42:30.278067 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:30.278049    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-a647d-serving-cert\""
Jul 28 10:42:30.278155 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:30.278134    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-a647d-kube-rbac-proxy-sar-config\""
Jul 28 10:42:30.278354 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:30.278334    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af518c78-57e4-45a2-bad3-4c7275a8e597-openshift-service-ca-bundle\") pod \"switch-graph-a647d-7bc89888f9-ftrq7\" (UID: \"af518c78-57e4-45a2-bad3-4c7275a8e597\") " pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7"
Jul 28 10:42:30.278472 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:30.278418    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/af518c78-57e4-45a2-bad3-4c7275a8e597-proxy-tls\") pod \"switch-graph-a647d-7bc89888f9-ftrq7\" (UID: \"af518c78-57e4-45a2-bad3-4c7275a8e597\") " pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7"
Jul 28 10:42:30.278682 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:30.278650    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 28 10:42:30.286217 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:30.286172    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7"]
Jul 28 10:42:30.379221 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:30.379181    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af518c78-57e4-45a2-bad3-4c7275a8e597-openshift-service-ca-bundle\") pod \"switch-graph-a647d-7bc89888f9-ftrq7\" (UID: \"af518c78-57e4-45a2-bad3-4c7275a8e597\") " pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7"
Jul 28 10:42:30.379409 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:30.379274    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/af518c78-57e4-45a2-bad3-4c7275a8e597-proxy-tls\") pod \"switch-graph-a647d-7bc89888f9-ftrq7\" (UID: \"af518c78-57e4-45a2-bad3-4c7275a8e597\") " pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7"
Jul 28 10:42:30.379460 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:42:30.379408    2577 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-a647d-serving-cert: secret "switch-graph-a647d-serving-cert" not found
Jul 28 10:42:30.379499 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:42:30.379483    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af518c78-57e4-45a2-bad3-4c7275a8e597-proxy-tls podName:af518c78-57e4-45a2-bad3-4c7275a8e597 nodeName:}" failed. No retries permitted until 2026-07-28 10:42:30.879460844 +0000 UTC m=+2084.281699227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/af518c78-57e4-45a2-bad3-4c7275a8e597-proxy-tls") pod "switch-graph-a647d-7bc89888f9-ftrq7" (UID: "af518c78-57e4-45a2-bad3-4c7275a8e597") : secret "switch-graph-a647d-serving-cert" not found
Jul 28 10:42:30.379788 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:30.379770    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af518c78-57e4-45a2-bad3-4c7275a8e597-openshift-service-ca-bundle\") pod \"switch-graph-a647d-7bc89888f9-ftrq7\" (UID: \"af518c78-57e4-45a2-bad3-4c7275a8e597\") " pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7"
Jul 28 10:42:30.882954 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:30.882924    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/af518c78-57e4-45a2-bad3-4c7275a8e597-proxy-tls\") pod \"switch-graph-a647d-7bc89888f9-ftrq7\" (UID: \"af518c78-57e4-45a2-bad3-4c7275a8e597\") " pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7"
Jul 28 10:42:30.885465 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:30.885432    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/af518c78-57e4-45a2-bad3-4c7275a8e597-proxy-tls\") pod \"switch-graph-a647d-7bc89888f9-ftrq7\" (UID: \"af518c78-57e4-45a2-bad3-4c7275a8e597\") " pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7"
Jul 28 10:42:30.886263 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:30.886244    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7"
Jul 28 10:42:31.017616 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:31.017594    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7"]
Jul 28 10:42:31.020406 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:42:31.020379    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf518c78_57e4_45a2_bad3_4c7275a8e597.slice/crio-715c8525b88ee5b7d91b8620be3e3b60dbf36f1000c4d8dced95c92a89d4bcc8 WatchSource:0}: Error finding container 715c8525b88ee5b7d91b8620be3e3b60dbf36f1000c4d8dced95c92a89d4bcc8: Status 404 returned error can't find the container with id 715c8525b88ee5b7d91b8620be3e3b60dbf36f1000c4d8dced95c92a89d4bcc8
Jul 28 10:42:31.285634 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:31.285600    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7" event={"ID":"af518c78-57e4-45a2-bad3-4c7275a8e597","Type":"ContainerStarted","Data":"92f8a7acb1b2c4365eb193957be878382731d1514446d6c0cfd4f2aafe8d6488"}
Jul 28 10:42:31.286094 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:31.285656    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7" event={"ID":"af518c78-57e4-45a2-bad3-4c7275a8e597","Type":"ContainerStarted","Data":"715c8525b88ee5b7d91b8620be3e3b60dbf36f1000c4d8dced95c92a89d4bcc8"}
Jul 28 10:42:31.286094 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:31.285721    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7"
Jul 28 10:42:31.304340 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:31.304289    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7" podStartSLOduration=1.304265874 podStartE2EDuration="1.304265874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:42:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:42:31.302156709 +0000 UTC m=+2084.704395108" watchObservedRunningTime="2026-07-28 10:42:31.304265874 +0000 UTC m=+2084.706504290"
Jul 28 10:42:37.296903 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:37.296871    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7"
Jul 28 10:42:40.886189 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:40.886157    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb"]
Jul 28 10:42:40.889965 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:40.889943    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb"
Jul 28 10:42:40.892094 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:40.892067    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-f7711-kube-rbac-proxy-sar-config\""
Jul 28 10:42:40.892209 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:40.892096    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-f7711-serving-cert\""
Jul 28 10:42:40.897574 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:40.897550    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb"]
Jul 28 10:42:40.969435 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:40.969397    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4052d564-bd42-4c3d-9d80-90162ce959ca-proxy-tls\") pod \"splitter-graph-f7711-5d9485b744-t55xb\" (UID: \"4052d564-bd42-4c3d-9d80-90162ce959ca\") " pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb"
Jul 28 10:42:40.969435 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:40.969440    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4052d564-bd42-4c3d-9d80-90162ce959ca-openshift-service-ca-bundle\") pod \"splitter-graph-f7711-5d9485b744-t55xb\" (UID: \"4052d564-bd42-4c3d-9d80-90162ce959ca\") " pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb"
Jul 28 10:42:41.070082 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:41.070043    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4052d564-bd42-4c3d-9d80-90162ce959ca-proxy-tls\") pod \"splitter-graph-f7711-5d9485b744-t55xb\" (UID: \"4052d564-bd42-4c3d-9d80-90162ce959ca\") " pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb"
Jul 28 10:42:41.070256 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:41.070093    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4052d564-bd42-4c3d-9d80-90162ce959ca-openshift-service-ca-bundle\") pod \"splitter-graph-f7711-5d9485b744-t55xb\" (UID: \"4052d564-bd42-4c3d-9d80-90162ce959ca\") " pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb"
Jul 28 10:42:41.070869 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:41.070809    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4052d564-bd42-4c3d-9d80-90162ce959ca-openshift-service-ca-bundle\") pod \"splitter-graph-f7711-5d9485b744-t55xb\" (UID: \"4052d564-bd42-4c3d-9d80-90162ce959ca\") " pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb"
Jul 28 10:42:41.072709 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:41.072683    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4052d564-bd42-4c3d-9d80-90162ce959ca-proxy-tls\") pod \"splitter-graph-f7711-5d9485b744-t55xb\" (UID: \"4052d564-bd42-4c3d-9d80-90162ce959ca\") " pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb"
Jul 28 10:42:41.202426 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:41.202322    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb"
Jul 28 10:42:41.330443 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:41.330410    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb"]
Jul 28 10:42:41.332678 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:42:41.332651    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4052d564_bd42_4c3d_9d80_90162ce959ca.slice/crio-09a3fbeacff28e1da182ee377e504fbad02663a13c049ce1955a815a60e36c11 WatchSource:0}: Error finding container 09a3fbeacff28e1da182ee377e504fbad02663a13c049ce1955a815a60e36c11: Status 404 returned error can't find the container with id 09a3fbeacff28e1da182ee377e504fbad02663a13c049ce1955a815a60e36c11
Jul 28 10:42:42.334184 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:42.334145    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb" event={"ID":"4052d564-bd42-4c3d-9d80-90162ce959ca","Type":"ContainerStarted","Data":"a3865126bf2fb1f049df424b2fcc6b842804158ed84120e0582900dab8f04204"}
Jul 28 10:42:42.334657 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:42.334198    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb" event={"ID":"4052d564-bd42-4c3d-9d80-90162ce959ca","Type":"ContainerStarted","Data":"09a3fbeacff28e1da182ee377e504fbad02663a13c049ce1955a815a60e36c11"}
Jul 28 10:42:42.334657 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:42.334229    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb"
Jul 28 10:42:42.350512 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:42.350461    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb" podStartSLOduration=2.350446679 podStartE2EDuration="2.350446679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 10:42:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:42:42.34939243 +0000 UTC m=+2095.751630829" watchObservedRunningTime="2026-07-28 10:42:42.350446679 +0000 UTC m=+2095.752685082"
Jul 28 10:42:48.345218 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:42:48.345184    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb"
Jul 28 10:50:55.540888 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:50:55.540851    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb"]
Jul 28 10:50:55.541440 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:50:55.541039    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb" podUID="4052d564-bd42-4c3d-9d80-90162ce959ca" containerName="splitter-graph-f7711" containerID="cri-o://a3865126bf2fb1f049df424b2fcc6b842804158ed84120e0582900dab8f04204" gracePeriod=30
Jul 28 10:50:58.342989 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:50:58.342943    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb" podUID="4052d564-bd42-4c3d-9d80-90162ce959ca" containerName="splitter-graph-f7711" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:51:03.343038 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:51:03.343002    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb" podUID="4052d564-bd42-4c3d-9d80-90162ce959ca" containerName="splitter-graph-f7711" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:51:08.342490 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:51:08.342405    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb" podUID="4052d564-bd42-4c3d-9d80-90162ce959ca" containerName="splitter-graph-f7711" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:51:08.342895 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:51:08.342504    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb"
Jul 28 10:51:13.342501 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:51:13.342426    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb" podUID="4052d564-bd42-4c3d-9d80-90162ce959ca" containerName="splitter-graph-f7711" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:51:18.342706 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:51:18.342653    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb" podUID="4052d564-bd42-4c3d-9d80-90162ce959ca" containerName="splitter-graph-f7711" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:51:23.342468 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:51:23.342429    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb" podUID="4052d564-bd42-4c3d-9d80-90162ce959ca" containerName="splitter-graph-f7711" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:51:25.667948 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:51:25.667918    2577 generic.go:356] "Generic (PLEG): container finished" podID="4052d564-bd42-4c3d-9d80-90162ce959ca" containerID="a3865126bf2fb1f049df424b2fcc6b842804158ed84120e0582900dab8f04204" exitCode=0
Jul 28 10:51:25.668304 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:51:25.667988    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb" event={"ID":"4052d564-bd42-4c3d-9d80-90162ce959ca","Type":"ContainerDied","Data":"a3865126bf2fb1f049df424b2fcc6b842804158ed84120e0582900dab8f04204"}
Jul 28 10:51:25.684697 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:51:25.684678    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb"
Jul 28 10:51:25.756638 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:51:25.756607    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4052d564-bd42-4c3d-9d80-90162ce959ca-openshift-service-ca-bundle\") pod \"4052d564-bd42-4c3d-9d80-90162ce959ca\" (UID: \"4052d564-bd42-4c3d-9d80-90162ce959ca\") "
Jul 28 10:51:25.756815 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:51:25.756675    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4052d564-bd42-4c3d-9d80-90162ce959ca-proxy-tls\") pod \"4052d564-bd42-4c3d-9d80-90162ce959ca\" (UID: \"4052d564-bd42-4c3d-9d80-90162ce959ca\") "
Jul 28 10:51:25.757054 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:51:25.757031    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4052d564-bd42-4c3d-9d80-90162ce959ca-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "4052d564-bd42-4c3d-9d80-90162ce959ca" (UID: "4052d564-bd42-4c3d-9d80-90162ce959ca"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:51:25.758818 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:51:25.758794    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4052d564-bd42-4c3d-9d80-90162ce959ca-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4052d564-bd42-4c3d-9d80-90162ce959ca" (UID: "4052d564-bd42-4c3d-9d80-90162ce959ca"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:51:25.858287 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:51:25.858203    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4052d564-bd42-4c3d-9d80-90162ce959ca-openshift-service-ca-bundle\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:51:25.858287 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:51:25.858240    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4052d564-bd42-4c3d-9d80-90162ce959ca-proxy-tls\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:51:26.673427 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:51:26.673392    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb" event={"ID":"4052d564-bd42-4c3d-9d80-90162ce959ca","Type":"ContainerDied","Data":"09a3fbeacff28e1da182ee377e504fbad02663a13c049ce1955a815a60e36c11"}
Jul 28 10:51:26.673961 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:51:26.673450    2577 scope.go:117] "RemoveContainer" containerID="a3865126bf2fb1f049df424b2fcc6b842804158ed84120e0582900dab8f04204"
Jul 28 10:51:26.673961 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:51:26.673406    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb"
Jul 28 10:51:26.695561 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:51:26.695538    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb"]
Jul 28 10:51:26.697135 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:51:26.697112    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-f7711-5d9485b744-t55xb"]
Jul 28 10:51:27.050087 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:51:27.050057    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4052d564-bd42-4c3d-9d80-90162ce959ca" path="/var/lib/kubelet/pods/4052d564-bd42-4c3d-9d80-90162ce959ca/volumes"
Jul 28 10:58:49.390375 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:58:49.390290    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7"]
Jul 28 10:58:49.392806 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:58:49.390520    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7" podUID="af518c78-57e4-45a2-bad3-4c7275a8e597" containerName="switch-graph-a647d" containerID="cri-o://92f8a7acb1b2c4365eb193957be878382731d1514446d6c0cfd4f2aafe8d6488" gracePeriod=30
Jul 28 10:58:52.294056 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:58:52.294010    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7" podUID="af518c78-57e4-45a2-bad3-4c7275a8e597" containerName="switch-graph-a647d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:58:57.294443 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:58:57.294398    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7" podUID="af518c78-57e4-45a2-bad3-4c7275a8e597" containerName="switch-graph-a647d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:59:02.294243 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:02.294204    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7" podUID="af518c78-57e4-45a2-bad3-4c7275a8e597" containerName="switch-graph-a647d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:59:02.294674 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:02.294351    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7"
Jul 28 10:59:05.413506 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:05.413478    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a647d-7bc89888f9-ftrq7_af518c78-57e4-45a2-bad3-4c7275a8e597/switch-graph-a647d/0.log"
Jul 28 10:59:06.265496 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:06.265466    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a647d-7bc89888f9-ftrq7_af518c78-57e4-45a2-bad3-4c7275a8e597/switch-graph-a647d/0.log"
Jul 28 10:59:07.113702 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:07.113665    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a647d-7bc89888f9-ftrq7_af518c78-57e4-45a2-bad3-4c7275a8e597/switch-graph-a647d/0.log"
Jul 28 10:59:07.295041 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:07.295003    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7" podUID="af518c78-57e4-45a2-bad3-4c7275a8e597" containerName="switch-graph-a647d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:59:07.950779 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:07.950746    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a647d-7bc89888f9-ftrq7_af518c78-57e4-45a2-bad3-4c7275a8e597/switch-graph-a647d/0.log"
Jul 28 10:59:08.774065 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:08.774037    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a647d-7bc89888f9-ftrq7_af518c78-57e4-45a2-bad3-4c7275a8e597/switch-graph-a647d/0.log"
Jul 28 10:59:09.595928 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:09.595902    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a647d-7bc89888f9-ftrq7_af518c78-57e4-45a2-bad3-4c7275a8e597/switch-graph-a647d/0.log"
Jul 28 10:59:10.418808 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:10.418769    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a647d-7bc89888f9-ftrq7_af518c78-57e4-45a2-bad3-4c7275a8e597/switch-graph-a647d/0.log"
Jul 28 10:59:11.224420 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:11.224385    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a647d-7bc89888f9-ftrq7_af518c78-57e4-45a2-bad3-4c7275a8e597/switch-graph-a647d/0.log"
Jul 28 10:59:12.051103 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:12.051074    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a647d-7bc89888f9-ftrq7_af518c78-57e4-45a2-bad3-4c7275a8e597/switch-graph-a647d/0.log"
Jul 28 10:59:12.295167 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:12.295129    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7" podUID="af518c78-57e4-45a2-bad3-4c7275a8e597" containerName="switch-graph-a647d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:59:12.948989 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:12.948960    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a647d-7bc89888f9-ftrq7_af518c78-57e4-45a2-bad3-4c7275a8e597/switch-graph-a647d/0.log"
Jul 28 10:59:13.885029 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:13.885006    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a647d-7bc89888f9-ftrq7_af518c78-57e4-45a2-bad3-4c7275a8e597/switch-graph-a647d/0.log"
Jul 28 10:59:14.766721 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:14.766648    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a647d-7bc89888f9-ftrq7_af518c78-57e4-45a2-bad3-4c7275a8e597/switch-graph-a647d/0.log"
Jul 28 10:59:15.659210 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:15.659180    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a647d-7bc89888f9-ftrq7_af518c78-57e4-45a2-bad3-4c7275a8e597/switch-graph-a647d/0.log"
Jul 28 10:59:16.584695 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:16.584650    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-a647d-7bc89888f9-ftrq7_af518c78-57e4-45a2-bad3-4c7275a8e597/switch-graph-a647d/0.log"
Jul 28 10:59:17.294209 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:17.294164    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7" podUID="af518c78-57e4-45a2-bad3-4c7275a8e597" containerName="switch-graph-a647d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 10:59:19.543172 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:19.543145    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7"
Jul 28 10:59:19.628527 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:19.628497    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/af518c78-57e4-45a2-bad3-4c7275a8e597-proxy-tls\") pod \"af518c78-57e4-45a2-bad3-4c7275a8e597\" (UID: \"af518c78-57e4-45a2-bad3-4c7275a8e597\") "
Jul 28 10:59:19.628713 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:19.628634    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af518c78-57e4-45a2-bad3-4c7275a8e597-openshift-service-ca-bundle\") pod \"af518c78-57e4-45a2-bad3-4c7275a8e597\" (UID: \"af518c78-57e4-45a2-bad3-4c7275a8e597\") "
Jul 28 10:59:19.628977 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:19.628952    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af518c78-57e4-45a2-bad3-4c7275a8e597-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "af518c78-57e4-45a2-bad3-4c7275a8e597" (UID: "af518c78-57e4-45a2-bad3-4c7275a8e597"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 10:59:19.630720 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:19.630690    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af518c78-57e4-45a2-bad3-4c7275a8e597-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "af518c78-57e4-45a2-bad3-4c7275a8e597" (UID: "af518c78-57e4-45a2-bad3-4c7275a8e597"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 10:59:19.730165 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:19.730140    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af518c78-57e4-45a2-bad3-4c7275a8e597-openshift-service-ca-bundle\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:59:19.730310 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:19.730195    2577 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/af518c78-57e4-45a2-bad3-4c7275a8e597-proxy-tls\") on node \"ip-10-0-140-175.ec2.internal\" DevicePath \"\""
Jul 28 10:59:19.753895 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:19.753857    2577 generic.go:356] "Generic (PLEG): container finished" podID="af518c78-57e4-45a2-bad3-4c7275a8e597" containerID="92f8a7acb1b2c4365eb193957be878382731d1514446d6c0cfd4f2aafe8d6488" exitCode=0
Jul 28 10:59:19.754018 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:19.753922    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7"
Jul 28 10:59:19.754018 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:19.753946    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7" event={"ID":"af518c78-57e4-45a2-bad3-4c7275a8e597","Type":"ContainerDied","Data":"92f8a7acb1b2c4365eb193957be878382731d1514446d6c0cfd4f2aafe8d6488"}
Jul 28 10:59:19.754018 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:19.753998    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7" event={"ID":"af518c78-57e4-45a2-bad3-4c7275a8e597","Type":"ContainerDied","Data":"715c8525b88ee5b7d91b8620be3e3b60dbf36f1000c4d8dced95c92a89d4bcc8"}
Jul 28 10:59:19.754160 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:19.754041    2577 scope.go:117] "RemoveContainer" containerID="92f8a7acb1b2c4365eb193957be878382731d1514446d6c0cfd4f2aafe8d6488"
Jul 28 10:59:19.763200 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:19.763186    2577 scope.go:117] "RemoveContainer" containerID="92f8a7acb1b2c4365eb193957be878382731d1514446d6c0cfd4f2aafe8d6488"
Jul 28 10:59:19.763498 ip-10-0-140-175 kubenswrapper[2577]: E0728 10:59:19.763480    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92f8a7acb1b2c4365eb193957be878382731d1514446d6c0cfd4f2aafe8d6488\": container with ID starting with 92f8a7acb1b2c4365eb193957be878382731d1514446d6c0cfd4f2aafe8d6488 not found: ID does not exist" containerID="92f8a7acb1b2c4365eb193957be878382731d1514446d6c0cfd4f2aafe8d6488"
Jul 28 10:59:19.763549 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:19.763507    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92f8a7acb1b2c4365eb193957be878382731d1514446d6c0cfd4f2aafe8d6488"} err="failed to get container status \"92f8a7acb1b2c4365eb193957be878382731d1514446d6c0cfd4f2aafe8d6488\": rpc error: code = NotFound desc = could not find container \"92f8a7acb1b2c4365eb193957be878382731d1514446d6c0cfd4f2aafe8d6488\": container with ID starting with 92f8a7acb1b2c4365eb193957be878382731d1514446d6c0cfd4f2aafe8d6488 not found: ID does not exist"
Jul 28 10:59:19.776458 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:19.776432    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7"]
Jul 28 10:59:19.783813 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:19.783794    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-a647d-7bc89888f9-ftrq7"]
Jul 28 10:59:21.044859 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:21.044815    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af518c78-57e4-45a2-bad3-4c7275a8e597" path="/var/lib/kubelet/pods/af518c78-57e4-45a2-bad3-4c7275a8e597/volumes"
Jul 28 10:59:21.683273 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:21.683233    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-v26n5_5536a6cc-73fa-4449-8a5c-d3798c359de8/global-pull-secret-syncer/0.log"
Jul 28 10:59:21.832759 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:21.832721    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-z8vrl_f30801a2-932d-4b83-97d7-c61d81b859c5/konnectivity-agent/0.log"
Jul 28 10:59:21.912751 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:21.912726    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-175.ec2.internal_59086c5e245afc5c657648266b073d96/haproxy/0.log"
Jul 28 10:59:25.558456 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:25.558428    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dc2d385b-1b90-467d-b3a9-837efd9fdc1f/alertmanager/0.log"
Jul 28 10:59:25.591725 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:25.591698    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dc2d385b-1b90-467d-b3a9-837efd9fdc1f/config-reloader/0.log"
Jul 28 10:59:25.623264 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:25.623243    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dc2d385b-1b90-467d-b3a9-837efd9fdc1f/kube-rbac-proxy-web/0.log"
Jul 28 10:59:25.655538 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:25.655516    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dc2d385b-1b90-467d-b3a9-837efd9fdc1f/kube-rbac-proxy/0.log"
Jul 28 10:59:25.687687 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:25.687668    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dc2d385b-1b90-467d-b3a9-837efd9fdc1f/kube-rbac-proxy-metric/0.log"
Jul 28 10:59:25.719269 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:25.719253    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dc2d385b-1b90-467d-b3a9-837efd9fdc1f/prom-label-proxy/0.log"
Jul 28 10:59:25.749131 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:25.749116    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_dc2d385b-1b90-467d-b3a9-837efd9fdc1f/init-config-reloader/0.log"
Jul 28 10:59:25.823434 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:25.823364    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-85whw_b826c4f0-64f0-45ef-9a39-2b56774f783d/cluster-monitoring-operator/0.log"
Jul 28 10:59:25.859274 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:25.859254    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-mg5rh_dfc4cbca-04de-476f-a117-145e21376e75/kube-state-metrics/0.log"
Jul 28 10:59:25.888893 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:25.888877    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-mg5rh_dfc4cbca-04de-476f-a117-145e21376e75/kube-rbac-proxy-main/0.log"
Jul 28 10:59:25.919926 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:25.919910    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-mg5rh_dfc4cbca-04de-476f-a117-145e21376e75/kube-rbac-proxy-self/0.log"
Jul 28 10:59:25.957208 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:25.957191    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-746cb6d799-rm4sl_b9076ee5-943a-4700-a8f9-de88c6706428/metrics-server/0.log"
Jul 28 10:59:26.231547 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:26.231522    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dh2q2_b7e7cc68-479b-4724-9f4d-59662bd3143e/node-exporter/0.log"
Jul 28 10:59:26.256798 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:26.256779    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dh2q2_b7e7cc68-479b-4724-9f4d-59662bd3143e/kube-rbac-proxy/0.log"
Jul 28 10:59:26.281032 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:26.281011    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dh2q2_b7e7cc68-479b-4724-9f4d-59662bd3143e/init-textfile/0.log"
Jul 28 10:59:26.662132 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:26.662059    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-jlvkz_bddaba43-f333-4c89-b522-c21055cca710/prometheus-operator-admission-webhook/0.log"
Jul 28 10:59:26.707500 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:26.707476    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-db5d75cc7-wvx9s_b4fb7b0f-07e2-416b-ae3f-f160d136e619/telemeter-client/0.log"
Jul 28 10:59:26.732180 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:26.732155    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-db5d75cc7-wvx9s_b4fb7b0f-07e2-416b-ae3f-f160d136e619/reload/0.log"
Jul 28 10:59:26.758891 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:26.758866    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-db5d75cc7-wvx9s_b4fb7b0f-07e2-416b-ae3f-f160d136e619/kube-rbac-proxy/0.log"
Jul 28 10:59:28.162163 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:28.162138    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-7dwzh_32f6e4c4-f599-4f50-a1c4-8e57158cd792/networking-console-plugin/0.log"
Jul 28 10:59:29.052109 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.052077    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5b9b789b64-tjkt8_d4ecab8b-5d77-4348-bda7-166cd4faf701/console/0.log"
Jul 28 10:59:29.087015 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.086991    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-8z9xm_d5abb0c1-8a9a-4ff4-b53c-6f617855af87/download-server/0.log"
Jul 28 10:59:29.372866 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.372744    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk"]
Jul 28 10:59:29.373311 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.373294    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af518c78-57e4-45a2-bad3-4c7275a8e597" containerName="switch-graph-a647d"
Jul 28 10:59:29.373379 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.373313    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="af518c78-57e4-45a2-bad3-4c7275a8e597" containerName="switch-graph-a647d"
Jul 28 10:59:29.373379 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.373337    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4052d564-bd42-4c3d-9d80-90162ce959ca" containerName="splitter-graph-f7711"
Jul 28 10:59:29.373379 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.373349    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4052d564-bd42-4c3d-9d80-90162ce959ca" containerName="splitter-graph-f7711"
Jul 28 10:59:29.373530 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.373439    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="af518c78-57e4-45a2-bad3-4c7275a8e597" containerName="switch-graph-a647d"
Jul 28 10:59:29.373530 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.373453    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4052d564-bd42-4c3d-9d80-90162ce959ca" containerName="splitter-graph-f7711"
Jul 28 10:59:29.376473 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.376451    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk"
Jul 28 10:59:29.378867 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.378822    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tvln5\"/\"kube-root-ca.crt\""
Jul 28 10:59:29.379577 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.379559    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tvln5\"/\"default-dockercfg-6kpps\""
Jul 28 10:59:29.379626 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.379594    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tvln5\"/\"openshift-service-ca.crt\""
Jul 28 10:59:29.382705 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.382687    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk"]
Jul 28 10:59:29.409184 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.409161    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c0d650b2-7feb-443d-94fe-602061a01973-podres\") pod \"perf-node-gather-daemonset-r2mxk\" (UID: \"c0d650b2-7feb-443d-94fe-602061a01973\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk"
Jul 28 10:59:29.409327 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.409197    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0d650b2-7feb-443d-94fe-602061a01973-sys\") pod \"perf-node-gather-daemonset-r2mxk\" (UID: \"c0d650b2-7feb-443d-94fe-602061a01973\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk"
Jul 28 10:59:29.409327 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.409234    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c0d650b2-7feb-443d-94fe-602061a01973-proc\") pod \"perf-node-gather-daemonset-r2mxk\" (UID: \"c0d650b2-7feb-443d-94fe-602061a01973\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk"
Jul 28 10:59:29.409327 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.409255    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0d650b2-7feb-443d-94fe-602061a01973-lib-modules\") pod \"perf-node-gather-daemonset-r2mxk\" (UID: \"c0d650b2-7feb-443d-94fe-602061a01973\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk"
Jul 28 10:59:29.409327 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.409277    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcd4d\" (UniqueName: \"kubernetes.io/projected/c0d650b2-7feb-443d-94fe-602061a01973-kube-api-access-gcd4d\") pod \"perf-node-gather-daemonset-r2mxk\" (UID: \"c0d650b2-7feb-443d-94fe-602061a01973\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk"
Jul 28 10:59:29.509634 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.509610    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c0d650b2-7feb-443d-94fe-602061a01973-proc\") pod \"perf-node-gather-daemonset-r2mxk\" (UID: \"c0d650b2-7feb-443d-94fe-602061a01973\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk"
Jul 28 10:59:29.509797 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.509650    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0d650b2-7feb-443d-94fe-602061a01973-lib-modules\") pod \"perf-node-gather-daemonset-r2mxk\" (UID: \"c0d650b2-7feb-443d-94fe-602061a01973\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk"
Jul 28 10:59:29.509797 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.509683    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcd4d\" (UniqueName: \"kubernetes.io/projected/c0d650b2-7feb-443d-94fe-602061a01973-kube-api-access-gcd4d\") pod \"perf-node-gather-daemonset-r2mxk\" (UID: \"c0d650b2-7feb-443d-94fe-602061a01973\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk"
Jul 28 10:59:29.509797 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.509744    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c0d650b2-7feb-443d-94fe-602061a01973-podres\") pod \"perf-node-gather-daemonset-r2mxk\" (UID: \"c0d650b2-7feb-443d-94fe-602061a01973\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk"
Jul 28 10:59:29.509797 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.509786    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0d650b2-7feb-443d-94fe-602061a01973-sys\") pod \"perf-node-gather-daemonset-r2mxk\" (UID: \"c0d650b2-7feb-443d-94fe-602061a01973\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk"
Jul 28 10:59:29.510027 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.509797    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0d650b2-7feb-443d-94fe-602061a01973-lib-modules\") pod \"perf-node-gather-daemonset-r2mxk\" (UID: \"c0d650b2-7feb-443d-94fe-602061a01973\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk"
Jul 28 10:59:29.510027 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.509743    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c0d650b2-7feb-443d-94fe-602061a01973-proc\") pod \"perf-node-gather-daemonset-r2mxk\" (UID: \"c0d650b2-7feb-443d-94fe-602061a01973\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk"
Jul 28 10:59:29.510027 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.509874    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c0d650b2-7feb-443d-94fe-602061a01973-podres\") pod \"perf-node-gather-daemonset-r2mxk\" (UID: \"c0d650b2-7feb-443d-94fe-602061a01973\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk"
Jul 28 10:59:29.510027 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.509889    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0d650b2-7feb-443d-94fe-602061a01973-sys\") pod \"perf-node-gather-daemonset-r2mxk\" (UID: \"c0d650b2-7feb-443d-94fe-602061a01973\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk"
Jul 28 10:59:29.519303 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.519281    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcd4d\" (UniqueName: \"kubernetes.io/projected/c0d650b2-7feb-443d-94fe-602061a01973-kube-api-access-gcd4d\") pod \"perf-node-gather-daemonset-r2mxk\" (UID: \"c0d650b2-7feb-443d-94fe-602061a01973\") " pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk"
Jul 28 10:59:29.687225 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.687138    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk"
Jul 28 10:59:29.821228 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:29.821202    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk"]
Jul 28 10:59:29.823533 ip-10-0-140-175 kubenswrapper[2577]: W0728 10:59:29.823509    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc0d650b2_7feb_443d_94fe_602061a01973.slice/crio-278688c7b4c0bb2625e8be9fa2822e3686a2addf09ce3cc6ddc8b934e09e14dd WatchSource:0}: Error finding container 278688c7b4c0bb2625e8be9fa2822e3686a2addf09ce3cc6ddc8b934e09e14dd: Status 404 returned error can't find the container with id 278688c7b4c0bb2625e8be9fa2822e3686a2addf09ce3cc6ddc8b934e09e14dd
Jul 28 10:59:30.580448 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:30.580420    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j5k8g_4d8c1a3b-efee-4b30-9022-087775f8ea49/dns/0.log"
Jul 28 10:59:30.604611 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:30.604585    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-j5k8g_4d8c1a3b-efee-4b30-9022-087775f8ea49/kube-rbac-proxy/0.log"
Jul 28 10:59:30.682916 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:30.682894    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-g59wc_166cc762-9ac9-414d-bc70-1cc5d7a9d718/dns-node-resolver/0.log"
Jul 28 10:59:30.810237 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:30.810204    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk" event={"ID":"c0d650b2-7feb-443d-94fe-602061a01973","Type":"ContainerStarted","Data":"c7f6e34b1099674e2bddcf228e0f0a563750c6220fcaae8735c7ea04d0664e3c"}
Jul 28 10:59:30.810406 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:30.810263    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk" event={"ID":"c0d650b2-7feb-443d-94fe-602061a01973","Type":"ContainerStarted","Data":"278688c7b4c0bb2625e8be9fa2822e3686a2addf09ce3cc6ddc8b934e09e14dd"}
Jul 28 10:59:30.810406 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:30.810292    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk"
Jul 28 10:59:30.830522 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:30.830424    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk" podStartSLOduration=1.83040895 podStartE2EDuration="1.83040895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 10:59:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 10:59:30.829704959 +0000 UTC m=+3104.231943359" watchObservedRunningTime="2026-07-28 10:59:30.83040895 +0000 UTC m=+3104.232647348"
Jul 28 10:59:31.272579 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:31.272554    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k7rg8_d7b8d225-6dc7-4a2b-9201-a47e73ffe254/node-ca/0.log"
Jul 28 10:59:32.478693 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:32.478664    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r2sgh_c70e4831-8e62-4e7c-8fd3-fb6404548c26/serve-healthcheck-canary/0.log"
Jul 28 10:59:33.026609 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:33.026584    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gkjrn_172a1903-cc50-48f2-b03c-0e682df09ea2/kube-rbac-proxy/0.log"
Jul 28 10:59:33.057026 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:33.057003    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gkjrn_172a1903-cc50-48f2-b03c-0e682df09ea2/exporter/0.log"
Jul 28 10:59:33.100028 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:33.100005    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gkjrn_172a1903-cc50-48f2-b03c-0e682df09ea2/extractor/0.log"
Jul 28 10:59:35.722931 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:35.722902    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-zw4cs_0663d54e-972e-4aa6-9b0a-6c58621ed73a/manager/0.log"
Jul 28 10:59:35.759253 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:35.759229    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-7b954ffc95-gh4f6_65d4c03a-6652-40c1-86b9-aeb06708e9ac/server/0.log"
Jul 28 10:59:36.825057 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:36.825031    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tvln5/perf-node-gather-daemonset-r2mxk"
Jul 28 10:59:42.383468 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:42.383441    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mfhr_75a3cd6d-6743-42dd-953e-b7270ecbe64e/kube-multus-additional-cni-plugins/0.log"
Jul 28 10:59:42.418164 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:42.418137    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mfhr_75a3cd6d-6743-42dd-953e-b7270ecbe64e/egress-router-binary-copy/0.log"
Jul 28 10:59:42.457034 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:42.457006    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mfhr_75a3cd6d-6743-42dd-953e-b7270ecbe64e/cni-plugins/0.log"
Jul 28 10:59:42.498596 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:42.498576    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mfhr_75a3cd6d-6743-42dd-953e-b7270ecbe64e/bond-cni-plugin/0.log"
Jul 28 10:59:42.526302 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:42.526278    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mfhr_75a3cd6d-6743-42dd-953e-b7270ecbe64e/routeoverride-cni/0.log"
Jul 28 10:59:42.573854 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:42.573811    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mfhr_75a3cd6d-6743-42dd-953e-b7270ecbe64e/whereabouts-cni-bincopy/0.log"
Jul 28 10:59:42.601783 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:42.601761    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-4mfhr_75a3cd6d-6743-42dd-953e-b7270ecbe64e/whereabouts-cni/0.log"
Jul 28 10:59:42.882900 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:42.882872    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hcmhj_daa091f9-dcf8-4259-ae5d-22cec31c3676/kube-multus/0.log"
Jul 28 10:59:42.907234 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:42.907212    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8dw4k_af1264bf-57b1-45a9-8753-f359fe2f0b65/network-metrics-daemon/0.log"
Jul 28 10:59:42.928781 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:42.928758    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8dw4k_af1264bf-57b1-45a9-8753-f359fe2f0b65/kube-rbac-proxy/0.log"
Jul 28 10:59:44.279685 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:44.279663    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsv94_08f379a0-030f-490c-8f02-22278e6e2fb9/ovn-controller/0.log"
Jul 28 10:59:44.300716 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:44.300696    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsv94_08f379a0-030f-490c-8f02-22278e6e2fb9/ovn-acl-logging/0.log"
Jul 28 10:59:44.329816 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:44.329796    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsv94_08f379a0-030f-490c-8f02-22278e6e2fb9/kube-rbac-proxy-node/0.log"
Jul 28 10:59:44.354856 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:44.354817    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsv94_08f379a0-030f-490c-8f02-22278e6e2fb9/kube-rbac-proxy-ovn-metrics/0.log"
Jul 28 10:59:44.377537 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:44.377521    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsv94_08f379a0-030f-490c-8f02-22278e6e2fb9/northd/0.log"
Jul 28 10:59:44.416825 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:44.416805    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsv94_08f379a0-030f-490c-8f02-22278e6e2fb9/nbdb/0.log"
Jul 28 10:59:44.447513 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:44.447492    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsv94_08f379a0-030f-490c-8f02-22278e6e2fb9/sbdb/0.log"
Jul 28 10:59:44.496555 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:44.496538    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nsv94_08f379a0-030f-490c-8f02-22278e6e2fb9/ovnkube-controller/0.log"
Jul 28 10:59:45.583671 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:45.583648    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-29c9r_e054c3a6-e305-4d49-8d17-f0218dc1874a/check-endpoints/0.log"
Jul 28 10:59:45.673086 ip-10-0-140-175 kubenswrapper[2577]: I0728 10:59:45.673004    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-rj8l7_0b17897e-d028-4f8b-ba02-5f5a0de532e7/network-check-target-container/0.log"