Jul 21 17:24:02.737487 ip-10-0-135-98 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 21 17:24:02.737500 ip-10-0-135-98 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 21 17:24:02.737510 ip-10-0-135-98 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 21 17:24:02.737831 ip-10-0-135-98 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 21 17:24:12.768525 ip-10-0-135-98 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 21 17:24:12.768545 ip-10-0-135-98 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8da475b328ea4c9ebe791a601c4e0e42 --
Jul 21 17:26:14.485435 ip-10-0-135-98 systemd[1]: Starting Kubernetes Kubelet...
Jul 21 17:26:14.871856 ip-10-0-135-98 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 17:26:14.871856 ip-10-0-135-98 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 21 17:26:14.871856 ip-10-0-135-98 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 17:26:14.871856 ip-10-0-135-98 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 21 17:26:14.871856 ip-10-0-135-98 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 21 17:26:14.872739 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.872612    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 21 17:26:14.880124 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880103    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 17:26:14.880124 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880121    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 17:26:14.880124 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880126    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 17:26:14.880124 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880129    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 17:26:14.880124 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880132    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 17:26:14.880334 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880136    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 17:26:14.880334 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880139    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 17:26:14.880334 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880141    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 17:26:14.880334 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880144    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 17:26:14.880334 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880146    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 17:26:14.880334 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880149    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 17:26:14.880334 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880151    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 17:26:14.880334 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880153    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 17:26:14.880334 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880156    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 17:26:14.880334 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880158    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 17:26:14.880334 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880161    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 17:26:14.880334 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880163    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 17:26:14.880334 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880165    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 17:26:14.880334 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880183    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 17:26:14.880334 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880186    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 17:26:14.880334 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880189    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 17:26:14.880334 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880192    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 17:26:14.880334 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880195    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 17:26:14.880334 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880197    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 17:26:14.880334 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880199    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 17:26:14.880852 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880202    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 17:26:14.880852 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880205    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 17:26:14.880852 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880207    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 17:26:14.880852 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880210    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 17:26:14.880852 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880212    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 17:26:14.880852 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880215    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 17:26:14.880852 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880218    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 17:26:14.880852 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880220    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 17:26:14.880852 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880223    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 17:26:14.880852 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880225    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 17:26:14.880852 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880228    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 17:26:14.880852 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880231    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 17:26:14.880852 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880233    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 17:26:14.880852 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880236    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 17:26:14.880852 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880239    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 17:26:14.880852 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880242    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 17:26:14.880852 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880244    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 17:26:14.880852 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880247    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 17:26:14.880852 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880249    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 17:26:14.880852 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880252    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 17:26:14.881358 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880254    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 17:26:14.881358 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880257    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 17:26:14.881358 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880260    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 17:26:14.881358 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880262    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 17:26:14.881358 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880265    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 17:26:14.881358 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880268    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 17:26:14.881358 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880270    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 17:26:14.881358 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880273    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 17:26:14.881358 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880275    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 17:26:14.881358 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880278    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 17:26:14.881358 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880280    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 17:26:14.881358 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880283    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 17:26:14.881358 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880285    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 17:26:14.881358 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880288    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 17:26:14.881358 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880292    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 17:26:14.881358 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880296    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 17:26:14.881358 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880298    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 17:26:14.881358 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880302    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 17:26:14.881358 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880305    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 17:26:14.881358 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880307    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 17:26:14.881851 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880310    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 17:26:14.881851 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880313    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 17:26:14.881851 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880316    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 17:26:14.881851 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880319    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 17:26:14.881851 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880322    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 17:26:14.881851 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880326    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 17:26:14.881851 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880329    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 17:26:14.881851 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880332    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 17:26:14.881851 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880335    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 17:26:14.881851 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880337    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 17:26:14.881851 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880340    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 17:26:14.881851 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880343    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 17:26:14.881851 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880345    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 17:26:14.881851 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880349    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 17:26:14.881851 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880353    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 17:26:14.881851 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880355    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 17:26:14.881851 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880358    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 17:26:14.881851 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880360    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 17:26:14.881851 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880363    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 17:26:14.882322 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880366    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 17:26:14.882322 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880368    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 17:26:14.882322 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880371    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 17:26:14.882322 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880373    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 17:26:14.882322 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880376    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 17:26:14.882322 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880378    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 17:26:14.882322 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880382    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 17:26:14.882322 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880385    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 17:26:14.882322 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880388    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 17:26:14.882322 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880391    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 17:26:14.882322 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880394    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 17:26:14.882322 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880397    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 17:26:14.882322 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880399    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 17:26:14.882322 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880402    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 17:26:14.882322 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.880404    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 17:26:14.882322 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881085    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 17:26:14.882322 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881093    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 17:26:14.882322 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881096    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 17:26:14.882322 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881099    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 17:26:14.882322 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881102    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 17:26:14.882819 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881105    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 17:26:14.882819 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881108    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 17:26:14.882819 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881111    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 17:26:14.882819 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881114    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 17:26:14.882819 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881116    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 17:26:14.882819 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881118    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 17:26:14.882819 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881121    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 17:26:14.882819 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881123    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 17:26:14.882819 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881126    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 17:26:14.882819 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881128    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 17:26:14.882819 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881131    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 17:26:14.882819 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881133    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 17:26:14.882819 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881137    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 17:26:14.882819 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881139    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 17:26:14.882819 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881142    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 17:26:14.882819 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881144    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 17:26:14.882819 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881146    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 17:26:14.882819 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881149    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 17:26:14.882819 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881151    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 17:26:14.882819 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881154    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 17:26:14.883361 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881156    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 17:26:14.883361 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881158    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 17:26:14.883361 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881161    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 17:26:14.883361 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881163    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 17:26:14.883361 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881166    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 17:26:14.883361 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881184    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 17:26:14.883361 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881187    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 17:26:14.883361 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881189    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 17:26:14.883361 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881193    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 17:26:14.883361 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881196    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 17:26:14.883361 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881199    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 17:26:14.883361 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881202    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 17:26:14.883361 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881204    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 17:26:14.883361 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881207    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 17:26:14.883361 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881210    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 17:26:14.883361 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881213    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 17:26:14.883361 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881215    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 17:26:14.883361 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881218    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 17:26:14.883361 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881220    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 17:26:14.883361 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881223    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 17:26:14.883856 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881225    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 17:26:14.883856 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881228    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 17:26:14.883856 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881230    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 17:26:14.883856 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881232    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 17:26:14.883856 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881235    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 17:26:14.883856 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881239    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 17:26:14.883856 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881241    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 17:26:14.883856 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881243    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 17:26:14.883856 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881246    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 17:26:14.883856 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881249    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 17:26:14.883856 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881251    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 17:26:14.883856 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881256    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 17:26:14.883856 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881260    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 17:26:14.883856 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881263    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 17:26:14.883856 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881266    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 17:26:14.883856 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881268    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 17:26:14.883856 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881271    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 17:26:14.883856 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881273    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 17:26:14.883856 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881276    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 17:26:14.884342 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881278    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 17:26:14.884342 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881281    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 17:26:14.884342 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881284    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 17:26:14.884342 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881287    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 17:26:14.884342 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881289    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 17:26:14.884342 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881293    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 17:26:14.884342 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881297    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 17:26:14.884342 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881299    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 17:26:14.884342 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881302    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 17:26:14.884342 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881305    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 17:26:14.884342 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881308    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 17:26:14.884342 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881310    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 17:26:14.884342 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881314    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 17:26:14.884342 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881317    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 17:26:14.884342 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881320    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 17:26:14.884342 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881323    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 17:26:14.884342 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881326    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 17:26:14.884342 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881330    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 17:26:14.884342 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881333    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 17:26:14.884821 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881336    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 17:26:14.884821 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881338    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 17:26:14.884821 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881341    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 17:26:14.884821 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881343    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 17:26:14.884821 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881346    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 17:26:14.884821 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881348    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 17:26:14.884821 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881351    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 17:26:14.884821 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881354    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 17:26:14.884821 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881356    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 17:26:14.884821 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881358    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 17:26:14.884821 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881361    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 17:26:14.884821 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881364    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 17:26:14.884821 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881367    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 17:26:14.884821 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881370    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 17:26:14.884821 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881372    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 17:26:14.884821 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881375    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 17:26:14.884821 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881749    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 17:26:14.884821 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881755    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 17:26:14.884821 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881759    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 17:26:14.884821 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881761    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 17:26:14.885320 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881764    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 17:26:14.885320 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881767    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 17:26:14.885320 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881769    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 17:26:14.885320 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881773    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 17:26:14.885320 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881775    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 17:26:14.885320 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881778    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 17:26:14.885320 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881780    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 17:26:14.885320 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881783    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 17:26:14.885320 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881785    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 17:26:14.885320 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881788    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 17:26:14.885320 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881791    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 17:26:14.885320 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881794    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 17:26:14.885320 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881797    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 17:26:14.885320 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881799    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 17:26:14.885320 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881802    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 17:26:14.885320 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881804    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 17:26:14.885320 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881807    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 17:26:14.885320 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881809    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 17:26:14.885320 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881811    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 17:26:14.885320 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881814    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 17:26:14.885812 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881817    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 17:26:14.885812 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881819    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 17:26:14.885812 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881821    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 17:26:14.885812 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881824    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 17:26:14.885812 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881828    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 17:26:14.885812 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881831    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 17:26:14.885812 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881834    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 17:26:14.885812 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881836    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 17:26:14.885812 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881838    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 17:26:14.885812 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881841    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 17:26:14.885812 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881844    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 17:26:14.885812 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881846    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 17:26:14.885812 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881848    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 17:26:14.885812 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881850    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 17:26:14.885812 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881853    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 17:26:14.885812 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881855    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 17:26:14.885812 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881858    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 17:26:14.885812 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881860    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 17:26:14.885812 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881863    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 17:26:14.886297 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881865    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 17:26:14.886297 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881868    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 17:26:14.886297 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881871    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 17:26:14.886297 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881874    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 17:26:14.886297 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881876    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 17:26:14.886297 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881878    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 17:26:14.886297 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881882    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 17:26:14.886297 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881884    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 17:26:14.886297 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881886    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 17:26:14.886297 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881889    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 17:26:14.886297 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881892    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 17:26:14.886297 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881894    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 17:26:14.886297 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881897    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 17:26:14.886297 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881899    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 17:26:14.886297 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881903    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 17:26:14.886297 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881905    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 17:26:14.886297 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881907    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 17:26:14.886297 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881910    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 17:26:14.886297 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881912    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 17:26:14.886297 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881914    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 17:26:14.886796 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881917    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 17:26:14.886796 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881919    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 17:26:14.886796 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881922    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 17:26:14.886796 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881924    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 17:26:14.886796 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881927    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 17:26:14.886796 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881929    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 17:26:14.886796 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881932    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 17:26:14.886796 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881934    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 17:26:14.886796 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881937    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 17:26:14.886796 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881939    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 17:26:14.886796 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881943    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 17:26:14.886796 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881946    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 17:26:14.886796 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881949    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 17:26:14.886796 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881952    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 17:26:14.886796 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881955    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 17:26:14.886796 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881958    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 17:26:14.886796 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881961    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 17:26:14.886796 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881963    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 17:26:14.886796 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881966    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 17:26:14.887272 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881969    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 17:26:14.887272 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881973    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 17:26:14.887272 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881976    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 17:26:14.887272 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881980    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 17:26:14.887272 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881983    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 17:26:14.887272 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881986    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 17:26:14.887272 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881989    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 17:26:14.887272 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881991    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 17:26:14.887272 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881994    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 17:26:14.887272 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.881997    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 17:26:14.887272 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882000    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 17:26:14.887272 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882002    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 17:26:14.887272 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882007    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 17:26:14.887272 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882010    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 17:26:14.887272 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882012    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 17:26:14.887272 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882015    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 17:26:14.887272 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882017    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 17:26:14.887272 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882083    2581 flags.go:64] FLAG: --address="0.0.0.0"
Jul 21 17:26:14.887272 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882090    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 21 17:26:14.887272 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882098    2581 flags.go:64] FLAG: --anonymous-auth="true"
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882104    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882111    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882116    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882121    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882137    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882142    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882146    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882149    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882152    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882155    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882158    2581 flags.go:64] FLAG: --cgroup-root=""
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882161    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882164    2581 flags.go:64] FLAG: --client-ca-file=""
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882180    2581 flags.go:64] FLAG: --cloud-provider="external"
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882183    2581 flags.go:64] FLAG: --cluster-dns="[]"
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882189    2581 flags.go:64] FLAG: --cluster-domain=""
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882192    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882195    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882198    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882201    2581 flags.go:64] FLAG: --container-log-max-files="5"
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882204    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882207    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 21 17:26:14.887833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882210    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882213    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882218    2581 flags.go:64] FLAG: --contention-profiling="false"
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882221    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882224    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882227    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882230    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882233    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882245    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882248    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882251    2581 flags.go:64] FLAG: --enable-load-reader="false"
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882253    2581 flags.go:64] FLAG: --enable-server="true"
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882256    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882260    2581 flags.go:64] FLAG: --event-burst="100"
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882263    2581 flags.go:64] FLAG: --event-qps="50"
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882266    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882269    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882271    2581 flags.go:64] FLAG: --eviction-hard=""
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882275    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882278    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882280    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882283    2581 flags.go:64] FLAG: --eviction-soft=""
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882285    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882288    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882291    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 21 17:26:14.888417 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882294    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882297    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882300    2581 flags.go:64] FLAG: --fail-swap-on="true"
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882303    2581 flags.go:64] FLAG: --feature-gates=""
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882306    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882309    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882312    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882314    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882317    2581 flags.go:64] FLAG: --healthz-port="10248"
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882322    2581 flags.go:64] FLAG: --help="false"
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882324    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-135-98.ec2.internal"
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882328    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882331    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882334    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882337    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882340    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882343    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882346    2581 flags.go:64] FLAG: --image-service-endpoint=""
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882348    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882351    2581 flags.go:64] FLAG: --kube-api-burst="100"
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882354    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882356    2581 flags.go:64] FLAG: --kube-api-qps="50"
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882359    2581 flags.go:64] FLAG: --kube-reserved=""
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882362    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 21 17:26:14.889072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882364    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882367    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882370    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882372    2581 flags.go:64] FLAG: --lock-file=""
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882375    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882378    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882382    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882388    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882391    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882394    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882396    2581 flags.go:64] FLAG: --logging-format="text"
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882399    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882402    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882405    2581 flags.go:64] FLAG: --manifest-url=""
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882407    2581 flags.go:64] FLAG: --manifest-url-header=""
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882412    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882414    2581 flags.go:64] FLAG: --max-open-files="1000000"
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882419    2581 flags.go:64] FLAG: --max-pods="110"
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882422    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882425    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882428    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882435    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882438    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882441    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882444    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 21 17:26:14.890031 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882452    2581 flags.go:64] FLAG: --node-status-max-images="50"
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882455    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882457    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882460    2581 flags.go:64] FLAG: --pod-cidr=""
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882463    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882469    2581 flags.go:64] FLAG: --pod-manifest-path=""
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882472    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882475    2581 flags.go:64] FLAG: --pods-per-core="0"
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882477    2581 flags.go:64] FLAG: --port="10250"
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882480    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882483    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-093fcd87ffa0bc8e2"
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882486    2581 flags.go:64] FLAG: --qos-reserved=""
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882489    2581 flags.go:64] FLAG: --read-only-port="10255"
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882492    2581 flags.go:64] FLAG: --register-node="true"
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882496    2581 flags.go:64] FLAG: --register-with-taints=""
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882499    2581 flags.go:64] FLAG: --registry-burst="10"
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882503    2581 flags.go:64] FLAG: --registry-qps="5"
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882505    2581 flags.go:64] FLAG: --reserved-cpus=""
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882508    2581 flags.go:64] FLAG: --reserved-memory=""
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882512    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882514    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882517    2581 flags.go:64] FLAG: --rotate-certificates="false"
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882520    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882523    2581 flags.go:64] FLAG: --runonce="false"
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882526    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 21 17:26:14.891152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882530    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882532    2581 flags.go:64] FLAG: --seccomp-default="false"
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882535    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882538    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882541    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882544    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882547    2581 flags.go:64] FLAG: --storage-driver-password="root"
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882550    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882552    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882555    2581 flags.go:64] FLAG: --storage-driver-user="root"
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882558    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882561    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882563    2581 flags.go:64] FLAG: --system-cgroups=""
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882566    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882571    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882574    2581 flags.go:64] FLAG: --tls-cert-file=""
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882577    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882581    2581 flags.go:64] FLAG: --tls-min-version=""
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882583    2581 flags.go:64] FLAG: --tls-private-key-file=""
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882586    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882589    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882593    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882595    2581 flags.go:64] FLAG: --v="2"
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882599    2581 flags.go:64] FLAG: --version="false"
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882604    2581 flags.go:64] FLAG: --vmodule=""
Jul 21 17:26:14.892282 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882607    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 21 17:26:14.893241 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.882611    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 21 17:26:14.893241 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882751    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 17:26:14.893241 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882757    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 17:26:14.893241 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882760    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 17:26:14.893241 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882763    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 17:26:14.893241 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882770    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 17:26:14.893241 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882773    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 17:26:14.893241 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882775    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 17:26:14.893241 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882778    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 17:26:14.893241 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882781    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 17:26:14.893241 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882783    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 17:26:14.893241 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882786    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 17:26:14.893241 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882789    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 17:26:14.893241 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882791    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 17:26:14.893241 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882793    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 17:26:14.893241 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882796    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 17:26:14.893241 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882798    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 17:26:14.893241 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882801    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 17:26:14.893241 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882803    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 17:26:14.893241 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882806    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 17:26:14.893773 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882808    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 17:26:14.893773 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882811    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 17:26:14.893773 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882813    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 17:26:14.893773 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882816    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 17:26:14.893773 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882818    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 17:26:14.893773 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882820    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 17:26:14.893773 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882823    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 17:26:14.893773 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882827    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 17:26:14.893773 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882829    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 17:26:14.893773 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882832    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 17:26:14.893773 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882835    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 17:26:14.893773 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882837    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 17:26:14.893773 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882840    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 17:26:14.893773 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882842    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 17:26:14.893773 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882845    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 17:26:14.893773 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882847    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 17:26:14.893773 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882850    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 17:26:14.893773 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882854    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 17:26:14.893773 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882856    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 17:26:14.893773 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882858    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 17:26:14.894744 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882861    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 17:26:14.894744 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882863    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 17:26:14.894744 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882867    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 17:26:14.894744 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882870    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 17:26:14.894744 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882873    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 17:26:14.894744 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882876    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 17:26:14.894744 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882878    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 17:26:14.894744 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882881    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 17:26:14.894744 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882883    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 17:26:14.894744 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882886    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 17:26:14.894744 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882889    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 17:26:14.894744 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882891    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 17:26:14.894744 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882893    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 17:26:14.894744 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882896    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 17:26:14.894744 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882898    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 17:26:14.894744 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882901    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 17:26:14.894744 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882903    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 17:26:14.894744 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882906    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 17:26:14.894744 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882908    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 17:26:14.895426 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882912    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 17:26:14.895426 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882914    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 17:26:14.895426 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882916    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 17:26:14.895426 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882919    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 17:26:14.895426 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882921    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 17:26:14.895426 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882924    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 17:26:14.895426 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882927    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 17:26:14.895426 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882929    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 17:26:14.895426 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882932    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 17:26:14.895426 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882934    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 17:26:14.895426 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882938    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 17:26:14.895426 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882941    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 17:26:14.895426 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882943    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 17:26:14.895426 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882946    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 17:26:14.895426 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882948    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 17:26:14.895426 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882950    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 17:26:14.895426 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882953    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 17:26:14.895426 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882956    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 17:26:14.895426 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882958    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 17:26:14.895426 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882961    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 17:26:14.896046 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882963    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 17:26:14.896046 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882966    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 17:26:14.896046 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882968    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 17:26:14.896046 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882971    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 17:26:14.896046 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882974    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 17:26:14.896046 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882977    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 17:26:14.896046 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882980    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 17:26:14.896046 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882983    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 17:26:14.896046 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882985    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 17:26:14.896046 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882988    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 17:26:14.896046 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882990    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 17:26:14.896046 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882993    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 17:26:14.896046 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882996    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 17:26:14.896046 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.882999    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 17:26:14.896046 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.883001    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 17:26:14.896046 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.883004    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 17:26:14.896046 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.883006    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 17:26:14.896046 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.883009    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 17:26:14.896046 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.883013    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 17:26:14.896046 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.883015    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 17:26:14.896562 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.883017    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 17:26:14.896562 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.883722    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 17:26:14.896562 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.891468    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 21 17:26:14.896562 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.891487    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 21 17:26:14.896562 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.891505    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 21 17:26:14.896562 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.891515    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 21 17:26:14.896562 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891598    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 17:26:14.896562 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891606    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 17:26:14.896562 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891612    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 17:26:14.896562 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891616    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 17:26:14.896562 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891621    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 17:26:14.896562 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891628    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 17:26:14.896562 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891634    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 17:26:14.896562 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891639    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 17:26:14.896938 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891643    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 17:26:14.896938 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891648    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 17:26:14.896938 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891652    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 17:26:14.896938 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891658    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 17:26:14.896938 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891662    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 17:26:14.896938 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891666    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 17:26:14.896938 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891670    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 17:26:14.896938 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891675    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 17:26:14.896938 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891679    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 17:26:14.896938 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891683    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 17:26:14.896938 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891688    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 17:26:14.896938 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891692    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 17:26:14.896938 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891696    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 17:26:14.896938 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891701    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 17:26:14.896938 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891705    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 17:26:14.896938 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891710    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 17:26:14.896938 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891714    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 17:26:14.896938 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891719    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 17:26:14.896938 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891723    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 17:26:14.896938 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891728    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 17:26:14.897452 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891732    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 17:26:14.897452 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891738    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 17:26:14.897452 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891743    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 17:26:14.897452 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891747    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 17:26:14.897452 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891751    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 17:26:14.897452 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891755    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 17:26:14.897452 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891762    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 17:26:14.897452 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891768    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 17:26:14.897452 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891773    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 17:26:14.897452 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891778    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 17:26:14.897452 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891783    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 17:26:14.897452 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891788    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 17:26:14.897452 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891792    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 17:26:14.897452 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891797    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 17:26:14.897452 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891801    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 17:26:14.897452 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891806    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 17:26:14.897452 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891810    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 17:26:14.897452 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891814    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 17:26:14.897452 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891819    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 17:26:14.897968 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891823    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 17:26:14.897968 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891827    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 17:26:14.897968 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891831    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 17:26:14.897968 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891836    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 17:26:14.897968 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891840    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 17:26:14.897968 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891844    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 17:26:14.897968 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891849    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 17:26:14.897968 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891853    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 17:26:14.897968 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891857    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 17:26:14.897968 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891862    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 17:26:14.897968 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891866    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 17:26:14.897968 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891871    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 17:26:14.897968 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891875    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 17:26:14.897968 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891879    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 17:26:14.897968 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891883    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 17:26:14.897968 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891890    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 17:26:14.897968 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891895    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 17:26:14.897968 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891899    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 17:26:14.897968 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891903    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 17:26:14.897968 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891907    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 17:26:14.898570 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891912    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 17:26:14.898570 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891916    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 17:26:14.898570 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891920    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 17:26:14.898570 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891926    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 17:26:14.898570 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891932    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 17:26:14.898570 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891937    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 17:26:14.898570 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891942    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 17:26:14.898570 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891946    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 17:26:14.898570 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891951    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 17:26:14.898570 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891956    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 17:26:14.898570 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891961    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 17:26:14.898570 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891966    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 17:26:14.898570 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891970    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 17:26:14.898570 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891975    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 17:26:14.898570 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891979    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 17:26:14.898570 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891983    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 17:26:14.898570 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891988    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 17:26:14.898570 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891993    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 17:26:14.898570 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.891997    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 17:26:14.899051 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892002    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 17:26:14.899051 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892006    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 17:26:14.899051 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892010    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 17:26:14.899051 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892014    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 17:26:14.899051 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892019    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 17:26:14.899051 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892023    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 17:26:14.899051 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892027    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 17:26:14.899051 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892031    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 17:26:14.899051 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892036    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 17:26:14.899051 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892041    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 17:26:14.899051 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892045    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 17:26:14.899051 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892049    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 17:26:14.899051 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892053    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 17:26:14.899051 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.892062    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 17:26:14.899051 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892257    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 21 17:26:14.899487 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892267    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 21 17:26:14.899487 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892273    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 21 17:26:14.899487 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892277    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 21 17:26:14.899487 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892282    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 21 17:26:14.899487 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892286    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 21 17:26:14.899487 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892291    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 21 17:26:14.899487 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892295    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 21 17:26:14.899487 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892299    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 21 17:26:14.899487 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892303    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 21 17:26:14.899487 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892307    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 21 17:26:14.899487 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892311    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 21 17:26:14.899487 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892315    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 21 17:26:14.899487 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892320    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 21 17:26:14.899487 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892324    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 21 17:26:14.899487 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892328    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 21 17:26:14.899487 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892333    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 21 17:26:14.899487 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892337    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 21 17:26:14.899487 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892342    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 21 17:26:14.899487 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892346    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 21 17:26:14.899487 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892350    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 21 17:26:14.899998 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892354    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 21 17:26:14.899998 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892358    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 21 17:26:14.899998 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892363    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 21 17:26:14.899998 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892366    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 21 17:26:14.899998 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892371    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 21 17:26:14.899998 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892376    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 21 17:26:14.899998 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892380    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 21 17:26:14.899998 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892386    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 21 17:26:14.899998 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892390    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 21 17:26:14.899998 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892394    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 21 17:26:14.899998 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892398    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 21 17:26:14.899998 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892402    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 21 17:26:14.899998 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892407    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 21 17:26:14.899998 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892411    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 21 17:26:14.899998 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892416    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 21 17:26:14.899998 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892420    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 21 17:26:14.899998 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892424    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 21 17:26:14.899998 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892429    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 21 17:26:14.899998 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892433    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 21 17:26:14.899998 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892437    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 21 17:26:14.900661 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892441    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 21 17:26:14.900661 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892445    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 21 17:26:14.900661 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892450    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 21 17:26:14.900661 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892454    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 21 17:26:14.900661 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892458    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 21 17:26:14.900661 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892463    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 21 17:26:14.900661 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892467    2581 feature_gate.go:328] unrecognized feature gate: Example
Jul 21 17:26:14.900661 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892471    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 21 17:26:14.900661 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892475    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 21 17:26:14.900661 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892480    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 21 17:26:14.900661 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892485    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 21 17:26:14.900661 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892489    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 21 17:26:14.900661 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892493    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 21 17:26:14.900661 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892497    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 21 17:26:14.900661 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892501    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 21 17:26:14.900661 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892505    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 21 17:26:14.900661 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892510    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 21 17:26:14.900661 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892514    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 21 17:26:14.900661 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892518    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 21 17:26:14.900661 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892524    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 21 17:26:14.901156 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892529    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 21 17:26:14.901156 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892533    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 21 17:26:14.901156 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892537    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 21 17:26:14.901156 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892541    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 21 17:26:14.901156 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892545    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 21 17:26:14.901156 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892550    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 21 17:26:14.901156 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892554    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 21 17:26:14.901156 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892558    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 21 17:26:14.901156 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892563    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 21 17:26:14.901156 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892567    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 21 17:26:14.901156 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892571    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 21 17:26:14.901156 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892577    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 21 17:26:14.901156 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892583    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 21 17:26:14.901156 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892588    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 21 17:26:14.901156 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892593    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 21 17:26:14.901156 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892598    2581 feature_gate.go:328] unrecognized feature gate: Example2
Jul 21 17:26:14.901156 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892603    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 21 17:26:14.901156 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892608    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 21 17:26:14.901156 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892612    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 21 17:26:14.901156 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892616    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 21 17:26:14.901702 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892621    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 21 17:26:14.901702 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892626    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 21 17:26:14.901702 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892631    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 21 17:26:14.901702 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892636    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 21 17:26:14.901702 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892640    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 21 17:26:14.901702 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892645    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 21 17:26:14.901702 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892649    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 21 17:26:14.901702 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892654    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 21 17:26:14.901702 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892658    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 21 17:26:14.901702 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892665    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 21 17:26:14.901702 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892670    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 21 17:26:14.901702 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892675    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 21 17:26:14.901702 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892679    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 21 17:26:14.901702 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892684    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 21 17:26:14.901702 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892689    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 21 17:26:14.901702 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892693    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 21 17:26:14.901702 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892699    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 21 17:26:14.901702 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:14.892705    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 21 17:26:14.902431 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.892713    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 21 17:26:14.902431 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.892873    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 21 17:26:14.902431 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.895822    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 21 17:26:14.902431 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.897576    2581 server.go:1019] "Starting client certificate rotation"
Jul 21 17:26:14.902431 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.897684    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 17:26:14.902431 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.897719    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 21 17:26:14.902431 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.900499    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 17:26:14.903399 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.903381    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 21 17:26:14.913067 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.913051    2581 log.go:25] "Validated CRI v1 runtime API"
Jul 21 17:26:14.916069 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.916054    2581 log.go:25] "Validated CRI v1 image API"
Jul 21 17:26:14.916902 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.916889    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 21 17:26:14.919130 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.919112    2581 fs.go:135] Filesystem UUIDs: map[3c7cb620-a291-4a45-a67a-f2fa34643302:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ddb89d45-80a1-4629-82b0-2352221709f8:/dev/nvme0n1p4]
Jul 21 17:26:14.919190 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.919131    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 21 17:26:14.923860 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.923756    2581 manager.go:216] Machine: {Timestamp:2026-07-21 17:26:14.922664386 +0000 UTC m=+0.323228464 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3120567 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27ab87af30cd0041c20ce1316fad1a SystemUUID:ec27ab87-af30-cd00-41c2-0ce1316fad1a BootID:8da475b3-28ea-4c9e-be79-1a601c4e0e42 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1a:c6:ce:dc:8d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1a:c6:ce:dc:8d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4e:0f:d6:18:bc:43 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 21 17:26:14.923860 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.923858    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 21 17:26:14.923962 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.923930    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 21 17:26:14.926096 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.926076    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 17:26:14.926864 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.926838    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 21 17:26:14.926985 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.926867    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-98.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 21 17:26:14.928249 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.928238    2581 topology_manager.go:138] "Creating topology manager with none policy"
Jul 21 17:26:14.928292 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.928251    2581 container_manager_linux.go:309] "Creating device plugin manager"
Jul 21 17:26:14.928292 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.928259    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 17:26:14.929100 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.929090    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 21 17:26:14.930819 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.930809    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 21 17:26:14.934000 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.933989    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 17:26:14.934149 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.934138    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 21 17:26:14.934212 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.934188    2581 kubelet.go:486] "Attempting to sync node with API server"
Jul 21 17:26:14.934212 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.934201    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 21 17:26:14.934294 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.934215    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 21 17:26:14.934294 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.934226    2581 kubelet.go:398] "Adding apiserver pod source"
Jul 21 17:26:14.934294 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.934234    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 21 17:26:14.934545 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.934534    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 17:26:14.934583 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.934555    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 21 17:26:14.936617 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.936599    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 21 17:26:14.939070 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.939056    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 21 17:26:14.939142 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.939087    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 21 17:26:14.940344 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.940331    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 21 17:26:14.940397 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.940350    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 21 17:26:14.940397 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.940357    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 21 17:26:14.940397 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.940363    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 21 17:26:14.940397 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.940375    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 21 17:26:14.940397 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.940383    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 21 17:26:14.940397 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.940390    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 21 17:26:14.940397 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.940395    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 21 17:26:14.940577 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.940401    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 21 17:26:14.940577 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.940406    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 21 17:26:14.940577 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.940414    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 21 17:26:14.940577 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.940420    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 21 17:26:14.941934 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.941921    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 21 17:26:14.941934 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.941932    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 21 17:26:14.944952 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.944940    2581 server.go:1268] "Started kubelet"
Jul 21 17:26:14.945067 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.945041    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 21 17:26:14.945161 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.945043    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 21 17:26:14.948687 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.948665    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 21 17:26:14.949186 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.949147    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-98.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 21 17:26:14.949307 ip-10-0-135-98 systemd[1]: Started Kubernetes Kubelet.
Jul 21 17:26:14.949540 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:14.949510    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 21 17:26:14.949749 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:14.949723    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-98.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 21 17:26:14.950684 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.950668    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 21 17:26:14.950885 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.950860    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g9tsg"
Jul 21 17:26:14.951428 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.951411    2581 server.go:310] "Adding debug handlers to kubelet server"
Jul 21 17:26:14.955773 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:14.955754    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 21 17:26:14.957030 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:14.956106    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-98.ec2.internal.18c45e0ff34bcd93  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-98.ec2.internal,UID:ip-10-0-135-98.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-98.ec2.internal,},FirstTimestamp:2026-07-21 17:26:14.944910739 +0000 UTC m=+0.345474802,LastTimestamp:2026-07-21 17:26:14.944910739 +0000 UTC m=+0.345474802,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-98.ec2.internal,}"
Jul 21 17:26:14.958387 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.958373    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g9tsg"
Jul 21 17:26:14.960046 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.960032    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 21 17:26:14.960117 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.960050    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 21 17:26:14.960190 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:14.960140    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found"
Jul 21 17:26:14.960735 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.960711    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 21 17:26:14.960810 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.960748    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 21 17:26:14.960810 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.960759    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 21 17:26:14.960908 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.960869    2581 reconstruct.go:97] "Volume reconstruction finished"
Jul 21 17:26:14.960908 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.960877    2581 reconciler.go:29] "Reconciler: start to sync state"
Jul 21 17:26:14.961605 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.961590    2581 factory.go:55] Registering systemd factory
Jul 21 17:26:14.961605 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.961606    2581 factory.go:223] Registration of the systemd container factory successfully
Jul 21 17:26:14.961806 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.961788    2581 factory.go:153] Registering CRI-O factory
Jul 21 17:26:14.961806 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.961808    2581 factory.go:223] Registration of the crio container factory successfully
Jul 21 17:26:14.961889 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.961867    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 21 17:26:14.961889 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.961887    2581 factory.go:103] Registering Raw factory
Jul 21 17:26:14.961946 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.961901    2581 manager.go:1196] Started watching for new ooms in manager
Jul 21 17:26:14.962414 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:14.962392    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-98.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 21 17:26:14.962510 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.962491    2581 manager.go:349] Starting recovery of all containers
Jul 21 17:26:14.962576 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:14.962514    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 21 17:26:14.969710 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.969665    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 21 17:26:14.972495 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.972478    2581 manager.go:354] Recovery completed
Jul 21 17:26:14.974791 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:14.974669    2581 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 21 17:26:14.977565 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.977554    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 17:26:14.979131 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.979114    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 17:26:14.979222 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.979145    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 17:26:14.979222 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.979154    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientPID"
Jul 21 17:26:14.979741 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.979728    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 21 17:26:14.979741 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.979739    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 21 17:26:14.979844 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.979755    2581 state_mem.go:36] "Initialized new in-memory state store"
Jul 21 17:26:14.979897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.979740    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 17:26:14.980598 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.980585    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 17:26:14.980661 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.980608    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 17:26:14.980661 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.980618    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientPID"
Jul 21 17:26:14.980895 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.980883    2581 policy_none.go:49] "None policy: Start"
Jul 21 17:26:14.980928 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.980900    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 21 17:26:14.980928 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.980909    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 21 17:26:14.981842 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:14.981831    2581 policy_none.go:47] "Start"
Jul 21 17:26:15.020677 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.020664    2581 manager.go:337] "Starting Device Plugin manager"
Jul 21 17:26:15.020764 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:15.020693    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 21 17:26:15.020764 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.020701    2581 server.go:87] "Starting device plugin registration server"
Jul 21 17:26:15.020891 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.020879    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 21 17:26:15.020955 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.020894    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 21 17:26:15.021010 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.020967    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 21 17:26:15.021058 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.021040    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 21 17:26:15.021058 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.021049    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 21 17:26:15.021529 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:15.021506    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 21 17:26:15.021613 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:15.021558    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-98.ec2.internal\" not found"
Jul 21 17:26:15.119344 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.119322    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 21 17:26:15.120447 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.119362    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 21 17:26:15.120447 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.119383    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 21 17:26:15.120447 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:15.119417    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 21 17:26:15.120984 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.120966    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 17:26:15.121942 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.121893    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 17:26:15.121942 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.121923    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 17:26:15.121942 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.121940    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientPID"
Jul 21 17:26:15.122118 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.121968    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-98.ec2.internal"
Jul 21 17:26:15.122118 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.122077    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 17:26:15.132240 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.132217    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-98.ec2.internal"
Jul 21 17:26:15.132240 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:15.132240    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-98.ec2.internal\": node \"ip-10-0-135-98.ec2.internal\" not found"
Jul 21 17:26:15.144679 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:15.144660    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found"
Jul 21 17:26:15.219785 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.219753    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-98.ec2.internal"]
Jul 21 17:26:15.219866 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.219829    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 17:26:15.220635 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.220620    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 17:26:15.220686 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.220648    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 17:26:15.220686 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.220656    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientPID"
Jul 21 17:26:15.221811 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.221799    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 17:26:15.221934 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.221921    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal"
Jul 21 17:26:15.221971 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.221948    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 17:26:15.222458 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.222445    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 17:26:15.222519 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.222468    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 17:26:15.222519 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.222484    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientPID"
Jul 21 17:26:15.222596 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.222540    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 17:26:15.222596 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.222558    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 17:26:15.222596 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.222568    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientPID"
Jul 21 17:26:15.223687 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.223674    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-98.ec2.internal"
Jul 21 17:26:15.223784 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.223696    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 21 17:26:15.224366 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.224350    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientMemory"
Jul 21 17:26:15.224443 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.224377    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasNoDiskPressure"
Jul 21 17:26:15.224443 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.224388    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeHasSufficientPID"
Jul 21 17:26:15.243769 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:15.243753    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-98.ec2.internal\" not found" node="ip-10-0-135-98.ec2.internal"
Jul 21 17:26:15.245707 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:15.245692    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found"
Jul 21 17:26:15.248285 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:15.248272    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-98.ec2.internal\" not found" node="ip-10-0-135-98.ec2.internal"
Jul 21 17:26:15.263334 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.263311    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0629444ec59d540f7d4f04814af2104d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal\" (UID: \"0629444ec59d540f7d4f04814af2104d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal"
Jul 21 17:26:15.263414 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.263339    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0629444ec59d540f7d4f04814af2104d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal\" (UID: \"0629444ec59d540f7d4f04814af2104d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal"
Jul 21 17:26:15.263414 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.263357    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/52a2fdb785bd958c3f182967e497262f-config\") pod \"kube-apiserver-proxy-ip-10-0-135-98.ec2.internal\" (UID: \"52a2fdb785bd958c3f182967e497262f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-98.ec2.internal"
Jul 21 17:26:15.346500 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:15.346481    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found"
Jul 21 17:26:15.363898 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.363878    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0629444ec59d540f7d4f04814af2104d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal\" (UID: \"0629444ec59d540f7d4f04814af2104d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal"
Jul 21 17:26:15.363953 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.363938    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0629444ec59d540f7d4f04814af2104d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal\" (UID: \"0629444ec59d540f7d4f04814af2104d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal"
Jul 21 17:26:15.363984 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.363961    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/52a2fdb785bd958c3f182967e497262f-config\") pod \"kube-apiserver-proxy-ip-10-0-135-98.ec2.internal\" (UID: \"52a2fdb785bd958c3f182967e497262f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-98.ec2.internal"
Jul 21 17:26:15.364017 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.363981    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0629444ec59d540f7d4f04814af2104d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal\" (UID: \"0629444ec59d540f7d4f04814af2104d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal"
Jul 21 17:26:15.364049 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.364017    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0629444ec59d540f7d4f04814af2104d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal\" (UID: \"0629444ec59d540f7d4f04814af2104d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal"
Jul 21 17:26:15.364083 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.364050    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/52a2fdb785bd958c3f182967e497262f-config\") pod \"kube-apiserver-proxy-ip-10-0-135-98.ec2.internal\" (UID: \"52a2fdb785bd958c3f182967e497262f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-98.ec2.internal"
Jul 21 17:26:15.447355 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:15.447299    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found"
Jul 21 17:26:15.547901 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:15.547872    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found"
Jul 21 17:26:15.547901 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.547881    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal"
Jul 21 17:26:15.552209 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.552025    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-98.ec2.internal"
Jul 21 17:26:15.648870 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:15.648842    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found"
Jul 21 17:26:15.749345 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:15.749273    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found"
Jul 21 17:26:15.849835 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:15.849797    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found"
Jul 21 17:26:15.896202 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.896181    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 21 17:26:15.896599 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.896305    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 21 17:26:15.949883 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:15.949852    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found"
Jul 21 17:26:15.963773 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.963735    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 17:21:15 +0000 UTC" deadline="2027-12-27 22:42:21.637923929 +0000 UTC"
Jul 21 17:26:15.963773 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:15.963769    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12581h16m5.674160213s"
Jul 21 17:26:16.050670 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:16.050631    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found"
Jul 21 17:26:16.121858 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:16.121824    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52a2fdb785bd958c3f182967e497262f.slice/crio-396460c5d08b928fe5d12554768e3876afa39628a152a3059a8df68d3a982fde WatchSource:0}: Error finding container 396460c5d08b928fe5d12554768e3876afa39628a152a3059a8df68d3a982fde: Status 404 returned error can't find the container with id 396460c5d08b928fe5d12554768e3876afa39628a152a3059a8df68d3a982fde
Jul 21 17:26:16.122376 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:16.122357    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0629444ec59d540f7d4f04814af2104d.slice/crio-9c0ac9a77549528e8cd9aa849d9dd61d8223f619e41ae969f6cb1576a744991c WatchSource:0}: Error finding container 9c0ac9a77549528e8cd9aa849d9dd61d8223f619e41ae969f6cb1576a744991c: Status 404 returned error can't find the container with id 9c0ac9a77549528e8cd9aa849d9dd61d8223f619e41ae969f6cb1576a744991c
Jul 21 17:26:16.127564 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.127544    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:26:16.151608 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:16.151572    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-98.ec2.internal\" not found"
Jul 21 17:26:16.162221 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.162201    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 17:26:16.194427 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.194407    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 17:26:16.261269 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.261191    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal"
Jul 21 17:26:16.281411 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.281391    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 17:26:16.283465 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.283451    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-98.ec2.internal"
Jul 21 17:26:16.293659 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.293640    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 21 17:26:16.507354 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.507327    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 17:26:16.906517 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.906485    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 21 17:26:16.934909 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.934888    2581 apiserver.go:52] "Watching apiserver"
Jul 21 17:26:16.945823 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.945612    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 21 17:26:16.947831 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.947801    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq","openshift-cluster-node-tuning-operator/tuned-hxw2v","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal","openshift-multus/multus-additional-cni-plugins-x9w4v","openshift-multus/multus-r55px","openshift-multus/network-metrics-daemon-w77vz","kube-system/kube-apiserver-proxy-ip-10-0-135-98.ec2.internal","openshift-dns/node-resolver-58wgl","openshift-image-registry/node-ca-j8hgf","openshift-network-diagnostics/network-check-target-jxfq5","openshift-network-operator/iptables-alerter-qf4cm","openshift-ovn-kubernetes/ovnkube-node-65gzx","kube-system/global-pull-secret-syncer-vrb68","kube-system/konnectivity-agent-vrcpb"]
Jul 21 17:26:16.949488 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.949465    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:16.949600 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:16.949564    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:26:16.951488 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.951460    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:16.951586 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:16.951537    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:16.952708 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.952686    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vrcpb"
Jul 21 17:26:16.954983 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.953958    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:16.955548 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.955469    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 21 17:26:16.955948 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.955635    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 21 17:26:16.957009 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.956132    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r55px"
Jul 21 17:26:16.957009 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.956635    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 21 17:26:16.957009 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.956901    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hf5rc\""
Jul 21 17:26:16.957887 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.957866    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 21 17:26:16.958118 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.958096    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 21 17:26:16.958927 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.958908    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 21 17:26:16.959230 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.959213    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-crsgh\""
Jul 21 17:26:16.959456 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.959440    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:16.959525 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:16.959498    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:26:16.959585 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.959565    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j8hgf"
Jul 21 17:26:16.961998 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.961968    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-58wgl"
Jul 21 17:26:16.963981 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.962870    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:16.963981 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.963210    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:16.963981 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.963795    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5mkbx\""
Jul 21 17:26:16.964366 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.964335    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 21 17:26:16.964533 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.964517    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 21 17:26:16.964715 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.964695    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 21 17:26:16.964841 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.964816    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8fs9n\""
Jul 21 17:26:16.965038 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.965013    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 21 17:26:16.965164 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.965136    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 21 17:26:16.965254 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.965225    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 21 17:26:16.965414 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.965396    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-scbxh\""
Jul 21 17:26:16.965543 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.965524    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 21 17:26:16.965609 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.965596    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 21 17:26:16.967418 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.967398    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 21 17:26:16.967512 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.967422    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 21 17:26:16.968926 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.968908    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qf4cm"
Jul 21 17:26:16.969966 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.969948    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:16.970660 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.970636    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xkvnl\""
Jul 21 17:26:16.971035 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.971017    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 21 17:26:16.971094 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.971054    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 21 17:26:16.971923 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.971888    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g5xl6\""
Jul 21 17:26:16.972105 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.972088    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 21 17:26:16.973415 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.973392    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-os-release\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:16.973520 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.973431    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:16.973520 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.973469    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a3829cd-c60c-49da-a862-9554ec6a0e2b-tmp-dir\") pod \"node-resolver-58wgl\" (UID: \"8a3829cd-c60c-49da-a862-9554ec6a0e2b\") " pod="openshift-dns/node-resolver-58wgl"
Jul 21 17:26:16.973520 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.973492    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-etc-tuned\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:16.973690 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.973515    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/75f2dec8-5c4a-4312-9743-0429cc8c0034-dbus\") pod \"global-pull-secret-syncer-vrb68\" (UID: \"75f2dec8-5c4a-4312-9743-0429cc8c0034\") " pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:16.973690 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.973542    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-multus-conf-dir\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:16.973690 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.973556    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 21 17:26:16.973690 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.973568    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-cnibin\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:16.973690 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.973591    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-sys\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:16.973690 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.973643    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-system-cni-dir\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:16.973690 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.973669    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:16.974039 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.973694    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-etc-sysconfig\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:16.974039 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.973717    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-lib-modules\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:16.974039 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.973765    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-hostroot\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:16.974039 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.973790    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/62937875-8b91-4296-a94b-da1fdb3fe975-socket-dir\") pod \"aws-ebs-csi-driver-node-4sfmq\" (UID: \"62937875-8b91-4296-a94b-da1fdb3fe975\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:16.974039 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.973834    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxxfl\" (UniqueName: \"kubernetes.io/projected/5adb8d35-0a04-4f54-af3a-fb4c2f8ef1c2-kube-api-access-mxxfl\") pod \"iptables-alerter-qf4cm\" (UID: \"5adb8d35-0a04-4f54-af3a-fb4c2f8ef1c2\") " pod="openshift-network-operator/iptables-alerter-qf4cm"
Jul 21 17:26:16.974039 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.973861    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-etc-sysctl-conf\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:16.974039 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.973921    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-var-lib-kubelet\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:16.974039 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.973928    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 21 17:26:16.974039 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.973949    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1fba69f3-8ad4-4823-b6fb-c3a93e5e5613-konnectivity-ca\") pod \"konnectivity-agent-vrcpb\" (UID: \"1fba69f3-8ad4-4823-b6fb-c3a93e5e5613\") " pod="kube-system/konnectivity-agent-vrcpb"
Jul 21 17:26:16.974039 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.973979    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-system-cni-dir\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:16.974039 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974004    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mlrf\" (UniqueName: \"kubernetes.io/projected/ca9f4acd-b386-4d33-9a03-ac667529f253-kube-api-access-5mlrf\") pod \"node-ca-j8hgf\" (UID: \"ca9f4acd-b386-4d33-9a03-ac667529f253\") " pod="openshift-image-registry/node-ca-j8hgf"
Jul 21 17:26:16.974505 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974027    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/62937875-8b91-4296-a94b-da1fdb3fe975-sys-fs\") pod \"aws-ebs-csi-driver-node-4sfmq\" (UID: \"62937875-8b91-4296-a94b-da1fdb3fe975\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:16.974505 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974076    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a3829cd-c60c-49da-a862-9554ec6a0e2b-hosts-file\") pod \"node-resolver-58wgl\" (UID: \"8a3829cd-c60c-49da-a862-9554ec6a0e2b\") " pod="openshift-dns/node-resolver-58wgl"
Jul 21 17:26:16.974505 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974099    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-host\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:16.974505 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974131    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-multus-cni-dir\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:16.974505 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974161    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-etc-kubernetes\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:16.974505 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974203    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 21 17:26:16.974505 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974201    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-os-release\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:16.974505 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974368    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93f882ed-dbcf-40a5-b763-8d11c45c2813-cni-binary-copy\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:16.974505 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974397    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-host-var-lib-cni-bin\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:16.974505 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974408    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 21 17:26:16.974505 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974425    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/93f882ed-dbcf-40a5-b763-8d11c45c2813-multus-daemon-config\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:16.974505 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974452    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:16.974505 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974484    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-host-var-lib-kubelet\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:16.974505 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974412    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 21 17:26:16.975143 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974519    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca9f4acd-b386-4d33-9a03-ac667529f253-host\") pod \"node-ca-j8hgf\" (UID: \"ca9f4acd-b386-4d33-9a03-ac667529f253\") " pod="openshift-image-registry/node-ca-j8hgf"
Jul 21 17:26:16.975143 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974545    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/62937875-8b91-4296-a94b-da1fdb3fe975-registration-dir\") pod \"aws-ebs-csi-driver-node-4sfmq\" (UID: \"62937875-8b91-4296-a94b-da1fdb3fe975\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:16.975143 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974571    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/62937875-8b91-4296-a94b-da1fdb3fe975-etc-selinux\") pod \"aws-ebs-csi-driver-node-4sfmq\" (UID: \"62937875-8b91-4296-a94b-da1fdb3fe975\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:16.975143 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974595    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-host-run-k8s-cni-cncf-io\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:16.975143 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974618    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-etc-systemd\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:16.975143 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974651    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-run\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:16.975143 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974683    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x2vt\" (UniqueName: \"kubernetes.io/projected/93f882ed-dbcf-40a5-b763-8d11c45c2813-kube-api-access-4x2vt\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:16.975143 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974708    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-etc-modprobe-d\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:16.975143 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974723    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/75f2dec8-5c4a-4312-9743-0429cc8c0034-kubelet-config\") pod \"global-pull-secret-syncer-vrb68\" (UID: \"75f2dec8-5c4a-4312-9743-0429cc8c0034\") " pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:16.975143 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974739    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/62937875-8b91-4296-a94b-da1fdb3fe975-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4sfmq\" (UID: \"62937875-8b91-4296-a94b-da1fdb3fe975\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:16.975143 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974772    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdrlj\" (UniqueName: \"kubernetes.io/projected/8a3829cd-c60c-49da-a862-9554ec6a0e2b-kube-api-access-cdrlj\") pod \"node-resolver-58wgl\" (UID: \"8a3829cd-c60c-49da-a862-9554ec6a0e2b\") " pod="openshift-dns/node-resolver-58wgl"
Jul 21 17:26:16.975143 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974787    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-etc-sysctl-d\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:16.975143 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974800    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-tmp\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:16.975143 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974815    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-multus-socket-dir-parent\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:16.975143 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974835    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs\") pod \"network-metrics-daemon-w77vz\" (UID: \"4402c8fb-d8a6-4c10-ab0f-acfa04695301\") " pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:16.975143 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974858    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7khdh\" (UniqueName: \"kubernetes.io/projected/62937875-8b91-4296-a94b-da1fdb3fe975-kube-api-access-7khdh\") pod \"aws-ebs-csi-driver-node-4sfmq\" (UID: \"62937875-8b91-4296-a94b-da1fdb3fe975\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:16.975980 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974883    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-cni-binary-copy\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:16.975980 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974907    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtbdr\" (UniqueName: \"kubernetes.io/projected/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-kube-api-access-dtbdr\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:16.975980 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.974943    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5adb8d35-0a04-4f54-af3a-fb4c2f8ef1c2-iptables-alerter-script\") pod \"iptables-alerter-qf4cm\" (UID: \"5adb8d35-0a04-4f54-af3a-fb4c2f8ef1c2\") " pod="openshift-network-operator/iptables-alerter-qf4cm"
Jul 21 17:26:16.975980 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.975146    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5adb8d35-0a04-4f54-af3a-fb4c2f8ef1c2-host-slash\") pod \"iptables-alerter-qf4cm\" (UID: \"5adb8d35-0a04-4f54-af3a-fb4c2f8ef1c2\") " pod="openshift-network-operator/iptables-alerter-qf4cm"
Jul 21 17:26:16.975980 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.975172    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ca9f4acd-b386-4d33-9a03-ac667529f253-serviceca\") pod \"node-ca-j8hgf\" (UID: \"ca9f4acd-b386-4d33-9a03-ac667529f253\") " pod="openshift-image-registry/node-ca-j8hgf"
Jul 21 17:26:16.975980 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.975077    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 21 17:26:16.975980 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.975224    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/62937875-8b91-4296-a94b-da1fdb3fe975-device-dir\") pod \"aws-ebs-csi-driver-node-4sfmq\" (UID: \"62937875-8b91-4296-a94b-da1fdb3fe975\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:16.975980 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.975104    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 21 17:26:16.975980 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.975252    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-etc-kubernetes\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:16.975980 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.975276    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5w8t\" (UniqueName: \"kubernetes.io/projected/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-kube-api-access-z5w8t\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:16.975980 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.975299    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-cnibin\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:16.975980 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.975324    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhbhk\" (UniqueName: \"kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk\") pod \"network-check-target-jxfq5\" (UID: \"94d13840-ec8d-446a-8212-c0daa4a94012\") " pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:16.975980 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.975346    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-host-run-netns\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:16.975980 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.975372    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-host-var-lib-cni-multus\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:16.975980 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.975399    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-host-run-multus-certs\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:16.975980 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.975418    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 21 17:26:16.975980 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.975441    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1fba69f3-8ad4-4823-b6fb-c3a93e5e5613-agent-certs\") pod \"konnectivity-agent-vrcpb\" (UID: \"1fba69f3-8ad4-4823-b6fb-c3a93e5e5613\") " pod="kube-system/konnectivity-agent-vrcpb"
Jul 21 17:26:16.975980 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.975465    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 21 17:26:16.976876 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.975524    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret\") pod \"global-pull-secret-syncer-vrb68\" (UID: \"75f2dec8-5c4a-4312-9743-0429cc8c0034\") " pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:16.976876 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.975554    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hrwg\" (UniqueName: \"kubernetes.io/projected/4402c8fb-d8a6-4c10-ab0f-acfa04695301-kube-api-access-6hrwg\") pod \"network-metrics-daemon-w77vz\" (UID: \"4402c8fb-d8a6-4c10-ab0f-acfa04695301\") " pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:16.976876 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.975735    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9zr4g\""
Jul 21 17:26:16.976876 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:16.975963    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nln7t\""
Jul 21 17:26:17.000250 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.000218    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 21 17:26:17.057073 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.057046    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m8jcg"
Jul 21 17:26:17.061905 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.061881    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 21 17:26:17.074829 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.074803    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m8jcg"
Jul 21 17:26:17.075905 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.075881    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs\") pod \"network-metrics-daemon-w77vz\" (UID: \"4402c8fb-d8a6-4c10-ab0f-acfa04695301\") " pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:17.075905 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.075920    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7khdh\" (UniqueName: \"kubernetes.io/projected/62937875-8b91-4296-a94b-da1fdb3fe975-kube-api-access-7khdh\") pod \"aws-ebs-csi-driver-node-4sfmq\" (UID: \"62937875-8b91-4296-a94b-da1fdb3fe975\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:17.076112 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.075949    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-cni-binary-copy\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:17.076112 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.075976    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtbdr\" (UniqueName: \"kubernetes.io/projected/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-kube-api-access-dtbdr\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:17.076112 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076010    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-run-systemd\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.076112 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076035    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8jtk\" (UniqueName: \"kubernetes.io/projected/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-kube-api-access-s8jtk\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.076112 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076061    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5adb8d35-0a04-4f54-af3a-fb4c2f8ef1c2-iptables-alerter-script\") pod \"iptables-alerter-qf4cm\" (UID: \"5adb8d35-0a04-4f54-af3a-fb4c2f8ef1c2\") " pod="openshift-network-operator/iptables-alerter-qf4cm"
Jul 21 17:26:17.076112 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:17.076060    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:26:17.076509 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:17.076164    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs podName:4402c8fb-d8a6-4c10-ab0f-acfa04695301 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:17.576121466 +0000 UTC m=+2.976685520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs") pod "network-metrics-daemon-w77vz" (UID: "4402c8fb-d8a6-4c10-ab0f-acfa04695301") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:26:17.076509 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5adb8d35-0a04-4f54-af3a-fb4c2f8ef1c2-host-slash\") pod \"iptables-alerter-qf4cm\" (UID: \"5adb8d35-0a04-4f54-af3a-fb4c2f8ef1c2\") " pod="openshift-network-operator/iptables-alerter-qf4cm"
Jul 21 17:26:17.076509 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076322    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ca9f4acd-b386-4d33-9a03-ac667529f253-serviceca\") pod \"node-ca-j8hgf\" (UID: \"ca9f4acd-b386-4d33-9a03-ac667529f253\") " pod="openshift-image-registry/node-ca-j8hgf"
Jul 21 17:26:17.076509 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076352    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/62937875-8b91-4296-a94b-da1fdb3fe975-device-dir\") pod \"aws-ebs-csi-driver-node-4sfmq\" (UID: \"62937875-8b91-4296-a94b-da1fdb3fe975\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:17.076509 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076379    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-etc-kubernetes\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.076509 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076404    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5w8t\" (UniqueName: \"kubernetes.io/projected/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-kube-api-access-z5w8t\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.076509 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076431    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-cnibin\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.076509 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076439    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5adb8d35-0a04-4f54-af3a-fb4c2f8ef1c2-host-slash\") pod \"iptables-alerter-qf4cm\" (UID: \"5adb8d35-0a04-4f54-af3a-fb4c2f8ef1c2\") " pod="openshift-network-operator/iptables-alerter-qf4cm"
Jul 21 17:26:17.076509 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076443    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/62937875-8b91-4296-a94b-da1fdb3fe975-device-dir\") pod \"aws-ebs-csi-driver-node-4sfmq\" (UID: \"62937875-8b91-4296-a94b-da1fdb3fe975\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:17.076509 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076458    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhbhk\" (UniqueName: \"kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk\") pod \"network-check-target-jxfq5\" (UID: \"94d13840-ec8d-446a-8212-c0daa4a94012\") " pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:17.076509 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076486    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-host-run-netns\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.076509 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076515    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-host-var-lib-cni-multus\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.077158 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076524    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-etc-kubernetes\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.077158 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076541    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-host-run-multus-certs\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.077158 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1fba69f3-8ad4-4823-b6fb-c3a93e5e5613-agent-certs\") pod \"konnectivity-agent-vrcpb\" (UID: \"1fba69f3-8ad4-4823-b6fb-c3a93e5e5613\") " pod="kube-system/konnectivity-agent-vrcpb"
Jul 21 17:26:17.077158 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076594    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-systemd-units\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.077158 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076598    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-cnibin\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.077158 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076623    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-etc-openvswitch\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.077158 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076650    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-host-run-multus-certs\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.077158 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret\") pod \"global-pull-secret-syncer-vrb68\" (UID: \"75f2dec8-5c4a-4312-9743-0429cc8c0034\") " pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:17.077158 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076694    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hrwg\" (UniqueName: \"kubernetes.io/projected/4402c8fb-d8a6-4c10-ab0f-acfa04695301-kube-api-access-6hrwg\") pod \"network-metrics-daemon-w77vz\" (UID: \"4402c8fb-d8a6-4c10-ab0f-acfa04695301\") " pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:17.077158 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:17.076718    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 17:26:17.077158 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076722    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-os-release\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:17.077158 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076730    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5adb8d35-0a04-4f54-af3a-fb4c2f8ef1c2-iptables-alerter-script\") pod \"iptables-alerter-qf4cm\" (UID: \"5adb8d35-0a04-4f54-af3a-fb4c2f8ef1c2\") " pod="openshift-network-operator/iptables-alerter-qf4cm"
Jul 21 17:26:17.077158 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076749    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:17.077158 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:17.076764    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret podName:75f2dec8-5c4a-4312-9743-0429cc8c0034 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:17.576747583 +0000 UTC m=+2.977311634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret") pod "global-pull-secret-syncer-vrb68" (UID: "75f2dec8-5c4a-4312-9743-0429cc8c0034") : object "kube-system"/"original-pull-secret" not registered
Jul 21 17:26:17.077158 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076789    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a3829cd-c60c-49da-a862-9554ec6a0e2b-tmp-dir\") pod \"node-resolver-58wgl\" (UID: \"8a3829cd-c60c-49da-a862-9554ec6a0e2b\") " pod="openshift-dns/node-resolver-58wgl"
Jul 21 17:26:17.077158 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076814    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-etc-tuned\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.077158 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076820    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-host-var-lib-cni-multus\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.078137 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076839    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/75f2dec8-5c4a-4312-9743-0429cc8c0034-dbus\") pod \"global-pull-secret-syncer-vrb68\" (UID: \"75f2dec8-5c4a-4312-9743-0429cc8c0034\") " pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:17.078137 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076865    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-multus-conf-dir\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.078137 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076874    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-host-run-netns\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.078137 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076884    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ca9f4acd-b386-4d33-9a03-ac667529f253-serviceca\") pod \"node-ca-j8hgf\" (UID: \"ca9f4acd-b386-4d33-9a03-ac667529f253\") " pod="openshift-image-registry/node-ca-j8hgf"
Jul 21 17:26:17.078137 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076892    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-cnibin\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:17.078137 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076934    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-run-ovn\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.078137 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076839    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-cni-binary-copy\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:17.078137 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076966    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-node-log\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.078137 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076994    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-ovnkube-config\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.078137 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076997    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-multus-conf-dir\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.078137 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077026    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-sys\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.078137 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077053    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-system-cni-dir\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.078137 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.076938    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-cnibin\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:17.078137 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077112    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:17.078137 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077146    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-ovnkube-script-lib\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.078137 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077158    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 21 17:26:17.078137 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077174    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-etc-sysconfig\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.078137 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077199    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-lib-modules\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.079084 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077222    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-hostroot\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.079084 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077265    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-sys\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.079084 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077244    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:17.079084 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077269    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/62937875-8b91-4296-a94b-da1fdb3fe975-socket-dir\") pod \"aws-ebs-csi-driver-node-4sfmq\" (UID: \"62937875-8b91-4296-a94b-da1fdb3fe975\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:17.079084 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077304    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/75f2dec8-5c4a-4312-9743-0429cc8c0034-dbus\") pod \"global-pull-secret-syncer-vrb68\" (UID: \"75f2dec8-5c4a-4312-9743-0429cc8c0034\") " pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:17.079084 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077328    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxxfl\" (UniqueName: \"kubernetes.io/projected/5adb8d35-0a04-4f54-af3a-fb4c2f8ef1c2-kube-api-access-mxxfl\") pod \"iptables-alerter-qf4cm\" (UID: \"5adb8d35-0a04-4f54-af3a-fb4c2f8ef1c2\") " pod="openshift-network-operator/iptables-alerter-qf4cm"
Jul 21 17:26:17.079084 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077339    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-os-release\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:17.079084 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077364    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-host-run-netns\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.079084 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077368    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-etc-sysconfig\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.079084 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077343    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-system-cni-dir\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.079084 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077394    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-ovn-node-metrics-cert\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.079084 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077421    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-etc-sysctl-conf\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.079084 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077449    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-var-lib-kubelet\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.079084 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077469    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-lib-modules\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.079084 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077477    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1fba69f3-8ad4-4823-b6fb-c3a93e5e5613-konnectivity-ca\") pod \"konnectivity-agent-vrcpb\" (UID: \"1fba69f3-8ad4-4823-b6fb-c3a93e5e5613\") " pod="kube-system/konnectivity-agent-vrcpb"
Jul 21 17:26:17.079084 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077517    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.079084 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077550    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-var-lib-kubelet\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.079897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077556    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-system-cni-dir\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:17.079897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077609    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-hostroot\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.079897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077583    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-run-openvswitch\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.079897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077646    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8a3829cd-c60c-49da-a862-9554ec6a0e2b-tmp-dir\") pod \"node-resolver-58wgl\" (UID: \"8a3829cd-c60c-49da-a862-9554ec6a0e2b\") " pod="openshift-dns/node-resolver-58wgl"
Jul 21 17:26:17.079897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077657    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-log-socket\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.079897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077652    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-etc-sysctl-conf\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.079897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077690    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mlrf\" (UniqueName: \"kubernetes.io/projected/ca9f4acd-b386-4d33-9a03-ac667529f253-kube-api-access-5mlrf\") pod \"node-ca-j8hgf\" (UID: \"ca9f4acd-b386-4d33-9a03-ac667529f253\") " pod="openshift-image-registry/node-ca-j8hgf"
Jul 21 17:26:17.079897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077718    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/62937875-8b91-4296-a94b-da1fdb3fe975-sys-fs\") pod \"aws-ebs-csi-driver-node-4sfmq\" (UID: \"62937875-8b91-4296-a94b-da1fdb3fe975\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:17.079897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077739    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/62937875-8b91-4296-a94b-da1fdb3fe975-socket-dir\") pod \"aws-ebs-csi-driver-node-4sfmq\" (UID: \"62937875-8b91-4296-a94b-da1fdb3fe975\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:17.079897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077747    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a3829cd-c60c-49da-a862-9554ec6a0e2b-hosts-file\") pod \"node-resolver-58wgl\" (UID: \"8a3829cd-c60c-49da-a862-9554ec6a0e2b\") " pod="openshift-dns/node-resolver-58wgl"
Jul 21 17:26:17.079897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077721    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-system-cni-dir\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:17.079897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077775    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-host\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.079897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077819    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-multus-cni-dir\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.079897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077826    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-host\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.079897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077859    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-etc-kubernetes\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.079897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077871    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8a3829cd-c60c-49da-a862-9554ec6a0e2b-hosts-file\") pod \"node-resolver-58wgl\" (UID: \"8a3829cd-c60c-49da-a862-9554ec6a0e2b\") " pod="openshift-dns/node-resolver-58wgl"
Jul 21 17:26:17.079897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077880    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:17.079897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-os-release\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.080612 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077922    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/62937875-8b91-4296-a94b-da1fdb3fe975-sys-fs\") pod \"aws-ebs-csi-driver-node-4sfmq\" (UID: \"62937875-8b91-4296-a94b-da1fdb3fe975\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:17.080612 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.077968    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-os-release\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.080612 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078003    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93f882ed-dbcf-40a5-b763-8d11c45c2813-cni-binary-copy\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.080612 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078025    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-etc-kubernetes\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.080612 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078018    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-multus-cni-dir\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.080612 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078078    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-host-var-lib-cni-bin\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.080612 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078117    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/93f882ed-dbcf-40a5-b763-8d11c45c2813-multus-daemon-config\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.080612 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078146    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:17.080612 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078187    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-host-var-lib-kubelet\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.080612 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078212    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca9f4acd-b386-4d33-9a03-ac667529f253-host\") pod \"node-ca-j8hgf\" (UID: \"ca9f4acd-b386-4d33-9a03-ac667529f253\") " pod="openshift-image-registry/node-ca-j8hgf"
Jul 21 17:26:17.080612 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078237    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/62937875-8b91-4296-a94b-da1fdb3fe975-registration-dir\") pod \"aws-ebs-csi-driver-node-4sfmq\" (UID: \"62937875-8b91-4296-a94b-da1fdb3fe975\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:17.080612 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078289    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/62937875-8b91-4296-a94b-da1fdb3fe975-etc-selinux\") pod \"aws-ebs-csi-driver-node-4sfmq\" (UID: \"62937875-8b91-4296-a94b-da1fdb3fe975\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:17.080612 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078333    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-host-slash\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.080612 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078360    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-host-run-k8s-cni-cncf-io\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.080612 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078388    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-env-overrides\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.080612 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078404    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1fba69f3-8ad4-4823-b6fb-c3a93e5e5613-konnectivity-ca\") pod \"konnectivity-agent-vrcpb\" (UID: \"1fba69f3-8ad4-4823-b6fb-c3a93e5e5613\") " pod="kube-system/konnectivity-agent-vrcpb"
Jul 21 17:26:17.080612 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078415    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-etc-systemd\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.080612 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078474    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca9f4acd-b386-4d33-9a03-ac667529f253-host\") pod \"node-ca-j8hgf\" (UID: \"ca9f4acd-b386-4d33-9a03-ac667529f253\") " pod="openshift-image-registry/node-ca-j8hgf"
Jul 21 17:26:17.081555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078504    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/62937875-8b91-4296-a94b-da1fdb3fe975-etc-selinux\") pod \"aws-ebs-csi-driver-node-4sfmq\" (UID: \"62937875-8b91-4296-a94b-da1fdb3fe975\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:17.081555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078519    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/62937875-8b91-4296-a94b-da1fdb3fe975-registration-dir\") pod \"aws-ebs-csi-driver-node-4sfmq\" (UID: \"62937875-8b91-4296-a94b-da1fdb3fe975\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:17.081555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078547    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-etc-systemd\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.081555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078561    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-host-var-lib-cni-bin\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.081555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078565    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-host-var-lib-kubelet\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.081555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078572    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-run\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.081555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078620    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93f882ed-dbcf-40a5-b763-8d11c45c2813-cni-binary-copy\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.081555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078638    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-run\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.081555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078672    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-host-run-k8s-cni-cncf-io\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.081555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078677    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x2vt\" (UniqueName: \"kubernetes.io/projected/93f882ed-dbcf-40a5-b763-8d11c45c2813-kube-api-access-4x2vt\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.081555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078691    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:17.081555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078716    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-host-kubelet\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.081555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078840    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-etc-modprobe-d\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.081555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078879    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/75f2dec8-5c4a-4312-9743-0429cc8c0034-kubelet-config\") pod \"global-pull-secret-syncer-vrb68\" (UID: \"75f2dec8-5c4a-4312-9743-0429cc8c0034\") " pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:17.081555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078900    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-etc-modprobe-d\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.081555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078911    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/62937875-8b91-4296-a94b-da1fdb3fe975-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4sfmq\" (UID: \"62937875-8b91-4296-a94b-da1fdb3fe975\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:17.081555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078936    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/75f2dec8-5c4a-4312-9743-0429cc8c0034-kubelet-config\") pod \"global-pull-secret-syncer-vrb68\" (UID: \"75f2dec8-5c4a-4312-9743-0429cc8c0034\") " pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:17.082324 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078944    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-var-lib-openvswitch\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.082324 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.078984    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-host-cni-bin\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.082324 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.079010    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-host-cni-netd\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.082324 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.079022    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/93f882ed-dbcf-40a5-b763-8d11c45c2813-multus-daemon-config\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.082324 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.079027    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/62937875-8b91-4296-a94b-da1fdb3fe975-kubelet-dir\") pod \"aws-ebs-csi-driver-node-4sfmq\" (UID: \"62937875-8b91-4296-a94b-da1fdb3fe975\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:17.082324 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.079040    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdrlj\" (UniqueName: \"kubernetes.io/projected/8a3829cd-c60c-49da-a862-9554ec6a0e2b-kube-api-access-cdrlj\") pod \"node-resolver-58wgl\" (UID: \"8a3829cd-c60c-49da-a862-9554ec6a0e2b\") " pod="openshift-dns/node-resolver-58wgl"
Jul 21 17:26:17.082324 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.079077    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-etc-sysctl-d\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.082324 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.079105    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-tmp\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.082324 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.079132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-multus-socket-dir-parent\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.082324 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.079185    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-host-run-ovn-kubernetes\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.082324 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.079236    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-etc-sysctl-d\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.082324 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.079240    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/93f882ed-dbcf-40a5-b763-8d11c45c2813-multus-socket-dir-parent\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.082324 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.080936    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-etc-tuned\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.082324 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.081455    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1fba69f3-8ad4-4823-b6fb-c3a93e5e5613-agent-certs\") pod \"konnectivity-agent-vrcpb\" (UID: \"1fba69f3-8ad4-4823-b6fb-c3a93e5e5613\") " pod="kube-system/konnectivity-agent-vrcpb"
Jul 21 17:26:17.083268 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.083191    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-tmp\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.113411 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.113380    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x2vt\" (UniqueName: \"kubernetes.io/projected/93f882ed-dbcf-40a5-b763-8d11c45c2813-kube-api-access-4x2vt\") pod \"multus-r55px\" (UID: \"93f882ed-dbcf-40a5-b763-8d11c45c2813\") " pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.123874 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:17.123852    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 17:26:17.123995 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:17.123879    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 17:26:17.123995 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:17.123894    2581 projected.go:196] Error preparing data for projected volume kube-api-access-mhbhk for pod openshift-network-diagnostics/network-check-target-jxfq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:26:17.123995 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:17.123963    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk podName:94d13840-ec8d-446a-8212-c0daa4a94012 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:17.623942818 +0000 UTC m=+3.024506872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mhbhk" (UniqueName: "kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk") pod "network-check-target-jxfq5" (UID: "94d13840-ec8d-446a-8212-c0daa4a94012") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:26:17.126728 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.126231    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-98.ec2.internal" event={"ID":"52a2fdb785bd958c3f182967e497262f","Type":"ContainerStarted","Data":"396460c5d08b928fe5d12554768e3876afa39628a152a3059a8df68d3a982fde"}
Jul 21 17:26:17.126728 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.126678    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7khdh\" (UniqueName: \"kubernetes.io/projected/62937875-8b91-4296-a94b-da1fdb3fe975-kube-api-access-7khdh\") pod \"aws-ebs-csi-driver-node-4sfmq\" (UID: \"62937875-8b91-4296-a94b-da1fdb3fe975\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:17.128037 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.127967    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdrlj\" (UniqueName: \"kubernetes.io/projected/8a3829cd-c60c-49da-a862-9554ec6a0e2b-kube-api-access-cdrlj\") pod \"node-resolver-58wgl\" (UID: \"8a3829cd-c60c-49da-a862-9554ec6a0e2b\") " pod="openshift-dns/node-resolver-58wgl"
Jul 21 17:26:17.128206 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.128175    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal" event={"ID":"0629444ec59d540f7d4f04814af2104d","Type":"ContainerStarted","Data":"9c0ac9a77549528e8cd9aa849d9dd61d8223f619e41ae969f6cb1576a744991c"}
Jul 21 17:26:17.128546 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.128506    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mlrf\" (UniqueName: \"kubernetes.io/projected/ca9f4acd-b386-4d33-9a03-ac667529f253-kube-api-access-5mlrf\") pod \"node-ca-j8hgf\" (UID: \"ca9f4acd-b386-4d33-9a03-ac667529f253\") " pod="openshift-image-registry/node-ca-j8hgf"
Jul 21 17:26:17.130565 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.130545    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hrwg\" (UniqueName: \"kubernetes.io/projected/4402c8fb-d8a6-4c10-ab0f-acfa04695301-kube-api-access-6hrwg\") pod \"network-metrics-daemon-w77vz\" (UID: \"4402c8fb-d8a6-4c10-ab0f-acfa04695301\") " pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:17.131178 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.131159    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxxfl\" (UniqueName: \"kubernetes.io/projected/5adb8d35-0a04-4f54-af3a-fb4c2f8ef1c2-kube-api-access-mxxfl\") pod \"iptables-alerter-qf4cm\" (UID: \"5adb8d35-0a04-4f54-af3a-fb4c2f8ef1c2\") " pod="openshift-network-operator/iptables-alerter-qf4cm"
Jul 21 17:26:17.131698 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.131680    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5w8t\" (UniqueName: \"kubernetes.io/projected/f667bf8a-c9cb-43ca-b207-3b42f3283f4b-kube-api-access-z5w8t\") pod \"tuned-hxw2v\" (UID: \"f667bf8a-c9cb-43ca-b207-3b42f3283f4b\") " pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.147914 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.147891    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtbdr\" (UniqueName: \"kubernetes.io/projected/fbbfd717-a4bd-4a5d-88fe-11b8e16e5443-kube-api-access-dtbdr\") pod \"multus-additional-cni-plugins-x9w4v\" (UID: \"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443\") " pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:17.180415 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.180344    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-env-overrides\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.180415 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.180380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-host-kubelet\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.180578 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.180429    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-var-lib-openvswitch\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.180578 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.180454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-host-cni-bin\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.180578 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.180477    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-host-cni-netd\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.180578 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.180506    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-host-run-ovn-kubernetes\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.180578 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.180552    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-run-systemd\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.180578 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.180577    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8jtk\" (UniqueName: \"kubernetes.io/projected/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-kube-api-access-s8jtk\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.180862 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.180629    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-systemd-units\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.180862 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.180654    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-etc-openvswitch\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.180862 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.180699    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-run-ovn\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.180862 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.180722    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-node-log\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.180862 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.180746    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-ovnkube-config\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.180862 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.180774    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-ovnkube-script-lib\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.180862 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.180804    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-host-run-netns\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.180862 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.180828    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-ovn-node-metrics-cert\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.180862 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.180856    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.181133 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.180883    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-run-openvswitch\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.181133 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.180909    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-log-socket\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.181133 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.180921    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-env-overrides\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.181133 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.180949    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-host-slash\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.181133 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.180981    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-etc-openvswitch\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.181133 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.181010    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-host-slash\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.181133 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.181023    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-host-kubelet\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.181133 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.181051    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-run-ovn\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.181133 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.181062    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-var-lib-openvswitch\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.181133 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.181090    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-node-log\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.181133 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.181097    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-host-cni-bin\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.181536 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.181139    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-run-systemd\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.181536 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.181150    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-run-openvswitch\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.181536 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.181218    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-host-run-ovn-kubernetes\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.181536 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.181437    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-systemd-units\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.183655 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.183628    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-ovnkube-config\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.184854 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.184828    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.184926 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.184916    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-host-run-netns\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.185497 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.185475    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-ovnkube-script-lib\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.185571 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.185554    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-log-socket\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.185648 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.185612    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-host-cni-netd\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.185898 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.185878    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-ovn-node-metrics-cert\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.194040 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.194019    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8jtk\" (UniqueName: \"kubernetes.io/projected/6b03e7f6-2d72-4e82-8d25-ab3a7043533b-kube-api-access-s8jtk\") pod \"ovnkube-node-65gzx\" (UID: \"6b03e7f6-2d72-4e82-8d25-ab3a7043533b\") " pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.271708 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.271680    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vrcpb"
Jul 21 17:26:17.284965 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.284942    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x9w4v"
Jul 21 17:26:17.296600 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.296576    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-r55px"
Jul 21 17:26:17.308413 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.308396    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-j8hgf"
Jul 21 17:26:17.316413 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.316391    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-58wgl"
Jul 21 17:26:17.323441 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.323422    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq"
Jul 21 17:26:17.331010 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.330983    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hxw2v"
Jul 21 17:26:17.340579 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.340560    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qf4cm"
Jul 21 17:26:17.347373 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.347353    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:17.585244 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.585159    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs\") pod \"network-metrics-daemon-w77vz\" (UID: \"4402c8fb-d8a6-4c10-ab0f-acfa04695301\") " pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:17.585244 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.585249    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret\") pod \"global-pull-secret-syncer-vrb68\" (UID: \"75f2dec8-5c4a-4312-9743-0429cc8c0034\") " pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:17.585484 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:17.585318    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:26:17.585484 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:17.585398    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs podName:4402c8fb-d8a6-4c10-ab0f-acfa04695301 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:18.585373999 +0000 UTC m=+3.985938052 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs") pod "network-metrics-daemon-w77vz" (UID: "4402c8fb-d8a6-4c10-ab0f-acfa04695301") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:26:17.585484 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:17.585398    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 17:26:17.585484 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:17.585456    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret podName:75f2dec8-5c4a-4312-9743-0429cc8c0034 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:18.585441239 +0000 UTC m=+3.986005291 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret") pod "global-pull-secret-syncer-vrb68" (UID: "75f2dec8-5c4a-4312-9743-0429cc8c0034") : object "kube-system"/"original-pull-secret" not registered
Jul 21 17:26:17.686590 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:17.686558    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhbhk\" (UniqueName: \"kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk\") pod \"network-check-target-jxfq5\" (UID: \"94d13840-ec8d-446a-8212-c0daa4a94012\") " pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:17.686782 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:17.686716    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 17:26:17.686782 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:17.686737    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 17:26:17.686782 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:17.686747    2581 projected.go:196] Error preparing data for projected volume kube-api-access-mhbhk for pod openshift-network-diagnostics/network-check-target-jxfq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:26:17.686925 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:17.686806    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk podName:94d13840-ec8d-446a-8212-c0daa4a94012 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:18.686790832 +0000 UTC m=+4.087354887 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhbhk" (UniqueName: "kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk") pod "network-check-target-jxfq5" (UID: "94d13840-ec8d-446a-8212-c0daa4a94012") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:26:18.077396 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:18.077343    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 17:21:17 +0000 UTC" deadline="2028-02-09 20:39:41.272455818 +0000 UTC"
Jul 21 17:26:18.077396 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:18.077390    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13635h13m23.19507035s"
Jul 21 17:26:18.112035 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:18.111997    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbbfd717_a4bd_4a5d_88fe_11b8e16e5443.slice/crio-bb6adf433e4940d70383c6068147b4ebd28d2c321187da5712757302ab8c5a1e WatchSource:0}: Error finding container bb6adf433e4940d70383c6068147b4ebd28d2c321187da5712757302ab8c5a1e: Status 404 returned error can't find the container with id bb6adf433e4940d70383c6068147b4ebd28d2c321187da5712757302ab8c5a1e
Jul 21 17:26:18.119443 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:18.119355    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93f882ed_dbcf_40a5_b763_8d11c45c2813.slice/crio-5ed27064a7aed3af15a5a8f0b0cecb680bd6e5ae2b4200367b84757f68184650 WatchSource:0}: Error finding container 5ed27064a7aed3af15a5a8f0b0cecb680bd6e5ae2b4200367b84757f68184650: Status 404 returned error can't find the container with id 5ed27064a7aed3af15a5a8f0b0cecb680bd6e5ae2b4200367b84757f68184650
Jul 21 17:26:18.120226 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:18.120208    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:18.120326 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:18.120244    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:18.120384 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:18.120351    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:18.120482 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:18.120454    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:26:18.121813 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:18.121793    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca9f4acd_b386_4d33_9a03_ac667529f253.slice/crio-949833b8ddc977eef459f51d5c0af9e87a387e2f8f084d21fe4d902e4e985ffd WatchSource:0}: Error finding container 949833b8ddc977eef459f51d5c0af9e87a387e2f8f084d21fe4d902e4e985ffd: Status 404 returned error can't find the container with id 949833b8ddc977eef459f51d5c0af9e87a387e2f8f084d21fe4d902e4e985ffd
Jul 21 17:26:18.122424 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:18.122397    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b03e7f6_2d72_4e82_8d25_ab3a7043533b.slice/crio-d0ef59ec08bd0ec526b57a17db465e8f814ea3215176ee6e961585903d038d9d WatchSource:0}: Error finding container d0ef59ec08bd0ec526b57a17db465e8f814ea3215176ee6e961585903d038d9d: Status 404 returned error can't find the container with id d0ef59ec08bd0ec526b57a17db465e8f814ea3215176ee6e961585903d038d9d
Jul 21 17:26:18.123265 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:18.123245    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5adb8d35_0a04_4f54_af3a_fb4c2f8ef1c2.slice/crio-804be7802a37e3294046f6d9584c3a5d1b288627a602c1537be7b6384b42cd1f WatchSource:0}: Error finding container 804be7802a37e3294046f6d9584c3a5d1b288627a602c1537be7b6384b42cd1f: Status 404 returned error can't find the container with id 804be7802a37e3294046f6d9584c3a5d1b288627a602c1537be7b6384b42cd1f
Jul 21 17:26:18.124091 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:26:18.124009    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62937875_8b91_4296_a94b_da1fdb3fe975.slice/crio-22b590c3057d3345d0aaddf6221c392c58d37af97c45192c08abda8ddad307db WatchSource:0}: Error finding container 22b590c3057d3345d0aaddf6221c392c58d37af97c45192c08abda8ddad307db: Status 404 returned error can't find the container with id 22b590c3057d3345d0aaddf6221c392c58d37af97c45192c08abda8ddad307db
Jul 21 17:26:18.136495 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:18.136464    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65gzx" event={"ID":"6b03e7f6-2d72-4e82-8d25-ab3a7043533b","Type":"ContainerStarted","Data":"d0ef59ec08bd0ec526b57a17db465e8f814ea3215176ee6e961585903d038d9d"}
Jul 21 17:26:18.138346 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:18.138319    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r55px" event={"ID":"93f882ed-dbcf-40a5-b763-8d11c45c2813","Type":"ContainerStarted","Data":"5ed27064a7aed3af15a5a8f0b0cecb680bd6e5ae2b4200367b84757f68184650"}
Jul 21 17:26:18.141112 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:18.140607    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hxw2v" event={"ID":"f667bf8a-c9cb-43ca-b207-3b42f3283f4b","Type":"ContainerStarted","Data":"e9854760ee9dbdf68c59003bb4cf67422bbd461bab4d5c36863186bfc1d0672d"}
Jul 21 17:26:18.141868 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:18.141843    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq" event={"ID":"62937875-8b91-4296-a94b-da1fdb3fe975","Type":"ContainerStarted","Data":"22b590c3057d3345d0aaddf6221c392c58d37af97c45192c08abda8ddad307db"}
Jul 21 17:26:18.143110 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:18.143076    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j8hgf" event={"ID":"ca9f4acd-b386-4d33-9a03-ac667529f253","Type":"ContainerStarted","Data":"949833b8ddc977eef459f51d5c0af9e87a387e2f8f084d21fe4d902e4e985ffd"}
Jul 21 17:26:18.144275 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:18.144252    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x9w4v" event={"ID":"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443","Type":"ContainerStarted","Data":"bb6adf433e4940d70383c6068147b4ebd28d2c321187da5712757302ab8c5a1e"}
Jul 21 17:26:18.145438 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:18.145412    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-58wgl" event={"ID":"8a3829cd-c60c-49da-a862-9554ec6a0e2b","Type":"ContainerStarted","Data":"7251bfe9037e1f0ecd1bc2652351e8fcf2970c9c88d08cb60ebf33b66af41baf"}
Jul 21 17:26:18.148698 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:18.148645    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vrcpb" event={"ID":"1fba69f3-8ad4-4823-b6fb-c3a93e5e5613","Type":"ContainerStarted","Data":"cca93961e42629949417c0de4b827850af0149847fc4be4793a6e0273e12fa0c"}
Jul 21 17:26:18.150029 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:18.150010    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qf4cm" event={"ID":"5adb8d35-0a04-4f54-af3a-fb4c2f8ef1c2","Type":"ContainerStarted","Data":"804be7802a37e3294046f6d9584c3a5d1b288627a602c1537be7b6384b42cd1f"}
Jul 21 17:26:18.592678 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:18.592354    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs\") pod \"network-metrics-daemon-w77vz\" (UID: \"4402c8fb-d8a6-4c10-ab0f-acfa04695301\") " pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:18.592678 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:18.592645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret\") pod \"global-pull-secret-syncer-vrb68\" (UID: \"75f2dec8-5c4a-4312-9743-0429cc8c0034\") " pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:18.592900 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:18.592772    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 17:26:18.592900 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:18.592841    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret podName:75f2dec8-5c4a-4312-9743-0429cc8c0034 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:20.592821803 +0000 UTC m=+5.993385858 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret") pod "global-pull-secret-syncer-vrb68" (UID: "75f2dec8-5c4a-4312-9743-0429cc8c0034") : object "kube-system"/"original-pull-secret" not registered
Jul 21 17:26:18.593280 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:18.593258    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:26:18.593379 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:18.593319    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs podName:4402c8fb-d8a6-4c10-ab0f-acfa04695301 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:20.593302307 +0000 UTC m=+5.993866361 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs") pod "network-metrics-daemon-w77vz" (UID: "4402c8fb-d8a6-4c10-ab0f-acfa04695301") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:26:18.693425 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:18.693387    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhbhk\" (UniqueName: \"kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk\") pod \"network-check-target-jxfq5\" (UID: \"94d13840-ec8d-446a-8212-c0daa4a94012\") " pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:18.693630 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:18.693577    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 17:26:18.693630 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:18.693606    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 17:26:18.693630 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:18.693619    2581 projected.go:196] Error preparing data for projected volume kube-api-access-mhbhk for pod openshift-network-diagnostics/network-check-target-jxfq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:26:18.693796 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:18.693681    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk podName:94d13840-ec8d-446a-8212-c0daa4a94012 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:20.693662947 +0000 UTC m=+6.094227013 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhbhk" (UniqueName: "kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk") pod "network-check-target-jxfq5" (UID: "94d13840-ec8d-446a-8212-c0daa4a94012") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:26:19.077959 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:19.077834    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 17:21:17 +0000 UTC" deadline="2028-04-28 22:10:31.815232222 +0000 UTC"
Jul 21 17:26:19.077959 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:19.077910    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15532h44m12.737326405s"
Jul 21 17:26:19.122846 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:19.122810    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:19.123025 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:19.122947    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:26:19.169721 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:19.169688    2581 generic.go:356] "Generic (PLEG): container finished" podID="0629444ec59d540f7d4f04814af2104d" containerID="b7f1ce3f2a0017ead56f85376aa54c1755fa9db93dd645aebd60f35c11c35da3" exitCode=0
Jul 21 17:26:19.169886 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:19.169783    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal" event={"ID":"0629444ec59d540f7d4f04814af2104d","Type":"ContainerDied","Data":"b7f1ce3f2a0017ead56f85376aa54c1755fa9db93dd645aebd60f35c11c35da3"}
Jul 21 17:26:19.185696 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:19.185644    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-98.ec2.internal" event={"ID":"52a2fdb785bd958c3f182967e497262f","Type":"ContainerStarted","Data":"e910317954b01285a13dd16f97f73f23d6c9a7d80a882505a49a7280f17b4080"}
Jul 21 17:26:19.212144 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:19.212078    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-98.ec2.internal" podStartSLOduration=3.212058352 podStartE2EDuration="3.212058352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:19.211567771 +0000 UTC m=+4.612131843" watchObservedRunningTime="2026-07-21 17:26:19.212058352 +0000 UTC m=+4.612622426"
Jul 21 17:26:20.120577 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:20.120536    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:20.121035 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:20.120686    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:26:20.121093 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:20.121063    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:20.121274 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:20.121150    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:20.215110 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:20.215076    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal" event={"ID":"0629444ec59d540f7d4f04814af2104d","Type":"ContainerStarted","Data":"cccb99673f37b552aa889b3a4492760317ea59249c14d580b8fcba91ff8befa0"}
Jul 21 17:26:20.611818 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:20.611728    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs\") pod \"network-metrics-daemon-w77vz\" (UID: \"4402c8fb-d8a6-4c10-ab0f-acfa04695301\") " pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:20.611818 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:20.611806    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret\") pod \"global-pull-secret-syncer-vrb68\" (UID: \"75f2dec8-5c4a-4312-9743-0429cc8c0034\") " pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:20.612159 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:20.611962    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 17:26:20.612159 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:20.612027    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret podName:75f2dec8-5c4a-4312-9743-0429cc8c0034 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:24.612008508 +0000 UTC m=+10.012572560 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret") pod "global-pull-secret-syncer-vrb68" (UID: "75f2dec8-5c4a-4312-9743-0429cc8c0034") : object "kube-system"/"original-pull-secret" not registered
Jul 21 17:26:20.612159 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:20.612127    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:26:20.612351 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:20.612163    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs podName:4402c8fb-d8a6-4c10-ab0f-acfa04695301 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:24.612151084 +0000 UTC m=+10.012715135 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs") pod "network-metrics-daemon-w77vz" (UID: "4402c8fb-d8a6-4c10-ab0f-acfa04695301") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:26:20.712492 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:20.712450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhbhk\" (UniqueName: \"kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk\") pod \"network-check-target-jxfq5\" (UID: \"94d13840-ec8d-446a-8212-c0daa4a94012\") " pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:20.712701 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:20.712661    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 17:26:20.712701 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:20.712684    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 17:26:20.712701 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:20.712699    2581 projected.go:196] Error preparing data for projected volume kube-api-access-mhbhk for pod openshift-network-diagnostics/network-check-target-jxfq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:26:20.712950 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:20.712761    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk podName:94d13840-ec8d-446a-8212-c0daa4a94012 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:24.712740195 +0000 UTC m=+10.113304247 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhbhk" (UniqueName: "kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk") pod "network-check-target-jxfq5" (UID: "94d13840-ec8d-446a-8212-c0daa4a94012") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:26:21.129330 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:21.129300    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:21.129920 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:21.129891    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:26:22.120447 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:22.120411    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:22.120634 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:22.120547    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:22.120634 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:22.120589    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:22.120756 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:22.120714    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:26:23.121294 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:23.121263    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:23.121661 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:23.121393    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:26:24.121285 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:24.120552    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:24.121285 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:24.120671    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:24.121285 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:24.121079    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:24.121285 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:24.121202    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:26:24.646495 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:24.646464    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs\") pod \"network-metrics-daemon-w77vz\" (UID: \"4402c8fb-d8a6-4c10-ab0f-acfa04695301\") " pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:24.646676 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:24.646513    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret\") pod \"global-pull-secret-syncer-vrb68\" (UID: \"75f2dec8-5c4a-4312-9743-0429cc8c0034\") " pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:24.646676 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:24.646611    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 17:26:24.646676 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:24.646639    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:26:24.646676 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:24.646670    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret podName:75f2dec8-5c4a-4312-9743-0429cc8c0034 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:32.646651432 +0000 UTC m=+18.047215483 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret") pod "global-pull-secret-syncer-vrb68" (UID: "75f2dec8-5c4a-4312-9743-0429cc8c0034") : object "kube-system"/"original-pull-secret" not registered
Jul 21 17:26:24.646870 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:24.646723    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs podName:4402c8fb-d8a6-4c10-ab0f-acfa04695301 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:32.646702053 +0000 UTC m=+18.047266106 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs") pod "network-metrics-daemon-w77vz" (UID: "4402c8fb-d8a6-4c10-ab0f-acfa04695301") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:26:24.747316 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:24.747285    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhbhk\" (UniqueName: \"kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk\") pod \"network-check-target-jxfq5\" (UID: \"94d13840-ec8d-446a-8212-c0daa4a94012\") " pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:24.747540 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:24.747518    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 17:26:24.747630 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:24.747547    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 17:26:24.747630 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:24.747561    2581 projected.go:196] Error preparing data for projected volume kube-api-access-mhbhk for pod openshift-network-diagnostics/network-check-target-jxfq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:26:24.747630 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:24.747614    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk podName:94d13840-ec8d-446a-8212-c0daa4a94012 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:32.747599295 +0000 UTC m=+18.148163347 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhbhk" (UniqueName: "kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk") pod "network-check-target-jxfq5" (UID: "94d13840-ec8d-446a-8212-c0daa4a94012") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:26:25.120631 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:25.120544    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:25.120794 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:25.120668    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:26:26.121059 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:26.120569    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:26.121059 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:26.120613    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:26.121059 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:26.120716    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:26:26.121059 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:26.120882    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:27.121200 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:27.120500    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:27.121200 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:27.120625    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:26:28.120123 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:28.120092    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:28.120325 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:28.120093    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:28.120325 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:28.120232    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:28.120325 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:28.120296    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:26:29.120064 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:29.119972    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:29.120528 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:29.120103    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:26:30.119670 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:30.119638    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:30.119670 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:30.119674    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:30.119867 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:30.119761    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:26:30.119921 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:30.119872    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:31.120663 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:31.120630    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:31.121108 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:31.120749    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:26:32.120355 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:32.120320    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:32.120567 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:32.120320    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:32.120567 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:32.120441    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:32.120567 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:32.120501    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:26:32.710328 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:32.710257    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs\") pod \"network-metrics-daemon-w77vz\" (UID: \"4402c8fb-d8a6-4c10-ab0f-acfa04695301\") " pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:32.710328 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:32.710321    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret\") pod \"global-pull-secret-syncer-vrb68\" (UID: \"75f2dec8-5c4a-4312-9743-0429cc8c0034\") " pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:32.710819 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:32.710425    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 17:26:32.710819 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:32.710434    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:26:32.710819 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:32.710483    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret podName:75f2dec8-5c4a-4312-9743-0429cc8c0034 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:48.710465944 +0000 UTC m=+34.111029994 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret") pod "global-pull-secret-syncer-vrb68" (UID: "75f2dec8-5c4a-4312-9743-0429cc8c0034") : object "kube-system"/"original-pull-secret" not registered
Jul 21 17:26:32.710819 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:32.710502    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs podName:4402c8fb-d8a6-4c10-ab0f-acfa04695301 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:48.710493451 +0000 UTC m=+34.111057500 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs") pod "network-metrics-daemon-w77vz" (UID: "4402c8fb-d8a6-4c10-ab0f-acfa04695301") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:26:32.811484 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:32.811440    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhbhk\" (UniqueName: \"kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk\") pod \"network-check-target-jxfq5\" (UID: \"94d13840-ec8d-446a-8212-c0daa4a94012\") " pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:32.811662 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:32.811639    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 17:26:32.811722 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:32.811675    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 17:26:32.811722 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:32.811690    2581 projected.go:196] Error preparing data for projected volume kube-api-access-mhbhk for pod openshift-network-diagnostics/network-check-target-jxfq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:26:32.811794 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:32.811752    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk podName:94d13840-ec8d-446a-8212-c0daa4a94012 nodeName:}" failed. No retries permitted until 2026-07-21 17:26:48.811737389 +0000 UTC m=+34.212301441 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhbhk" (UniqueName: "kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk") pod "network-check-target-jxfq5" (UID: "94d13840-ec8d-446a-8212-c0daa4a94012") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:26:33.119645 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:33.119571    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:33.119796 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:33.119691    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:26:34.120223 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:34.120187    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:34.120616 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:34.120206    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:34.120616 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:34.120328    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:26:34.120616 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:34.120391    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:35.121153 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:35.121116    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:35.121621 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:35.121244    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:26:36.119897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:36.119860    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:36.120051 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:36.119869    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:36.120051 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:36.119966    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:36.120140 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:36.120068    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:26:37.120421 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:37.119997    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:37.120421 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:37.120107    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:26:37.248953 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:37.248717    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65gzx" event={"ID":"6b03e7f6-2d72-4e82-8d25-ab3a7043533b","Type":"ContainerStarted","Data":"37b1958100363586902b7a606b8f9733f197f46b8eec3ed51ca9d37bbec66bfc"}
Jul 21 17:26:37.250076 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:37.249993    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-r55px" event={"ID":"93f882ed-dbcf-40a5-b763-8d11c45c2813","Type":"ContainerStarted","Data":"703cb4f8ec099ea257322a3979c0bf8a43c86e3b536e2f6f71d2a7968c7cb1bf"}
Jul 21 17:26:37.251438 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:37.251410    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hxw2v" event={"ID":"f667bf8a-c9cb-43ca-b207-3b42f3283f4b","Type":"ContainerStarted","Data":"fc55d89b1049965f3145aeff48e581d318473a90d09173ba0d67bf5c47e617a1"}
Jul 21 17:26:37.252747 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:37.252730    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq" event={"ID":"62937875-8b91-4296-a94b-da1fdb3fe975","Type":"ContainerStarted","Data":"8a3613ff125d4a1d4df7c63b3132d696e05ded91ad300d966175bde4fe67eaa2"}
Jul 21 17:26:37.254005 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:37.253984    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x9w4v" event={"ID":"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443","Type":"ContainerStarted","Data":"dbffa26908ce2785dce8b3fcae980e021136f0813c943443b3873911f8ecca04"}
Jul 21 17:26:37.255148 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:37.255125    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-58wgl" event={"ID":"8a3829cd-c60c-49da-a862-9554ec6a0e2b","Type":"ContainerStarted","Data":"01a050826a2d9a22b8a9a61780ac59dc04b8727563bd19074dbe2617a4f61b88"}
Jul 21 17:26:37.257451 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:37.257432    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vrcpb" event={"ID":"1fba69f3-8ad4-4823-b6fb-c3a93e5e5613","Type":"ContainerStarted","Data":"e7b432786fd953e97a00d5d5361f50be463b7b6a574c1c84816b14b121268057"}
Jul 21 17:26:37.268425 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:37.268393    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-98.ec2.internal" podStartSLOduration=21.268382047 podStartE2EDuration="21.268382047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:20.23223911 +0000 UTC m=+5.632803206" watchObservedRunningTime="2026-07-21 17:26:37.268382047 +0000 UTC m=+22.668946119"
Jul 21 17:26:37.268528 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:37.268510    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-r55px" podStartSLOduration=3.355115838 podStartE2EDuration="22.268506011s" totalImagesPullingTime="18.913390173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:37.268084796 +0000 UTC m=+22.668648886" watchObservedRunningTime="2026-07-21 17:26:37.268506011 +0000 UTC m=+22.669070082"
Jul 21 17:26:37.283875 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:37.283837    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vrcpb" podStartSLOduration=8.039312678 podStartE2EDuration="22.283826521s" totalImagesPullingTime="14.244513843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:37.283432465 +0000 UTC m=+22.683996554" watchObservedRunningTime="2026-07-21 17:26:37.283826521 +0000 UTC m=+22.684390591"
Jul 21 17:26:37.357631 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:37.357591    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-58wgl" podStartSLOduration=3.498828033 podStartE2EDuration="22.357577941s" totalImagesPullingTime="18.858749908s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:37.328469054 +0000 UTC m=+22.729033124" watchObservedRunningTime="2026-07-21 17:26:37.357577941 +0000 UTC m=+22.758142070"
Jul 21 17:26:37.357996 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:37.357968    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hxw2v" podStartSLOduration=3.478131932 podStartE2EDuration="22.357959511s" totalImagesPullingTime="18.879827579s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:37.357456 +0000 UTC m=+22.758020096" watchObservedRunningTime="2026-07-21 17:26:37.357959511 +0000 UTC m=+22.758523581"
Jul 21 17:26:37.390009 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:37.389946    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vrcpb"
Jul 21 17:26:37.391248 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:37.391226    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vrcpb"
Jul 21 17:26:38.120232 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:38.120044    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:38.120377 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:38.120059    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:38.120377 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:38.120315    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:38.120459 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:38.120384    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:26:38.260974 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:38.260949    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-j8hgf" event={"ID":"ca9f4acd-b386-4d33-9a03-ac667529f253","Type":"ContainerStarted","Data":"afe81f24c420e558c45c0d44a3d6ecd4ec2426890fbc277942e541d986b5285e"}
Jul 21 17:26:38.265121 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:38.265098    2581 generic.go:356] "Generic (PLEG): container finished" podID="fbbfd717-a4bd-4a5d-88fe-11b8e16e5443" containerID="dbffa26908ce2785dce8b3fcae980e021136f0813c943443b3873911f8ecca04" exitCode=0
Jul 21 17:26:38.265233 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:38.265184    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x9w4v" event={"ID":"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443","Type":"ContainerDied","Data":"dbffa26908ce2785dce8b3fcae980e021136f0813c943443b3873911f8ecca04"}
Jul 21 17:26:38.266593 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:38.266563    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qf4cm" event={"ID":"5adb8d35-0a04-4f54-af3a-fb4c2f8ef1c2","Type":"ContainerStarted","Data":"2f25027937594bf9443c3ed41ae506976e8623453d96b70f108351f7df6cf4a5"}
Jul 21 17:26:38.269060 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:38.269043    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 17:26:38.269363 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:38.269343    2581 generic.go:356] "Generic (PLEG): container finished" podID="6b03e7f6-2d72-4e82-8d25-ab3a7043533b" containerID="747d4eb2bfece0892f029699885d2f5cee9a104f01eb4ea6861c1b77077e022f" exitCode=1
Jul 21 17:26:38.269433 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:38.269417    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65gzx" event={"ID":"6b03e7f6-2d72-4e82-8d25-ab3a7043533b","Type":"ContainerStarted","Data":"419b768312948323356a8fc87a9e16f8d939cf114bf972b669097f166a3f0b74"}
Jul 21 17:26:38.269473 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:38.269465    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65gzx" event={"ID":"6b03e7f6-2d72-4e82-8d25-ab3a7043533b","Type":"ContainerStarted","Data":"35ab8f9fed6f8a1e8fa18a089505155f9fc3c04407b7048e253286c992bcf11c"}
Jul 21 17:26:38.269514 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:38.269495    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65gzx" event={"ID":"6b03e7f6-2d72-4e82-8d25-ab3a7043533b","Type":"ContainerStarted","Data":"e4feb3394bf59fd54635cb6b7537abd2150ad2a5594009de5fb510b8f158a84d"}
Jul 21 17:26:38.269552 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:38.269522    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65gzx" event={"ID":"6b03e7f6-2d72-4e82-8d25-ab3a7043533b","Type":"ContainerStarted","Data":"aa51ee288fc5cc151a2962c95bddaf83512c88643f9172147c857e74ee54127e"}
Jul 21 17:26:38.269552 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:38.269548    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65gzx" event={"ID":"6b03e7f6-2d72-4e82-8d25-ab3a7043533b","Type":"ContainerDied","Data":"747d4eb2bfece0892f029699885d2f5cee9a104f01eb4ea6861c1b77077e022f"}
Jul 21 17:26:38.269628 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:38.269581    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vrcpb"
Jul 21 17:26:38.270082 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:38.270066    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vrcpb"
Jul 21 17:26:38.279661 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:38.279599    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-j8hgf" podStartSLOduration=4.425953161 podStartE2EDuration="23.279587826s" totalImagesPullingTime="18.853634665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:38.279404949 +0000 UTC m=+23.679969043" watchObservedRunningTime="2026-07-21 17:26:38.279587826 +0000 UTC m=+23.680151897"
Jul 21 17:26:38.425264 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:38.425243    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 21 17:26:39.032300 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:39.032164    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T17:26:38.425260276Z","UUID":"d47bc392-4cd9-44f3-a8c7-0eabe6ebf9b3","Handler":null,"Name":"","Endpoint":""}
Jul 21 17:26:39.033776 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:39.033758    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 21 17:26:39.033909 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:39.033797    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 21 17:26:39.120361 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:39.120330    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:39.120507 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:39.120430    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:26:39.274739 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:39.274700    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq" event={"ID":"62937875-8b91-4296-a94b-da1fdb3fe975","Type":"ContainerStarted","Data":"2f2dc8c57d545212849ee9b2c0b11885fc33d086663c88d1ced3095e2f879ac9"}
Jul 21 17:26:40.120295 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:40.120269    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:40.120412 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:40.120367    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:40.120478 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:40.120438    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:40.120537 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:40.120517    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:26:40.279364 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:40.279323    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq" event={"ID":"62937875-8b91-4296-a94b-da1fdb3fe975","Type":"ContainerStarted","Data":"ec98d1c9b1dc3798fcfac49dacfda06cbaa077abd5336dbf311044445106b3fc"}
Jul 21 17:26:40.286599 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:40.286573    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 17:26:40.287072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:40.287051    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65gzx" event={"ID":"6b03e7f6-2d72-4e82-8d25-ab3a7043533b","Type":"ContainerStarted","Data":"7371ca3b60605c47b68cf88dc8a6369056ef078895252a5220bebf78503211bd"}
Jul 21 17:26:40.300392 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:40.300343    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qf4cm" podStartSLOduration=6.415517803 podStartE2EDuration="25.300327522s" totalImagesPullingTime="18.884809719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:38.361246772 +0000 UTC m=+23.761810858" watchObservedRunningTime="2026-07-21 17:26:40.300327522 +0000 UTC m=+25.700891595"
Jul 21 17:26:40.300646 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:40.300618    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-4sfmq" podStartSLOduration=3.783806809 podStartE2EDuration="25.300609084s" totalImagesPullingTime="21.516802275s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:40.299098131 +0000 UTC m=+25.699662215" watchObservedRunningTime="2026-07-21 17:26:40.300609084 +0000 UTC m=+25.701173156"
Jul 21 17:26:40.878252 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:40.878060    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-58wgl_8a3829cd-c60c-49da-a862-9554ec6a0e2b/dns-node-resolver/0.log"
Jul 21 17:26:41.120959 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:41.120468    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:41.120959 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:41.120595    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:26:41.657371 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:41.657339    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j8hgf_ca9f4acd-b386-4d33-9a03-ac667529f253/node-ca/0.log"
Jul 21 17:26:42.120592 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:42.120558    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:42.120818 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:42.120708    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:26:42.121070 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:42.121053    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:42.121484 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:42.121143    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:43.120235 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:43.120041    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:43.120360 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:43.120324    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:26:43.295016 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:43.294993    2581 generic.go:356] "Generic (PLEG): container finished" podID="fbbfd717-a4bd-4a5d-88fe-11b8e16e5443" containerID="27ac06e0b3e738205644170b259c380aaf4e5457598678064be8b4d019ea4551" exitCode=0
Jul 21 17:26:43.295633 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:43.295071    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x9w4v" event={"ID":"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443","Type":"ContainerDied","Data":"27ac06e0b3e738205644170b259c380aaf4e5457598678064be8b4d019ea4551"}
Jul 21 17:26:43.298724 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:43.298708    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 17:26:43.299051 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:43.299029    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65gzx" event={"ID":"6b03e7f6-2d72-4e82-8d25-ab3a7043533b","Type":"ContainerStarted","Data":"bc892f6a5f0e0815cd5c43090c4eaf360d5125b65c861d1d942235e0aa32d087"}
Jul 21 17:26:43.299336 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:43.299319    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:43.299412 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:43.299373    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:43.299531 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:43.299514    2581 scope.go:117] "RemoveContainer" containerID="747d4eb2bfece0892f029699885d2f5cee9a104f01eb4ea6861c1b77077e022f"
Jul 21 17:26:43.315750 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:43.315728    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:44.120024 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:44.119979    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:44.120197 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:44.120125    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:26:44.120277 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:44.120204    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:44.120345 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:44.120322    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:44.305932 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:44.305908    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 17:26:44.306428 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:44.306275    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-65gzx" event={"ID":"6b03e7f6-2d72-4e82-8d25-ab3a7043533b","Type":"ContainerStarted","Data":"5d2784a76f43a2a93b276c4457d0cd752f0799bd4aff4e24cab96eec65f37c45"}
Jul 21 17:26:44.306620 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:44.306601    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:44.324280 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:44.324260    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:26:44.338882 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:44.338836    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-65gzx" podStartSLOduration=10.389266217 podStartE2EDuration="29.338819229s" totalImagesPullingTime="18.949553012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:44.337340365 +0000 UTC m=+29.737904461" watchObservedRunningTime="2026-07-21 17:26:44.338819229 +0000 UTC m=+29.739383300"
Jul 21 17:26:44.718744 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:44.718636    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w77vz"]
Jul 21 17:26:44.718958 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:44.718751    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:44.718958 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:44.718874    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:26:44.719357 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:44.719338    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jxfq5"]
Jul 21 17:26:44.719425 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:44.719415    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:44.719491 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:44.719477    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:26:44.732406 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:44.732381    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vrb68"]
Jul 21 17:26:44.732509 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:44.732466    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:44.732572 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:44.732555    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:45.310561 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:45.310524    2581 generic.go:356] "Generic (PLEG): container finished" podID="fbbfd717-a4bd-4a5d-88fe-11b8e16e5443" containerID="dd0596e53434c9f2875ff4b8305e35fcd0357466c3e82f10e5dfa4d43003c9cf" exitCode=0
Jul 21 17:26:45.310932 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:45.310603    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x9w4v" event={"ID":"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443","Type":"ContainerDied","Data":"dd0596e53434c9f2875ff4b8305e35fcd0357466c3e82f10e5dfa4d43003c9cf"}
Jul 21 17:26:46.119878 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:46.119726    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:46.119964 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:46.119777    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:46.119964 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:46.119953    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:26:46.120076 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:46.120057    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:46.315766 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:46.315738    2581 generic.go:356] "Generic (PLEG): container finished" podID="fbbfd717-a4bd-4a5d-88fe-11b8e16e5443" containerID="385d96e73ad853fb6c7d0441741126cd180903e05ecc5376d7aba8fdd57e3fb1" exitCode=0
Jul 21 17:26:46.316156 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:46.315824    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x9w4v" event={"ID":"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443","Type":"ContainerDied","Data":"385d96e73ad853fb6c7d0441741126cd180903e05ecc5376d7aba8fdd57e3fb1"}
Jul 21 17:26:47.120238 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:47.120202    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:47.120396 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:47.120348    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:26:48.120528 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:48.120493    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:48.121019 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:48.120503    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:48.121019 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:48.120611    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:26:48.121019 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:48.120719    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:48.733080 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:48.733045    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs\") pod \"network-metrics-daemon-w77vz\" (UID: \"4402c8fb-d8a6-4c10-ab0f-acfa04695301\") " pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:48.733316 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:48.733105    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret\") pod \"global-pull-secret-syncer-vrb68\" (UID: \"75f2dec8-5c4a-4312-9743-0429cc8c0034\") " pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:48.733316 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:48.733230    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 21 17:26:48.733316 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:48.733237    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:26:48.733316 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:48.733309    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret podName:75f2dec8-5c4a-4312-9743-0429cc8c0034 nodeName:}" failed. No retries permitted until 2026-07-21 17:27:20.733268524 +0000 UTC m=+66.133832574 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret") pod "global-pull-secret-syncer-vrb68" (UID: "75f2dec8-5c4a-4312-9743-0429cc8c0034") : object "kube-system"/"original-pull-secret" not registered
Jul 21 17:26:48.733493 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:48.733324    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs podName:4402c8fb-d8a6-4c10-ab0f-acfa04695301 nodeName:}" failed. No retries permitted until 2026-07-21 17:27:20.733317214 +0000 UTC m=+66.133881263 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs") pod "network-metrics-daemon-w77vz" (UID: "4402c8fb-d8a6-4c10-ab0f-acfa04695301") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 21 17:26:48.833671 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:48.833639    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhbhk\" (UniqueName: \"kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk\") pod \"network-check-target-jxfq5\" (UID: \"94d13840-ec8d-446a-8212-c0daa4a94012\") " pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:48.833848 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:48.833808    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 21 17:26:48.833848 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:48.833833    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 21 17:26:48.833848 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:48.833843    2581 projected.go:196] Error preparing data for projected volume kube-api-access-mhbhk for pod openshift-network-diagnostics/network-check-target-jxfq5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:26:48.833976 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:48.833896    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk podName:94d13840-ec8d-446a-8212-c0daa4a94012 nodeName:}" failed. No retries permitted until 2026-07-21 17:27:20.833878602 +0000 UTC m=+66.234442652 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mhbhk" (UniqueName: "kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk") pod "network-check-target-jxfq5" (UID: "94d13840-ec8d-446a-8212-c0daa4a94012") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 21 17:26:49.120684 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:49.120651    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:49.121244 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:49.120779    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:26:50.120470 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:50.120435    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:50.120470 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:50.120469    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:50.121192 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:50.120561    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:26:50.121192 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:50.120692    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:51.120014 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:51.119986    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:51.120187 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:51.120089    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:26:52.120409 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:52.120379    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:52.120873 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:52.120381    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:52.120873 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:52.120467    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:26:52.120873 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:52.120564    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:52.331758 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:52.331725    2581 generic.go:356] "Generic (PLEG): container finished" podID="fbbfd717-a4bd-4a5d-88fe-11b8e16e5443" containerID="f8976dd178b4482a2e707e8c1b7ebbe28accce93f29a328b52a9deea0aa70ca0" exitCode=0
Jul 21 17:26:52.331758 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:52.331755    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x9w4v" event={"ID":"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443","Type":"ContainerDied","Data":"f8976dd178b4482a2e707e8c1b7ebbe28accce93f29a328b52a9deea0aa70ca0"}
Jul 21 17:26:53.120550 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:53.120525    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:53.121013 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:53.120640    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:26:53.337060 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:53.337033    2581 generic.go:356] "Generic (PLEG): container finished" podID="fbbfd717-a4bd-4a5d-88fe-11b8e16e5443" containerID="a8543ec468572149b5abda744799d0ad7e350b1575d7e92a23f29451e795c6af" exitCode=0
Jul 21 17:26:53.337211 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:53.337074    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x9w4v" event={"ID":"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443","Type":"ContainerDied","Data":"a8543ec468572149b5abda744799d0ad7e350b1575d7e92a23f29451e795c6af"}
Jul 21 17:26:54.119882 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:54.119850    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:54.120072 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:54.119850    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:54.120072 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:54.119947    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:54.120072 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:54.120035    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:26:54.342077 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:54.342047    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x9w4v" event={"ID":"fbbfd717-a4bd-4a5d-88fe-11b8e16e5443","Type":"ContainerStarted","Data":"fdeda551448811c20983c2d1187513a1f6feef203c39b067e66c93ebb55d00d0"}
Jul 21 17:26:54.366226 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:54.366166    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-x9w4v" podStartSLOduration=9.547592327 podStartE2EDuration="39.366153145s" totalImagesPullingTime="29.818560818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:26:54.364582908 +0000 UTC m=+39.765146980" watchObservedRunningTime="2026-07-21 17:26:54.366153145 +0000 UTC m=+39.766717216"
Jul 21 17:26:55.120883 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:55.120717    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:55.121063 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:55.120947    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:26:56.119749 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:56.119717    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:56.120150 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:56.119717    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:56.120150 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:56.119886    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:56.120150 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:56.119804    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:26:57.119867 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:57.119837    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:57.120319 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:57.119964    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:26:58.119510 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:58.119484    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:26:58.119675 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:58.119490    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:26:58.119675 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:58.119651    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:26:58.119675 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:58.119568    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:26:59.119923 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:26:59.119889    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:26:59.120394 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:26:59.120044    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:27:00.119649 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:00.119619    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:27:00.119649 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:00.119636    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:27:00.119854 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:27:00.119711    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:27:00.119854 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:27:00.119837    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:27:01.120348 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:01.120316    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:27:01.120830 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:27:01.120413    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:27:02.120122 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:02.120088    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:27:02.120288 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:02.120088    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:27:02.120288 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:27:02.120215    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:27:02.120288 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:27:02.120264    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:27:03.120418 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:03.120387    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:27:03.120908 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:27:03.120507    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:27:04.120189 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:04.120153    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:27:04.120189 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:04.120189    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:27:04.120434 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:27:04.120279    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vrb68" podUID="75f2dec8-5c4a-4312-9743-0429cc8c0034"
Jul 21 17:27:04.120434 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:27:04.120381    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jxfq5" podUID="94d13840-ec8d-446a-8212-c0daa4a94012"
Jul 21 17:27:05.122746 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:05.122722    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:27:05.123196 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:27:05.122814    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w77vz" podUID="4402c8fb-d8a6-4c10-ab0f-acfa04695301"
Jul 21 17:27:05.910351 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:05.910323    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-98.ec2.internal" event="NodeReady"
Jul 21 17:27:05.910530 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:05.910428    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 21 17:27:05.948890 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:05.948835    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c4d88bd77-d6qpg"]
Jul 21 17:27:05.966629 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:05.966610    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zkt82"]
Jul 21 17:27:05.966755 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:05.966738    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:05.970242 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:05.970221    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 21 17:27:05.970334 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:05.970225    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 21 17:27:05.970334 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:05.970295    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 21 17:27:05.970796 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:05.970779    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cdlpx\""
Jul 21 17:27:05.975414 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:05.975390    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 21 17:27:05.992794 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:05.992764    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c4d88bd77-d6qpg"]
Jul 21 17:27:05.992910 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:05.992801    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rrwdh"]
Jul 21 17:27:05.992988 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:05.992962    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zkt82"
Jul 21 17:27:05.995836 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:05.995817    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vzv2x\""
Jul 21 17:27:05.995977 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:05.995845    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 21 17:27:05.996100 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:05.996086    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 21 17:27:06.012947 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.012931    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zkt82"]
Jul 21 17:27:06.013035 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.012957    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rrwdh"]
Jul 21 17:27:06.013035 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.013027    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rrwdh"
Jul 21 17:27:06.015865 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.015841    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 21 17:27:06.015980 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.015965    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 21 17:27:06.016515 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.016496    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v2zc6\""
Jul 21 17:27:06.016593 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.016551    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 21 17:27:06.016593 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.016497    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 21 17:27:06.066204 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.066165    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gbssj"]
Jul 21 17:27:06.066623 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.066605    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac75fb55-b0c9-4893-8fa3-2b41003858a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rrwdh\" (UID: \"ac75fb55-b0c9-4893-8fa3-2b41003858a1\") " pod="openshift-insights/insights-runtime-extractor-rrwdh"
Jul 21 17:27:06.066670 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.066632    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f77df7d-c68e-44b1-8810-4c61c52e2d27-metrics-tls\") pod \"dns-default-zkt82\" (UID: \"8f77df7d-c68e-44b1-8810-4c61c52e2d27\") " pod="openshift-dns/dns-default-zkt82"
Jul 21 17:27:06.066670 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.066655    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6g5j\" (UniqueName: \"kubernetes.io/projected/ac75fb55-b0c9-4893-8fa3-2b41003858a1-kube-api-access-l6g5j\") pod \"insights-runtime-extractor-rrwdh\" (UID: \"ac75fb55-b0c9-4893-8fa3-2b41003858a1\") " pod="openshift-insights/insights-runtime-extractor-rrwdh"
Jul 21 17:27:06.066754 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.066675    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee9b3577-15a4-4dee-adbc-68674593a081-ca-trust-extracted\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.066754 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.066719    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9wbb\" (UniqueName: \"kubernetes.io/projected/8f77df7d-c68e-44b1-8810-4c61c52e2d27-kube-api-access-h9wbb\") pod \"dns-default-zkt82\" (UID: \"8f77df7d-c68e-44b1-8810-4c61c52e2d27\") " pod="openshift-dns/dns-default-zkt82"
Jul 21 17:27:06.066754 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.066738    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee9b3577-15a4-4dee-adbc-68674593a081-installation-pull-secrets\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.066754 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.066752    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac75fb55-b0c9-4893-8fa3-2b41003858a1-data-volume\") pod \"insights-runtime-extractor-rrwdh\" (UID: \"ac75fb55-b0c9-4893-8fa3-2b41003858a1\") " pod="openshift-insights/insights-runtime-extractor-rrwdh"
Jul 21 17:27:06.066903 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.066770    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee9b3577-15a4-4dee-adbc-68674593a081-bound-sa-token\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.066903 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.066789    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f77df7d-c68e-44b1-8810-4c61c52e2d27-tmp-dir\") pod \"dns-default-zkt82\" (UID: \"8f77df7d-c68e-44b1-8810-4c61c52e2d27\") " pod="openshift-dns/dns-default-zkt82"
Jul 21 17:27:06.066903 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.066848    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee9b3577-15a4-4dee-adbc-68674593a081-image-registry-private-configuration\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.066903 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.066883    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee9b3577-15a4-4dee-adbc-68674593a081-registry-tls\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.067049 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.066914    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee9b3577-15a4-4dee-adbc-68674593a081-trusted-ca\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.067049 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.066931    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac75fb55-b0c9-4893-8fa3-2b41003858a1-crio-socket\") pod \"insights-runtime-extractor-rrwdh\" (UID: \"ac75fb55-b0c9-4893-8fa3-2b41003858a1\") " pod="openshift-insights/insights-runtime-extractor-rrwdh"
Jul 21 17:27:06.067049 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.066945    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8f77df7d-c68e-44b1-8810-4c61c52e2d27-config-volume\") pod \"dns-default-zkt82\" (UID: \"8f77df7d-c68e-44b1-8810-4c61c52e2d27\") " pod="openshift-dns/dns-default-zkt82"
Jul 21 17:27:06.067049 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.066974    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhj2d\" (UniqueName: \"kubernetes.io/projected/ee9b3577-15a4-4dee-adbc-68674593a081-kube-api-access-dhj2d\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.067049 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.067009    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee9b3577-15a4-4dee-adbc-68674593a081-registry-certificates\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.067049 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.067022    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac75fb55-b0c9-4893-8fa3-2b41003858a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rrwdh\" (UID: \"ac75fb55-b0c9-4893-8fa3-2b41003858a1\") " pod="openshift-insights/insights-runtime-extractor-rrwdh"
Jul 21 17:27:06.081118 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.081095    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gbssj"]
Jul 21 17:27:06.081234 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.081217    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gbssj"
Jul 21 17:27:06.084067 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.084046    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2bv6x\""
Jul 21 17:27:06.084157 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.084118    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 21 17:27:06.084418 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.084402    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 21 17:27:06.084589 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.084571    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 21 17:27:06.120101 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.120083    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:27:06.120278 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.120264    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:27:06.122512 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.122490    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 17:27:06.122591 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.122518    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sxr4r\""
Jul 21 17:27:06.122591 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.122547    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 17:27:06.122864 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.122846    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 17:27:06.167872 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.167854    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee9b3577-15a4-4dee-adbc-68674593a081-installation-pull-secrets\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.167962 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.167878    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac75fb55-b0c9-4893-8fa3-2b41003858a1-data-volume\") pod \"insights-runtime-extractor-rrwdh\" (UID: \"ac75fb55-b0c9-4893-8fa3-2b41003858a1\") " pod="openshift-insights/insights-runtime-extractor-rrwdh"
Jul 21 17:27:06.167962 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.167896    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee9b3577-15a4-4dee-adbc-68674593a081-bound-sa-token\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.167962 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.167915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f77df7d-c68e-44b1-8810-4c61c52e2d27-tmp-dir\") pod \"dns-default-zkt82\" (UID: \"8f77df7d-c68e-44b1-8810-4c61c52e2d27\") " pod="openshift-dns/dns-default-zkt82"
Jul 21 17:27:06.167962 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.167943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee9b3577-15a4-4dee-adbc-68674593a081-image-registry-private-configuration\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.168152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.167966    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee9b3577-15a4-4dee-adbc-68674593a081-registry-tls\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.168152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.167992    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee9b3577-15a4-4dee-adbc-68674593a081-trusted-ca\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.168152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.168038    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac75fb55-b0c9-4893-8fa3-2b41003858a1-crio-socket\") pod \"insights-runtime-extractor-rrwdh\" (UID: \"ac75fb55-b0c9-4893-8fa3-2b41003858a1\") " pod="openshift-insights/insights-runtime-extractor-rrwdh"
Jul 21 17:27:06.168152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.168095    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8f77df7d-c68e-44b1-8810-4c61c52e2d27-config-volume\") pod \"dns-default-zkt82\" (UID: \"8f77df7d-c68e-44b1-8810-4c61c52e2d27\") " pod="openshift-dns/dns-default-zkt82"
Jul 21 17:27:06.168373 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.168263    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ac75fb55-b0c9-4893-8fa3-2b41003858a1-data-volume\") pod \"insights-runtime-extractor-rrwdh\" (UID: \"ac75fb55-b0c9-4893-8fa3-2b41003858a1\") " pod="openshift-insights/insights-runtime-extractor-rrwdh"
Jul 21 17:27:06.168373 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.168290    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8f77df7d-c68e-44b1-8810-4c61c52e2d27-tmp-dir\") pod \"dns-default-zkt82\" (UID: \"8f77df7d-c68e-44b1-8810-4c61c52e2d27\") " pod="openshift-dns/dns-default-zkt82"
Jul 21 17:27:06.168373 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.168299    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ac75fb55-b0c9-4893-8fa3-2b41003858a1-crio-socket\") pod \"insights-runtime-extractor-rrwdh\" (UID: \"ac75fb55-b0c9-4893-8fa3-2b41003858a1\") " pod="openshift-insights/insights-runtime-extractor-rrwdh"
Jul 21 17:27:06.168373 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.168354    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhj2d\" (UniqueName: \"kubernetes.io/projected/ee9b3577-15a4-4dee-adbc-68674593a081-kube-api-access-dhj2d\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.168618 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.168396    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5be7304d-47e3-4590-afed-b4f6b09be876-cert\") pod \"ingress-canary-gbssj\" (UID: \"5be7304d-47e3-4590-afed-b4f6b09be876\") " pod="openshift-ingress-canary/ingress-canary-gbssj"
Jul 21 17:27:06.168618 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.168494    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee9b3577-15a4-4dee-adbc-68674593a081-registry-certificates\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.168618 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.168521    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac75fb55-b0c9-4893-8fa3-2b41003858a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rrwdh\" (UID: \"ac75fb55-b0c9-4893-8fa3-2b41003858a1\") " pod="openshift-insights/insights-runtime-extractor-rrwdh"
Jul 21 17:27:06.168765 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.168624    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac75fb55-b0c9-4893-8fa3-2b41003858a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rrwdh\" (UID: \"ac75fb55-b0c9-4893-8fa3-2b41003858a1\") " pod="openshift-insights/insights-runtime-extractor-rrwdh"
Jul 21 17:27:06.168765 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.168661    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f77df7d-c68e-44b1-8810-4c61c52e2d27-metrics-tls\") pod \"dns-default-zkt82\" (UID: \"8f77df7d-c68e-44b1-8810-4c61c52e2d27\") " pod="openshift-dns/dns-default-zkt82"
Jul 21 17:27:06.168765 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.168698    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6g5j\" (UniqueName: \"kubernetes.io/projected/ac75fb55-b0c9-4893-8fa3-2b41003858a1-kube-api-access-l6g5j\") pod \"insights-runtime-extractor-rrwdh\" (UID: \"ac75fb55-b0c9-4893-8fa3-2b41003858a1\") " pod="openshift-insights/insights-runtime-extractor-rrwdh"
Jul 21 17:27:06.168765 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.168730    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee9b3577-15a4-4dee-adbc-68674593a081-ca-trust-extracted\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.168926 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.168765    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9wbb\" (UniqueName: \"kubernetes.io/projected/8f77df7d-c68e-44b1-8810-4c61c52e2d27-kube-api-access-h9wbb\") pod \"dns-default-zkt82\" (UID: \"8f77df7d-c68e-44b1-8810-4c61c52e2d27\") " pod="openshift-dns/dns-default-zkt82"
Jul 21 17:27:06.168926 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.168792    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gddl6\" (UniqueName: \"kubernetes.io/projected/5be7304d-47e3-4590-afed-b4f6b09be876-kube-api-access-gddl6\") pod \"ingress-canary-gbssj\" (UID: \"5be7304d-47e3-4590-afed-b4f6b09be876\") " pod="openshift-ingress-canary/ingress-canary-gbssj"
Jul 21 17:27:06.168926 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.168881    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8f77df7d-c68e-44b1-8810-4c61c52e2d27-config-volume\") pod \"dns-default-zkt82\" (UID: \"8f77df7d-c68e-44b1-8810-4c61c52e2d27\") " pod="openshift-dns/dns-default-zkt82"
Jul 21 17:27:06.169314 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.169189    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ee9b3577-15a4-4dee-adbc-68674593a081-trusted-ca\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.169314 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.169279    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ee9b3577-15a4-4dee-adbc-68674593a081-registry-certificates\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.169436 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.169320    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ac75fb55-b0c9-4893-8fa3-2b41003858a1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rrwdh\" (UID: \"ac75fb55-b0c9-4893-8fa3-2b41003858a1\") " pod="openshift-insights/insights-runtime-extractor-rrwdh"
Jul 21 17:27:06.169529 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.169508    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ee9b3577-15a4-4dee-adbc-68674593a081-ca-trust-extracted\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.172295 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.172275    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8f77df7d-c68e-44b1-8810-4c61c52e2d27-metrics-tls\") pod \"dns-default-zkt82\" (UID: \"8f77df7d-c68e-44b1-8810-4c61c52e2d27\") " pod="openshift-dns/dns-default-zkt82"
Jul 21 17:27:06.172388 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.172306    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ac75fb55-b0c9-4893-8fa3-2b41003858a1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rrwdh\" (UID: \"ac75fb55-b0c9-4893-8fa3-2b41003858a1\") " pod="openshift-insights/insights-runtime-extractor-rrwdh"
Jul 21 17:27:06.172456 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.172436    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ee9b3577-15a4-4dee-adbc-68674593a081-image-registry-private-configuration\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.172492 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.172444    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ee9b3577-15a4-4dee-adbc-68674593a081-registry-tls\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.172492 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.172482    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ee9b3577-15a4-4dee-adbc-68674593a081-installation-pull-secrets\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.201982 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.201933    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9wbb\" (UniqueName: \"kubernetes.io/projected/8f77df7d-c68e-44b1-8810-4c61c52e2d27-kube-api-access-h9wbb\") pod \"dns-default-zkt82\" (UID: \"8f77df7d-c68e-44b1-8810-4c61c52e2d27\") " pod="openshift-dns/dns-default-zkt82"
Jul 21 17:27:06.202804 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.202782    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhj2d\" (UniqueName: \"kubernetes.io/projected/ee9b3577-15a4-4dee-adbc-68674593a081-kube-api-access-dhj2d\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.205096 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.205076    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6g5j\" (UniqueName: \"kubernetes.io/projected/ac75fb55-b0c9-4893-8fa3-2b41003858a1-kube-api-access-l6g5j\") pod \"insights-runtime-extractor-rrwdh\" (UID: \"ac75fb55-b0c9-4893-8fa3-2b41003858a1\") " pod="openshift-insights/insights-runtime-extractor-rrwdh"
Jul 21 17:27:06.205891 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.205870    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ee9b3577-15a4-4dee-adbc-68674593a081-bound-sa-token\") pod \"image-registry-7c4d88bd77-d6qpg\" (UID: \"ee9b3577-15a4-4dee-adbc-68674593a081\") " pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.270050 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.270030    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gddl6\" (UniqueName: \"kubernetes.io/projected/5be7304d-47e3-4590-afed-b4f6b09be876-kube-api-access-gddl6\") pod \"ingress-canary-gbssj\" (UID: \"5be7304d-47e3-4590-afed-b4f6b09be876\") " pod="openshift-ingress-canary/ingress-canary-gbssj"
Jul 21 17:27:06.270157 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.270099    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5be7304d-47e3-4590-afed-b4f6b09be876-cert\") pod \"ingress-canary-gbssj\" (UID: \"5be7304d-47e3-4590-afed-b4f6b09be876\") " pod="openshift-ingress-canary/ingress-canary-gbssj"
Jul 21 17:27:06.272120 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.272100    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5be7304d-47e3-4590-afed-b4f6b09be876-cert\") pod \"ingress-canary-gbssj\" (UID: \"5be7304d-47e3-4590-afed-b4f6b09be876\") " pod="openshift-ingress-canary/ingress-canary-gbssj"
Jul 21 17:27:06.277351 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.277334    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:06.277974 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.277952    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gddl6\" (UniqueName: \"kubernetes.io/projected/5be7304d-47e3-4590-afed-b4f6b09be876-kube-api-access-gddl6\") pod \"ingress-canary-gbssj\" (UID: \"5be7304d-47e3-4590-afed-b4f6b09be876\") " pod="openshift-ingress-canary/ingress-canary-gbssj"
Jul 21 17:27:06.301839 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.301820    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zkt82"
Jul 21 17:27:06.324274 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.324256    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rrwdh"
Jul 21 17:27:06.389740 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.389688    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gbssj"
Jul 21 17:27:06.501593 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.501567    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zkt82"]
Jul 21 17:27:06.507222 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.505270    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c4d88bd77-d6qpg"]
Jul 21 17:27:06.507222 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:27:06.507152    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f77df7d_c68e_44b1_8810_4c61c52e2d27.slice/crio-377c17b51af89665ee8d1b9ffaadf49c471397f646f707c0783c72632de8d1a7 WatchSource:0}: Error finding container 377c17b51af89665ee8d1b9ffaadf49c471397f646f707c0783c72632de8d1a7: Status 404 returned error can't find the container with id 377c17b51af89665ee8d1b9ffaadf49c471397f646f707c0783c72632de8d1a7
Jul 21 17:27:06.516674 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:27:06.516647    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee9b3577_15a4_4dee_adbc_68674593a081.slice/crio-e7560759b56d50b35c3b8adf0db86bcb7d714aaa86a8dd4880344358830a2445 WatchSource:0}: Error finding container e7560759b56d50b35c3b8adf0db86bcb7d714aaa86a8dd4880344358830a2445: Status 404 returned error can't find the container with id e7560759b56d50b35c3b8adf0db86bcb7d714aaa86a8dd4880344358830a2445
Jul 21 17:27:06.542718 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.542689    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rrwdh"]
Jul 21 17:27:06.576499 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:06.576474    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gbssj"]
Jul 21 17:27:06.578741 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:27:06.578721    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5be7304d_47e3_4590_afed_b4f6b09be876.slice/crio-dae0a203fe91d79e90d14c2eb1a3617180431414792779048081a8336d85445c WatchSource:0}: Error finding container dae0a203fe91d79e90d14c2eb1a3617180431414792779048081a8336d85445c: Status 404 returned error can't find the container with id dae0a203fe91d79e90d14c2eb1a3617180431414792779048081a8336d85445c
Jul 21 17:27:07.120838 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:07.120446    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:27:07.124135 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:07.124109    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nmxsm\""
Jul 21 17:27:07.124135 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:07.124133    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 17:27:07.374791 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:07.374711    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gbssj" event={"ID":"5be7304d-47e3-4590-afed-b4f6b09be876","Type":"ContainerStarted","Data":"dae0a203fe91d79e90d14c2eb1a3617180431414792779048081a8336d85445c"}
Jul 21 17:27:07.379040 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:07.378971    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zkt82" event={"ID":"8f77df7d-c68e-44b1-8810-4c61c52e2d27","Type":"ContainerStarted","Data":"377c17b51af89665ee8d1b9ffaadf49c471397f646f707c0783c72632de8d1a7"}
Jul 21 17:27:07.382573 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:07.382535    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rrwdh" event={"ID":"ac75fb55-b0c9-4893-8fa3-2b41003858a1","Type":"ContainerStarted","Data":"5bffa2832c3a50f7905eef02e081ca9bd2d9737bf44d0e094b01358f9cad9d80"}
Jul 21 17:27:07.386055 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:07.386026    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg" event={"ID":"ee9b3577-15a4-4dee-adbc-68674593a081","Type":"ContainerStarted","Data":"993a38417135c2140812b5d45ed79644ce76f7b5827b3e12554e8b85fdd555ad"}
Jul 21 17:27:07.386188 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:07.386074    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg" event={"ID":"ee9b3577-15a4-4dee-adbc-68674593a081","Type":"ContainerStarted","Data":"e7560759b56d50b35c3b8adf0db86bcb7d714aaa86a8dd4880344358830a2445"}
Jul 21 17:27:07.386779 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:07.386743    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:07.412831 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:07.412786    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg" podStartSLOduration=3.412768558 podStartE2EDuration="3.412768558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:27:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:07.412390412 +0000 UTC m=+52.812954484" watchObservedRunningTime="2026-07-21 17:27:07.412768558 +0000 UTC m=+52.813332631"
Jul 21 17:27:13.406626 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:13.406583    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gbssj" event={"ID":"5be7304d-47e3-4590-afed-b4f6b09be876","Type":"ContainerStarted","Data":"c48f4f7068c10b236e3de25363401be9fa3dc9c4af2abf6e5dd2ce87d594b2a7"}
Jul 21 17:27:13.408901 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:13.408874    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zkt82" event={"ID":"8f77df7d-c68e-44b1-8810-4c61c52e2d27","Type":"ContainerStarted","Data":"579d877f57b44336b7d3d30c6c58a66efdf2301cc8c063b43652cf4f48c4ffa3"}
Jul 21 17:27:13.409014 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:13.408923    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zkt82" event={"ID":"8f77df7d-c68e-44b1-8810-4c61c52e2d27","Type":"ContainerStarted","Data":"ac1ec49e193f506dc2a321740d8296e7af12ac2a2028a550803a6c4f9b4854fb"}
Jul 21 17:27:13.409014 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:13.408952    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zkt82"
Jul 21 17:27:13.410538 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:13.410513    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rrwdh" event={"ID":"ac75fb55-b0c9-4893-8fa3-2b41003858a1","Type":"ContainerStarted","Data":"8d11732a6862f7fdceee7a484ba124b69b65349cecc7d15194fe885c79f68981"}
Jul 21 17:27:13.426133 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:13.426096    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gbssj" podStartSLOduration=1.625985655 podStartE2EDuration="7.426084993s" totalImagesPullingTime="5.800099338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:27:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:13.425086014 +0000 UTC m=+58.825650087" watchObservedRunningTime="2026-07-21 17:27:13.426084993 +0000 UTC m=+58.826649042"
Jul 21 17:27:16.328336 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:16.328303    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-65gzx"
Jul 21 17:27:16.362039 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:16.361983    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zkt82" podStartSLOduration=5.490682704 podStartE2EDuration="11.361968321s" totalImagesPullingTime="5.871285617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:27:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:13.450413787 +0000 UTC m=+58.850977875" watchObservedRunningTime="2026-07-21 17:27:16.361968321 +0000 UTC m=+61.762532452"
Jul 21 17:27:16.421995 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:16.421951    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rrwdh" event={"ID":"ac75fb55-b0c9-4893-8fa3-2b41003858a1","Type":"ContainerStarted","Data":"61c8cb898f139b9ece63eac1e84366b0973a10a86c393a48cf5886c32cf9d968"}
Jul 21 17:27:19.433721 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:19.433689    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rrwdh" event={"ID":"ac75fb55-b0c9-4893-8fa3-2b41003858a1","Type":"ContainerStarted","Data":"a89e08169157c98dd287370a0510a16b73c5e20c4bce6451722a84fb645d3291"}
Jul 21 17:27:19.460148 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:19.460073    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rrwdh" podStartSLOduration=1.858875168 podStartE2EDuration="14.460057064s" totalImagesPullingTime="12.601181896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:27:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:19.459475552 +0000 UTC m=+64.860039624" watchObservedRunningTime="2026-07-21 17:27:19.460057064 +0000 UTC m=+64.860621113"
Jul 21 17:27:20.191150 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.191117    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-6m2w8"]
Jul 21 17:27:20.213040 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.213010    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-6m2w8"]
Jul 21 17:27:20.213593 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.213559    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6m2w8"
Jul 21 17:27:20.217271 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.217250    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 21 17:27:20.217370 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.217250    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 21 17:27:20.218279 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.218258    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-gbsmd\""
Jul 21 17:27:20.218394 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.218330    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 21 17:27:20.218394 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.218374    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 21 17:27:20.218773 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.218285    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 21 17:27:20.255250 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.255227    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2hdb6"]
Jul 21 17:27:20.276248 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.276219    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.281139 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.281119    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 21 17:27:20.281248 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.281154    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jhq4k\""
Jul 21 17:27:20.281774 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.281747    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 21 17:27:20.281864 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.281779    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 21 17:27:20.285814 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.285793    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-6m2w8\" (UID: \"ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6m2w8"
Jul 21 17:27:20.285897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.285826    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-6m2w8\" (UID: \"ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6m2w8"
Jul 21 17:27:20.285897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.285850    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-6m2w8\" (UID: \"ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6m2w8"
Jul 21 17:27:20.286010 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.285916    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddczw\" (UniqueName: \"kubernetes.io/projected/ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c-kube-api-access-ddczw\") pod \"openshift-state-metrics-79f6958cdf-6m2w8\" (UID: \"ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6m2w8"
Jul 21 17:27:20.386540 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.386521    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dcnv\" (UniqueName: \"kubernetes.io/projected/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-kube-api-access-6dcnv\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.386646 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.386551    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-6m2w8\" (UID: \"ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6m2w8"
Jul 21 17:27:20.386646 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.386572    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-metrics-client-ca\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.386646 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.386590    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-node-exporter-accelerators-collector-config\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.386646 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.386614    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-node-exporter-textfile\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.386646 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.386641    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddczw\" (UniqueName: \"kubernetes.io/projected/ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c-kube-api-access-ddczw\") pod \"openshift-state-metrics-79f6958cdf-6m2w8\" (UID: \"ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6m2w8"
Jul 21 17:27:20.386831 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.386717    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.386831 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.386790    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-sys\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.386831 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.386804    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-root\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.386831 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.386827    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-6m2w8\" (UID: \"ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6m2w8"
Jul 21 17:27:20.386994 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.386968    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-6m2w8\" (UID: \"ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6m2w8"
Jul 21 17:27:20.387047 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.387014    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-node-exporter-tls\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.387098 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.387042    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-node-exporter-wtmp\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.387405 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.387389    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-6m2w8\" (UID: \"ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6m2w8"
Jul 21 17:27:20.389275 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.389252    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-6m2w8\" (UID: \"ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6m2w8"
Jul 21 17:27:20.389354 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.389298    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-6m2w8\" (UID: \"ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6m2w8"
Jul 21 17:27:20.406103 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.406076    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddczw\" (UniqueName: \"kubernetes.io/projected/ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c-kube-api-access-ddczw\") pod \"openshift-state-metrics-79f6958cdf-6m2w8\" (UID: \"ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6m2w8"
Jul 21 17:27:20.487894 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.487846    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-node-exporter-tls\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.487894 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.487870    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-node-exporter-wtmp\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.487894 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.487888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dcnv\" (UniqueName: \"kubernetes.io/projected/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-kube-api-access-6dcnv\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.488555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.487918    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-metrics-client-ca\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.488555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.487943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-node-exporter-accelerators-collector-config\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.488555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.487970    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-node-exporter-textfile\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.488555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.488045    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-node-exporter-wtmp\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.488555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.488104    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.488555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.488205    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-sys\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.488555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.488229    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-root\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.488555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.488292    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-root\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.488555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.488298    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-sys\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.488555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.488489    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-node-exporter-textfile\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.488886 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.488585    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-metrics-client-ca\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.488995 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.488969    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-node-exporter-accelerators-collector-config\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.490184 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.490153    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-node-exporter-tls\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.490388 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.490373    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.501659 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.501576    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dcnv\" (UniqueName: \"kubernetes.io/projected/92d9c4b7-2010-4bfb-af9d-bb81ff1e716f-kube-api-access-6dcnv\") pod \"node-exporter-2hdb6\" (UID: \"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f\") " pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.526418 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.526393    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6m2w8"
Jul 21 17:27:20.584064 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.584039    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2hdb6"
Jul 21 17:27:20.614967 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:27:20.614930    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d9c4b7_2010_4bfb_af9d_bb81ff1e716f.slice/crio-813922e3dfa98e02a6e04268abfbb9dbd9c3fa69701efe3b31a3d32ca880c1e5 WatchSource:0}: Error finding container 813922e3dfa98e02a6e04268abfbb9dbd9c3fa69701efe3b31a3d32ca880c1e5: Status 404 returned error can't find the container with id 813922e3dfa98e02a6e04268abfbb9dbd9c3fa69701efe3b31a3d32ca880c1e5
Jul 21 17:27:20.691636 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.691613    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-6m2w8"]
Jul 21 17:27:20.694027 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:27:20.694003    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccaa5a14_dc5f_4ed0_87d8_39bdcd72cc1c.slice/crio-d0ac9050afe62e138f270b091ef1828b40d7cc36abd2b78badc5771b37c92f2b WatchSource:0}: Error finding container d0ac9050afe62e138f270b091ef1828b40d7cc36abd2b78badc5771b37c92f2b: Status 404 returned error can't find the container with id d0ac9050afe62e138f270b091ef1828b40d7cc36abd2b78badc5771b37c92f2b
Jul 21 17:27:20.789892 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.789868    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs\") pod \"network-metrics-daemon-w77vz\" (UID: \"4402c8fb-d8a6-4c10-ab0f-acfa04695301\") " pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:27:20.789988 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.789924    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret\") pod \"global-pull-secret-syncer-vrb68\" (UID: \"75f2dec8-5c4a-4312-9743-0429cc8c0034\") " pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:27:20.792944 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.792920    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 21 17:27:20.793009 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.792973    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 21 17:27:20.802447 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.802429    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/75f2dec8-5c4a-4312-9743-0429cc8c0034-original-pull-secret\") pod \"global-pull-secret-syncer-vrb68\" (UID: \"75f2dec8-5c4a-4312-9743-0429cc8c0034\") " pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:27:20.802571 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.802555    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4402c8fb-d8a6-4c10-ab0f-acfa04695301-metrics-certs\") pod \"network-metrics-daemon-w77vz\" (UID: \"4402c8fb-d8a6-4c10-ab0f-acfa04695301\") " pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:27:20.828689 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.828667    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vrb68"
Jul 21 17:27:20.891147 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.891114    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhbhk\" (UniqueName: \"kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk\") pod \"network-check-target-jxfq5\" (UID: \"94d13840-ec8d-446a-8212-c0daa4a94012\") " pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:27:20.894046 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.894029    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 21 17:27:20.904869 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.904659    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 21 17:27:20.915209 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.915187    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhbhk\" (UniqueName: \"kubernetes.io/projected/94d13840-ec8d-446a-8212-c0daa4a94012-kube-api-access-mhbhk\") pod \"network-check-target-jxfq5\" (UID: \"94d13840-ec8d-446a-8212-c0daa4a94012\") " pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:27:20.933038 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.933018    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nmxsm\""
Jul 21 17:27:20.941115 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.941059    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w77vz"
Jul 21 17:27:20.991723 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:20.991696    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vrb68"]
Jul 21 17:27:20.995261 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:27:20.995235    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f2dec8_5c4a_4312_9743_0429cc8c0034.slice/crio-0711bbc934764a1aeb86c739028cfbc7c70d4f5d0d5627be4115089e78e3953c WatchSource:0}: Error finding container 0711bbc934764a1aeb86c739028cfbc7c70d4f5d0d5627be4115089e78e3953c: Status 404 returned error can't find the container with id 0711bbc934764a1aeb86c739028cfbc7c70d4f5d0d5627be4115089e78e3953c
Jul 21 17:27:21.088891 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.088859    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w77vz"]
Jul 21 17:27:21.091579 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:27:21.091549    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4402c8fb_d8a6_4c10_ab0f_acfa04695301.slice/crio-e6e969b160df4b35424d5665974190004ae3fb263356f3f205459118e1b9c9a0 WatchSource:0}: Error finding container e6e969b160df4b35424d5665974190004ae3fb263356f3f205459118e1b9c9a0: Status 404 returned error can't find the container with id e6e969b160df4b35424d5665974190004ae3fb263356f3f205459118e1b9c9a0
Jul 21 17:27:21.136022 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.135995    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sxr4r\""
Jul 21 17:27:21.144463 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.144445    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:27:21.258969 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.258946    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 17:27:21.277287 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.277232    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.280771 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.280546    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 21 17:27:21.281191 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.281145    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 21 17:27:21.281292 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.281236    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 21 17:27:21.281549 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.281395    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 21 17:27:21.281549 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.281449    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 21 17:27:21.281549 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.281518    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 21 17:27:21.281761 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.281549    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 21 17:27:21.281761 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.281641    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 21 17:27:21.282273 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.281951    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bq65d\""
Jul 21 17:27:21.282273 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.281951    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 21 17:27:21.283401 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.283374    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 17:27:21.314568 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.314536    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jxfq5"]
Jul 21 17:27:21.317637 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:27:21.317603    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d13840_ec8d_446a_8212_c0daa4a94012.slice/crio-8d8e9221b561bbecc7a6e2fac70eeeccaf3c79c381f902bbc7c6586c7c0aef5e WatchSource:0}: Error finding container 8d8e9221b561bbecc7a6e2fac70eeeccaf3c79c381f902bbc7c6586c7c0aef5e: Status 404 returned error can't find the container with id 8d8e9221b561bbecc7a6e2fac70eeeccaf3c79c381f902bbc7c6586c7c0aef5e
Jul 21 17:27:21.393621 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.393588    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.393621 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.393621    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.393774 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.393639    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-web-config\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.393774 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.393656    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-config-volume\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.393774 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.393691    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78600264-f11e-4282-a45e-9bf75cbf3180-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.393774 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.393770    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/78600264-f11e-4282-a45e-9bf75cbf3180-tls-assets\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.393924 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.393788    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.393924 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.393810    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/78600264-f11e-4282-a45e-9bf75cbf3180-config-out\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.393924 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.393836    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/78600264-f11e-4282-a45e-9bf75cbf3180-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.393924 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.393860    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.393924 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.393888    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78600264-f11e-4282-a45e-9bf75cbf3180-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.394066 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.393935    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhxb6\" (UniqueName: \"kubernetes.io/projected/78600264-f11e-4282-a45e-9bf75cbf3180-kube-api-access-lhxb6\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.394066 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.393961    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.446228 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.446194    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jxfq5" event={"ID":"94d13840-ec8d-446a-8212-c0daa4a94012","Type":"ContainerStarted","Data":"8d8e9221b561bbecc7a6e2fac70eeeccaf3c79c381f902bbc7c6586c7c0aef5e"}
Jul 21 17:27:21.447223 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.447197    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w77vz" event={"ID":"4402c8fb-d8a6-4c10-ab0f-acfa04695301","Type":"ContainerStarted","Data":"e6e969b160df4b35424d5665974190004ae3fb263356f3f205459118e1b9c9a0"}
Jul 21 17:27:21.448341 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.448320    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vrb68" event={"ID":"75f2dec8-5c4a-4312-9743-0429cc8c0034","Type":"ContainerStarted","Data":"0711bbc934764a1aeb86c739028cfbc7c70d4f5d0d5627be4115089e78e3953c"}
Jul 21 17:27:21.449475 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.449455    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2hdb6" event={"ID":"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f","Type":"ContainerStarted","Data":"813922e3dfa98e02a6e04268abfbb9dbd9c3fa69701efe3b31a3d32ca880c1e5"}
Jul 21 17:27:21.451316 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.451292    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6m2w8" event={"ID":"ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c","Type":"ContainerStarted","Data":"c7119791aa0c6931b0341dfa586a3a04fca1f0acb28e7715ff6747136dd16610"}
Jul 21 17:27:21.451433 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.451345    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6m2w8" event={"ID":"ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c","Type":"ContainerStarted","Data":"c670ff4a2bad9a5683ce5c3bc6bac3343f67d12be68b0f13e0563f79890bafba"}
Jul 21 17:27:21.451433 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.451373    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6m2w8" event={"ID":"ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c","Type":"ContainerStarted","Data":"d0ac9050afe62e138f270b091ef1828b40d7cc36abd2b78badc5771b37c92f2b"}
Jul 21 17:27:21.494811 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.494788    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/78600264-f11e-4282-a45e-9bf75cbf3180-config-out\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.495209 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.494827    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/78600264-f11e-4282-a45e-9bf75cbf3180-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.495209 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.494851    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.495209 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.494878    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78600264-f11e-4282-a45e-9bf75cbf3180-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.495209 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.494914    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhxb6\" (UniqueName: \"kubernetes.io/projected/78600264-f11e-4282-a45e-9bf75cbf3180-kube-api-access-lhxb6\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.495209 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.494951    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.495209 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.494979    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.495209 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.495006    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.495209 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.495033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-web-config\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.495209 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.495058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-config-volume\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.495209 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.495079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78600264-f11e-4282-a45e-9bf75cbf3180-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.495209 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.495117    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/78600264-f11e-4282-a45e-9bf75cbf3180-tls-assets\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.495209 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.495141    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.495858 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.495282    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/78600264-f11e-4282-a45e-9bf75cbf3180-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.496083 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.496063    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78600264-f11e-4282-a45e-9bf75cbf3180-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.497618 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.497591    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78600264-f11e-4282-a45e-9bf75cbf3180-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.498888 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.498832    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.500248 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.500054    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/78600264-f11e-4282-a45e-9bf75cbf3180-tls-assets\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.500346 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.500286    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/78600264-f11e-4282-a45e-9bf75cbf3180-config-out\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.500467 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.500443    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.500662 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.500635    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.502264 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.502237    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.502360 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.502301    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.502404 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.502371    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-config-volume\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.502494 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.502449    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-web-config\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.505132 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.505107    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhxb6\" (UniqueName: \"kubernetes.io/projected/78600264-f11e-4282-a45e-9bf75cbf3180-kube-api-access-lhxb6\") pod \"alertmanager-main-0\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.590329 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.590238    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:27:21.896547 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:21.896400    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 17:27:22.378324 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:27:22.378286    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78600264_f11e_4282_a45e_9bf75cbf3180.slice/crio-1cbcb0fa03318591fc1ff4505ece2ba0b50e479535d275961e6faf5c5d40223d WatchSource:0}: Error finding container 1cbcb0fa03318591fc1ff4505ece2ba0b50e479535d275961e6faf5c5d40223d: Status 404 returned error can't find the container with id 1cbcb0fa03318591fc1ff4505ece2ba0b50e479535d275961e6faf5c5d40223d
Jul 21 17:27:22.457796 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:22.457764    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78600264-f11e-4282-a45e-9bf75cbf3180","Type":"ContainerStarted","Data":"1cbcb0fa03318591fc1ff4505ece2ba0b50e479535d275961e6faf5c5d40223d"}
Jul 21 17:27:23.269904 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.269868    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"]
Jul 21 17:27:23.274051 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.274029    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.284193 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.283961    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 21 17:27:23.284193 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.283961    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 21 17:27:23.284193 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.283961    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 21 17:27:23.284752 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.284591    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 21 17:27:23.288982 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.288828    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-b3jpau9dap94\""
Jul 21 17:27:23.292603 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.292160    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wrn5h\""
Jul 21 17:27:23.292603 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.292385    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 21 17:27:23.307550 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.307506    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"]
Jul 21 17:27:23.311337 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.311029    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96dfb480-8daf-42e2-8d3c-4c50eee2487a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.311337 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.311074    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/96dfb480-8daf-42e2-8d3c-4c50eee2487a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.311337 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.311156    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/96dfb480-8daf-42e2-8d3c-4c50eee2487a-secret-thanos-querier-tls\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.311337 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.311200    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96dfb480-8daf-42e2-8d3c-4c50eee2487a-secret-grpc-tls\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.311337 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.311229    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96dfb480-8daf-42e2-8d3c-4c50eee2487a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.311337 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.311259    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/96dfb480-8daf-42e2-8d3c-4c50eee2487a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.311337 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.311286    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzxcq\" (UniqueName: \"kubernetes.io/projected/96dfb480-8daf-42e2-8d3c-4c50eee2487a-kube-api-access-jzxcq\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.311337 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.311315    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96dfb480-8daf-42e2-8d3c-4c50eee2487a-metrics-client-ca\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.411818 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.411784    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/96dfb480-8daf-42e2-8d3c-4c50eee2487a-secret-thanos-querier-tls\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.411960 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.411826    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96dfb480-8daf-42e2-8d3c-4c50eee2487a-secret-grpc-tls\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.411960 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.411860    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96dfb480-8daf-42e2-8d3c-4c50eee2487a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.411960 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.411888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/96dfb480-8daf-42e2-8d3c-4c50eee2487a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.411960 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.411915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzxcq\" (UniqueName: \"kubernetes.io/projected/96dfb480-8daf-42e2-8d3c-4c50eee2487a-kube-api-access-jzxcq\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.411960 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.411943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96dfb480-8daf-42e2-8d3c-4c50eee2487a-metrics-client-ca\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.412130 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.411994    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96dfb480-8daf-42e2-8d3c-4c50eee2487a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.412130 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.412019    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/96dfb480-8daf-42e2-8d3c-4c50eee2487a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.412977 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.412928    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96dfb480-8daf-42e2-8d3c-4c50eee2487a-metrics-client-ca\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.416608 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.415948    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/96dfb480-8daf-42e2-8d3c-4c50eee2487a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.416608 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.416378    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/96dfb480-8daf-42e2-8d3c-4c50eee2487a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.417875 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.417005    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zkt82"
Jul 21 17:27:23.420836 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.420739    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/96dfb480-8daf-42e2-8d3c-4c50eee2487a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.422425 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.421385    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/96dfb480-8daf-42e2-8d3c-4c50eee2487a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.422425 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.421503    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/96dfb480-8daf-42e2-8d3c-4c50eee2487a-secret-thanos-querier-tls\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.426413 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.426393    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/96dfb480-8daf-42e2-8d3c-4c50eee2487a-secret-grpc-tls\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.426507 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.426476    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzxcq\" (UniqueName: \"kubernetes.io/projected/96dfb480-8daf-42e2-8d3c-4c50eee2487a-kube-api-access-jzxcq\") pod \"thanos-querier-7d7fb48895-fn8bb\" (UID: \"96dfb480-8daf-42e2-8d3c-4c50eee2487a\") " pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.465111 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.465083    2581 generic.go:356] "Generic (PLEG): container finished" podID="92d9c4b7-2010-4bfb-af9d-bb81ff1e716f" containerID="bdb32683cbb62e2c3d7adfec89136a53474312b6a798ffff58842fab44815ca5" exitCode=0
Jul 21 17:27:23.465278 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.465164    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2hdb6" event={"ID":"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f","Type":"ContainerDied","Data":"bdb32683cbb62e2c3d7adfec89136a53474312b6a798ffff58842fab44815ca5"}
Jul 21 17:27:23.470867 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.470844    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6m2w8" event={"ID":"ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c","Type":"ContainerStarted","Data":"06fda15274ac256352eb321b29b37c5d7a3eafd147e3476661a8799908dc9ea6"}
Jul 21 17:27:23.473658 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.473125    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w77vz" event={"ID":"4402c8fb-d8a6-4c10-ab0f-acfa04695301","Type":"ContainerStarted","Data":"9727c475ce0434bd8e78ff90cc944a6679c8ad73576837f672e053964b817c66"}
Jul 21 17:27:23.473658 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.473204    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w77vz" event={"ID":"4402c8fb-d8a6-4c10-ab0f-acfa04695301","Type":"ContainerStarted","Data":"6bf8307dd43e582645c9097e20b78df1824e2318dd3d230782a9174744e0b56d"}
Jul 21 17:27:23.513889 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.510163    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-6m2w8" podStartSLOduration=2.056223123 podStartE2EDuration="3.510143809s" totalImagesPullingTime="1.453920686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:27:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:23.505024434 +0000 UTC m=+68.905588504" watchObservedRunningTime="2026-07-21 17:27:23.510143809 +0000 UTC m=+68.910707881"
Jul 21 17:27:23.529884 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.529789    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w77vz" podStartSLOduration=67.208915445 podStartE2EDuration="1m8.529771045s" totalImagesPullingTime="1.3208556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:23.528424906 +0000 UTC m=+68.928989000" watchObservedRunningTime="2026-07-21 17:27:23.529771045 +0000 UTC m=+68.930335116"
Jul 21 17:27:23.587369 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.587337    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:23.760138 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:23.760107    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"]
Jul 21 17:27:24.479564 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.479529    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2hdb6" event={"ID":"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f","Type":"ContainerStarted","Data":"f6dd5de772ff04db839cf278a84c0612b2f75b039bf0cc03514ffee28b5a6dae"}
Jul 21 17:27:24.480012 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.479590    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2hdb6" event={"ID":"92d9c4b7-2010-4bfb-af9d-bb81ff1e716f","Type":"ContainerStarted","Data":"426e79dc99a6070d56faecd59e08e0fb5c4dedec603f58518ba19634a82a4625"}
Jul 21 17:27:24.481253 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.481221    2581 generic.go:356] "Generic (PLEG): container finished" podID="78600264-f11e-4282-a45e-9bf75cbf3180" containerID="9def963211e7a3e64cd9dd7c9ca56165a1fe8fbd55901864e1e713f74365f461" exitCode=0
Jul 21 17:27:24.481486 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.481461    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78600264-f11e-4282-a45e-9bf75cbf3180","Type":"ContainerDied","Data":"9def963211e7a3e64cd9dd7c9ca56165a1fe8fbd55901864e1e713f74365f461"}
Jul 21 17:27:24.501126 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.501084    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2hdb6" podStartSLOduration=2.6291753399999997 podStartE2EDuration="4.501071398s" totalImagesPullingTime="1.761234817s" totalInitContainerRuntime="110.661241ms" isStatefulPod=true podCreationTimestamp="2026-07-21 17:27:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:24.499600905 +0000 UTC m=+69.900164977" watchObservedRunningTime="2026-07-21 17:27:24.501071398 +0000 UTC m=+69.901635469"
Jul 21 17:27:24.601302 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.601269    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-66cc4d8469-hqj9w"]
Jul 21 17:27:24.604711 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.604689    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:24.607140 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.607116    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 21 17:27:24.607262 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.607196    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 21 17:27:24.607262 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.607246    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rfvq6\""
Jul 21 17:27:24.607262 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.607251    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 21 17:27:24.607395 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.607291    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-8t7e03u8557j9\""
Jul 21 17:27:24.607547 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.607514    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 21 17:27:24.614768 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.614747    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66cc4d8469-hqj9w"]
Jul 21 17:27:24.727526 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.727496    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/55280080-4cf6-4bd5-98ad-06a6750d129f-metrics-server-audit-profiles\") pod \"metrics-server-66cc4d8469-hqj9w\" (UID: \"55280080-4cf6-4bd5-98ad-06a6750d129f\") " pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:24.727672 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.727533    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55280080-4cf6-4bd5-98ad-06a6750d129f-client-ca-bundle\") pod \"metrics-server-66cc4d8469-hqj9w\" (UID: \"55280080-4cf6-4bd5-98ad-06a6750d129f\") " pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:24.727672 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.727552    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/55280080-4cf6-4bd5-98ad-06a6750d129f-secret-metrics-server-tls\") pod \"metrics-server-66cc4d8469-hqj9w\" (UID: \"55280080-4cf6-4bd5-98ad-06a6750d129f\") " pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:24.727672 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.727570    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55280080-4cf6-4bd5-98ad-06a6750d129f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66cc4d8469-hqj9w\" (UID: \"55280080-4cf6-4bd5-98ad-06a6750d129f\") " pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:24.727672 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.727594    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/55280080-4cf6-4bd5-98ad-06a6750d129f-secret-metrics-server-client-certs\") pod \"metrics-server-66cc4d8469-hqj9w\" (UID: \"55280080-4cf6-4bd5-98ad-06a6750d129f\") " pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:24.727672 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.727615    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr8p4\" (UniqueName: \"kubernetes.io/projected/55280080-4cf6-4bd5-98ad-06a6750d129f-kube-api-access-lr8p4\") pod \"metrics-server-66cc4d8469-hqj9w\" (UID: \"55280080-4cf6-4bd5-98ad-06a6750d129f\") " pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:24.727672 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.727639    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/55280080-4cf6-4bd5-98ad-06a6750d129f-audit-log\") pod \"metrics-server-66cc4d8469-hqj9w\" (UID: \"55280080-4cf6-4bd5-98ad-06a6750d129f\") " pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:24.780551 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:27:24.780523    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96dfb480_8daf_42e2_8d3c_4c50eee2487a.slice/crio-ed89a0a3b964ae4f76da92eb6130853f78c1578572326f1dab73b80735df7c36 WatchSource:0}: Error finding container ed89a0a3b964ae4f76da92eb6130853f78c1578572326f1dab73b80735df7c36: Status 404 returned error can't find the container with id ed89a0a3b964ae4f76da92eb6130853f78c1578572326f1dab73b80735df7c36
Jul 21 17:27:24.828459 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.828429    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/55280080-4cf6-4bd5-98ad-06a6750d129f-metrics-server-audit-profiles\") pod \"metrics-server-66cc4d8469-hqj9w\" (UID: \"55280080-4cf6-4bd5-98ad-06a6750d129f\") " pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:24.828596 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.828465    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55280080-4cf6-4bd5-98ad-06a6750d129f-client-ca-bundle\") pod \"metrics-server-66cc4d8469-hqj9w\" (UID: \"55280080-4cf6-4bd5-98ad-06a6750d129f\") " pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:24.828596 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.828488    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/55280080-4cf6-4bd5-98ad-06a6750d129f-secret-metrics-server-tls\") pod \"metrics-server-66cc4d8469-hqj9w\" (UID: \"55280080-4cf6-4bd5-98ad-06a6750d129f\") " pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:24.829676 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.828912    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55280080-4cf6-4bd5-98ad-06a6750d129f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66cc4d8469-hqj9w\" (UID: \"55280080-4cf6-4bd5-98ad-06a6750d129f\") " pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:24.829676 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.828969    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/55280080-4cf6-4bd5-98ad-06a6750d129f-secret-metrics-server-client-certs\") pod \"metrics-server-66cc4d8469-hqj9w\" (UID: \"55280080-4cf6-4bd5-98ad-06a6750d129f\") " pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:24.829676 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.829008    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr8p4\" (UniqueName: \"kubernetes.io/projected/55280080-4cf6-4bd5-98ad-06a6750d129f-kube-api-access-lr8p4\") pod \"metrics-server-66cc4d8469-hqj9w\" (UID: \"55280080-4cf6-4bd5-98ad-06a6750d129f\") " pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:24.829676 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.829049    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/55280080-4cf6-4bd5-98ad-06a6750d129f-audit-log\") pod \"metrics-server-66cc4d8469-hqj9w\" (UID: \"55280080-4cf6-4bd5-98ad-06a6750d129f\") " pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:24.829676 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.829582    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/55280080-4cf6-4bd5-98ad-06a6750d129f-metrics-server-audit-profiles\") pod \"metrics-server-66cc4d8469-hqj9w\" (UID: \"55280080-4cf6-4bd5-98ad-06a6750d129f\") " pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:24.829676 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.829628    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/55280080-4cf6-4bd5-98ad-06a6750d129f-audit-log\") pod \"metrics-server-66cc4d8469-hqj9w\" (UID: \"55280080-4cf6-4bd5-98ad-06a6750d129f\") " pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:24.830101 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.830078    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/55280080-4cf6-4bd5-98ad-06a6750d129f-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66cc4d8469-hqj9w\" (UID: \"55280080-4cf6-4bd5-98ad-06a6750d129f\") " pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:24.831458 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.831425    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/55280080-4cf6-4bd5-98ad-06a6750d129f-secret-metrics-server-tls\") pod \"metrics-server-66cc4d8469-hqj9w\" (UID: \"55280080-4cf6-4bd5-98ad-06a6750d129f\") " pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:24.832143 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.832116    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/55280080-4cf6-4bd5-98ad-06a6750d129f-client-ca-bundle\") pod \"metrics-server-66cc4d8469-hqj9w\" (UID: \"55280080-4cf6-4bd5-98ad-06a6750d129f\") " pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:24.832316 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.832293    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/55280080-4cf6-4bd5-98ad-06a6750d129f-secret-metrics-server-client-certs\") pod \"metrics-server-66cc4d8469-hqj9w\" (UID: \"55280080-4cf6-4bd5-98ad-06a6750d129f\") " pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:24.840646 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.840623    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr8p4\" (UniqueName: \"kubernetes.io/projected/55280080-4cf6-4bd5-98ad-06a6750d129f-kube-api-access-lr8p4\") pod \"metrics-server-66cc4d8469-hqj9w\" (UID: \"55280080-4cf6-4bd5-98ad-06a6750d129f\") " pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:24.914862 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:24.914833    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:25.487067 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:25.487025    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb" event={"ID":"96dfb480-8daf-42e2-8d3c-4c50eee2487a","Type":"ContainerStarted","Data":"ed89a0a3b964ae4f76da92eb6130853f78c1578572326f1dab73b80735df7c36"}
Jul 21 17:27:26.285276 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:26.284961    2581 patch_prober.go:28] interesting pod/image-registry-7c4d88bd77-d6qpg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 21 17:27:26.285276 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:26.285020    2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg" podUID="ee9b3577-15a4-4dee-adbc-68674593a081" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:27:26.384764 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:26.384726    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66cc4d8469-hqj9w"]
Jul 21 17:27:26.389104 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:27:26.389075    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55280080_4cf6_4bd5_98ad_06a6750d129f.slice/crio-3fd6aa89c9120bb90906bdfecc26086f808af9815fb4b3b3c9c2562103609be7 WatchSource:0}: Error finding container 3fd6aa89c9120bb90906bdfecc26086f808af9815fb4b3b3c9c2562103609be7: Status 404 returned error can't find the container with id 3fd6aa89c9120bb90906bdfecc26086f808af9815fb4b3b3c9c2562103609be7
Jul 21 17:27:26.493543 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:26.493398    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jxfq5" event={"ID":"94d13840-ec8d-446a-8212-c0daa4a94012","Type":"ContainerStarted","Data":"e4effb2e100e23a64b3c5a87500ced6d726c208fc4127653ee6448f5881e1cb5"}
Jul 21 17:27:26.493543 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:26.493462    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:27:26.496633 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:26.496598    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vrb68" event={"ID":"75f2dec8-5c4a-4312-9743-0429cc8c0034","Type":"ContainerStarted","Data":"aef60b27f61a8f886e9788ef59cec7173c58222ef82014e9e1a924ee6bba91e4"}
Jul 21 17:27:26.499045 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:26.499018    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w" event={"ID":"55280080-4cf6-4bd5-98ad-06a6750d129f","Type":"ContainerStarted","Data":"3fd6aa89c9120bb90906bdfecc26086f808af9815fb4b3b3c9c2562103609be7"}
Jul 21 17:27:26.550681 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:26.549608    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jxfq5" podStartSLOduration=66.64414635 podStartE2EDuration="1m11.549592944s" totalImagesPullingTime="4.905446594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:26.549078616 +0000 UTC m=+71.949642688" watchObservedRunningTime="2026-07-21 17:27:26.549592944 +0000 UTC m=+71.950157014"
Jul 21 17:27:28.013117 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:28.013057    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vrb68" podStartSLOduration=67.771764416 podStartE2EDuration="1m13.013036682s" totalImagesPullingTime="5.241272266s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:26:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:26.571751657 +0000 UTC m=+71.972315730" watchObservedRunningTime="2026-07-21 17:27:28.013036682 +0000 UTC m=+73.413600730"
Jul 21 17:27:28.013889 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:28.013861    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-kv94m"]
Jul 21 17:27:28.017329 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:28.017303    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-kv94m"
Jul 21 17:27:28.020597 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:28.020337    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 21 17:27:28.020597 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:28.020389    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 21 17:27:28.020597 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:28.020410    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-959f7\""
Jul 21 17:27:28.036487 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:28.036463    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-kv94m"]
Jul 21 17:27:28.163478 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:28.163448    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77j9h\" (UniqueName: \"kubernetes.io/projected/26d1f966-465f-4fad-adfd-4dd1bd702287-kube-api-access-77j9h\") pod \"downloads-5bc67dcd46-kv94m\" (UID: \"26d1f966-465f-4fad-adfd-4dd1bd702287\") " pod="openshift-console/downloads-5bc67dcd46-kv94m"
Jul 21 17:27:28.263938 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:28.263883    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77j9h\" (UniqueName: \"kubernetes.io/projected/26d1f966-465f-4fad-adfd-4dd1bd702287-kube-api-access-77j9h\") pod \"downloads-5bc67dcd46-kv94m\" (UID: \"26d1f966-465f-4fad-adfd-4dd1bd702287\") " pod="openshift-console/downloads-5bc67dcd46-kv94m"
Jul 21 17:27:28.272654 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:28.272626    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77j9h\" (UniqueName: \"kubernetes.io/projected/26d1f966-465f-4fad-adfd-4dd1bd702287-kube-api-access-77j9h\") pod \"downloads-5bc67dcd46-kv94m\" (UID: \"26d1f966-465f-4fad-adfd-4dd1bd702287\") " pod="openshift-console/downloads-5bc67dcd46-kv94m"
Jul 21 17:27:28.328533 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:28.328506    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-kv94m"
Jul 21 17:27:28.506738 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:28.506630    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-kv94m"]
Jul 21 17:27:28.513299 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:27:28.513145    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26d1f966_465f_4fad_adfd_4dd1bd702287.slice/crio-02adabbe28063a3c24a89fe0ca9e10f3ad239b5523d2516b81779482b6d099b9 WatchSource:0}: Error finding container 02adabbe28063a3c24a89fe0ca9e10f3ad239b5523d2516b81779482b6d099b9: Status 404 returned error can't find the container with id 02adabbe28063a3c24a89fe0ca9e10f3ad239b5523d2516b81779482b6d099b9
Jul 21 17:27:28.513838 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:28.513808    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78600264-f11e-4282-a45e-9bf75cbf3180","Type":"ContainerStarted","Data":"042c4ccee3646af89ce3022e6075c48ab5d2a2940a6e7d53ed6d5a24c53ce341"}
Jul 21 17:27:28.513930 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:28.513887    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78600264-f11e-4282-a45e-9bf75cbf3180","Type":"ContainerStarted","Data":"1091f4a14ccd2541456e804dab8f5bab7f5e60b13b4c8d2997c30b4861206c83"}
Jul 21 17:27:28.514008 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:28.513929    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78600264-f11e-4282-a45e-9bf75cbf3180","Type":"ContainerStarted","Data":"a4dbf2aab73065a09f6007b2ba2af0e0935ed781ac4339df1a62a6e90c478c02"}
Jul 21 17:27:28.519009 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:28.518965    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb" event={"ID":"96dfb480-8daf-42e2-8d3c-4c50eee2487a","Type":"ContainerStarted","Data":"03d5300099b6f8615f83b3b157b7fe1f554515106f3a76f4ef1cf9a4134558f2"}
Jul 21 17:27:28.519091 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:28.519034    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb" event={"ID":"96dfb480-8daf-42e2-8d3c-4c50eee2487a","Type":"ContainerStarted","Data":"906af3f964f91014c8c151f244e8fbd44f3cf3c3941a1cb986fd6096a8e73b2f"}
Jul 21 17:27:28.519091 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:28.519073    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb" event={"ID":"96dfb480-8daf-42e2-8d3c-4c50eee2487a","Type":"ContainerStarted","Data":"3a96b221e219297e04667413aaaa72c8abb3a9a1c428e2efdf1f1448ee46da02"}
Jul 21 17:27:28.521677 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:28.521651    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w" event={"ID":"55280080-4cf6-4bd5-98ad-06a6750d129f","Type":"ContainerStarted","Data":"0692f70d6337212499fc94ab69e5256e457dc50ae47ce167c01967ba1d42ec55"}
Jul 21 17:27:28.547988 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:28.547945    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w" podStartSLOduration=2.7051466360000003 podStartE2EDuration="4.547927949s" totalImagesPullingTime="1.842781313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:27:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:28.546568128 +0000 UTC m=+73.947132253" watchObservedRunningTime="2026-07-21 17:27:28.547927949 +0000 UTC m=+73.948491998"
Jul 21 17:27:29.397850 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:29.397827    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c4d88bd77-d6qpg"
Jul 21 17:27:29.527489 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:29.527414    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-kv94m" event={"ID":"26d1f966-465f-4fad-adfd-4dd1bd702287","Type":"ContainerStarted","Data":"02adabbe28063a3c24a89fe0ca9e10f3ad239b5523d2516b81779482b6d099b9"}
Jul 21 17:27:29.532195 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:29.531940    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78600264-f11e-4282-a45e-9bf75cbf3180","Type":"ContainerStarted","Data":"c4e6a5596d7d9e4becee46a236a16880c708c86cb2ce54c2e73bb8dd3da2374d"}
Jul 21 17:27:29.532195 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:29.531991    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78600264-f11e-4282-a45e-9bf75cbf3180","Type":"ContainerStarted","Data":"0f26107a23def7981042c31c11b8562952791b8ad1e0d42cde2821787efb5fb1"}
Jul 21 17:27:29.532195 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:29.532015    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78600264-f11e-4282-a45e-9bf75cbf3180","Type":"ContainerStarted","Data":"13b24c98349884cf21127f69b3df4af6225d7b80ca4466c01c1f9f421b399a59"}
Jul 21 17:27:29.537330 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:29.537211    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb" event={"ID":"96dfb480-8daf-42e2-8d3c-4c50eee2487a","Type":"ContainerStarted","Data":"bc557c91b6650275911a0211adf1488c35477eceb0c222d8ba111382cfa9296e"}
Jul 21 17:27:29.537330 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:29.537284    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:29.537845 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:29.537566    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb" event={"ID":"96dfb480-8daf-42e2-8d3c-4c50eee2487a","Type":"ContainerStarted","Data":"28f148fb3ec611233c8db4d29147cd78f3d5b56e44289bbb6d45347788ce0a90"}
Jul 21 17:27:29.537845 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:29.537617    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb" event={"ID":"96dfb480-8daf-42e2-8d3c-4c50eee2487a","Type":"ContainerStarted","Data":"b8679b074be19f3ecad17faa32bc161c6402ce220f788495e9489a358cc85c91"}
Jul 21 17:27:29.565277 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:29.565237    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.885520337 podStartE2EDuration="8.565222917s" totalImagesPullingTime="5.66341256s" totalInitContainerRuntime="16.29002ms" isStatefulPod=false podCreationTimestamp="2026-07-21 17:27:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:29.563281564 +0000 UTC m=+74.963845651" watchObservedRunningTime="2026-07-21 17:27:29.565222917 +0000 UTC m=+74.965786987"
Jul 21 17:27:35.546088 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:35.545975    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb"
Jul 21 17:27:35.580233 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:35.580146    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7d7fb48895-fn8bb" podStartSLOduration=8.333876727 podStartE2EDuration="12.580127725s" totalImagesPullingTime="4.246250998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:27:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:29.594127931 +0000 UTC m=+74.994692004" watchObservedRunningTime="2026-07-21 17:27:35.580127725 +0000 UTC m=+80.980691797"
Jul 21 17:27:36.966790 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:36.966754    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-99bc9c657-h7mbr"]
Jul 21 17:27:36.970110 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:36.970089    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:27:36.976673 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:36.976644    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 21 17:27:36.976673 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:36.976646    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 21 17:27:36.976844 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:36.976646    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 21 17:27:36.976844 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:36.976652    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wmv6v\""
Jul 21 17:27:36.977157 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:36.977140    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 21 17:27:36.978080 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:36.977403    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 21 17:27:36.991997 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:36.991973    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-99bc9c657-h7mbr"]
Jul 21 17:27:37.041514 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:37.041492    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e714948-af27-459b-8bc9-ec4095fe3edd-console-serving-cert\") pod \"console-99bc9c657-h7mbr\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") " pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:27:37.041653 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:37.041529    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e714948-af27-459b-8bc9-ec4095fe3edd-console-config\") pod \"console-99bc9c657-h7mbr\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") " pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:27:37.041653 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:37.041607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e714948-af27-459b-8bc9-ec4095fe3edd-console-oauth-config\") pod \"console-99bc9c657-h7mbr\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") " pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:27:37.041653 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:37.041638    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e714948-af27-459b-8bc9-ec4095fe3edd-oauth-serving-cert\") pod \"console-99bc9c657-h7mbr\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") " pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:27:37.041773 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:37.041660    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x6v8\" (UniqueName: \"kubernetes.io/projected/9e714948-af27-459b-8bc9-ec4095fe3edd-kube-api-access-2x6v8\") pod \"console-99bc9c657-h7mbr\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") " pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:27:37.041773 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:37.041733    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e714948-af27-459b-8bc9-ec4095fe3edd-service-ca\") pod \"console-99bc9c657-h7mbr\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") " pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:27:37.142863 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:37.142831    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e714948-af27-459b-8bc9-ec4095fe3edd-console-oauth-config\") pod \"console-99bc9c657-h7mbr\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") " pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:27:37.143107 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:37.142878    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e714948-af27-459b-8bc9-ec4095fe3edd-oauth-serving-cert\") pod \"console-99bc9c657-h7mbr\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") " pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:27:37.143107 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:37.142904    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x6v8\" (UniqueName: \"kubernetes.io/projected/9e714948-af27-459b-8bc9-ec4095fe3edd-kube-api-access-2x6v8\") pod \"console-99bc9c657-h7mbr\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") " pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:27:37.143107 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:37.142943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e714948-af27-459b-8bc9-ec4095fe3edd-service-ca\") pod \"console-99bc9c657-h7mbr\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") " pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:27:37.143107 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:37.142969    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e714948-af27-459b-8bc9-ec4095fe3edd-console-serving-cert\") pod \"console-99bc9c657-h7mbr\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") " pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:27:37.143363 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:37.143164    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e714948-af27-459b-8bc9-ec4095fe3edd-console-config\") pod \"console-99bc9c657-h7mbr\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") " pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:27:37.143783 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:37.143759    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e714948-af27-459b-8bc9-ec4095fe3edd-service-ca\") pod \"console-99bc9c657-h7mbr\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") " pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:27:37.144130 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:37.144111    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e714948-af27-459b-8bc9-ec4095fe3edd-oauth-serving-cert\") pod \"console-99bc9c657-h7mbr\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") " pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:27:37.144714 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:37.144691    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e714948-af27-459b-8bc9-ec4095fe3edd-console-config\") pod \"console-99bc9c657-h7mbr\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") " pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:27:37.145505 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:37.145476    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e714948-af27-459b-8bc9-ec4095fe3edd-console-oauth-config\") pod \"console-99bc9c657-h7mbr\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") " pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:27:37.145750 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:37.145734    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e714948-af27-459b-8bc9-ec4095fe3edd-console-serving-cert\") pod \"console-99bc9c657-h7mbr\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") " pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:27:37.161615 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:37.161593    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x6v8\" (UniqueName: \"kubernetes.io/projected/9e714948-af27-459b-8bc9-ec4095fe3edd-kube-api-access-2x6v8\") pod \"console-99bc9c657-h7mbr\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") " pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:27:37.280792 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:37.280759    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:27:37.428850 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:37.428824    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-99bc9c657-h7mbr"]
Jul 21 17:27:37.431547 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:27:37.431515    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e714948_af27_459b_8bc9_ec4095fe3edd.slice/crio-2479690b73bf8cb1bba4f8a4126638be0b71eb465189569d84dab42599558702 WatchSource:0}: Error finding container 2479690b73bf8cb1bba4f8a4126638be0b71eb465189569d84dab42599558702: Status 404 returned error can't find the container with id 2479690b73bf8cb1bba4f8a4126638be0b71eb465189569d84dab42599558702
Jul 21 17:27:37.569789 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:37.569718    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-99bc9c657-h7mbr" event={"ID":"9e714948-af27-459b-8bc9-ec4095fe3edd","Type":"ContainerStarted","Data":"2479690b73bf8cb1bba4f8a4126638be0b71eb465189569d84dab42599558702"}
Jul 21 17:27:44.915440 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:44.915406    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:44.916053 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:44.915496    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:27:46.293918 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.293883    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8675775596-8khfj"]
Jul 21 17:27:46.306821 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.306796    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:46.308334 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.308306    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8675775596-8khfj"]
Jul 21 17:27:46.314985 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.314963    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 21 17:27:46.427580 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.427545    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-oauth-serving-cert\") pod \"console-8675775596-8khfj\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") " pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:46.427580 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.427578    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49s7w\" (UniqueName: \"kubernetes.io/projected/31373243-1faa-495f-8789-0d0325ba60f5-kube-api-access-49s7w\") pod \"console-8675775596-8khfj\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") " pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:46.427820 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.427671    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31373243-1faa-495f-8789-0d0325ba60f5-console-oauth-config\") pod \"console-8675775596-8khfj\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") " pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:46.427820 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.427721    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-trusted-ca-bundle\") pod \"console-8675775596-8khfj\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") " pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:46.427820 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.427757    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31373243-1faa-495f-8789-0d0325ba60f5-console-serving-cert\") pod \"console-8675775596-8khfj\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") " pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:46.427820 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.427784    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-console-config\") pod \"console-8675775596-8khfj\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") " pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:46.427820 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.427817    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-service-ca\") pod \"console-8675775596-8khfj\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") " pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:46.529061 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.529018    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-trusted-ca-bundle\") pod \"console-8675775596-8khfj\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") " pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:46.529254 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.529080    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31373243-1faa-495f-8789-0d0325ba60f5-console-serving-cert\") pod \"console-8675775596-8khfj\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") " pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:46.529254 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.529105    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-console-config\") pod \"console-8675775596-8khfj\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") " pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:46.529254 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.529136    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-service-ca\") pod \"console-8675775596-8khfj\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") " pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:46.529435 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.529304    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-oauth-serving-cert\") pod \"console-8675775596-8khfj\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") " pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:46.529435 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.529347    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49s7w\" (UniqueName: \"kubernetes.io/projected/31373243-1faa-495f-8789-0d0325ba60f5-kube-api-access-49s7w\") pod \"console-8675775596-8khfj\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") " pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:46.529435 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.529431    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31373243-1faa-495f-8789-0d0325ba60f5-console-oauth-config\") pod \"console-8675775596-8khfj\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") " pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:46.530026 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.529974    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-console-config\") pod \"console-8675775596-8khfj\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") " pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:46.530026 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.529989    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-service-ca\") pod \"console-8675775596-8khfj\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") " pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:46.530026 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.530016    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-trusted-ca-bundle\") pod \"console-8675775596-8khfj\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") " pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:46.530348 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.530325    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-oauth-serving-cert\") pod \"console-8675775596-8khfj\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") " pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:46.532210 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.532188    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31373243-1faa-495f-8789-0d0325ba60f5-console-oauth-config\") pod \"console-8675775596-8khfj\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") " pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:46.532473 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.532453    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31373243-1faa-495f-8789-0d0325ba60f5-console-serving-cert\") pod \"console-8675775596-8khfj\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") " pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:46.541727 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.541705    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49s7w\" (UniqueName: \"kubernetes.io/projected/31373243-1faa-495f-8789-0d0325ba60f5-kube-api-access-49s7w\") pod \"console-8675775596-8khfj\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") " pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:46.618625 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:46.618557    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:47.817329 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:47.817303    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8675775596-8khfj"]
Jul 21 17:27:47.820149 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:27:47.820120    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31373243_1faa_495f_8789_0d0325ba60f5.slice/crio-949a6120cece6d08296f4ff3441ab01e7d0b738ba1dbe8ef927b2e2ab6776c59 WatchSource:0}: Error finding container 949a6120cece6d08296f4ff3441ab01e7d0b738ba1dbe8ef927b2e2ab6776c59: Status 404 returned error can't find the container with id 949a6120cece6d08296f4ff3441ab01e7d0b738ba1dbe8ef927b2e2ab6776c59
Jul 21 17:27:48.620526 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:48.620491    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-kv94m" event={"ID":"26d1f966-465f-4fad-adfd-4dd1bd702287","Type":"ContainerStarted","Data":"4ef6c747d096eb4d4642928f962930378d57994e04f10a04a2e8f4f2cae8f357"}
Jul 21 17:27:48.620722 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:48.620675    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-kv94m"
Jul 21 17:27:48.622817 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:48.622784    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-99bc9c657-h7mbr" event={"ID":"9e714948-af27-459b-8bc9-ec4095fe3edd","Type":"ContainerStarted","Data":"2cfae2b2ff2aa0bedb7ac0ad32f3a2d3cd7e12b6a575e280f1161688b8a83c65"}
Jul 21 17:27:48.625127 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:48.625104    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8675775596-8khfj" event={"ID":"31373243-1faa-495f-8789-0d0325ba60f5","Type":"ContainerStarted","Data":"dcbef573b228f197d8e2efabc818fd1ebef883dd52728755176f85ac395c167f"}
Jul 21 17:27:48.625268 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:48.625152    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8675775596-8khfj" event={"ID":"31373243-1faa-495f-8789-0d0325ba60f5","Type":"ContainerStarted","Data":"949a6120cece6d08296f4ff3441ab01e7d0b738ba1dbe8ef927b2e2ab6776c59"}
Jul 21 17:27:48.633581 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:48.633556    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-kv94m"
Jul 21 17:27:48.640290 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:48.640248    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-kv94m" podStartSLOduration=2.450369978 podStartE2EDuration="21.640234725s" totalImagesPullingTime="19.189864747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:48.639416449 +0000 UTC m=+94.039980521" watchObservedRunningTime="2026-07-21 17:27:48.640234725 +0000 UTC m=+94.040798797"
Jul 21 17:27:48.657301 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:48.657250    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-99bc9c657-h7mbr" podStartSLOduration=2.40136035 podStartE2EDuration="12.65723441s" totalImagesPullingTime="10.25587406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:27:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:48.656342306 +0000 UTC m=+94.056906378" watchObservedRunningTime="2026-07-21 17:27:48.65723441 +0000 UTC m=+94.057798481"
Jul 21 17:27:56.619009 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:56.618970    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:56.619536 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:56.619045    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:56.624627 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:56.624597    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:56.651621 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:56.651575    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8675775596-8khfj" podStartSLOduration=10.651555485 podStartE2EDuration="10.651555485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:27:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:27:48.692919876 +0000 UTC m=+94.093483949" watchObservedRunningTime="2026-07-21 17:27:56.651555485 +0000 UTC m=+102.052119559"
Jul 21 17:27:56.664839 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:56.664804    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:27:56.731588 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:56.731559    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-99bc9c657-h7mbr"]
Jul 21 17:27:57.280997 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:57.280960    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:27:57.506600 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:27:57.506575    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jxfq5"
Jul 21 17:28:04.921038 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:04.921006    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:28:04.924875 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:04.924850    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-66cc4d8469-hqj9w"
Jul 21 17:28:21.757286 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:21.757227    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-99bc9c657-h7mbr" podUID="9e714948-af27-459b-8bc9-ec4095fe3edd" containerName="console" containerID="cri-o://2cfae2b2ff2aa0bedb7ac0ad32f3a2d3cd7e12b6a575e280f1161688b8a83c65" gracePeriod=15
Jul 21 17:28:22.026771 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.026715    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:28:22.111438 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.111407    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x6v8\" (UniqueName: \"kubernetes.io/projected/9e714948-af27-459b-8bc9-ec4095fe3edd-kube-api-access-2x6v8\") pod \"9e714948-af27-459b-8bc9-ec4095fe3edd\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") "
Jul 21 17:28:22.111582 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.111452    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e714948-af27-459b-8bc9-ec4095fe3edd-console-oauth-config\") pod \"9e714948-af27-459b-8bc9-ec4095fe3edd\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") "
Jul 21 17:28:22.111582 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.111475    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e714948-af27-459b-8bc9-ec4095fe3edd-service-ca\") pod \"9e714948-af27-459b-8bc9-ec4095fe3edd\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") "
Jul 21 17:28:22.111703 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.111582    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e714948-af27-459b-8bc9-ec4095fe3edd-console-serving-cert\") pod \"9e714948-af27-459b-8bc9-ec4095fe3edd\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") "
Jul 21 17:28:22.111703 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.111615    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e714948-af27-459b-8bc9-ec4095fe3edd-oauth-serving-cert\") pod \"9e714948-af27-459b-8bc9-ec4095fe3edd\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") "
Jul 21 17:28:22.111703 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.111668    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e714948-af27-459b-8bc9-ec4095fe3edd-console-config\") pod \"9e714948-af27-459b-8bc9-ec4095fe3edd\" (UID: \"9e714948-af27-459b-8bc9-ec4095fe3edd\") "
Jul 21 17:28:22.111850 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.111817    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e714948-af27-459b-8bc9-ec4095fe3edd-service-ca" (OuterVolumeSpecName: "service-ca") pod "9e714948-af27-459b-8bc9-ec4095fe3edd" (UID: "9e714948-af27-459b-8bc9-ec4095fe3edd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:28:22.111961 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.111943    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9e714948-af27-459b-8bc9-ec4095fe3edd-service-ca\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:28:22.112044 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.112025    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e714948-af27-459b-8bc9-ec4095fe3edd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9e714948-af27-459b-8bc9-ec4095fe3edd" (UID: "9e714948-af27-459b-8bc9-ec4095fe3edd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:28:22.112339 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.112305    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9e714948-af27-459b-8bc9-ec4095fe3edd-console-config" (OuterVolumeSpecName: "console-config") pod "9e714948-af27-459b-8bc9-ec4095fe3edd" (UID: "9e714948-af27-459b-8bc9-ec4095fe3edd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:28:22.113766 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.113745    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e714948-af27-459b-8bc9-ec4095fe3edd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9e714948-af27-459b-8bc9-ec4095fe3edd" (UID: "9e714948-af27-459b-8bc9-ec4095fe3edd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:28:22.113870 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.113849    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e714948-af27-459b-8bc9-ec4095fe3edd-kube-api-access-2x6v8" (OuterVolumeSpecName: "kube-api-access-2x6v8") pod "9e714948-af27-459b-8bc9-ec4095fe3edd" (UID: "9e714948-af27-459b-8bc9-ec4095fe3edd"). InnerVolumeSpecName "kube-api-access-2x6v8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:28:22.113910 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.113863    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e714948-af27-459b-8bc9-ec4095fe3edd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9e714948-af27-459b-8bc9-ec4095fe3edd" (UID: "9e714948-af27-459b-8bc9-ec4095fe3edd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:28:22.213101 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.213077    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9e714948-af27-459b-8bc9-ec4095fe3edd-console-config\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:28:22.213101 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.213100    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x6v8\" (UniqueName: \"kubernetes.io/projected/9e714948-af27-459b-8bc9-ec4095fe3edd-kube-api-access-2x6v8\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:28:22.213242 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.213109    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9e714948-af27-459b-8bc9-ec4095fe3edd-console-oauth-config\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:28:22.213242 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.213117    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9e714948-af27-459b-8bc9-ec4095fe3edd-console-serving-cert\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:28:22.213242 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.213125    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9e714948-af27-459b-8bc9-ec4095fe3edd-oauth-serving-cert\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:28:22.759222 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.759162    2581 generic.go:356] "Generic (PLEG): container finished" podID="9e714948-af27-459b-8bc9-ec4095fe3edd" containerID="2cfae2b2ff2aa0bedb7ac0ad32f3a2d3cd7e12b6a575e280f1161688b8a83c65" exitCode=0
Jul 21 17:28:22.759609 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.759233    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-99bc9c657-h7mbr"
Jul 21 17:28:22.759609 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.759272    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-99bc9c657-h7mbr" event={"ID":"9e714948-af27-459b-8bc9-ec4095fe3edd","Type":"ContainerDied","Data":"2cfae2b2ff2aa0bedb7ac0ad32f3a2d3cd7e12b6a575e280f1161688b8a83c65"}
Jul 21 17:28:22.759609 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.759329    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-99bc9c657-h7mbr" event={"ID":"9e714948-af27-459b-8bc9-ec4095fe3edd","Type":"ContainerDied","Data":"2479690b73bf8cb1bba4f8a4126638be0b71eb465189569d84dab42599558702"}
Jul 21 17:28:22.759609 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.759354    2581 scope.go:117] "RemoveContainer" containerID="2cfae2b2ff2aa0bedb7ac0ad32f3a2d3cd7e12b6a575e280f1161688b8a83c65"
Jul 21 17:28:22.768494 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.768475    2581 scope.go:117] "RemoveContainer" containerID="2cfae2b2ff2aa0bedb7ac0ad32f3a2d3cd7e12b6a575e280f1161688b8a83c65"
Jul 21 17:28:22.768787 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:28:22.768766    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cfae2b2ff2aa0bedb7ac0ad32f3a2d3cd7e12b6a575e280f1161688b8a83c65\": container with ID starting with 2cfae2b2ff2aa0bedb7ac0ad32f3a2d3cd7e12b6a575e280f1161688b8a83c65 not found: ID does not exist" containerID="2cfae2b2ff2aa0bedb7ac0ad32f3a2d3cd7e12b6a575e280f1161688b8a83c65"
Jul 21 17:28:22.768869 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.768794    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cfae2b2ff2aa0bedb7ac0ad32f3a2d3cd7e12b6a575e280f1161688b8a83c65"} err="failed to get container status \"2cfae2b2ff2aa0bedb7ac0ad32f3a2d3cd7e12b6a575e280f1161688b8a83c65\": rpc error: code = NotFound desc = could not find container \"2cfae2b2ff2aa0bedb7ac0ad32f3a2d3cd7e12b6a575e280f1161688b8a83c65\": container with ID starting with 2cfae2b2ff2aa0bedb7ac0ad32f3a2d3cd7e12b6a575e280f1161688b8a83c65 not found: ID does not exist"
Jul 21 17:28:22.780855 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.780835    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-99bc9c657-h7mbr"]
Jul 21 17:28:22.784041 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:22.784021    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-99bc9c657-h7mbr"]
Jul 21 17:28:23.128786 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:23.128711    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e714948-af27-459b-8bc9-ec4095fe3edd" path="/var/lib/kubelet/pods/9e714948-af27-459b-8bc9-ec4095fe3edd/volumes"
Jul 21 17:28:40.557605 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:40.557566    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 17:28:40.558065 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:40.557880    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="alertmanager" containerID="cri-o://a4dbf2aab73065a09f6007b2ba2af0e0935ed781ac4339df1a62a6e90c478c02" gracePeriod=120
Jul 21 17:28:40.558065 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:40.557934    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="kube-rbac-proxy-metric" containerID="cri-o://0f26107a23def7981042c31c11b8562952791b8ad1e0d42cde2821787efb5fb1" gracePeriod=120
Jul 21 17:28:40.558065 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:40.557984    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="config-reloader" containerID="cri-o://1091f4a14ccd2541456e804dab8f5bab7f5e60b13b4c8d2997c30b4861206c83" gracePeriod=120
Jul 21 17:28:40.558065 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:40.557968    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="kube-rbac-proxy" containerID="cri-o://13b24c98349884cf21127f69b3df4af6225d7b80ca4466c01c1f9f421b399a59" gracePeriod=120
Jul 21 17:28:40.558065 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:40.557999    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="prom-label-proxy" containerID="cri-o://c4e6a5596d7d9e4becee46a236a16880c708c86cb2ce54c2e73bb8dd3da2374d" gracePeriod=120
Jul 21 17:28:40.558065 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:40.557945    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="kube-rbac-proxy-web" containerID="cri-o://042c4ccee3646af89ce3022e6075c48ab5d2a2940a6e7d53ed6d5a24c53ce341" gracePeriod=120
Jul 21 17:28:40.831258 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:40.831195    2581 generic.go:356] "Generic (PLEG): container finished" podID="78600264-f11e-4282-a45e-9bf75cbf3180" containerID="c4e6a5596d7d9e4becee46a236a16880c708c86cb2ce54c2e73bb8dd3da2374d" exitCode=0
Jul 21 17:28:40.831258 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:40.831220    2581 generic.go:356] "Generic (PLEG): container finished" podID="78600264-f11e-4282-a45e-9bf75cbf3180" containerID="13b24c98349884cf21127f69b3df4af6225d7b80ca4466c01c1f9f421b399a59" exitCode=0
Jul 21 17:28:40.831258 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:40.831226    2581 generic.go:356] "Generic (PLEG): container finished" podID="78600264-f11e-4282-a45e-9bf75cbf3180" containerID="1091f4a14ccd2541456e804dab8f5bab7f5e60b13b4c8d2997c30b4861206c83" exitCode=0
Jul 21 17:28:40.831258 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:40.831232    2581 generic.go:356] "Generic (PLEG): container finished" podID="78600264-f11e-4282-a45e-9bf75cbf3180" containerID="a4dbf2aab73065a09f6007b2ba2af0e0935ed781ac4339df1a62a6e90c478c02" exitCode=0
Jul 21 17:28:40.831451 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:40.831263    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78600264-f11e-4282-a45e-9bf75cbf3180","Type":"ContainerDied","Data":"c4e6a5596d7d9e4becee46a236a16880c708c86cb2ce54c2e73bb8dd3da2374d"}
Jul 21 17:28:40.831451 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:40.831332    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78600264-f11e-4282-a45e-9bf75cbf3180","Type":"ContainerDied","Data":"13b24c98349884cf21127f69b3df4af6225d7b80ca4466c01c1f9f421b399a59"}
Jul 21 17:28:40.831451 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:40.831361    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78600264-f11e-4282-a45e-9bf75cbf3180","Type":"ContainerDied","Data":"1091f4a14ccd2541456e804dab8f5bab7f5e60b13b4c8d2997c30b4861206c83"}
Jul 21 17:28:40.831451 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:40.831391    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78600264-f11e-4282-a45e-9bf75cbf3180","Type":"ContainerDied","Data":"a4dbf2aab73065a09f6007b2ba2af0e0935ed781ac4339df1a62a6e90c478c02"}
Jul 21 17:28:41.797015 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.796995    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:41.838769 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.838737    2581 generic.go:356] "Generic (PLEG): container finished" podID="78600264-f11e-4282-a45e-9bf75cbf3180" containerID="0f26107a23def7981042c31c11b8562952791b8ad1e0d42cde2821787efb5fb1" exitCode=0
Jul 21 17:28:41.838769 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.838766    2581 generic.go:356] "Generic (PLEG): container finished" podID="78600264-f11e-4282-a45e-9bf75cbf3180" containerID="042c4ccee3646af89ce3022e6075c48ab5d2a2940a6e7d53ed6d5a24c53ce341" exitCode=0
Jul 21 17:28:41.838985 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.838834    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:41.839128 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.838835    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78600264-f11e-4282-a45e-9bf75cbf3180","Type":"ContainerDied","Data":"0f26107a23def7981042c31c11b8562952791b8ad1e0d42cde2821787efb5fb1"}
Jul 21 17:28:41.839273 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.839215    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78600264-f11e-4282-a45e-9bf75cbf3180","Type":"ContainerDied","Data":"042c4ccee3646af89ce3022e6075c48ab5d2a2940a6e7d53ed6d5a24c53ce341"}
Jul 21 17:28:41.839273 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.839262    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"78600264-f11e-4282-a45e-9bf75cbf3180","Type":"ContainerDied","Data":"1cbcb0fa03318591fc1ff4505ece2ba0b50e479535d275961e6faf5c5d40223d"}
Jul 21 17:28:41.839381 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.839277    2581 scope.go:117] "RemoveContainer" containerID="c4e6a5596d7d9e4becee46a236a16880c708c86cb2ce54c2e73bb8dd3da2374d"
Jul 21 17:28:41.848776 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.848749    2581 scope.go:117] "RemoveContainer" containerID="0f26107a23def7981042c31c11b8562952791b8ad1e0d42cde2821787efb5fb1"
Jul 21 17:28:41.855627 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.855609    2581 scope.go:117] "RemoveContainer" containerID="13b24c98349884cf21127f69b3df4af6225d7b80ca4466c01c1f9f421b399a59"
Jul 21 17:28:41.862642 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.862627    2581 scope.go:117] "RemoveContainer" containerID="042c4ccee3646af89ce3022e6075c48ab5d2a2940a6e7d53ed6d5a24c53ce341"
Jul 21 17:28:41.869634 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.869614    2581 scope.go:117] "RemoveContainer" containerID="1091f4a14ccd2541456e804dab8f5bab7f5e60b13b4c8d2997c30b4861206c83"
Jul 21 17:28:41.876917 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.876903    2581 scope.go:117] "RemoveContainer" containerID="a4dbf2aab73065a09f6007b2ba2af0e0935ed781ac4339df1a62a6e90c478c02"
Jul 21 17:28:41.883512 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.883494    2581 scope.go:117] "RemoveContainer" containerID="9def963211e7a3e64cd9dd7c9ca56165a1fe8fbd55901864e1e713f74365f461"
Jul 21 17:28:41.889905 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.889886    2581 scope.go:117] "RemoveContainer" containerID="c4e6a5596d7d9e4becee46a236a16880c708c86cb2ce54c2e73bb8dd3da2374d"
Jul 21 17:28:41.890124 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:28:41.890106    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4e6a5596d7d9e4becee46a236a16880c708c86cb2ce54c2e73bb8dd3da2374d\": container with ID starting with c4e6a5596d7d9e4becee46a236a16880c708c86cb2ce54c2e73bb8dd3da2374d not found: ID does not exist" containerID="c4e6a5596d7d9e4becee46a236a16880c708c86cb2ce54c2e73bb8dd3da2374d"
Jul 21 17:28:41.890216 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.890136    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4e6a5596d7d9e4becee46a236a16880c708c86cb2ce54c2e73bb8dd3da2374d"} err="failed to get container status \"c4e6a5596d7d9e4becee46a236a16880c708c86cb2ce54c2e73bb8dd3da2374d\": rpc error: code = NotFound desc = could not find container \"c4e6a5596d7d9e4becee46a236a16880c708c86cb2ce54c2e73bb8dd3da2374d\": container with ID starting with c4e6a5596d7d9e4becee46a236a16880c708c86cb2ce54c2e73bb8dd3da2374d not found: ID does not exist"
Jul 21 17:28:41.890216 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.890162    2581 scope.go:117] "RemoveContainer" containerID="0f26107a23def7981042c31c11b8562952791b8ad1e0d42cde2821787efb5fb1"
Jul 21 17:28:41.890420 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:28:41.890404    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f26107a23def7981042c31c11b8562952791b8ad1e0d42cde2821787efb5fb1\": container with ID starting with 0f26107a23def7981042c31c11b8562952791b8ad1e0d42cde2821787efb5fb1 not found: ID does not exist" containerID="0f26107a23def7981042c31c11b8562952791b8ad1e0d42cde2821787efb5fb1"
Jul 21 17:28:41.890462 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.890428    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f26107a23def7981042c31c11b8562952791b8ad1e0d42cde2821787efb5fb1"} err="failed to get container status \"0f26107a23def7981042c31c11b8562952791b8ad1e0d42cde2821787efb5fb1\": rpc error: code = NotFound desc = could not find container \"0f26107a23def7981042c31c11b8562952791b8ad1e0d42cde2821787efb5fb1\": container with ID starting with 0f26107a23def7981042c31c11b8562952791b8ad1e0d42cde2821787efb5fb1 not found: ID does not exist"
Jul 21 17:28:41.890462 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.890444    2581 scope.go:117] "RemoveContainer" containerID="13b24c98349884cf21127f69b3df4af6225d7b80ca4466c01c1f9f421b399a59"
Jul 21 17:28:41.890631 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:28:41.890614    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13b24c98349884cf21127f69b3df4af6225d7b80ca4466c01c1f9f421b399a59\": container with ID starting with 13b24c98349884cf21127f69b3df4af6225d7b80ca4466c01c1f9f421b399a59 not found: ID does not exist" containerID="13b24c98349884cf21127f69b3df4af6225d7b80ca4466c01c1f9f421b399a59"
Jul 21 17:28:41.890691 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.890638    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13b24c98349884cf21127f69b3df4af6225d7b80ca4466c01c1f9f421b399a59"} err="failed to get container status \"13b24c98349884cf21127f69b3df4af6225d7b80ca4466c01c1f9f421b399a59\": rpc error: code = NotFound desc = could not find container \"13b24c98349884cf21127f69b3df4af6225d7b80ca4466c01c1f9f421b399a59\": container with ID starting with 13b24c98349884cf21127f69b3df4af6225d7b80ca4466c01c1f9f421b399a59 not found: ID does not exist"
Jul 21 17:28:41.890691 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.890657    2581 scope.go:117] "RemoveContainer" containerID="042c4ccee3646af89ce3022e6075c48ab5d2a2940a6e7d53ed6d5a24c53ce341"
Jul 21 17:28:41.890887 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:28:41.890869    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"042c4ccee3646af89ce3022e6075c48ab5d2a2940a6e7d53ed6d5a24c53ce341\": container with ID starting with 042c4ccee3646af89ce3022e6075c48ab5d2a2940a6e7d53ed6d5a24c53ce341 not found: ID does not exist" containerID="042c4ccee3646af89ce3022e6075c48ab5d2a2940a6e7d53ed6d5a24c53ce341"
Jul 21 17:28:41.890926 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.890898    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"042c4ccee3646af89ce3022e6075c48ab5d2a2940a6e7d53ed6d5a24c53ce341"} err="failed to get container status \"042c4ccee3646af89ce3022e6075c48ab5d2a2940a6e7d53ed6d5a24c53ce341\": rpc error: code = NotFound desc = could not find container \"042c4ccee3646af89ce3022e6075c48ab5d2a2940a6e7d53ed6d5a24c53ce341\": container with ID starting with 042c4ccee3646af89ce3022e6075c48ab5d2a2940a6e7d53ed6d5a24c53ce341 not found: ID does not exist"
Jul 21 17:28:41.890926 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.890915    2581 scope.go:117] "RemoveContainer" containerID="1091f4a14ccd2541456e804dab8f5bab7f5e60b13b4c8d2997c30b4861206c83"
Jul 21 17:28:41.891181 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:28:41.891150    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1091f4a14ccd2541456e804dab8f5bab7f5e60b13b4c8d2997c30b4861206c83\": container with ID starting with 1091f4a14ccd2541456e804dab8f5bab7f5e60b13b4c8d2997c30b4861206c83 not found: ID does not exist" containerID="1091f4a14ccd2541456e804dab8f5bab7f5e60b13b4c8d2997c30b4861206c83"
Jul 21 17:28:41.891248 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.891197    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1091f4a14ccd2541456e804dab8f5bab7f5e60b13b4c8d2997c30b4861206c83"} err="failed to get container status \"1091f4a14ccd2541456e804dab8f5bab7f5e60b13b4c8d2997c30b4861206c83\": rpc error: code = NotFound desc = could not find container \"1091f4a14ccd2541456e804dab8f5bab7f5e60b13b4c8d2997c30b4861206c83\": container with ID starting with 1091f4a14ccd2541456e804dab8f5bab7f5e60b13b4c8d2997c30b4861206c83 not found: ID does not exist"
Jul 21 17:28:41.891248 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.891216    2581 scope.go:117] "RemoveContainer" containerID="a4dbf2aab73065a09f6007b2ba2af0e0935ed781ac4339df1a62a6e90c478c02"
Jul 21 17:28:41.891420 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:28:41.891405    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4dbf2aab73065a09f6007b2ba2af0e0935ed781ac4339df1a62a6e90c478c02\": container with ID starting with a4dbf2aab73065a09f6007b2ba2af0e0935ed781ac4339df1a62a6e90c478c02 not found: ID does not exist" containerID="a4dbf2aab73065a09f6007b2ba2af0e0935ed781ac4339df1a62a6e90c478c02"
Jul 21 17:28:41.891455 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.891427    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4dbf2aab73065a09f6007b2ba2af0e0935ed781ac4339df1a62a6e90c478c02"} err="failed to get container status \"a4dbf2aab73065a09f6007b2ba2af0e0935ed781ac4339df1a62a6e90c478c02\": rpc error: code = NotFound desc = could not find container \"a4dbf2aab73065a09f6007b2ba2af0e0935ed781ac4339df1a62a6e90c478c02\": container with ID starting with a4dbf2aab73065a09f6007b2ba2af0e0935ed781ac4339df1a62a6e90c478c02 not found: ID does not exist"
Jul 21 17:28:41.891455 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.891440    2581 scope.go:117] "RemoveContainer" containerID="9def963211e7a3e64cd9dd7c9ca56165a1fe8fbd55901864e1e713f74365f461"
Jul 21 17:28:41.891617 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:28:41.891602    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9def963211e7a3e64cd9dd7c9ca56165a1fe8fbd55901864e1e713f74365f461\": container with ID starting with 9def963211e7a3e64cd9dd7c9ca56165a1fe8fbd55901864e1e713f74365f461 not found: ID does not exist" containerID="9def963211e7a3e64cd9dd7c9ca56165a1fe8fbd55901864e1e713f74365f461"
Jul 21 17:28:41.891672 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.891624    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9def963211e7a3e64cd9dd7c9ca56165a1fe8fbd55901864e1e713f74365f461"} err="failed to get container status \"9def963211e7a3e64cd9dd7c9ca56165a1fe8fbd55901864e1e713f74365f461\": rpc error: code = NotFound desc = could not find container \"9def963211e7a3e64cd9dd7c9ca56165a1fe8fbd55901864e1e713f74365f461\": container with ID starting with 9def963211e7a3e64cd9dd7c9ca56165a1fe8fbd55901864e1e713f74365f461 not found: ID does not exist"
Jul 21 17:28:41.891672 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.891644    2581 scope.go:117] "RemoveContainer" containerID="c4e6a5596d7d9e4becee46a236a16880c708c86cb2ce54c2e73bb8dd3da2374d"
Jul 21 17:28:41.891839 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.891823    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4e6a5596d7d9e4becee46a236a16880c708c86cb2ce54c2e73bb8dd3da2374d"} err="failed to get container status \"c4e6a5596d7d9e4becee46a236a16880c708c86cb2ce54c2e73bb8dd3da2374d\": rpc error: code = NotFound desc = could not find container \"c4e6a5596d7d9e4becee46a236a16880c708c86cb2ce54c2e73bb8dd3da2374d\": container with ID starting with c4e6a5596d7d9e4becee46a236a16880c708c86cb2ce54c2e73bb8dd3da2374d not found: ID does not exist"
Jul 21 17:28:41.891882 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.891839    2581 scope.go:117] "RemoveContainer" containerID="0f26107a23def7981042c31c11b8562952791b8ad1e0d42cde2821787efb5fb1"
Jul 21 17:28:41.892008 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.891991    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f26107a23def7981042c31c11b8562952791b8ad1e0d42cde2821787efb5fb1"} err="failed to get container status \"0f26107a23def7981042c31c11b8562952791b8ad1e0d42cde2821787efb5fb1\": rpc error: code = NotFound desc = could not find container \"0f26107a23def7981042c31c11b8562952791b8ad1e0d42cde2821787efb5fb1\": container with ID starting with 0f26107a23def7981042c31c11b8562952791b8ad1e0d42cde2821787efb5fb1 not found: ID does not exist"
Jul 21 17:28:41.892073 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.892010    2581 scope.go:117] "RemoveContainer" containerID="13b24c98349884cf21127f69b3df4af6225d7b80ca4466c01c1f9f421b399a59"
Jul 21 17:28:41.892230 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.892214    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13b24c98349884cf21127f69b3df4af6225d7b80ca4466c01c1f9f421b399a59"} err="failed to get container status \"13b24c98349884cf21127f69b3df4af6225d7b80ca4466c01c1f9f421b399a59\": rpc error: code = NotFound desc = could not find container \"13b24c98349884cf21127f69b3df4af6225d7b80ca4466c01c1f9f421b399a59\": container with ID starting with 13b24c98349884cf21127f69b3df4af6225d7b80ca4466c01c1f9f421b399a59 not found: ID does not exist"
Jul 21 17:28:41.892279 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.892231    2581 scope.go:117] "RemoveContainer" containerID="042c4ccee3646af89ce3022e6075c48ab5d2a2940a6e7d53ed6d5a24c53ce341"
Jul 21 17:28:41.892410 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.892396    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"042c4ccee3646af89ce3022e6075c48ab5d2a2940a6e7d53ed6d5a24c53ce341"} err="failed to get container status \"042c4ccee3646af89ce3022e6075c48ab5d2a2940a6e7d53ed6d5a24c53ce341\": rpc error: code = NotFound desc = could not find container \"042c4ccee3646af89ce3022e6075c48ab5d2a2940a6e7d53ed6d5a24c53ce341\": container with ID starting with 042c4ccee3646af89ce3022e6075c48ab5d2a2940a6e7d53ed6d5a24c53ce341 not found: ID does not exist"
Jul 21 17:28:41.892452 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.892410    2581 scope.go:117] "RemoveContainer" containerID="1091f4a14ccd2541456e804dab8f5bab7f5e60b13b4c8d2997c30b4861206c83"
Jul 21 17:28:41.892599 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.892582    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1091f4a14ccd2541456e804dab8f5bab7f5e60b13b4c8d2997c30b4861206c83"} err="failed to get container status \"1091f4a14ccd2541456e804dab8f5bab7f5e60b13b4c8d2997c30b4861206c83\": rpc error: code = NotFound desc = could not find container \"1091f4a14ccd2541456e804dab8f5bab7f5e60b13b4c8d2997c30b4861206c83\": container with ID starting with 1091f4a14ccd2541456e804dab8f5bab7f5e60b13b4c8d2997c30b4861206c83 not found: ID does not exist"
Jul 21 17:28:41.892648 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.892603    2581 scope.go:117] "RemoveContainer" containerID="a4dbf2aab73065a09f6007b2ba2af0e0935ed781ac4339df1a62a6e90c478c02"
Jul 21 17:28:41.892804 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.892787    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4dbf2aab73065a09f6007b2ba2af0e0935ed781ac4339df1a62a6e90c478c02"} err="failed to get container status \"a4dbf2aab73065a09f6007b2ba2af0e0935ed781ac4339df1a62a6e90c478c02\": rpc error: code = NotFound desc = could not find container \"a4dbf2aab73065a09f6007b2ba2af0e0935ed781ac4339df1a62a6e90c478c02\": container with ID starting with a4dbf2aab73065a09f6007b2ba2af0e0935ed781ac4339df1a62a6e90c478c02 not found: ID does not exist"
Jul 21 17:28:41.892882 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.892806    2581 scope.go:117] "RemoveContainer" containerID="9def963211e7a3e64cd9dd7c9ca56165a1fe8fbd55901864e1e713f74365f461"
Jul 21 17:28:41.893030 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.893013    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9def963211e7a3e64cd9dd7c9ca56165a1fe8fbd55901864e1e713f74365f461"} err="failed to get container status \"9def963211e7a3e64cd9dd7c9ca56165a1fe8fbd55901864e1e713f74365f461\": rpc error: code = NotFound desc = could not find container \"9def963211e7a3e64cd9dd7c9ca56165a1fe8fbd55901864e1e713f74365f461\": container with ID starting with 9def963211e7a3e64cd9dd7c9ca56165a1fe8fbd55901864e1e713f74365f461 not found: ID does not exist"
Jul 21 17:28:41.948092 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.948073    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhxb6\" (UniqueName: \"kubernetes.io/projected/78600264-f11e-4282-a45e-9bf75cbf3180-kube-api-access-lhxb6\") pod \"78600264-f11e-4282-a45e-9bf75cbf3180\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") "
Jul 21 17:28:41.948147 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.948106    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-kube-rbac-proxy\") pod \"78600264-f11e-4282-a45e-9bf75cbf3180\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") "
Jul 21 17:28:41.948147 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.948135    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78600264-f11e-4282-a45e-9bf75cbf3180-metrics-client-ca\") pod \"78600264-f11e-4282-a45e-9bf75cbf3180\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") "
Jul 21 17:28:41.948279 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.948156    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-config-volume\") pod \"78600264-f11e-4282-a45e-9bf75cbf3180\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") "
Jul 21 17:28:41.948279 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.948196    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-cluster-tls-config\") pod \"78600264-f11e-4282-a45e-9bf75cbf3180\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") "
Jul 21 17:28:41.948279 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.948230    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-kube-rbac-proxy-web\") pod \"78600264-f11e-4282-a45e-9bf75cbf3180\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") "
Jul 21 17:28:41.948431 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.948281    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-kube-rbac-proxy-metric\") pod \"78600264-f11e-4282-a45e-9bf75cbf3180\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") "
Jul 21 17:28:41.948431 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.948317    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/78600264-f11e-4282-a45e-9bf75cbf3180-config-out\") pod \"78600264-f11e-4282-a45e-9bf75cbf3180\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") "
Jul 21 17:28:41.948431 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.948345    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/78600264-f11e-4282-a45e-9bf75cbf3180-alertmanager-main-db\") pod \"78600264-f11e-4282-a45e-9bf75cbf3180\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") "
Jul 21 17:28:41.948431 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.948369    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78600264-f11e-4282-a45e-9bf75cbf3180-alertmanager-trusted-ca-bundle\") pod \"78600264-f11e-4282-a45e-9bf75cbf3180\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") "
Jul 21 17:28:41.948636 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.948451    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-web-config\") pod \"78600264-f11e-4282-a45e-9bf75cbf3180\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") "
Jul 21 17:28:41.948636 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.948484    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-main-tls\") pod \"78600264-f11e-4282-a45e-9bf75cbf3180\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") "
Jul 21 17:28:41.948636 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.948493    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78600264-f11e-4282-a45e-9bf75cbf3180-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "78600264-f11e-4282-a45e-9bf75cbf3180" (UID: "78600264-f11e-4282-a45e-9bf75cbf3180"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:28:41.948636 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.948511    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/78600264-f11e-4282-a45e-9bf75cbf3180-tls-assets\") pod \"78600264-f11e-4282-a45e-9bf75cbf3180\" (UID: \"78600264-f11e-4282-a45e-9bf75cbf3180\") "
Jul 21 17:28:41.948898 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.948756    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78600264-f11e-4282-a45e-9bf75cbf3180-metrics-client-ca\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:28:41.949104 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.949036    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78600264-f11e-4282-a45e-9bf75cbf3180-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "78600264-f11e-4282-a45e-9bf75cbf3180" (UID: "78600264-f11e-4282-a45e-9bf75cbf3180"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:28:41.949267 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.949242    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78600264-f11e-4282-a45e-9bf75cbf3180-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "78600264-f11e-4282-a45e-9bf75cbf3180" (UID: "78600264-f11e-4282-a45e-9bf75cbf3180"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:28:41.951898 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.951862    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "78600264-f11e-4282-a45e-9bf75cbf3180" (UID: "78600264-f11e-4282-a45e-9bf75cbf3180"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:28:41.951980 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.951892    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78600264-f11e-4282-a45e-9bf75cbf3180-kube-api-access-lhxb6" (OuterVolumeSpecName: "kube-api-access-lhxb6") pod "78600264-f11e-4282-a45e-9bf75cbf3180" (UID: "78600264-f11e-4282-a45e-9bf75cbf3180"). InnerVolumeSpecName "kube-api-access-lhxb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:28:41.952135 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.952112    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-config-volume" (OuterVolumeSpecName: "config-volume") pod "78600264-f11e-4282-a45e-9bf75cbf3180" (UID: "78600264-f11e-4282-a45e-9bf75cbf3180"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:28:41.952304 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.952248    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "78600264-f11e-4282-a45e-9bf75cbf3180" (UID: "78600264-f11e-4282-a45e-9bf75cbf3180"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:28:41.952304 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.952271    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78600264-f11e-4282-a45e-9bf75cbf3180-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "78600264-f11e-4282-a45e-9bf75cbf3180" (UID: "78600264-f11e-4282-a45e-9bf75cbf3180"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:28:41.952514 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.952343    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "78600264-f11e-4282-a45e-9bf75cbf3180" (UID: "78600264-f11e-4282-a45e-9bf75cbf3180"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:28:41.952796 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.952770    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/78600264-f11e-4282-a45e-9bf75cbf3180-config-out" (OuterVolumeSpecName: "config-out") pod "78600264-f11e-4282-a45e-9bf75cbf3180" (UID: "78600264-f11e-4282-a45e-9bf75cbf3180"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:28:41.953209 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.953185    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "78600264-f11e-4282-a45e-9bf75cbf3180" (UID: "78600264-f11e-4282-a45e-9bf75cbf3180"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:28:41.955936 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.955912    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "78600264-f11e-4282-a45e-9bf75cbf3180" (UID: "78600264-f11e-4282-a45e-9bf75cbf3180"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:28:41.962081 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:41.962061    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-web-config" (OuterVolumeSpecName: "web-config") pod "78600264-f11e-4282-a45e-9bf75cbf3180" (UID: "78600264-f11e-4282-a45e-9bf75cbf3180"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:28:42.049533 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.049508    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:28:42.049533 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.049531    2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-config-volume\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:28:42.049657 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.049541    2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-cluster-tls-config\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:28:42.049657 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.049551    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:28:42.049657 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.049560    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:28:42.049657 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.049569    2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/78600264-f11e-4282-a45e-9bf75cbf3180-config-out\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:28:42.049657 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.049577    2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/78600264-f11e-4282-a45e-9bf75cbf3180-alertmanager-main-db\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:28:42.049657 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.049586    2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/78600264-f11e-4282-a45e-9bf75cbf3180-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:28:42.049657 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.049595    2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-web-config\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:28:42.049657 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.049602    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/78600264-f11e-4282-a45e-9bf75cbf3180-secret-alertmanager-main-tls\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:28:42.049657 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.049611    2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/78600264-f11e-4282-a45e-9bf75cbf3180-tls-assets\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:28:42.049657 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.049619    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhxb6\" (UniqueName: \"kubernetes.io/projected/78600264-f11e-4282-a45e-9bf75cbf3180-kube-api-access-lhxb6\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:28:42.160290 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.160268    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 17:28:42.163468 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.163447    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 17:28:42.187185 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187143    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 17:28:42.187436 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187420    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="alertmanager"
Jul 21 17:28:42.187500 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187440    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="alertmanager"
Jul 21 17:28:42.187500 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187459    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="prom-label-proxy"
Jul 21 17:28:42.187500 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187469    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="prom-label-proxy"
Jul 21 17:28:42.187500 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187479    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e714948-af27-459b-8bc9-ec4095fe3edd" containerName="console"
Jul 21 17:28:42.187500 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187487    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e714948-af27-459b-8bc9-ec4095fe3edd" containerName="console"
Jul 21 17:28:42.187500 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187498    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="kube-rbac-proxy-metric"
Jul 21 17:28:42.187784 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187506    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="kube-rbac-proxy-metric"
Jul 21 17:28:42.187784 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187517    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="config-reloader"
Jul 21 17:28:42.187784 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187525    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="config-reloader"
Jul 21 17:28:42.187784 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187536    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="kube-rbac-proxy-web"
Jul 21 17:28:42.187784 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187545    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="kube-rbac-proxy-web"
Jul 21 17:28:42.187784 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187556    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="kube-rbac-proxy"
Jul 21 17:28:42.187784 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187564    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="kube-rbac-proxy"
Jul 21 17:28:42.187784 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187579    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="init-config-reloader"
Jul 21 17:28:42.187784 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187588    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="init-config-reloader"
Jul 21 17:28:42.187784 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187660    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="kube-rbac-proxy-metric"
Jul 21 17:28:42.187784 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187672    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="kube-rbac-proxy"
Jul 21 17:28:42.187784 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187679    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e714948-af27-459b-8bc9-ec4095fe3edd" containerName="console"
Jul 21 17:28:42.187784 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187688    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="prom-label-proxy"
Jul 21 17:28:42.187784 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187696    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="config-reloader"
Jul 21 17:28:42.187784 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187705    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="alertmanager"
Jul 21 17:28:42.187784 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.187712    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" containerName="kube-rbac-proxy-web"
Jul 21 17:28:42.191511 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.191492    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.193921 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.193897    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 21 17:28:42.195925 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.195906    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 21 17:28:42.196003 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.195906    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 21 17:28:42.196039 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.196011    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 21 17:28:42.196215 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.196201    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bq65d\""
Jul 21 17:28:42.196737 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.196719    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 21 17:28:42.196737 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.196727    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 21 17:28:42.197128 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.197112    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 21 17:28:42.197256 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.197237    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 21 17:28:42.202630 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.202611    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 21 17:28:42.208585 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.208562    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 17:28:42.352662 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.352630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2abfa793-fe8b-474e-8854-0fed95ec1067-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.352801 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.352678    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2abfa793-fe8b-474e-8854-0fed95ec1067-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.352801 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.352733    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2abfa793-fe8b-474e-8854-0fed95ec1067-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.352801 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.352751    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2abfa793-fe8b-474e-8854-0fed95ec1067-config-out\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.352801 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.352772    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2abfa793-fe8b-474e-8854-0fed95ec1067-web-config\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.352801 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.352797    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2abfa793-fe8b-474e-8854-0fed95ec1067-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.353025 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.352820    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2abfa793-fe8b-474e-8854-0fed95ec1067-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.353025 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.352905    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2abfa793-fe8b-474e-8854-0fed95ec1067-config-volume\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.353025 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.352949    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftmgq\" (UniqueName: \"kubernetes.io/projected/2abfa793-fe8b-474e-8854-0fed95ec1067-kube-api-access-ftmgq\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.353025 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.352971    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2abfa793-fe8b-474e-8854-0fed95ec1067-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.353025 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.352989    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2abfa793-fe8b-474e-8854-0fed95ec1067-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.353025 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.353016    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2abfa793-fe8b-474e-8854-0fed95ec1067-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.353415 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.353069    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2abfa793-fe8b-474e-8854-0fed95ec1067-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.453879 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.453826    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2abfa793-fe8b-474e-8854-0fed95ec1067-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.453879 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.453853    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2abfa793-fe8b-474e-8854-0fed95ec1067-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.453879 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.453872    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2abfa793-fe8b-474e-8854-0fed95ec1067-config-out\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.454065 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.453887    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2abfa793-fe8b-474e-8854-0fed95ec1067-web-config\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.454065 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.453906    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2abfa793-fe8b-474e-8854-0fed95ec1067-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.454065 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.453927    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2abfa793-fe8b-474e-8854-0fed95ec1067-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.454065 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.453952    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2abfa793-fe8b-474e-8854-0fed95ec1067-config-volume\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.454065 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.453971    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftmgq\" (UniqueName: \"kubernetes.io/projected/2abfa793-fe8b-474e-8854-0fed95ec1067-kube-api-access-ftmgq\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.454065 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.453994    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2abfa793-fe8b-474e-8854-0fed95ec1067-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.454065 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.454020    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2abfa793-fe8b-474e-8854-0fed95ec1067-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.454065 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.454057    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2abfa793-fe8b-474e-8854-0fed95ec1067-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.454455 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.454083    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2abfa793-fe8b-474e-8854-0fed95ec1067-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.454455 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.454107    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2abfa793-fe8b-474e-8854-0fed95ec1067-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.454455 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.454444    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2abfa793-fe8b-474e-8854-0fed95ec1067-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.454924 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.454899    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2abfa793-fe8b-474e-8854-0fed95ec1067-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.455022 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.454952    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2abfa793-fe8b-474e-8854-0fed95ec1067-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.457066 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.457028    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2abfa793-fe8b-474e-8854-0fed95ec1067-config-out\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.457219 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.457197    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2abfa793-fe8b-474e-8854-0fed95ec1067-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.457362 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.457331    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2abfa793-fe8b-474e-8854-0fed95ec1067-web-config\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.457362 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.457331    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2abfa793-fe8b-474e-8854-0fed95ec1067-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.457506 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.457449    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2abfa793-fe8b-474e-8854-0fed95ec1067-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.457615 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.457598    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2abfa793-fe8b-474e-8854-0fed95ec1067-config-volume\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.457725 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.457707    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2abfa793-fe8b-474e-8854-0fed95ec1067-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.458240 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.458215    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2abfa793-fe8b-474e-8854-0fed95ec1067-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.459163 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.459148    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2abfa793-fe8b-474e-8854-0fed95ec1067-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.463340 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.463324    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftmgq\" (UniqueName: \"kubernetes.io/projected/2abfa793-fe8b-474e-8854-0fed95ec1067-kube-api-access-ftmgq\") pod \"alertmanager-main-0\" (UID: \"2abfa793-fe8b-474e-8854-0fed95ec1067\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.500909 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.500890    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 21 17:28:42.630809 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.630781    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 21 17:28:42.633623 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:28:42.633599    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2abfa793_fe8b_474e_8854_0fed95ec1067.slice/crio-df68bcd2263c97123db10b91e6b09aedf7baf903e652c85ffadc4f9cabb031a2 WatchSource:0}: Error finding container df68bcd2263c97123db10b91e6b09aedf7baf903e652c85ffadc4f9cabb031a2: Status 404 returned error can't find the container with id df68bcd2263c97123db10b91e6b09aedf7baf903e652c85ffadc4f9cabb031a2
Jul 21 17:28:42.844457 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.844423    2581 generic.go:356] "Generic (PLEG): container finished" podID="2abfa793-fe8b-474e-8854-0fed95ec1067" containerID="c4b5fbad82fb46e6ca1a2bbb8e3fd04ff3c84ee6b2f67bb800ccaf6ba8dea2df" exitCode=0
Jul 21 17:28:42.844756 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.844509    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2abfa793-fe8b-474e-8854-0fed95ec1067","Type":"ContainerDied","Data":"c4b5fbad82fb46e6ca1a2bbb8e3fd04ff3c84ee6b2f67bb800ccaf6ba8dea2df"}
Jul 21 17:28:42.844756 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:42.844610    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2abfa793-fe8b-474e-8854-0fed95ec1067","Type":"ContainerStarted","Data":"df68bcd2263c97123db10b91e6b09aedf7baf903e652c85ffadc4f9cabb031a2"}
Jul 21 17:28:43.125561 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:43.125536    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="78600264-f11e-4282-a45e-9bf75cbf3180" path="/var/lib/kubelet/pods/78600264-f11e-4282-a45e-9bf75cbf3180/volumes"
Jul 21 17:28:43.852571 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:43.852536    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2abfa793-fe8b-474e-8854-0fed95ec1067","Type":"ContainerStarted","Data":"52d2d37d9306ddb2671cefa9abac368c6418edbac69142549736ff86c9bb1013"}
Jul 21 17:28:43.853004 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:43.852613    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2abfa793-fe8b-474e-8854-0fed95ec1067","Type":"ContainerStarted","Data":"979cc8e68762e78ae2919173c496af4623b392cac82708f28b853ee2efac7479"}
Jul 21 17:28:43.853004 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:43.852656    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2abfa793-fe8b-474e-8854-0fed95ec1067","Type":"ContainerStarted","Data":"2552f556341e4c878622cf652df8ca2508160043795251ab6a0bf4628bf29853"}
Jul 21 17:28:43.853004 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:43.852699    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2abfa793-fe8b-474e-8854-0fed95ec1067","Type":"ContainerStarted","Data":"32f7259a1b98a76437ad9435d49494f3519e4a959b0483159baf54c492ba7d95"}
Jul 21 17:28:43.853004 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:43.852737    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2abfa793-fe8b-474e-8854-0fed95ec1067","Type":"ContainerStarted","Data":"ea629403766b002a7d23e1d88ee1bca2a94ed04e97e58d62fbd5c0d6e3eebf89"}
Jul 21 17:28:43.853004 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:43.852774    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2abfa793-fe8b-474e-8854-0fed95ec1067","Type":"ContainerStarted","Data":"95118fd1e235be01f167843ec5c6d83eeea181159a3fd2bc6e9269607678430b"}
Jul 21 17:28:43.879877 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:43.879785    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.86002497 podStartE2EDuration="1.879771539s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.746569ms" isStatefulPod=false podCreationTimestamp="2026-07-21 17:28:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:28:43.878124461 +0000 UTC m=+149.278688552" watchObservedRunningTime="2026-07-21 17:28:43.879771539 +0000 UTC m=+149.280335610"
Jul 21 17:28:44.578511 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.578475    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-bb7f8949b-dljg7"]
Jul 21 17:28:44.580643 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.580621    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.584018 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.583578    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 21 17:28:44.584018 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.583847    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 21 17:28:44.584018 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.583890    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 21 17:28:44.584301 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.584039    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-q4f96\""
Jul 21 17:28:44.584301 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.584104    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 21 17:28:44.584301 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.584132    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 21 17:28:44.589371 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.589352    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 21 17:28:44.595421 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.595400    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-bb7f8949b-dljg7"]
Jul 21 17:28:44.672600 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.672571    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38212eff-a6d4-41ea-9c6b-696d31528057-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.672710 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.672607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/38212eff-a6d4-41ea-9c6b-696d31528057-telemeter-client-tls\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.672710 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.672629    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/38212eff-a6d4-41ea-9c6b-696d31528057-secret-telemeter-client\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.672710 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.672645    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38212eff-a6d4-41ea-9c6b-696d31528057-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.672821 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.672741    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/38212eff-a6d4-41ea-9c6b-696d31528057-federate-client-tls\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.672821 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.672767    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38212eff-a6d4-41ea-9c6b-696d31528057-metrics-client-ca\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.672821 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.672788    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38212eff-a6d4-41ea-9c6b-696d31528057-serving-certs-ca-bundle\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.672935 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.672850    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx549\" (UniqueName: \"kubernetes.io/projected/38212eff-a6d4-41ea-9c6b-696d31528057-kube-api-access-zx549\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.773879 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.773844    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/38212eff-a6d4-41ea-9c6b-696d31528057-federate-client-tls\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.773879 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.773880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38212eff-a6d4-41ea-9c6b-696d31528057-metrics-client-ca\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.774015 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.773899    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38212eff-a6d4-41ea-9c6b-696d31528057-serving-certs-ca-bundle\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.774060 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.774014    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx549\" (UniqueName: \"kubernetes.io/projected/38212eff-a6d4-41ea-9c6b-696d31528057-kube-api-access-zx549\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.774093 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.774059    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38212eff-a6d4-41ea-9c6b-696d31528057-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.774127 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.774096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/38212eff-a6d4-41ea-9c6b-696d31528057-telemeter-client-tls\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.774197 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.774135    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/38212eff-a6d4-41ea-9c6b-696d31528057-secret-telemeter-client\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.774259 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.774161    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38212eff-a6d4-41ea-9c6b-696d31528057-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.774712 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.774688    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38212eff-a6d4-41ea-9c6b-696d31528057-metrics-client-ca\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.775261 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.775236    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38212eff-a6d4-41ea-9c6b-696d31528057-serving-certs-ca-bundle\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.775525 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.775502    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38212eff-a6d4-41ea-9c6b-696d31528057-telemeter-trusted-ca-bundle\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.776736 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.776709    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/38212eff-a6d4-41ea-9c6b-696d31528057-federate-client-tls\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.776833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.776817    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/38212eff-a6d4-41ea-9c6b-696d31528057-secret-telemeter-client\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.776911 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.776880    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/38212eff-a6d4-41ea-9c6b-696d31528057-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.776952 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.776913    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/38212eff-a6d4-41ea-9c6b-696d31528057-telemeter-client-tls\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.782778 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.782760    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx549\" (UniqueName: \"kubernetes.io/projected/38212eff-a6d4-41ea-9c6b-696d31528057-kube-api-access-zx549\") pod \"telemeter-client-bb7f8949b-dljg7\" (UID: \"38212eff-a6d4-41ea-9c6b-696d31528057\") " pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:44.895191 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:44.895128    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7"
Jul 21 17:28:45.028717 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:45.028673    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-bb7f8949b-dljg7"]
Jul 21 17:28:45.030939 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:28:45.030912    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38212eff_a6d4_41ea_9c6b_696d31528057.slice/crio-54837af148166ba76a39950f6e8dcf2c6db2e8a12f46e272029950c80d61e391 WatchSource:0}: Error finding container 54837af148166ba76a39950f6e8dcf2c6db2e8a12f46e272029950c80d61e391: Status 404 returned error can't find the container with id 54837af148166ba76a39950f6e8dcf2c6db2e8a12f46e272029950c80d61e391
Jul 21 17:28:45.862353 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:45.862310    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7" event={"ID":"38212eff-a6d4-41ea-9c6b-696d31528057","Type":"ContainerStarted","Data":"54837af148166ba76a39950f6e8dcf2c6db2e8a12f46e272029950c80d61e391"}
Jul 21 17:28:46.869925 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:46.869885    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7" event={"ID":"38212eff-a6d4-41ea-9c6b-696d31528057","Type":"ContainerStarted","Data":"0d0552d48f889d36d84dd4dc0a01818a41a186403834e2043392c88a629a7335"}
Jul 21 17:28:46.870438 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:46.869962    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7" event={"ID":"38212eff-a6d4-41ea-9c6b-696d31528057","Type":"ContainerStarted","Data":"d4f420470e4874923f53e5e7d1a6cae6b55dfe47f71fbd7e59b79a06efe085d8"}
Jul 21 17:28:46.870438 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:46.869996    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7" event={"ID":"38212eff-a6d4-41ea-9c6b-696d31528057","Type":"ContainerStarted","Data":"ba1728359fafc8a9c0f90b059199ccc1710b61bfb7456fa27cb845b40827969a"}
Jul 21 17:28:46.897693 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:46.897645    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-bb7f8949b-dljg7" podStartSLOduration=1.26047563 podStartE2EDuration="2.897628414s" totalImagesPullingTime="1.637152784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:28:46.89573958 +0000 UTC m=+152.296303667" watchObservedRunningTime="2026-07-21 17:28:46.897628414 +0000 UTC m=+152.298192485"
Jul 21 17:28:47.690739 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.690702    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79bd5b68d9-9r97w"]
Jul 21 17:28:47.693042 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.693026    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:47.712135 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.712104    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79bd5b68d9-9r97w"]
Jul 21 17:28:47.798401 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.798377    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-console-serving-cert\") pod \"console-79bd5b68d9-9r97w\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") " pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:47.798527 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.798407    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-oauth-serving-cert\") pod \"console-79bd5b68d9-9r97w\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") " pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:47.798527 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.798442    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bp6p9\" (UniqueName: \"kubernetes.io/projected/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-kube-api-access-bp6p9\") pod \"console-79bd5b68d9-9r97w\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") " pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:47.798527 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.798456    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-console-config\") pod \"console-79bd5b68d9-9r97w\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") " pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:47.798527 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.798516    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-service-ca\") pod \"console-79bd5b68d9-9r97w\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") " pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:47.798691 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.798588    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-console-oauth-config\") pod \"console-79bd5b68d9-9r97w\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") " pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:47.798691 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.798630    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-trusted-ca-bundle\") pod \"console-79bd5b68d9-9r97w\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") " pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:47.899636 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.899610    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-console-oauth-config\") pod \"console-79bd5b68d9-9r97w\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") " pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:47.899990 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.899652    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-trusted-ca-bundle\") pod \"console-79bd5b68d9-9r97w\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") " pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:47.899990 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.899678    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-console-serving-cert\") pod \"console-79bd5b68d9-9r97w\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") " pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:47.899990 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.899790    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-oauth-serving-cert\") pod \"console-79bd5b68d9-9r97w\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") " pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:47.899990 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.899848    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bp6p9\" (UniqueName: \"kubernetes.io/projected/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-kube-api-access-bp6p9\") pod \"console-79bd5b68d9-9r97w\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") " pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:47.899990 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.899868    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-console-config\") pod \"console-79bd5b68d9-9r97w\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") " pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:47.899990 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.899897    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-service-ca\") pod \"console-79bd5b68d9-9r97w\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") " pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:47.900593 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.900561    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-trusted-ca-bundle\") pod \"console-79bd5b68d9-9r97w\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") " pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:47.900659 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.900625    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-service-ca\") pod \"console-79bd5b68d9-9r97w\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") " pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:47.900659 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.900625    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-console-config\") pod \"console-79bd5b68d9-9r97w\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") " pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:47.900759 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.900704    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-oauth-serving-cert\") pod \"console-79bd5b68d9-9r97w\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") " pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:47.902339 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.902319    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-console-oauth-config\") pod \"console-79bd5b68d9-9r97w\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") " pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:47.902429 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.902383    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-console-serving-cert\") pod \"console-79bd5b68d9-9r97w\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") " pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:47.907512 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:47.907486    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bp6p9\" (UniqueName: \"kubernetes.io/projected/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-kube-api-access-bp6p9\") pod \"console-79bd5b68d9-9r97w\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") " pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:48.001052 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:48.000984    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:48.128609 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:48.128576    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79bd5b68d9-9r97w"]
Jul 21 17:28:48.132603 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:28:48.132580    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode433f8f4_fac4_4ac7_993a_0f4581bb32b0.slice/crio-8a62d620754ddca67c0d1f7f586f0e8d443e1fd3a9228f498d8f6ed01ec0d946 WatchSource:0}: Error finding container 8a62d620754ddca67c0d1f7f586f0e8d443e1fd3a9228f498d8f6ed01ec0d946: Status 404 returned error can't find the container with id 8a62d620754ddca67c0d1f7f586f0e8d443e1fd3a9228f498d8f6ed01ec0d946
Jul 21 17:28:48.880095 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:48.880063    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79bd5b68d9-9r97w" event={"ID":"e433f8f4-fac4-4ac7-993a-0f4581bb32b0","Type":"ContainerStarted","Data":"09856072ae43cea1dd98cfdd43c9cb15503ad1c902091c1c5ba2f50905c14f59"}
Jul 21 17:28:48.880294 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:48.880109    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79bd5b68d9-9r97w" event={"ID":"e433f8f4-fac4-4ac7-993a-0f4581bb32b0","Type":"ContainerStarted","Data":"8a62d620754ddca67c0d1f7f586f0e8d443e1fd3a9228f498d8f6ed01ec0d946"}
Jul 21 17:28:48.898916 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:48.898866    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79bd5b68d9-9r97w" podStartSLOduration=1.898852347 podStartE2EDuration="1.898852347s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:28:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:28:48.897663171 +0000 UTC m=+154.298227237" watchObservedRunningTime="2026-07-21 17:28:48.898852347 +0000 UTC m=+154.299416417"
Jul 21 17:28:58.002048 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:58.002015    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:58.002483 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:58.002099    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:58.006759 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:58.006738    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:58.920258 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:58.920231    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:28:58.973019 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:28:58.972983    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8675775596-8khfj"]
Jul 21 17:29:23.993515 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:23.993474    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8675775596-8khfj" podUID="31373243-1faa-495f-8789-0d0325ba60f5" containerName="console" containerID="cri-o://dcbef573b228f197d8e2efabc818fd1ebef883dd52728755176f85ac395c167f" gracePeriod=15
Jul 21 17:29:24.227082 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:24.227060    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:29:24.260681 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:24.260656    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-console-config\") pod \"31373243-1faa-495f-8789-0d0325ba60f5\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") "
Jul 21 17:29:24.260842 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:24.260693    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31373243-1faa-495f-8789-0d0325ba60f5-console-oauth-config\") pod \"31373243-1faa-495f-8789-0d0325ba60f5\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") "
Jul 21 17:29:24.260842 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:24.260724    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49s7w\" (UniqueName: \"kubernetes.io/projected/31373243-1faa-495f-8789-0d0325ba60f5-kube-api-access-49s7w\") pod \"31373243-1faa-495f-8789-0d0325ba60f5\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") "
Jul 21 17:29:24.260964 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:24.260903    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-service-ca\") pod \"31373243-1faa-495f-8789-0d0325ba60f5\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") "
Jul 21 17:29:24.260964 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:24.260955    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-trusted-ca-bundle\") pod \"31373243-1faa-495f-8789-0d0325ba60f5\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") "
Jul 21 17:29:24.261075 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:24.261029    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-oauth-serving-cert\") pod \"31373243-1faa-495f-8789-0d0325ba60f5\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") "
Jul 21 17:29:24.261075 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:24.261069    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31373243-1faa-495f-8789-0d0325ba60f5-console-serving-cert\") pod \"31373243-1faa-495f-8789-0d0325ba60f5\" (UID: \"31373243-1faa-495f-8789-0d0325ba60f5\") "
Jul 21 17:29:24.261229 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:24.261088    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-console-config" (OuterVolumeSpecName: "console-config") pod "31373243-1faa-495f-8789-0d0325ba60f5" (UID: "31373243-1faa-495f-8789-0d0325ba60f5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:29:24.261366 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:24.261349    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-console-config\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:29:24.261418 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:24.261376    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-service-ca" (OuterVolumeSpecName: "service-ca") pod "31373243-1faa-495f-8789-0d0325ba60f5" (UID: "31373243-1faa-495f-8789-0d0325ba60f5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:29:24.261418 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:24.261386    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "31373243-1faa-495f-8789-0d0325ba60f5" (UID: "31373243-1faa-495f-8789-0d0325ba60f5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:29:24.261479 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:24.261420    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "31373243-1faa-495f-8789-0d0325ba60f5" (UID: "31373243-1faa-495f-8789-0d0325ba60f5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:29:24.262881 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:24.262851    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31373243-1faa-495f-8789-0d0325ba60f5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "31373243-1faa-495f-8789-0d0325ba60f5" (UID: "31373243-1faa-495f-8789-0d0325ba60f5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:29:24.263135 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:24.263115    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31373243-1faa-495f-8789-0d0325ba60f5-kube-api-access-49s7w" (OuterVolumeSpecName: "kube-api-access-49s7w") pod "31373243-1faa-495f-8789-0d0325ba60f5" (UID: "31373243-1faa-495f-8789-0d0325ba60f5"). InnerVolumeSpecName "kube-api-access-49s7w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:29:24.263533 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:24.263511    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31373243-1faa-495f-8789-0d0325ba60f5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "31373243-1faa-495f-8789-0d0325ba60f5" (UID: "31373243-1faa-495f-8789-0d0325ba60f5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:29:24.361803 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:24.361770    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-service-ca\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:29:24.361803 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:24.361798    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-trusted-ca-bundle\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:29:24.361944 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:24.361813    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31373243-1faa-495f-8789-0d0325ba60f5-oauth-serving-cert\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:29:24.361944 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:24.361826    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31373243-1faa-495f-8789-0d0325ba60f5-console-serving-cert\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:29:24.361944 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:24.361840    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31373243-1faa-495f-8789-0d0325ba60f5-console-oauth-config\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:29:24.361944 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:24.361852    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49s7w\" (UniqueName: \"kubernetes.io/projected/31373243-1faa-495f-8789-0d0325ba60f5-kube-api-access-49s7w\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:29:25.017159 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:25.017119    2581 generic.go:356] "Generic (PLEG): container finished" podID="31373243-1faa-495f-8789-0d0325ba60f5" containerID="dcbef573b228f197d8e2efabc818fd1ebef883dd52728755176f85ac395c167f" exitCode=0
Jul 21 17:29:25.017655 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:25.017190    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8675775596-8khfj"
Jul 21 17:29:25.017655 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:25.017212    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8675775596-8khfj" event={"ID":"31373243-1faa-495f-8789-0d0325ba60f5","Type":"ContainerDied","Data":"dcbef573b228f197d8e2efabc818fd1ebef883dd52728755176f85ac395c167f"}
Jul 21 17:29:25.017655 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:25.017266    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8675775596-8khfj" event={"ID":"31373243-1faa-495f-8789-0d0325ba60f5","Type":"ContainerDied","Data":"949a6120cece6d08296f4ff3441ab01e7d0b738ba1dbe8ef927b2e2ab6776c59"}
Jul 21 17:29:25.017655 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:25.017288    2581 scope.go:117] "RemoveContainer" containerID="dcbef573b228f197d8e2efabc818fd1ebef883dd52728755176f85ac395c167f"
Jul 21 17:29:25.026109 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:25.026095    2581 scope.go:117] "RemoveContainer" containerID="dcbef573b228f197d8e2efabc818fd1ebef883dd52728755176f85ac395c167f"
Jul 21 17:29:25.026401 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:29:25.026381    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcbef573b228f197d8e2efabc818fd1ebef883dd52728755176f85ac395c167f\": container with ID starting with dcbef573b228f197d8e2efabc818fd1ebef883dd52728755176f85ac395c167f not found: ID does not exist" containerID="dcbef573b228f197d8e2efabc818fd1ebef883dd52728755176f85ac395c167f"
Jul 21 17:29:25.026453 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:25.026409    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcbef573b228f197d8e2efabc818fd1ebef883dd52728755176f85ac395c167f"} err="failed to get container status \"dcbef573b228f197d8e2efabc818fd1ebef883dd52728755176f85ac395c167f\": rpc error: code = NotFound desc = could not find container \"dcbef573b228f197d8e2efabc818fd1ebef883dd52728755176f85ac395c167f\": container with ID starting with dcbef573b228f197d8e2efabc818fd1ebef883dd52728755176f85ac395c167f not found: ID does not exist"
Jul 21 17:29:25.038038 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:25.038017    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8675775596-8khfj"]
Jul 21 17:29:25.040234 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:25.040214    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8675775596-8khfj"]
Jul 21 17:29:25.124821 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:29:25.124784    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31373243-1faa-495f-8789-0d0325ba60f5" path="/var/lib/kubelet/pods/31373243-1faa-495f-8789-0d0325ba60f5/volumes"
Jul 21 17:30:28.066774 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.066733    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-677f5bdd6d-2g6sv"]
Jul 21 17:30:28.067312 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.067193    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31373243-1faa-495f-8789-0d0325ba60f5" containerName="console"
Jul 21 17:30:28.067312 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.067213    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="31373243-1faa-495f-8789-0d0325ba60f5" containerName="console"
Jul 21 17:30:28.067435 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.067313    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="31373243-1faa-495f-8789-0d0325ba60f5" containerName="console"
Jul 21 17:30:28.071287 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.071266    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.093202 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.093157    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677f5bdd6d-2g6sv"]
Jul 21 17:30:28.227400 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.227372    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-console-serving-cert\") pod \"console-677f5bdd6d-2g6sv\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") " pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.227524 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.227403    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-oauth-serving-cert\") pod \"console-677f5bdd6d-2g6sv\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") " pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.227524 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.227432    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5qh9\" (UniqueName: \"kubernetes.io/projected/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-kube-api-access-b5qh9\") pod \"console-677f5bdd6d-2g6sv\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") " pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.227524 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.227513    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-console-oauth-config\") pod \"console-677f5bdd6d-2g6sv\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") " pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.227633 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.227539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-console-config\") pod \"console-677f5bdd6d-2g6sv\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") " pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.227633 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.227575    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-trusted-ca-bundle\") pod \"console-677f5bdd6d-2g6sv\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") " pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.227633 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.227596    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-service-ca\") pod \"console-677f5bdd6d-2g6sv\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") " pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.328229 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.328156    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5qh9\" (UniqueName: \"kubernetes.io/projected/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-kube-api-access-b5qh9\") pod \"console-677f5bdd6d-2g6sv\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") " pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.328229 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.328201    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-console-oauth-config\") pod \"console-677f5bdd6d-2g6sv\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") " pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.328229 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.328220    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-console-config\") pod \"console-677f5bdd6d-2g6sv\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") " pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.328470 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.328246    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-trusted-ca-bundle\") pod \"console-677f5bdd6d-2g6sv\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") " pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.328470 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.328264    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-service-ca\") pod \"console-677f5bdd6d-2g6sv\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") " pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.328470 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.328308    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-console-serving-cert\") pod \"console-677f5bdd6d-2g6sv\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") " pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.328470 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.328326    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-oauth-serving-cert\") pod \"console-677f5bdd6d-2g6sv\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") " pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.329106 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.329082    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-oauth-serving-cert\") pod \"console-677f5bdd6d-2g6sv\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") " pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.329266 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.329149    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-service-ca\") pod \"console-677f5bdd6d-2g6sv\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") " pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.329266 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.329149    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-console-config\") pod \"console-677f5bdd6d-2g6sv\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") " pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.329660 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.329603    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-trusted-ca-bundle\") pod \"console-677f5bdd6d-2g6sv\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") " pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.330966 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.330944    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-console-oauth-config\") pod \"console-677f5bdd6d-2g6sv\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") " pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.331069 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.331055    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-console-serving-cert\") pod \"console-677f5bdd6d-2g6sv\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") " pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.337961 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.337942    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5qh9\" (UniqueName: \"kubernetes.io/projected/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-kube-api-access-b5qh9\") pod \"console-677f5bdd6d-2g6sv\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") " pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.380839 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.380821    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:28.512701 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:30:28.512672    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b4417b_ba10_41e1_983b_3d1a7f37cfbb.slice/crio-d9b557bba4c80294952adfdeeedb00275ca5ed8c35c119644d46ef9542181b2d WatchSource:0}: Error finding container d9b557bba4c80294952adfdeeedb00275ca5ed8c35c119644d46ef9542181b2d: Status 404 returned error can't find the container with id d9b557bba4c80294952adfdeeedb00275ca5ed8c35c119644d46ef9542181b2d
Jul 21 17:30:28.513370 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:28.513348    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677f5bdd6d-2g6sv"]
Jul 21 17:30:29.248509 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:29.248475    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677f5bdd6d-2g6sv" event={"ID":"19b4417b-ba10-41e1-983b-3d1a7f37cfbb","Type":"ContainerStarted","Data":"dbe23e42c62d9e20017e4a2970d70cefae87e4f62f70e50d2f1bbd22ce1368a6"}
Jul 21 17:30:29.248866 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:29.248522    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677f5bdd6d-2g6sv" event={"ID":"19b4417b-ba10-41e1-983b-3d1a7f37cfbb","Type":"ContainerStarted","Data":"d9b557bba4c80294952adfdeeedb00275ca5ed8c35c119644d46ef9542181b2d"}
Jul 21 17:30:38.381162 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:38.381126    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:38.381632 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:38.381214    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:38.386166 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:38.386144    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:38.406005 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:38.405965    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-677f5bdd6d-2g6sv" podStartSLOduration=10.405951485 podStartE2EDuration="10.405951485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:30:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:30:29.273433981 +0000 UTC m=+254.673998053" watchObservedRunningTime="2026-07-21 17:30:38.405951485 +0000 UTC m=+263.806515621"
Jul 21 17:30:39.291130 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:39.291102    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:30:39.347041 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:30:39.347016    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79bd5b68d9-9r97w"]
Jul 21 17:31:00.661946 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:00.661908    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd"]
Jul 21 17:31:00.665599 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:00.665582    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd"
Jul 21 17:31:00.668386 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:00.668366    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 21 17:31:00.668485 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:00.668398    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 21 17:31:00.669419 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:00.669397    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bjm68\""
Jul 21 17:31:00.682978 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:00.682954    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd"]
Jul 21 17:31:00.777453 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:00.777430    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e4a6178-23fe-4a30-a275-72394c3fba37-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd\" (UID: \"2e4a6178-23fe-4a30-a275-72394c3fba37\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd"
Jul 21 17:31:00.777615 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:00.777473    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e4a6178-23fe-4a30-a275-72394c3fba37-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd\" (UID: \"2e4a6178-23fe-4a30-a275-72394c3fba37\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd"
Jul 21 17:31:00.777615 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:00.777504    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qbzg\" (UniqueName: \"kubernetes.io/projected/2e4a6178-23fe-4a30-a275-72394c3fba37-kube-api-access-4qbzg\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd\" (UID: \"2e4a6178-23fe-4a30-a275-72394c3fba37\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd"
Jul 21 17:31:00.878085 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:00.878059    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e4a6178-23fe-4a30-a275-72394c3fba37-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd\" (UID: \"2e4a6178-23fe-4a30-a275-72394c3fba37\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd"
Jul 21 17:31:00.878215 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:00.878100    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e4a6178-23fe-4a30-a275-72394c3fba37-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd\" (UID: \"2e4a6178-23fe-4a30-a275-72394c3fba37\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd"
Jul 21 17:31:00.878215 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:00.878119    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qbzg\" (UniqueName: \"kubernetes.io/projected/2e4a6178-23fe-4a30-a275-72394c3fba37-kube-api-access-4qbzg\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd\" (UID: \"2e4a6178-23fe-4a30-a275-72394c3fba37\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd"
Jul 21 17:31:00.878461 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:00.878444    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e4a6178-23fe-4a30-a275-72394c3fba37-util\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd\" (UID: \"2e4a6178-23fe-4a30-a275-72394c3fba37\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd"
Jul 21 17:31:00.878501 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:00.878482    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e4a6178-23fe-4a30-a275-72394c3fba37-bundle\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd\" (UID: \"2e4a6178-23fe-4a30-a275-72394c3fba37\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd"
Jul 21 17:31:00.889213 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:00.889183    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qbzg\" (UniqueName: \"kubernetes.io/projected/2e4a6178-23fe-4a30-a275-72394c3fba37-kube-api-access-4qbzg\") pod \"320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd\" (UID: \"2e4a6178-23fe-4a30-a275-72394c3fba37\") " pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd"
Jul 21 17:31:00.975476 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:00.975426    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd"
Jul 21 17:31:01.101686 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:01.101659    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd"]
Jul 21 17:31:01.104247 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:31:01.104222    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e4a6178_23fe_4a30_a275_72394c3fba37.slice/crio-c5457a3d165a5ef688572d7ec53bad5aadbe5dfd1845ce9d6ecc8515278c7859 WatchSource:0}: Error finding container c5457a3d165a5ef688572d7ec53bad5aadbe5dfd1845ce9d6ecc8515278c7859: Status 404 returned error can't find the container with id c5457a3d165a5ef688572d7ec53bad5aadbe5dfd1845ce9d6ecc8515278c7859
Jul 21 17:31:01.368373 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:01.368331    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd" event={"ID":"2e4a6178-23fe-4a30-a275-72394c3fba37","Type":"ContainerStarted","Data":"c5457a3d165a5ef688572d7ec53bad5aadbe5dfd1845ce9d6ecc8515278c7859"}
Jul 21 17:31:04.367303 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.367260    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79bd5b68d9-9r97w" podUID="e433f8f4-fac4-4ac7-993a-0f4581bb32b0" containerName="console" containerID="cri-o://09856072ae43cea1dd98cfdd43c9cb15503ad1c902091c1c5ba2f50905c14f59" gracePeriod=15
Jul 21 17:31:04.626083 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.626023    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:31:04.712275 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.712251    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-oauth-serving-cert\") pod \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") "
Jul 21 17:31:04.712412 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.712286    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-console-oauth-config\") pod \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") "
Jul 21 17:31:04.712412 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.712310    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-console-config\") pod \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") "
Jul 21 17:31:04.712412 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.712343    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bp6p9\" (UniqueName: \"kubernetes.io/projected/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-kube-api-access-bp6p9\") pod \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") "
Jul 21 17:31:04.712412 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.712365    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-console-serving-cert\") pod \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") "
Jul 21 17:31:04.712412 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.712387    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-trusted-ca-bundle\") pod \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") "
Jul 21 17:31:04.712412 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.712402    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-service-ca\") pod \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\" (UID: \"e433f8f4-fac4-4ac7-993a-0f4581bb32b0\") "
Jul 21 17:31:04.712833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.712789    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e433f8f4-fac4-4ac7-993a-0f4581bb32b0" (UID: "e433f8f4-fac4-4ac7-993a-0f4581bb32b0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:31:04.712833 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.712799    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-console-config" (OuterVolumeSpecName: "console-config") pod "e433f8f4-fac4-4ac7-993a-0f4581bb32b0" (UID: "e433f8f4-fac4-4ac7-993a-0f4581bb32b0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:31:04.713227 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.712843    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e433f8f4-fac4-4ac7-993a-0f4581bb32b0" (UID: "e433f8f4-fac4-4ac7-993a-0f4581bb32b0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:31:04.713227 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.712878    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-service-ca" (OuterVolumeSpecName: "service-ca") pod "e433f8f4-fac4-4ac7-993a-0f4581bb32b0" (UID: "e433f8f4-fac4-4ac7-993a-0f4581bb32b0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:31:04.714726 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.714701    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e433f8f4-fac4-4ac7-993a-0f4581bb32b0" (UID: "e433f8f4-fac4-4ac7-993a-0f4581bb32b0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:31:04.714849 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.714832    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e433f8f4-fac4-4ac7-993a-0f4581bb32b0" (UID: "e433f8f4-fac4-4ac7-993a-0f4581bb32b0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:31:04.714933 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.714908    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-kube-api-access-bp6p9" (OuterVolumeSpecName: "kube-api-access-bp6p9") pod "e433f8f4-fac4-4ac7-993a-0f4581bb32b0" (UID: "e433f8f4-fac4-4ac7-993a-0f4581bb32b0"). InnerVolumeSpecName "kube-api-access-bp6p9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:31:04.812985 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.812954    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-trusted-ca-bundle\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:31:04.812985 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.812984    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-service-ca\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:31:04.813212 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.813001    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-oauth-serving-cert\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:31:04.813212 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.813011    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-console-oauth-config\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:31:04.813212 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.813024    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-console-config\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:31:04.813212 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.813034    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bp6p9\" (UniqueName: \"kubernetes.io/projected/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-kube-api-access-bp6p9\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:31:04.813212 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:04.813043    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e433f8f4-fac4-4ac7-993a-0f4581bb32b0-console-serving-cert\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:31:05.386236 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:05.386136    2581 generic.go:356] "Generic (PLEG): container finished" podID="e433f8f4-fac4-4ac7-993a-0f4581bb32b0" containerID="09856072ae43cea1dd98cfdd43c9cb15503ad1c902091c1c5ba2f50905c14f59" exitCode=0
Jul 21 17:31:05.386236 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:05.386223    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79bd5b68d9-9r97w"
Jul 21 17:31:05.386727 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:05.386213    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79bd5b68d9-9r97w" event={"ID":"e433f8f4-fac4-4ac7-993a-0f4581bb32b0","Type":"ContainerDied","Data":"09856072ae43cea1dd98cfdd43c9cb15503ad1c902091c1c5ba2f50905c14f59"}
Jul 21 17:31:05.386727 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:05.386398    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79bd5b68d9-9r97w" event={"ID":"e433f8f4-fac4-4ac7-993a-0f4581bb32b0","Type":"ContainerDied","Data":"8a62d620754ddca67c0d1f7f586f0e8d443e1fd3a9228f498d8f6ed01ec0d946"}
Jul 21 17:31:05.386727 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:05.386436    2581 scope.go:117] "RemoveContainer" containerID="09856072ae43cea1dd98cfdd43c9cb15503ad1c902091c1c5ba2f50905c14f59"
Jul 21 17:31:05.395631 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:05.395608    2581 scope.go:117] "RemoveContainer" containerID="09856072ae43cea1dd98cfdd43c9cb15503ad1c902091c1c5ba2f50905c14f59"
Jul 21 17:31:05.395918 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:31:05.395897    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09856072ae43cea1dd98cfdd43c9cb15503ad1c902091c1c5ba2f50905c14f59\": container with ID starting with 09856072ae43cea1dd98cfdd43c9cb15503ad1c902091c1c5ba2f50905c14f59 not found: ID does not exist" containerID="09856072ae43cea1dd98cfdd43c9cb15503ad1c902091c1c5ba2f50905c14f59"
Jul 21 17:31:05.396010 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:05.395923    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09856072ae43cea1dd98cfdd43c9cb15503ad1c902091c1c5ba2f50905c14f59"} err="failed to get container status \"09856072ae43cea1dd98cfdd43c9cb15503ad1c902091c1c5ba2f50905c14f59\": rpc error: code = NotFound desc = could not find container \"09856072ae43cea1dd98cfdd43c9cb15503ad1c902091c1c5ba2f50905c14f59\": container with ID starting with 09856072ae43cea1dd98cfdd43c9cb15503ad1c902091c1c5ba2f50905c14f59 not found: ID does not exist"
Jul 21 17:31:05.403971 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:05.403949    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79bd5b68d9-9r97w"]
Jul 21 17:31:05.407615 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:05.407593    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79bd5b68d9-9r97w"]
Jul 21 17:31:07.125476 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:07.125446    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e433f8f4-fac4-4ac7-993a-0f4581bb32b0" path="/var/lib/kubelet/pods/e433f8f4-fac4-4ac7-993a-0f4581bb32b0/volumes"
Jul 21 17:31:08.402106 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:08.402078    2581 generic.go:356] "Generic (PLEG): container finished" podID="2e4a6178-23fe-4a30-a275-72394c3fba37" containerID="4faf07f21b65a630469f5e5b50d0ecfdda96598e085fd631be7ca43d9269b725" exitCode=0
Jul 21 17:31:08.402518 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:08.402130    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd" event={"ID":"2e4a6178-23fe-4a30-a275-72394c3fba37","Type":"ContainerDied","Data":"4faf07f21b65a630469f5e5b50d0ecfdda96598e085fd631be7ca43d9269b725"}
Jul 21 17:31:11.416397 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:11.416364    2581 generic.go:356] "Generic (PLEG): container finished" podID="2e4a6178-23fe-4a30-a275-72394c3fba37" containerID="b488681ead76222e5ff6967e56f55addb642033d68604f78456fa2b77c24262e" exitCode=0
Jul 21 17:31:11.416756 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:11.416454    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd" event={"ID":"2e4a6178-23fe-4a30-a275-72394c3fba37","Type":"ContainerDied","Data":"b488681ead76222e5ff6967e56f55addb642033d68604f78456fa2b77c24262e"}
Jul 21 17:31:14.985305 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:14.985280    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 17:31:14.987865 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:14.987842    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 17:31:14.991464 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:14.991440    2581 kubelet.go:1648] "Image garbage collection succeeded"
Jul 21 17:31:19.456781 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:19.456741    2581 generic.go:356] "Generic (PLEG): container finished" podID="2e4a6178-23fe-4a30-a275-72394c3fba37" containerID="4424b081bfcdc0dd50b1fb10786861d943f8afce731e9f913fe2edaafa6c757d" exitCode=0
Jul 21 17:31:19.457200 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:19.456806    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd" event={"ID":"2e4a6178-23fe-4a30-a275-72394c3fba37","Type":"ContainerDied","Data":"4424b081bfcdc0dd50b1fb10786861d943f8afce731e9f913fe2edaafa6c757d"}
Jul 21 17:31:20.583400 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:20.583378    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd"
Jul 21 17:31:20.747622 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:20.747549    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e4a6178-23fe-4a30-a275-72394c3fba37-util\") pod \"2e4a6178-23fe-4a30-a275-72394c3fba37\" (UID: \"2e4a6178-23fe-4a30-a275-72394c3fba37\") "
Jul 21 17:31:20.747622 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:20.747597    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qbzg\" (UniqueName: \"kubernetes.io/projected/2e4a6178-23fe-4a30-a275-72394c3fba37-kube-api-access-4qbzg\") pod \"2e4a6178-23fe-4a30-a275-72394c3fba37\" (UID: \"2e4a6178-23fe-4a30-a275-72394c3fba37\") "
Jul 21 17:31:20.747822 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:20.747648    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e4a6178-23fe-4a30-a275-72394c3fba37-bundle\") pod \"2e4a6178-23fe-4a30-a275-72394c3fba37\" (UID: \"2e4a6178-23fe-4a30-a275-72394c3fba37\") "
Jul 21 17:31:20.748477 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:20.748438    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e4a6178-23fe-4a30-a275-72394c3fba37-bundle" (OuterVolumeSpecName: "bundle") pod "2e4a6178-23fe-4a30-a275-72394c3fba37" (UID: "2e4a6178-23fe-4a30-a275-72394c3fba37"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:31:20.749906 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:20.749875    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e4a6178-23fe-4a30-a275-72394c3fba37-kube-api-access-4qbzg" (OuterVolumeSpecName: "kube-api-access-4qbzg") pod "2e4a6178-23fe-4a30-a275-72394c3fba37" (UID: "2e4a6178-23fe-4a30-a275-72394c3fba37"). InnerVolumeSpecName "kube-api-access-4qbzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:31:20.752054 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:20.752034    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e4a6178-23fe-4a30-a275-72394c3fba37-util" (OuterVolumeSpecName: "util") pod "2e4a6178-23fe-4a30-a275-72394c3fba37" (UID: "2e4a6178-23fe-4a30-a275-72394c3fba37"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 21 17:31:20.848182 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:20.848142    2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e4a6178-23fe-4a30-a275-72394c3fba37-util\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:31:20.848182 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:20.848165    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qbzg\" (UniqueName: \"kubernetes.io/projected/2e4a6178-23fe-4a30-a275-72394c3fba37-kube-api-access-4qbzg\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:31:20.848334 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:20.848195    2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e4a6178-23fe-4a30-a275-72394c3fba37-bundle\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:31:21.466250 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:21.466150    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd" event={"ID":"2e4a6178-23fe-4a30-a275-72394c3fba37","Type":"ContainerDied","Data":"c5457a3d165a5ef688572d7ec53bad5aadbe5dfd1845ce9d6ecc8515278c7859"}
Jul 21 17:31:21.466250 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:21.466221    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5457a3d165a5ef688572d7ec53bad5aadbe5dfd1845ce9d6ecc8515278c7859"
Jul 21 17:31:21.466250 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:21.466241    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/320da698f62953fa8a11a45982d6c7ee4dcf44b832e3de43010dcb42b5dhdcd"
Jul 21 17:31:29.264597 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.264558    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2d7js"]
Jul 21 17:31:29.264983 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.264852    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e4a6178-23fe-4a30-a275-72394c3fba37" containerName="pull"
Jul 21 17:31:29.264983 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.264863    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e4a6178-23fe-4a30-a275-72394c3fba37" containerName="pull"
Jul 21 17:31:29.264983 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.264872    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e433f8f4-fac4-4ac7-993a-0f4581bb32b0" containerName="console"
Jul 21 17:31:29.264983 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.264877    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e433f8f4-fac4-4ac7-993a-0f4581bb32b0" containerName="console"
Jul 21 17:31:29.264983 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.264896    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e4a6178-23fe-4a30-a275-72394c3fba37" containerName="extract"
Jul 21 17:31:29.264983 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.264902    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e4a6178-23fe-4a30-a275-72394c3fba37" containerName="extract"
Jul 21 17:31:29.264983 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.264910    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e4a6178-23fe-4a30-a275-72394c3fba37" containerName="util"
Jul 21 17:31:29.264983 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.264915    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e4a6178-23fe-4a30-a275-72394c3fba37" containerName="util"
Jul 21 17:31:29.264983 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.264957    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e433f8f4-fac4-4ac7-993a-0f4581bb32b0" containerName="console"
Jul 21 17:31:29.264983 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.264967    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e4a6178-23fe-4a30-a275-72394c3fba37" containerName="extract"
Jul 21 17:31:29.268418 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.268402    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2d7js"
Jul 21 17:31:29.272372 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.272339    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\""
Jul 21 17:31:29.272531 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.272409    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\""
Jul 21 17:31:29.272531 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.272343    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-nmxq7\""
Jul 21 17:31:29.272531 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.272450    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\""
Jul 21 17:31:29.357843 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.357811    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2d7js"]
Jul 21 17:31:29.403615 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.403575    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jsmdp\" (UniqueName: \"kubernetes.io/projected/fb8b3d13-de4f-4269-aa51-a4d94a0b3045-kube-api-access-jsmdp\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2d7js\" (UID: \"fb8b3d13-de4f-4269-aa51-a4d94a0b3045\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2d7js"
Jul 21 17:31:29.403615 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.403616    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/fb8b3d13-de4f-4269-aa51-a4d94a0b3045-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2d7js\" (UID: \"fb8b3d13-de4f-4269-aa51-a4d94a0b3045\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2d7js"
Jul 21 17:31:29.504444 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.504413    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jsmdp\" (UniqueName: \"kubernetes.io/projected/fb8b3d13-de4f-4269-aa51-a4d94a0b3045-kube-api-access-jsmdp\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2d7js\" (UID: \"fb8b3d13-de4f-4269-aa51-a4d94a0b3045\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2d7js"
Jul 21 17:31:29.504616 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.504455    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/fb8b3d13-de4f-4269-aa51-a4d94a0b3045-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2d7js\" (UID: \"fb8b3d13-de4f-4269-aa51-a4d94a0b3045\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2d7js"
Jul 21 17:31:29.506889 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.506867    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/fb8b3d13-de4f-4269-aa51-a4d94a0b3045-certificates\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2d7js\" (UID: \"fb8b3d13-de4f-4269-aa51-a4d94a0b3045\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2d7js"
Jul 21 17:31:29.515952 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.515905    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jsmdp\" (UniqueName: \"kubernetes.io/projected/fb8b3d13-de4f-4269-aa51-a4d94a0b3045-kube-api-access-jsmdp\") pod \"custom-metrics-autoscaler-operator-6969cb7dfb-2d7js\" (UID: \"fb8b3d13-de4f-4269-aa51-a4d94a0b3045\") " pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2d7js"
Jul 21 17:31:29.578325 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.578300    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2d7js"
Jul 21 17:31:29.704651 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.704628    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2d7js"]
Jul 21 17:31:29.707277 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:31:29.707248    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb8b3d13_de4f_4269_aa51_a4d94a0b3045.slice/crio-51e36f5019eb9afb2ee543d3ca108733dc4120b8830732611ba961ae606c4ae3 WatchSource:0}: Error finding container 51e36f5019eb9afb2ee543d3ca108733dc4120b8830732611ba961ae606c4ae3: Status 404 returned error can't find the container with id 51e36f5019eb9afb2ee543d3ca108733dc4120b8830732611ba961ae606c4ae3
Jul 21 17:31:29.709044 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:29.709025    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:31:30.507851 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:30.507811    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2d7js" event={"ID":"fb8b3d13-de4f-4269-aa51-a4d94a0b3045","Type":"ContainerStarted","Data":"51e36f5019eb9afb2ee543d3ca108733dc4120b8830732611ba961ae606c4ae3"}
Jul 21 17:31:32.518376 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:32.518334    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2d7js" event={"ID":"fb8b3d13-de4f-4269-aa51-a4d94a0b3045","Type":"ContainerStarted","Data":"791f23c8a73ec04eb72eeec2ec4e4982df92cbb95f1e86dd7756343c826e74ef"}
Jul 21 17:31:32.518838 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:32.518438    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2d7js"
Jul 21 17:31:32.539625 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:32.539555    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2d7js" podStartSLOduration=0.94777643 podStartE2EDuration="3.539537745s" totalImagesPullingTime="2.591761315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:31:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:31:32.53803882 +0000 UTC m=+317.938602890" watchObservedRunningTime="2026-07-21 17:31:32.539537745 +0000 UTC m=+317.940101817"
Jul 21 17:31:33.115450 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.115416    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-77f648d694-m9lz7"]
Jul 21 17:31:33.117583 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.117568    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-m9lz7"
Jul 21 17:31:33.119834 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.119809    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\""
Jul 21 17:31:33.120082 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.120060    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\""
Jul 21 17:31:33.120241 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.120221    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-zn7p2\""
Jul 21 17:31:33.131098 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.131073    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-m9lz7"]
Jul 21 17:31:33.135904 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.135884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/37f3df78-e7dd-4979-b3e0-0e976f8a6cf0-certificates\") pod \"keda-operator-77f648d694-m9lz7\" (UID: \"37f3df78-e7dd-4979-b3e0-0e976f8a6cf0\") " pod="openshift-keda/keda-operator-77f648d694-m9lz7"
Jul 21 17:31:33.135993 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.135912    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/37f3df78-e7dd-4979-b3e0-0e976f8a6cf0-cabundle0\") pod \"keda-operator-77f648d694-m9lz7\" (UID: \"37f3df78-e7dd-4979-b3e0-0e976f8a6cf0\") " pod="openshift-keda/keda-operator-77f648d694-m9lz7"
Jul 21 17:31:33.135993 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.135934    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85cq4\" (UniqueName: \"kubernetes.io/projected/37f3df78-e7dd-4979-b3e0-0e976f8a6cf0-kube-api-access-85cq4\") pod \"keda-operator-77f648d694-m9lz7\" (UID: \"37f3df78-e7dd-4979-b3e0-0e976f8a6cf0\") " pod="openshift-keda/keda-operator-77f648d694-m9lz7"
Jul 21 17:31:33.236490 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.236460    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/37f3df78-e7dd-4979-b3e0-0e976f8a6cf0-certificates\") pod \"keda-operator-77f648d694-m9lz7\" (UID: \"37f3df78-e7dd-4979-b3e0-0e976f8a6cf0\") " pod="openshift-keda/keda-operator-77f648d694-m9lz7"
Jul 21 17:31:33.236490 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.236486    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/37f3df78-e7dd-4979-b3e0-0e976f8a6cf0-cabundle0\") pod \"keda-operator-77f648d694-m9lz7\" (UID: \"37f3df78-e7dd-4979-b3e0-0e976f8a6cf0\") " pod="openshift-keda/keda-operator-77f648d694-m9lz7"
Jul 21 17:31:33.236668 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.236510    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85cq4\" (UniqueName: \"kubernetes.io/projected/37f3df78-e7dd-4979-b3e0-0e976f8a6cf0-kube-api-access-85cq4\") pod \"keda-operator-77f648d694-m9lz7\" (UID: \"37f3df78-e7dd-4979-b3e0-0e976f8a6cf0\") " pod="openshift-keda/keda-operator-77f648d694-m9lz7"
Jul 21 17:31:33.236668 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:31:33.236606    2581 projected.go:266] Couldn't get secret openshift-keda/keda-operator-certs: secret "keda-operator-certs" not found
Jul 21 17:31:33.236668 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:31:33.236626    2581 secret.go:281] references non-existent secret key: ca.crt
Jul 21 17:31:33.236668 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:31:33.236633    2581 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt
Jul 21 17:31:33.236668 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:31:33.236646    2581 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-77f648d694-m9lz7: [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Jul 21 17:31:33.236965 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:31:33.236697    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37f3df78-e7dd-4979-b3e0-0e976f8a6cf0-certificates podName:37f3df78-e7dd-4979-b3e0-0e976f8a6cf0 nodeName:}" failed. No retries permitted until 2026-07-21 17:31:33.736682293 +0000 UTC m=+319.137246346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/37f3df78-e7dd-4979-b3e0-0e976f8a6cf0-certificates") pod "keda-operator-77f648d694-m9lz7" (UID: "37f3df78-e7dd-4979-b3e0-0e976f8a6cf0") : [secret "keda-operator-certs" not found, references non-existent secret key: ca.crt]
Jul 21 17:31:33.237114 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.237095    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/37f3df78-e7dd-4979-b3e0-0e976f8a6cf0-cabundle0\") pod \"keda-operator-77f648d694-m9lz7\" (UID: \"37f3df78-e7dd-4979-b3e0-0e976f8a6cf0\") " pod="openshift-keda/keda-operator-77f648d694-m9lz7"
Jul 21 17:31:33.247710 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.247688    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85cq4\" (UniqueName: \"kubernetes.io/projected/37f3df78-e7dd-4979-b3e0-0e976f8a6cf0-kube-api-access-85cq4\") pod \"keda-operator-77f648d694-m9lz7\" (UID: \"37f3df78-e7dd-4979-b3e0-0e976f8a6cf0\") " pod="openshift-keda/keda-operator-77f648d694-m9lz7"
Jul 21 17:31:33.325962 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.325930    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-z9v2t"]
Jul 21 17:31:33.328390 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.328376    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-z9v2t"
Jul 21 17:31:33.330733 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.330716    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-metrics-apiserver-certs\""
Jul 21 17:31:33.336913 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.336891    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/f7374e98-2681-4634-a294-3303d724edc7-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-z9v2t\" (UID: \"f7374e98-2681-4634-a294-3303d724edc7\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-z9v2t"
Jul 21 17:31:33.336998 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.336925    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk8sl\" (UniqueName: \"kubernetes.io/projected/f7374e98-2681-4634-a294-3303d724edc7-kube-api-access-nk8sl\") pod \"keda-metrics-apiserver-55557df8c-z9v2t\" (UID: \"f7374e98-2681-4634-a294-3303d724edc7\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-z9v2t"
Jul 21 17:31:33.337041 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.337012    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f7374e98-2681-4634-a294-3303d724edc7-certificates\") pod \"keda-metrics-apiserver-55557df8c-z9v2t\" (UID: \"f7374e98-2681-4634-a294-3303d724edc7\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-z9v2t"
Jul 21 17:31:33.340921 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.340902    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-z9v2t"]
Jul 21 17:31:33.437636 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.437561    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk8sl\" (UniqueName: \"kubernetes.io/projected/f7374e98-2681-4634-a294-3303d724edc7-kube-api-access-nk8sl\") pod \"keda-metrics-apiserver-55557df8c-z9v2t\" (UID: \"f7374e98-2681-4634-a294-3303d724edc7\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-z9v2t"
Jul 21 17:31:33.437773 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.437664    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f7374e98-2681-4634-a294-3303d724edc7-certificates\") pod \"keda-metrics-apiserver-55557df8c-z9v2t\" (UID: \"f7374e98-2681-4634-a294-3303d724edc7\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-z9v2t"
Jul 21 17:31:33.437773 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.437749    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/f7374e98-2681-4634-a294-3303d724edc7-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-z9v2t\" (UID: \"f7374e98-2681-4634-a294-3303d724edc7\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-z9v2t"
Jul 21 17:31:33.437898 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:31:33.437834    2581 projected.go:266] Couldn't get secret openshift-keda/keda-metrics-apiserver-certs: secret "keda-metrics-apiserver-certs" not found
Jul 21 17:31:33.437898 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:31:33.437863    2581 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-metrics-apiserver-55557df8c-z9v2t: secret "keda-metrics-apiserver-certs" not found
Jul 21 17:31:33.437993 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:31:33.437930    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f7374e98-2681-4634-a294-3303d724edc7-certificates podName:f7374e98-2681-4634-a294-3303d724edc7 nodeName:}" failed. No retries permitted until 2026-07-21 17:31:33.937909999 +0000 UTC m=+319.338474053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/f7374e98-2681-4634-a294-3303d724edc7-certificates") pod "keda-metrics-apiserver-55557df8c-z9v2t" (UID: "f7374e98-2681-4634-a294-3303d724edc7") : secret "keda-metrics-apiserver-certs" not found
Jul 21 17:31:33.438200 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.438151    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"temp-vol\" (UniqueName: \"kubernetes.io/empty-dir/f7374e98-2681-4634-a294-3303d724edc7-temp-vol\") pod \"keda-metrics-apiserver-55557df8c-z9v2t\" (UID: \"f7374e98-2681-4634-a294-3303d724edc7\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-z9v2t"
Jul 21 17:31:33.449208 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.449186    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk8sl\" (UniqueName: \"kubernetes.io/projected/f7374e98-2681-4634-a294-3303d724edc7-kube-api-access-nk8sl\") pod \"keda-metrics-apiserver-55557df8c-z9v2t\" (UID: \"f7374e98-2681-4634-a294-3303d724edc7\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-z9v2t"
Jul 21 17:31:33.526324 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.526300    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-8llfq"]
Jul 21 17:31:33.528530 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.528515    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-8llfq"
Jul 21 17:31:33.531060 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.531035    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\""
Jul 21 17:31:33.538146 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.538121    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e05a9139-c9e2-46e1-a9de-499e9c5185c9-certificates\") pod \"keda-admission-56f9798bb4-8llfq\" (UID: \"e05a9139-c9e2-46e1-a9de-499e9c5185c9\") " pod="openshift-keda/keda-admission-56f9798bb4-8llfq"
Jul 21 17:31:33.538254 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.538218    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xqlr\" (UniqueName: \"kubernetes.io/projected/e05a9139-c9e2-46e1-a9de-499e9c5185c9-kube-api-access-7xqlr\") pod \"keda-admission-56f9798bb4-8llfq\" (UID: \"e05a9139-c9e2-46e1-a9de-499e9c5185c9\") " pod="openshift-keda/keda-admission-56f9798bb4-8llfq"
Jul 21 17:31:33.540982 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.540941    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-8llfq"]
Jul 21 17:31:33.639022 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.638996    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e05a9139-c9e2-46e1-a9de-499e9c5185c9-certificates\") pod \"keda-admission-56f9798bb4-8llfq\" (UID: \"e05a9139-c9e2-46e1-a9de-499e9c5185c9\") " pod="openshift-keda/keda-admission-56f9798bb4-8llfq"
Jul 21 17:31:33.639135 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.639045    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xqlr\" (UniqueName: \"kubernetes.io/projected/e05a9139-c9e2-46e1-a9de-499e9c5185c9-kube-api-access-7xqlr\") pod \"keda-admission-56f9798bb4-8llfq\" (UID: \"e05a9139-c9e2-46e1-a9de-499e9c5185c9\") " pod="openshift-keda/keda-admission-56f9798bb4-8llfq"
Jul 21 17:31:33.639200 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:31:33.639135    2581 projected.go:266] Couldn't get secret openshift-keda/keda-admission-webhooks-certs: secret "keda-admission-webhooks-certs" not found
Jul 21 17:31:33.639200 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:31:33.639158    2581 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-admission-56f9798bb4-8llfq: secret "keda-admission-webhooks-certs" not found
Jul 21 17:31:33.639276 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:31:33.639228    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e05a9139-c9e2-46e1-a9de-499e9c5185c9-certificates podName:e05a9139-c9e2-46e1-a9de-499e9c5185c9 nodeName:}" failed. No retries permitted until 2026-07-21 17:31:34.139213233 +0000 UTC m=+319.539777282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/e05a9139-c9e2-46e1-a9de-499e9c5185c9-certificates") pod "keda-admission-56f9798bb4-8llfq" (UID: "e05a9139-c9e2-46e1-a9de-499e9c5185c9") : secret "keda-admission-webhooks-certs" not found
Jul 21 17:31:33.650951 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.650924    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xqlr\" (UniqueName: \"kubernetes.io/projected/e05a9139-c9e2-46e1-a9de-499e9c5185c9-kube-api-access-7xqlr\") pod \"keda-admission-56f9798bb4-8llfq\" (UID: \"e05a9139-c9e2-46e1-a9de-499e9c5185c9\") " pod="openshift-keda/keda-admission-56f9798bb4-8llfq"
Jul 21 17:31:33.739457 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.739397    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/37f3df78-e7dd-4979-b3e0-0e976f8a6cf0-certificates\") pod \"keda-operator-77f648d694-m9lz7\" (UID: \"37f3df78-e7dd-4979-b3e0-0e976f8a6cf0\") " pod="openshift-keda/keda-operator-77f648d694-m9lz7"
Jul 21 17:31:33.741857 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.741838    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/37f3df78-e7dd-4979-b3e0-0e976f8a6cf0-certificates\") pod \"keda-operator-77f648d694-m9lz7\" (UID: \"37f3df78-e7dd-4979-b3e0-0e976f8a6cf0\") " pod="openshift-keda/keda-operator-77f648d694-m9lz7"
Jul 21 17:31:33.940999 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.940970    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f7374e98-2681-4634-a294-3303d724edc7-certificates\") pod \"keda-metrics-apiserver-55557df8c-z9v2t\" (UID: \"f7374e98-2681-4634-a294-3303d724edc7\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-z9v2t"
Jul 21 17:31:33.943533 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:33.943517    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f7374e98-2681-4634-a294-3303d724edc7-certificates\") pod \"keda-metrics-apiserver-55557df8c-z9v2t\" (UID: \"f7374e98-2681-4634-a294-3303d724edc7\") " pod="openshift-keda/keda-metrics-apiserver-55557df8c-z9v2t"
Jul 21 17:31:34.027891 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:34.027865    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-77f648d694-m9lz7"
Jul 21 17:31:34.143231 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:34.143204    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e05a9139-c9e2-46e1-a9de-499e9c5185c9-certificates\") pod \"keda-admission-56f9798bb4-8llfq\" (UID: \"e05a9139-c9e2-46e1-a9de-499e9c5185c9\") " pod="openshift-keda/keda-admission-56f9798bb4-8llfq"
Jul 21 17:31:34.145859 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:34.145833    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/e05a9139-c9e2-46e1-a9de-499e9c5185c9-certificates\") pod \"keda-admission-56f9798bb4-8llfq\" (UID: \"e05a9139-c9e2-46e1-a9de-499e9c5185c9\") " pod="openshift-keda/keda-admission-56f9798bb4-8llfq"
Jul 21 17:31:34.158016 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:34.158002    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-77f648d694-m9lz7"]
Jul 21 17:31:34.160273 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:31:34.160245    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f3df78_e7dd_4979_b3e0_0e976f8a6cf0.slice/crio-a04f3dc3c42d6464fa47dfaf721f91b3ded1fea4e525c162c9343cec1c8c19ee WatchSource:0}: Error finding container a04f3dc3c42d6464fa47dfaf721f91b3ded1fea4e525c162c9343cec1c8c19ee: Status 404 returned error can't find the container with id a04f3dc3c42d6464fa47dfaf721f91b3ded1fea4e525c162c9343cec1c8c19ee
Jul 21 17:31:34.238753 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:34.238732    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-metrics-apiserver-55557df8c-z9v2t"
Jul 21 17:31:34.369189 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:34.369142    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-metrics-apiserver-55557df8c-z9v2t"]
Jul 21 17:31:34.371362 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:31:34.371336    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7374e98_2681_4634_a294_3303d724edc7.slice/crio-94b309f6cb2beecfeb78c0be9b3dd5a669cffee32291e5f374eb2d59900b8b75 WatchSource:0}: Error finding container 94b309f6cb2beecfeb78c0be9b3dd5a669cffee32291e5f374eb2d59900b8b75: Status 404 returned error can't find the container with id 94b309f6cb2beecfeb78c0be9b3dd5a669cffee32291e5f374eb2d59900b8b75
Jul 21 17:31:34.437790 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:34.437763    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-56f9798bb4-8llfq"
Jul 21 17:31:34.529783 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:34.529734    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-m9lz7" event={"ID":"37f3df78-e7dd-4979-b3e0-0e976f8a6cf0","Type":"ContainerStarted","Data":"a04f3dc3c42d6464fa47dfaf721f91b3ded1fea4e525c162c9343cec1c8c19ee"}
Jul 21 17:31:34.531138 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:34.531101    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-z9v2t" event={"ID":"f7374e98-2681-4634-a294-3303d724edc7","Type":"ContainerStarted","Data":"94b309f6cb2beecfeb78c0be9b3dd5a669cffee32291e5f374eb2d59900b8b75"}
Jul 21 17:31:34.565838 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:34.565814    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-56f9798bb4-8llfq"]
Jul 21 17:31:34.567997 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:31:34.567971    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode05a9139_c9e2_46e1_a9de_499e9c5185c9.slice/crio-a2af0b786a19467c8a6b15c7cafa93939473e329e3ca53f00c7f9c03c30a58b7 WatchSource:0}: Error finding container a2af0b786a19467c8a6b15c7cafa93939473e329e3ca53f00c7f9c03c30a58b7: Status 404 returned error can't find the container with id a2af0b786a19467c8a6b15c7cafa93939473e329e3ca53f00c7f9c03c30a58b7
Jul 21 17:31:35.538228 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:35.538189    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-8llfq" event={"ID":"e05a9139-c9e2-46e1-a9de-499e9c5185c9","Type":"ContainerStarted","Data":"a2af0b786a19467c8a6b15c7cafa93939473e329e3ca53f00c7f9c03c30a58b7"}
Jul 21 17:31:37.550835 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:37.550804    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-56f9798bb4-8llfq" event={"ID":"e05a9139-c9e2-46e1-a9de-499e9c5185c9","Type":"ContainerStarted","Data":"c4199b9a1fe30c21465ebacbc744d80fa1bc66d0f77a951b9955888e57f2db0c"}
Jul 21 17:31:37.551274 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:37.550879    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-56f9798bb4-8llfq"
Jul 21 17:31:37.569972 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:37.569922    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-56f9798bb4-8llfq" podStartSLOduration=2.533347502 podStartE2EDuration="4.569907555s" totalImagesPullingTime="2.036560053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:31:37.568560439 +0000 UTC m=+322.969124545" watchObservedRunningTime="2026-07-21 17:31:37.569907555 +0000 UTC m=+322.970471625"
Jul 21 17:31:39.560228 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:39.560189    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-metrics-apiserver-55557df8c-z9v2t" event={"ID":"f7374e98-2681-4634-a294-3303d724edc7","Type":"ContainerStarted","Data":"97e786d448f33105be15ad50ae7d8651db32eaa5dbdd284c1d4f7aeddef54682"}
Jul 21 17:31:39.560711 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:39.560296    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-z9v2t"
Jul 21 17:31:39.561836 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:39.561814    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-77f648d694-m9lz7" event={"ID":"37f3df78-e7dd-4979-b3e0-0e976f8a6cf0","Type":"ContainerStarted","Data":"1a9674bed45061b1eef4a256c11abb8356d55579d04863938e8c72dd9bb9bf51"}
Jul 21 17:31:39.561984 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:39.561970    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-77f648d694-m9lz7"
Jul 21 17:31:39.579890 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:39.579850    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-metrics-apiserver-55557df8c-z9v2t" podStartSLOduration=2.43471876 podStartE2EDuration="6.57983897s" totalImagesPullingTime="4.14512021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:31:39.579546749 +0000 UTC m=+324.980110822" watchObservedRunningTime="2026-07-21 17:31:39.57983897 +0000 UTC m=+324.980403032"
Jul 21 17:31:50.569994 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:50.569966    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-metrics-apiserver-55557df8c-z9v2t"
Jul 21 17:31:50.587567 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:50.587517    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-77f648d694-m9lz7" podStartSLOduration=13.230760503 podStartE2EDuration="17.587503655s" totalImagesPullingTime="4.356743152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:31:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:31:39.597583082 +0000 UTC m=+324.998147206" watchObservedRunningTime="2026-07-21 17:31:50.587503655 +0000 UTC m=+335.988067725"
Jul 21 17:31:53.525053 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:53.525025    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-6969cb7dfb-2d7js"
Jul 21 17:31:58.556804 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:31:58.556770    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-56f9798bb4-8llfq"
Jul 21 17:32:00.568122 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:00.568091    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-77f648d694-m9lz7"
Jul 21 17:32:51.907535 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:51.907506    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-6b69bf598b-vl6pf"]
Jul 21 17:32:51.909714 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:51.909694    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6b69bf598b-vl6pf"
Jul 21 17:32:51.913510 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:51.913484    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-24thm\""
Jul 21 17:32:51.913510 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:51.913508    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\""
Jul 21 17:32:51.913510 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:51.913516    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\""
Jul 21 17:32:51.913737 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:51.913525    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\""
Jul 21 17:32:51.915034 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:51.915013    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-2gcz7"]
Jul 21 17:32:51.917383 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:51.917368    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-2gcz7"
Jul 21 17:32:51.920201 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:51.920155    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\""
Jul 21 17:32:51.920463 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:51.920449    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-4bf7x\""
Jul 21 17:32:51.922803 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:51.922785    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6b69bf598b-vl6pf"]
Jul 21 17:32:51.936998 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:51.936973    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-2gcz7"]
Jul 21 17:32:51.946054 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:51.946025    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxshx\" (UniqueName: \"kubernetes.io/projected/253c5827-1ddc-44ae-be00-1db49031afde-kube-api-access-jxshx\") pod \"kserve-controller-manager-6b69bf598b-vl6pf\" (UID: \"253c5827-1ddc-44ae-be00-1db49031afde\") " pod="kserve/kserve-controller-manager-6b69bf598b-vl6pf"
Jul 21 17:32:51.946155 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:51.946067    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/253c5827-1ddc-44ae-be00-1db49031afde-cert\") pod \"kserve-controller-manager-6b69bf598b-vl6pf\" (UID: \"253c5827-1ddc-44ae-be00-1db49031afde\") " pod="kserve/kserve-controller-manager-6b69bf598b-vl6pf"
Jul 21 17:32:51.946155 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:51.946097    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c83e437-c5c8-433a-9dc2-8472fc4e722b-cert\") pod \"llmisvc-controller-manager-654c557856-2gcz7\" (UID: \"5c83e437-c5c8-433a-9dc2-8472fc4e722b\") " pod="kserve/llmisvc-controller-manager-654c557856-2gcz7"
Jul 21 17:32:51.946291 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:51.946269    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2ms5\" (UniqueName: \"kubernetes.io/projected/5c83e437-c5c8-433a-9dc2-8472fc4e722b-kube-api-access-w2ms5\") pod \"llmisvc-controller-manager-654c557856-2gcz7\" (UID: \"5c83e437-c5c8-433a-9dc2-8472fc4e722b\") " pod="kserve/llmisvc-controller-manager-654c557856-2gcz7"
Jul 21 17:32:51.954753 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:51.954729    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-sbcfr"]
Jul 21 17:32:51.957436 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:51.957420    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-sbcfr"
Jul 21 17:32:51.960215 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:51.960199    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-xsj9q\""
Jul 21 17:32:51.960404 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:51.960389    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\""
Jul 21 17:32:51.965084 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:51.965064    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-sbcfr"]
Jul 21 17:32:52.046971 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.046941    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2ms5\" (UniqueName: \"kubernetes.io/projected/5c83e437-c5c8-433a-9dc2-8472fc4e722b-kube-api-access-w2ms5\") pod \"llmisvc-controller-manager-654c557856-2gcz7\" (UID: \"5c83e437-c5c8-433a-9dc2-8472fc4e722b\") " pod="kserve/llmisvc-controller-manager-654c557856-2gcz7"
Jul 21 17:32:52.047095 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.046992    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxshx\" (UniqueName: \"kubernetes.io/projected/253c5827-1ddc-44ae-be00-1db49031afde-kube-api-access-jxshx\") pod \"kserve-controller-manager-6b69bf598b-vl6pf\" (UID: \"253c5827-1ddc-44ae-be00-1db49031afde\") " pod="kserve/kserve-controller-manager-6b69bf598b-vl6pf"
Jul 21 17:32:52.047095 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.047022    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr7sf\" (UniqueName: \"kubernetes.io/projected/b149c0e9-4bda-4d29-93bd-b8b74664dd6e-kube-api-access-vr7sf\") pod \"seaweedfs-64568bcd49-sbcfr\" (UID: \"b149c0e9-4bda-4d29-93bd-b8b74664dd6e\") " pod="kserve/seaweedfs-64568bcd49-sbcfr"
Jul 21 17:32:52.047095 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.047054    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b149c0e9-4bda-4d29-93bd-b8b74664dd6e-data\") pod \"seaweedfs-64568bcd49-sbcfr\" (UID: \"b149c0e9-4bda-4d29-93bd-b8b74664dd6e\") " pod="kserve/seaweedfs-64568bcd49-sbcfr"
Jul 21 17:32:52.047281 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.047119    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/253c5827-1ddc-44ae-be00-1db49031afde-cert\") pod \"kserve-controller-manager-6b69bf598b-vl6pf\" (UID: \"253c5827-1ddc-44ae-be00-1db49031afde\") " pod="kserve/kserve-controller-manager-6b69bf598b-vl6pf"
Jul 21 17:32:52.047281 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.047154    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c83e437-c5c8-433a-9dc2-8472fc4e722b-cert\") pod \"llmisvc-controller-manager-654c557856-2gcz7\" (UID: \"5c83e437-c5c8-433a-9dc2-8472fc4e722b\") " pod="kserve/llmisvc-controller-manager-654c557856-2gcz7"
Jul 21 17:32:52.047281 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:32:52.047244    2581 secret.go:189] Couldn't get secret kserve/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 21 17:32:52.047381 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:32:52.047297    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c83e437-c5c8-433a-9dc2-8472fc4e722b-cert podName:5c83e437-c5c8-433a-9dc2-8472fc4e722b nodeName:}" failed. No retries permitted until 2026-07-21 17:32:52.54727989 +0000 UTC m=+397.947843940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5c83e437-c5c8-433a-9dc2-8472fc4e722b-cert") pod "llmisvc-controller-manager-654c557856-2gcz7" (UID: "5c83e437-c5c8-433a-9dc2-8472fc4e722b") : secret "llmisvc-webhook-server-cert" not found
Jul 21 17:32:52.049593 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.049574    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/253c5827-1ddc-44ae-be00-1db49031afde-cert\") pod \"kserve-controller-manager-6b69bf598b-vl6pf\" (UID: \"253c5827-1ddc-44ae-be00-1db49031afde\") " pod="kserve/kserve-controller-manager-6b69bf598b-vl6pf"
Jul 21 17:32:52.061193 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.061146    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxshx\" (UniqueName: \"kubernetes.io/projected/253c5827-1ddc-44ae-be00-1db49031afde-kube-api-access-jxshx\") pod \"kserve-controller-manager-6b69bf598b-vl6pf\" (UID: \"253c5827-1ddc-44ae-be00-1db49031afde\") " pod="kserve/kserve-controller-manager-6b69bf598b-vl6pf"
Jul 21 17:32:52.062263 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.062247    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2ms5\" (UniqueName: \"kubernetes.io/projected/5c83e437-c5c8-433a-9dc2-8472fc4e722b-kube-api-access-w2ms5\") pod \"llmisvc-controller-manager-654c557856-2gcz7\" (UID: \"5c83e437-c5c8-433a-9dc2-8472fc4e722b\") " pod="kserve/llmisvc-controller-manager-654c557856-2gcz7"
Jul 21 17:32:52.147818 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.147793    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr7sf\" (UniqueName: \"kubernetes.io/projected/b149c0e9-4bda-4d29-93bd-b8b74664dd6e-kube-api-access-vr7sf\") pod \"seaweedfs-64568bcd49-sbcfr\" (UID: \"b149c0e9-4bda-4d29-93bd-b8b74664dd6e\") " pod="kserve/seaweedfs-64568bcd49-sbcfr"
Jul 21 17:32:52.147941 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.147825    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b149c0e9-4bda-4d29-93bd-b8b74664dd6e-data\") pod \"seaweedfs-64568bcd49-sbcfr\" (UID: \"b149c0e9-4bda-4d29-93bd-b8b74664dd6e\") " pod="kserve/seaweedfs-64568bcd49-sbcfr"
Jul 21 17:32:52.148146 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.148130    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b149c0e9-4bda-4d29-93bd-b8b74664dd6e-data\") pod \"seaweedfs-64568bcd49-sbcfr\" (UID: \"b149c0e9-4bda-4d29-93bd-b8b74664dd6e\") " pod="kserve/seaweedfs-64568bcd49-sbcfr"
Jul 21 17:32:52.161432 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.161386    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr7sf\" (UniqueName: \"kubernetes.io/projected/b149c0e9-4bda-4d29-93bd-b8b74664dd6e-kube-api-access-vr7sf\") pod \"seaweedfs-64568bcd49-sbcfr\" (UID: \"b149c0e9-4bda-4d29-93bd-b8b74664dd6e\") " pod="kserve/seaweedfs-64568bcd49-sbcfr"
Jul 21 17:32:52.220261 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.220236    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6b69bf598b-vl6pf"
Jul 21 17:32:52.267659 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.267632    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-sbcfr"
Jul 21 17:32:52.356865 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.356411    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6b69bf598b-vl6pf"]
Jul 21 17:32:52.358912 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:32:52.358887    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod253c5827_1ddc_44ae_be00_1db49031afde.slice/crio-c1c83550a81f6476b53d567e47baeba2fd9fd521f3dc2608b65ddd93a8c18470 WatchSource:0}: Error finding container c1c83550a81f6476b53d567e47baeba2fd9fd521f3dc2608b65ddd93a8c18470: Status 404 returned error can't find the container with id c1c83550a81f6476b53d567e47baeba2fd9fd521f3dc2608b65ddd93a8c18470
Jul 21 17:32:52.409381 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.409353    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-sbcfr"]
Jul 21 17:32:52.411896 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:32:52.411848    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb149c0e9_4bda_4d29_93bd_b8b74664dd6e.slice/crio-c1bb60e4fc00b5a30c4759879e32deae88fdcfa2d229593179e28c2a436fb9e2 WatchSource:0}: Error finding container c1bb60e4fc00b5a30c4759879e32deae88fdcfa2d229593179e28c2a436fb9e2: Status 404 returned error can't find the container with id c1bb60e4fc00b5a30c4759879e32deae88fdcfa2d229593179e28c2a436fb9e2
Jul 21 17:32:52.550398 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.550369    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c83e437-c5c8-433a-9dc2-8472fc4e722b-cert\") pod \"llmisvc-controller-manager-654c557856-2gcz7\" (UID: \"5c83e437-c5c8-433a-9dc2-8472fc4e722b\") " pod="kserve/llmisvc-controller-manager-654c557856-2gcz7"
Jul 21 17:32:52.552771 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.552750    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5c83e437-c5c8-433a-9dc2-8472fc4e722b-cert\") pod \"llmisvc-controller-manager-654c557856-2gcz7\" (UID: \"5c83e437-c5c8-433a-9dc2-8472fc4e722b\") " pod="kserve/llmisvc-controller-manager-654c557856-2gcz7"
Jul 21 17:32:52.827497 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.827473    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-654c557856-2gcz7"
Jul 21 17:32:52.882279 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.882224    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6b69bf598b-vl6pf" event={"ID":"253c5827-1ddc-44ae-be00-1db49031afde","Type":"ContainerStarted","Data":"c1c83550a81f6476b53d567e47baeba2fd9fd521f3dc2608b65ddd93a8c18470"}
Jul 21 17:32:52.884533 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.883857    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-sbcfr" event={"ID":"b149c0e9-4bda-4d29-93bd-b8b74664dd6e","Type":"ContainerStarted","Data":"c1bb60e4fc00b5a30c4759879e32deae88fdcfa2d229593179e28c2a436fb9e2"}
Jul 21 17:32:52.985385 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:52.985093    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-654c557856-2gcz7"]
Jul 21 17:32:52.988235 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:32:52.988155    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5c83e437_c5c8_433a_9dc2_8472fc4e722b.slice/crio-9275504fd67a98fa3af04fc18b8f41c72551e3a92dab7c783f0fb547c15f9a16 WatchSource:0}: Error finding container 9275504fd67a98fa3af04fc18b8f41c72551e3a92dab7c783f0fb547c15f9a16: Status 404 returned error can't find the container with id 9275504fd67a98fa3af04fc18b8f41c72551e3a92dab7c783f0fb547c15f9a16
Jul 21 17:32:53.894070 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:53.894025    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-2gcz7" event={"ID":"5c83e437-c5c8-433a-9dc2-8472fc4e722b","Type":"ContainerStarted","Data":"9275504fd67a98fa3af04fc18b8f41c72551e3a92dab7c783f0fb547c15f9a16"}
Jul 21 17:32:57.915339 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:57.915305    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6b69bf598b-vl6pf" event={"ID":"253c5827-1ddc-44ae-be00-1db49031afde","Type":"ContainerStarted","Data":"14fc7ae0224067c63f0aaeee3eb8cd5b7d199363793bbbff31dc567f45951a99"}
Jul 21 17:32:57.915784 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:57.915488    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-6b69bf598b-vl6pf"
Jul 21 17:32:57.916863 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:57.916835    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-sbcfr" event={"ID":"b149c0e9-4bda-4d29-93bd-b8b74664dd6e","Type":"ContainerStarted","Data":"57fb4d806591cacf1ca7ecb6b6e475b3478db375d18da9832cbb36acb50bbfa9"}
Jul 21 17:32:57.916959 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:57.916938    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-sbcfr"
Jul 21 17:32:57.918219 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:57.918197    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-654c557856-2gcz7" event={"ID":"5c83e437-c5c8-433a-9dc2-8472fc4e722b","Type":"ContainerStarted","Data":"a000a91ef32f522bdbf56d5ccc2325fcb25a1ad1295759efce4d6e34e7d42537"}
Jul 21 17:32:57.918312 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:57.918242    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-654c557856-2gcz7"
Jul 21 17:32:57.935327 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:57.935286    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-6b69bf598b-vl6pf" podStartSLOduration=2.867706904 podStartE2EDuration="6.935271806s" totalImagesPullingTime="4.067564902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:32:57.934439687 +0000 UTC m=+403.335003792" watchObservedRunningTime="2026-07-21 17:32:57.935271806 +0000 UTC m=+403.335835877"
Jul 21 17:32:57.954525 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:57.954479    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-654c557856-2gcz7" podStartSLOduration=2.777082604 podStartE2EDuration="6.954462684s" totalImagesPullingTime="4.17738008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:32:57.95345398 +0000 UTC m=+403.354018066" watchObservedRunningTime="2026-07-21 17:32:57.954462684 +0000 UTC m=+403.355026757"
Jul 21 17:32:57.972298 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:32:57.972262    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-sbcfr" podStartSLOduration=2.24631687 podStartE2EDuration="6.972251441s" totalImagesPullingTime="4.725934571s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:32:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:32:57.97074205 +0000 UTC m=+403.371306142" watchObservedRunningTime="2026-07-21 17:32:57.972251441 +0000 UTC m=+403.372815512"
Jul 21 17:33:03.924692 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:03.924662    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-sbcfr"
Jul 21 17:33:28.925079 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:28.925049    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-654c557856-2gcz7"
Jul 21 17:33:28.928187 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:28.928143    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-6b69bf598b-vl6pf"
Jul 21 17:33:36.797290 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:36.797197    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-6b69bf598b-vl6pf"]
Jul 21 17:33:36.797775 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:36.797433    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve/kserve-controller-manager-6b69bf598b-vl6pf" podUID="253c5827-1ddc-44ae-be00-1db49031afde" containerName="manager" containerID="cri-o://14fc7ae0224067c63f0aaeee3eb8cd5b7d199363793bbbff31dc567f45951a99" gracePeriod=10
Jul 21 17:33:36.815564 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:36.815539    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-6b69bf598b-znmjs"]
Jul 21 17:33:36.818226 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:36.818206    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6b69bf598b-znmjs"
Jul 21 17:33:36.829217 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:36.829195    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6b69bf598b-znmjs"]
Jul 21 17:33:36.915532 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:36.915512    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecc53b5a-be74-4b17-b450-ca1b76e46aa7-cert\") pod \"kserve-controller-manager-6b69bf598b-znmjs\" (UID: \"ecc53b5a-be74-4b17-b450-ca1b76e46aa7\") " pod="kserve/kserve-controller-manager-6b69bf598b-znmjs"
Jul 21 17:33:36.915664 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:36.915546    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2s22\" (UniqueName: \"kubernetes.io/projected/ecc53b5a-be74-4b17-b450-ca1b76e46aa7-kube-api-access-d2s22\") pod \"kserve-controller-manager-6b69bf598b-znmjs\" (UID: \"ecc53b5a-be74-4b17-b450-ca1b76e46aa7\") " pod="kserve/kserve-controller-manager-6b69bf598b-znmjs"
Jul 21 17:33:37.016612 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:37.016584    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecc53b5a-be74-4b17-b450-ca1b76e46aa7-cert\") pod \"kserve-controller-manager-6b69bf598b-znmjs\" (UID: \"ecc53b5a-be74-4b17-b450-ca1b76e46aa7\") " pod="kserve/kserve-controller-manager-6b69bf598b-znmjs"
Jul 21 17:33:37.016752 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:37.016630    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2s22\" (UniqueName: \"kubernetes.io/projected/ecc53b5a-be74-4b17-b450-ca1b76e46aa7-kube-api-access-d2s22\") pod \"kserve-controller-manager-6b69bf598b-znmjs\" (UID: \"ecc53b5a-be74-4b17-b450-ca1b76e46aa7\") " pod="kserve/kserve-controller-manager-6b69bf598b-znmjs"
Jul 21 17:33:37.019358 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:37.019338    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ecc53b5a-be74-4b17-b450-ca1b76e46aa7-cert\") pod \"kserve-controller-manager-6b69bf598b-znmjs\" (UID: \"ecc53b5a-be74-4b17-b450-ca1b76e46aa7\") " pod="kserve/kserve-controller-manager-6b69bf598b-znmjs"
Jul 21 17:33:37.025458 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:37.025426    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2s22\" (UniqueName: \"kubernetes.io/projected/ecc53b5a-be74-4b17-b450-ca1b76e46aa7-kube-api-access-d2s22\") pod \"kserve-controller-manager-6b69bf598b-znmjs\" (UID: \"ecc53b5a-be74-4b17-b450-ca1b76e46aa7\") " pod="kserve/kserve-controller-manager-6b69bf598b-znmjs"
Jul 21 17:33:37.039016 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:37.038996    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6b69bf598b-vl6pf"
Jul 21 17:33:37.097573 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:37.097497    2581 generic.go:356] "Generic (PLEG): container finished" podID="253c5827-1ddc-44ae-be00-1db49031afde" containerID="14fc7ae0224067c63f0aaeee3eb8cd5b7d199363793bbbff31dc567f45951a99" exitCode=0
Jul 21 17:33:37.097573 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:37.097537    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6b69bf598b-vl6pf"
Jul 21 17:33:37.097573 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:37.097555    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6b69bf598b-vl6pf" event={"ID":"253c5827-1ddc-44ae-be00-1db49031afde","Type":"ContainerDied","Data":"14fc7ae0224067c63f0aaeee3eb8cd5b7d199363793bbbff31dc567f45951a99"}
Jul 21 17:33:37.097818 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:37.097613    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6b69bf598b-vl6pf" event={"ID":"253c5827-1ddc-44ae-be00-1db49031afde","Type":"ContainerDied","Data":"c1c83550a81f6476b53d567e47baeba2fd9fd521f3dc2608b65ddd93a8c18470"}
Jul 21 17:33:37.097818 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:37.097648    2581 scope.go:117] "RemoveContainer" containerID="14fc7ae0224067c63f0aaeee3eb8cd5b7d199363793bbbff31dc567f45951a99"
Jul 21 17:33:37.106378 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:37.106360    2581 scope.go:117] "RemoveContainer" containerID="14fc7ae0224067c63f0aaeee3eb8cd5b7d199363793bbbff31dc567f45951a99"
Jul 21 17:33:37.106670 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:33:37.106647    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14fc7ae0224067c63f0aaeee3eb8cd5b7d199363793bbbff31dc567f45951a99\": container with ID starting with 14fc7ae0224067c63f0aaeee3eb8cd5b7d199363793bbbff31dc567f45951a99 not found: ID does not exist" containerID="14fc7ae0224067c63f0aaeee3eb8cd5b7d199363793bbbff31dc567f45951a99"
Jul 21 17:33:37.106744 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:37.106681    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14fc7ae0224067c63f0aaeee3eb8cd5b7d199363793bbbff31dc567f45951a99"} err="failed to get container status \"14fc7ae0224067c63f0aaeee3eb8cd5b7d199363793bbbff31dc567f45951a99\": rpc error: code = NotFound desc = could not find container \"14fc7ae0224067c63f0aaeee3eb8cd5b7d199363793bbbff31dc567f45951a99\": container with ID starting with 14fc7ae0224067c63f0aaeee3eb8cd5b7d199363793bbbff31dc567f45951a99 not found: ID does not exist"
Jul 21 17:33:37.117138 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:37.117109    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/253c5827-1ddc-44ae-be00-1db49031afde-cert\") pod \"253c5827-1ddc-44ae-be00-1db49031afde\" (UID: \"253c5827-1ddc-44ae-be00-1db49031afde\") "
Jul 21 17:33:37.117240 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:37.117217    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxshx\" (UniqueName: \"kubernetes.io/projected/253c5827-1ddc-44ae-be00-1db49031afde-kube-api-access-jxshx\") pod \"253c5827-1ddc-44ae-be00-1db49031afde\" (UID: \"253c5827-1ddc-44ae-be00-1db49031afde\") "
Jul 21 17:33:37.119268 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:37.119246    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/253c5827-1ddc-44ae-be00-1db49031afde-cert" (OuterVolumeSpecName: "cert") pod "253c5827-1ddc-44ae-be00-1db49031afde" (UID: "253c5827-1ddc-44ae-be00-1db49031afde"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:33:37.119268 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:37.119252    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/253c5827-1ddc-44ae-be00-1db49031afde-kube-api-access-jxshx" (OuterVolumeSpecName: "kube-api-access-jxshx") pod "253c5827-1ddc-44ae-be00-1db49031afde" (UID: "253c5827-1ddc-44ae-be00-1db49031afde"). InnerVolumeSpecName "kube-api-access-jxshx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:33:37.171902 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:37.171884    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-6b69bf598b-znmjs"
Jul 21 17:33:37.217958 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:37.217888    2581 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/253c5827-1ddc-44ae-be00-1db49031afde-cert\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:33:37.217958 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:37.217922    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxshx\" (UniqueName: \"kubernetes.io/projected/253c5827-1ddc-44ae-be00-1db49031afde-kube-api-access-jxshx\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:33:37.299832 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:37.299809    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-6b69bf598b-znmjs"]
Jul 21 17:33:37.302204 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:33:37.302160    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecc53b5a_be74_4b17_b450_ca1b76e46aa7.slice/crio-06bbd7068c44370fafa74c7ce3e0100775a7e2eb5387382f3a2798d7018d9d49 WatchSource:0}: Error finding container 06bbd7068c44370fafa74c7ce3e0100775a7e2eb5387382f3a2798d7018d9d49: Status 404 returned error can't find the container with id 06bbd7068c44370fafa74c7ce3e0100775a7e2eb5387382f3a2798d7018d9d49
Jul 21 17:33:37.412461 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:37.412394    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-6b69bf598b-vl6pf"]
Jul 21 17:33:37.416288 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:37.416267    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-6b69bf598b-vl6pf"]
Jul 21 17:33:38.104384 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:38.104353    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6b69bf598b-znmjs" event={"ID":"ecc53b5a-be74-4b17-b450-ca1b76e46aa7","Type":"ContainerStarted","Data":"a1f461bfb79f0ed44c34d10b71a5be51e32edf3d58a797d008cb2c4d5ad79715"}
Jul 21 17:33:38.104767 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:38.104406    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-6b69bf598b-znmjs" event={"ID":"ecc53b5a-be74-4b17-b450-ca1b76e46aa7","Type":"ContainerStarted","Data":"06bbd7068c44370fafa74c7ce3e0100775a7e2eb5387382f3a2798d7018d9d49"}
Jul 21 17:33:38.104767 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:38.104501    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-6b69bf598b-znmjs"
Jul 21 17:33:38.120572 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:38.120531    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-6b69bf598b-znmjs" podStartSLOduration=1.8051928689999999 podStartE2EDuration="2.12051812s" totalImagesPullingTime="315.325251ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:33:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:33:38.119716103 +0000 UTC m=+443.520280191" watchObservedRunningTime="2026-07-21 17:33:38.12051812 +0000 UTC m=+443.521082190"
Jul 21 17:33:39.124958 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:39.124930    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="253c5827-1ddc-44ae-be00-1db49031afde" path="/var/lib/kubelet/pods/253c5827-1ddc-44ae-be00-1db49031afde/volumes"
Jul 21 17:33:52.190360 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.190315    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5468bd6b95-9hmzp"]
Jul 21 17:33:52.190736 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.190659    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="253c5827-1ddc-44ae-be00-1db49031afde" containerName="manager"
Jul 21 17:33:52.190736 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.190669    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="253c5827-1ddc-44ae-be00-1db49031afde" containerName="manager"
Jul 21 17:33:52.190822 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.190739    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="253c5827-1ddc-44ae-be00-1db49031afde" containerName="manager"
Jul 21 17:33:52.192638 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.192621    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.206433 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.206410    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5468bd6b95-9hmzp"]
Jul 21 17:33:52.230423 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.230401    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0cf3182-0923-4eb9-90db-0ffcb6ab132a-trusted-ca-bundle\") pod \"console-5468bd6b95-9hmzp\" (UID: \"d0cf3182-0923-4eb9-90db-0ffcb6ab132a\") " pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.230533 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.230451    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0cf3182-0923-4eb9-90db-0ffcb6ab132a-console-oauth-config\") pod \"console-5468bd6b95-9hmzp\" (UID: \"d0cf3182-0923-4eb9-90db-0ffcb6ab132a\") " pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.230533 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.230473    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjl7b\" (UniqueName: \"kubernetes.io/projected/d0cf3182-0923-4eb9-90db-0ffcb6ab132a-kube-api-access-kjl7b\") pod \"console-5468bd6b95-9hmzp\" (UID: \"d0cf3182-0923-4eb9-90db-0ffcb6ab132a\") " pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.230533 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.230517    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0cf3182-0923-4eb9-90db-0ffcb6ab132a-console-config\") pod \"console-5468bd6b95-9hmzp\" (UID: \"d0cf3182-0923-4eb9-90db-0ffcb6ab132a\") " pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.230688 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.230536    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0cf3182-0923-4eb9-90db-0ffcb6ab132a-oauth-serving-cert\") pod \"console-5468bd6b95-9hmzp\" (UID: \"d0cf3182-0923-4eb9-90db-0ffcb6ab132a\") " pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.230688 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.230556    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0cf3182-0923-4eb9-90db-0ffcb6ab132a-console-serving-cert\") pod \"console-5468bd6b95-9hmzp\" (UID: \"d0cf3182-0923-4eb9-90db-0ffcb6ab132a\") " pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.230688 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.230625    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0cf3182-0923-4eb9-90db-0ffcb6ab132a-service-ca\") pod \"console-5468bd6b95-9hmzp\" (UID: \"d0cf3182-0923-4eb9-90db-0ffcb6ab132a\") " pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.331385 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.331356    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0cf3182-0923-4eb9-90db-0ffcb6ab132a-oauth-serving-cert\") pod \"console-5468bd6b95-9hmzp\" (UID: \"d0cf3182-0923-4eb9-90db-0ffcb6ab132a\") " pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.331497 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.331415    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0cf3182-0923-4eb9-90db-0ffcb6ab132a-console-serving-cert\") pod \"console-5468bd6b95-9hmzp\" (UID: \"d0cf3182-0923-4eb9-90db-0ffcb6ab132a\") " pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.331497 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.331457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0cf3182-0923-4eb9-90db-0ffcb6ab132a-service-ca\") pod \"console-5468bd6b95-9hmzp\" (UID: \"d0cf3182-0923-4eb9-90db-0ffcb6ab132a\") " pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.331497 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.331481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0cf3182-0923-4eb9-90db-0ffcb6ab132a-trusted-ca-bundle\") pod \"console-5468bd6b95-9hmzp\" (UID: \"d0cf3182-0923-4eb9-90db-0ffcb6ab132a\") " pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.331660 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.331550    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0cf3182-0923-4eb9-90db-0ffcb6ab132a-console-oauth-config\") pod \"console-5468bd6b95-9hmzp\" (UID: \"d0cf3182-0923-4eb9-90db-0ffcb6ab132a\") " pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.331660 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.331583    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjl7b\" (UniqueName: \"kubernetes.io/projected/d0cf3182-0923-4eb9-90db-0ffcb6ab132a-kube-api-access-kjl7b\") pod \"console-5468bd6b95-9hmzp\" (UID: \"d0cf3182-0923-4eb9-90db-0ffcb6ab132a\") " pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.331660 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.331623    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0cf3182-0923-4eb9-90db-0ffcb6ab132a-console-config\") pod \"console-5468bd6b95-9hmzp\" (UID: \"d0cf3182-0923-4eb9-90db-0ffcb6ab132a\") " pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.331932 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.331899    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0cf3182-0923-4eb9-90db-0ffcb6ab132a-oauth-serving-cert\") pod \"console-5468bd6b95-9hmzp\" (UID: \"d0cf3182-0923-4eb9-90db-0ffcb6ab132a\") " pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.332226 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.332199    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0cf3182-0923-4eb9-90db-0ffcb6ab132a-service-ca\") pod \"console-5468bd6b95-9hmzp\" (UID: \"d0cf3182-0923-4eb9-90db-0ffcb6ab132a\") " pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.332326 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.332310    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0cf3182-0923-4eb9-90db-0ffcb6ab132a-trusted-ca-bundle\") pod \"console-5468bd6b95-9hmzp\" (UID: \"d0cf3182-0923-4eb9-90db-0ffcb6ab132a\") " pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.332507 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.332488    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0cf3182-0923-4eb9-90db-0ffcb6ab132a-console-config\") pod \"console-5468bd6b95-9hmzp\" (UID: \"d0cf3182-0923-4eb9-90db-0ffcb6ab132a\") " pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.334042 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.334019    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0cf3182-0923-4eb9-90db-0ffcb6ab132a-console-serving-cert\") pod \"console-5468bd6b95-9hmzp\" (UID: \"d0cf3182-0923-4eb9-90db-0ffcb6ab132a\") " pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.334216 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.334197    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0cf3182-0923-4eb9-90db-0ffcb6ab132a-console-oauth-config\") pod \"console-5468bd6b95-9hmzp\" (UID: \"d0cf3182-0923-4eb9-90db-0ffcb6ab132a\") " pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.339730 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.339709    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjl7b\" (UniqueName: \"kubernetes.io/projected/d0cf3182-0923-4eb9-90db-0ffcb6ab132a-kube-api-access-kjl7b\") pod \"console-5468bd6b95-9hmzp\" (UID: \"d0cf3182-0923-4eb9-90db-0ffcb6ab132a\") " pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.502607 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.502534    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:33:52.641211 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:52.641077    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5468bd6b95-9hmzp"]
Jul 21 17:33:52.644096 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:33:52.644058    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0cf3182_0923_4eb9_90db_0ffcb6ab132a.slice/crio-cbc4e6709031016b993ca932bdc12ba158aab8ddbf3cfeb88c55428ca1626cd1 WatchSource:0}: Error finding container cbc4e6709031016b993ca932bdc12ba158aab8ddbf3cfeb88c55428ca1626cd1: Status 404 returned error can't find the container with id cbc4e6709031016b993ca932bdc12ba158aab8ddbf3cfeb88c55428ca1626cd1
Jul 21 17:33:53.170673 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:53.170639    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5468bd6b95-9hmzp" event={"ID":"d0cf3182-0923-4eb9-90db-0ffcb6ab132a","Type":"ContainerStarted","Data":"2f0c05bc804639b360f936b363ee299db4a5492f65970c6e15b4424ce702abc6"}
Jul 21 17:33:53.170847 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:53.170684    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5468bd6b95-9hmzp" event={"ID":"d0cf3182-0923-4eb9-90db-0ffcb6ab132a","Type":"ContainerStarted","Data":"cbc4e6709031016b993ca932bdc12ba158aab8ddbf3cfeb88c55428ca1626cd1"}
Jul 21 17:33:53.190521 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:33:53.190473    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5468bd6b95-9hmzp" podStartSLOduration=1.19045906 podStartE2EDuration="1.19045906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:33:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:33:53.189434085 +0000 UTC m=+458.589998181" watchObservedRunningTime="2026-07-21 17:33:53.19045906 +0000 UTC m=+458.591023130"
Jul 21 17:34:02.502977 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:02.502932    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:34:02.503516 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:02.503006    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:34:02.507761 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:02.507738    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:34:03.218832 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:03.218805    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5468bd6b95-9hmzp"
Jul 21 17:34:03.267883 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:03.267848    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-677f5bdd6d-2g6sv"]
Jul 21 17:34:09.112705 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:09.112675    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/kserve-controller-manager-6b69bf598b-znmjs"
Jul 21 17:34:28.288816 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.288776    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-677f5bdd6d-2g6sv" podUID="19b4417b-ba10-41e1-983b-3d1a7f37cfbb" containerName="console" containerID="cri-o://dbe23e42c62d9e20017e4a2970d70cefae87e4f62f70e50d2f1bbd22ce1368a6" gracePeriod=15
Jul 21 17:34:28.529653 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.529631    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:34:28.625363 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.625294    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-service-ca\") pod \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") "
Jul 21 17:34:28.625363 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.625329    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-oauth-serving-cert\") pod \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") "
Jul 21 17:34:28.625363 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.625353    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-console-config\") pod \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") "
Jul 21 17:34:28.625598 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.625369    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-trusted-ca-bundle\") pod \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") "
Jul 21 17:34:28.625598 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.625417    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5qh9\" (UniqueName: \"kubernetes.io/projected/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-kube-api-access-b5qh9\") pod \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") "
Jul 21 17:34:28.625598 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.625442    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-console-serving-cert\") pod \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") "
Jul 21 17:34:28.625598 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.625503    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-console-oauth-config\") pod \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\" (UID: \"19b4417b-ba10-41e1-983b-3d1a7f37cfbb\") "
Jul 21 17:34:28.625794 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.625709    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-console-config" (OuterVolumeSpecName: "console-config") pod "19b4417b-ba10-41e1-983b-3d1a7f37cfbb" (UID: "19b4417b-ba10-41e1-983b-3d1a7f37cfbb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:34:28.625794 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.625739    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "19b4417b-ba10-41e1-983b-3d1a7f37cfbb" (UID: "19b4417b-ba10-41e1-983b-3d1a7f37cfbb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:34:28.625901 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.625722    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-service-ca" (OuterVolumeSpecName: "service-ca") pod "19b4417b-ba10-41e1-983b-3d1a7f37cfbb" (UID: "19b4417b-ba10-41e1-983b-3d1a7f37cfbb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:34:28.625982 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.625958    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "19b4417b-ba10-41e1-983b-3d1a7f37cfbb" (UID: "19b4417b-ba10-41e1-983b-3d1a7f37cfbb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:34:28.627790 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.627760    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-kube-api-access-b5qh9" (OuterVolumeSpecName: "kube-api-access-b5qh9") pod "19b4417b-ba10-41e1-983b-3d1a7f37cfbb" (UID: "19b4417b-ba10-41e1-983b-3d1a7f37cfbb"). InnerVolumeSpecName "kube-api-access-b5qh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 21 17:34:28.627790 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.627777    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "19b4417b-ba10-41e1-983b-3d1a7f37cfbb" (UID: "19b4417b-ba10-41e1-983b-3d1a7f37cfbb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:34:28.627941 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.627842    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "19b4417b-ba10-41e1-983b-3d1a7f37cfbb" (UID: "19b4417b-ba10-41e1-983b-3d1a7f37cfbb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:34:28.727033 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.727006    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-console-oauth-config\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:34:28.727033 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.727029    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-service-ca\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:34:28.727203 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.727039    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-oauth-serving-cert\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:34:28.727203 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.727047    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-console-config\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:34:28.727203 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.727055    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-trusted-ca-bundle\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:34:28.727203 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.727063    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5qh9\" (UniqueName: \"kubernetes.io/projected/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-kube-api-access-b5qh9\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:34:28.727203 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:28.727072    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/19b4417b-ba10-41e1-983b-3d1a7f37cfbb-console-serving-cert\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:34:29.325900 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:29.325867    2581 generic.go:356] "Generic (PLEG): container finished" podID="19b4417b-ba10-41e1-983b-3d1a7f37cfbb" containerID="dbe23e42c62d9e20017e4a2970d70cefae87e4f62f70e50d2f1bbd22ce1368a6" exitCode=0
Jul 21 17:34:29.326301 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:29.325909    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677f5bdd6d-2g6sv" event={"ID":"19b4417b-ba10-41e1-983b-3d1a7f37cfbb","Type":"ContainerDied","Data":"dbe23e42c62d9e20017e4a2970d70cefae87e4f62f70e50d2f1bbd22ce1368a6"}
Jul 21 17:34:29.326301 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:29.325949    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677f5bdd6d-2g6sv" event={"ID":"19b4417b-ba10-41e1-983b-3d1a7f37cfbb","Type":"ContainerDied","Data":"d9b557bba4c80294952adfdeeedb00275ca5ed8c35c119644d46ef9542181b2d"}
Jul 21 17:34:29.326301 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:29.325968    2581 scope.go:117] "RemoveContainer" containerID="dbe23e42c62d9e20017e4a2970d70cefae87e4f62f70e50d2f1bbd22ce1368a6"
Jul 21 17:34:29.326301 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:29.325916    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677f5bdd6d-2g6sv"
Jul 21 17:34:29.334392 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:29.334372    2581 scope.go:117] "RemoveContainer" containerID="dbe23e42c62d9e20017e4a2970d70cefae87e4f62f70e50d2f1bbd22ce1368a6"
Jul 21 17:34:29.334651 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:34:29.334632    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbe23e42c62d9e20017e4a2970d70cefae87e4f62f70e50d2f1bbd22ce1368a6\": container with ID starting with dbe23e42c62d9e20017e4a2970d70cefae87e4f62f70e50d2f1bbd22ce1368a6 not found: ID does not exist" containerID="dbe23e42c62d9e20017e4a2970d70cefae87e4f62f70e50d2f1bbd22ce1368a6"
Jul 21 17:34:29.334710 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:29.334663    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbe23e42c62d9e20017e4a2970d70cefae87e4f62f70e50d2f1bbd22ce1368a6"} err="failed to get container status \"dbe23e42c62d9e20017e4a2970d70cefae87e4f62f70e50d2f1bbd22ce1368a6\": rpc error: code = NotFound desc = could not find container \"dbe23e42c62d9e20017e4a2970d70cefae87e4f62f70e50d2f1bbd22ce1368a6\": container with ID starting with dbe23e42c62d9e20017e4a2970d70cefae87e4f62f70e50d2f1bbd22ce1368a6 not found: ID does not exist"
Jul 21 17:34:29.350767 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:29.347633    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-677f5bdd6d-2g6sv"]
Jul 21 17:34:29.353045 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:29.353023    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-677f5bdd6d-2g6sv"]
Jul 21 17:34:31.125959 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:34:31.125921    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19b4417b-ba10-41e1-983b-3d1a7f37cfbb" path="/var/lib/kubelet/pods/19b4417b-ba10-41e1-983b-3d1a7f37cfbb/volumes"
Jul 21 17:36:15.014143 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:36:15.014115    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 17:36:15.015094 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:36:15.015071    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 17:37:38.321083 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:38.321054    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w"]
Jul 21 17:37:38.321555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:38.321415    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19b4417b-ba10-41e1-983b-3d1a7f37cfbb" containerName="console"
Jul 21 17:37:38.321555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:38.321426    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b4417b-ba10-41e1-983b-3d1a7f37cfbb" containerName="console"
Jul 21 17:37:38.321555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:38.321495    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="19b4417b-ba10-41e1-983b-3d1a7f37cfbb" containerName="console"
Jul 21 17:37:38.324335 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:38.324317    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w"
Jul 21 17:37:38.326841 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:38.326809    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 21 17:37:38.326937 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:38.326851    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-4dfe2-kube-rbac-proxy-sar-config\""
Jul 21 17:37:38.327954 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:38.327931    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-4dfe2-serving-cert\""
Jul 21 17:37:38.328061 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:38.328017    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-wx68x\""
Jul 21 17:37:38.347540 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:38.347521    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w"]
Jul 21 17:37:38.499616 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:38.499573    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2b312ed3-829f-44a2-b234-94f65637c42d-proxy-tls\") pod \"switch-graph-4dfe2-bb5dbc976-h6n8w\" (UID: \"2b312ed3-829f-44a2-b234-94f65637c42d\") " pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w"
Jul 21 17:37:38.499616 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:38.499621    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b312ed3-829f-44a2-b234-94f65637c42d-openshift-service-ca-bundle\") pod \"switch-graph-4dfe2-bb5dbc976-h6n8w\" (UID: \"2b312ed3-829f-44a2-b234-94f65637c42d\") " pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w"
Jul 21 17:37:38.601025 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:38.600947    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2b312ed3-829f-44a2-b234-94f65637c42d-proxy-tls\") pod \"switch-graph-4dfe2-bb5dbc976-h6n8w\" (UID: \"2b312ed3-829f-44a2-b234-94f65637c42d\") " pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w"
Jul 21 17:37:38.601025 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:38.600992    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b312ed3-829f-44a2-b234-94f65637c42d-openshift-service-ca-bundle\") pod \"switch-graph-4dfe2-bb5dbc976-h6n8w\" (UID: \"2b312ed3-829f-44a2-b234-94f65637c42d\") " pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w"
Jul 21 17:37:38.601593 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:38.601576    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b312ed3-829f-44a2-b234-94f65637c42d-openshift-service-ca-bundle\") pod \"switch-graph-4dfe2-bb5dbc976-h6n8w\" (UID: \"2b312ed3-829f-44a2-b234-94f65637c42d\") " pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w"
Jul 21 17:37:38.603525 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:38.603505    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2b312ed3-829f-44a2-b234-94f65637c42d-proxy-tls\") pod \"switch-graph-4dfe2-bb5dbc976-h6n8w\" (UID: \"2b312ed3-829f-44a2-b234-94f65637c42d\") " pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w"
Jul 21 17:37:38.634606 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:38.634582    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w"
Jul 21 17:37:38.763316 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:38.763291    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w"]
Jul 21 17:37:38.764848 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:37:38.764817    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b312ed3_829f_44a2_b234_94f65637c42d.slice/crio-a0923c2752b41bcd7a6f66a52eb1c4f8e62f2ba325e8349075de88c1714b9e9c WatchSource:0}: Error finding container a0923c2752b41bcd7a6f66a52eb1c4f8e62f2ba325e8349075de88c1714b9e9c: Status 404 returned error can't find the container with id a0923c2752b41bcd7a6f66a52eb1c4f8e62f2ba325e8349075de88c1714b9e9c
Jul 21 17:37:38.766882 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:38.766863    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 21 17:37:39.158760 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:39.158725    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w" event={"ID":"2b312ed3-829f-44a2-b234-94f65637c42d","Type":"ContainerStarted","Data":"a0923c2752b41bcd7a6f66a52eb1c4f8e62f2ba325e8349075de88c1714b9e9c"}
Jul 21 17:37:42.175847 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:42.175810    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w" event={"ID":"2b312ed3-829f-44a2-b234-94f65637c42d","Type":"ContainerStarted","Data":"8403b9cf247241a8ba22bd9301966fe61839390c44bb8ba618461f8207b9fdc8"}
Jul 21 17:37:42.176231 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:42.175926    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w"
Jul 21 17:37:42.195308 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:42.195268    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w" podStartSLOduration=1.3720753509999999 podStartE2EDuration="4.195253647s" totalImagesPullingTime="2.823178296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:37:42.19492197 +0000 UTC m=+687.595486041" watchObservedRunningTime="2026-07-21 17:37:42.195253647 +0000 UTC m=+687.595817751"
Jul 21 17:37:48.186207 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:48.186159    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w"
Jul 21 17:37:48.431352 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:48.431318    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w"]
Jul 21 17:37:48.431568 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:48.431524    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w" podUID="2b312ed3-829f-44a2-b234-94f65637c42d" containerName="switch-graph-4dfe2" containerID="cri-o://8403b9cf247241a8ba22bd9301966fe61839390c44bb8ba618461f8207b9fdc8" gracePeriod=30
Jul 21 17:37:53.184681 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:53.184646    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w" podUID="2b312ed3-829f-44a2-b234-94f65637c42d" containerName="switch-graph-4dfe2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:37:58.184437 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:37:58.184393    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w" podUID="2b312ed3-829f-44a2-b234-94f65637c42d" containerName="switch-graph-4dfe2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:38:03.184600 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:03.184559    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w" podUID="2b312ed3-829f-44a2-b234-94f65637c42d" containerName="switch-graph-4dfe2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:38:03.185007 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:03.184655    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w"
Jul 21 17:38:08.184596 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:08.184505    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w" podUID="2b312ed3-829f-44a2-b234-94f65637c42d" containerName="switch-graph-4dfe2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:38:08.233477 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:08.233450    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p"]
Jul 21 17:38:08.236790 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:08.236770    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p"
Jul 21 17:38:08.239094 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:08.239075    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-kube-rbac-proxy-sar-config\""
Jul 21 17:38:08.239094 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:08.239083    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"model-chainer-serving-cert\""
Jul 21 17:38:08.247969 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:08.247950    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p"]
Jul 21 17:38:08.349631 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:08.349605    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4703a6d4-0761-4b4b-9bdb-2aa0e274aee8-proxy-tls\") pod \"model-chainer-b94c8c4fd-9pj2p\" (UID: \"4703a6d4-0761-4b4b-9bdb-2aa0e274aee8\") " pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p"
Jul 21 17:38:08.349801 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:08.349662    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4703a6d4-0761-4b4b-9bdb-2aa0e274aee8-openshift-service-ca-bundle\") pod \"model-chainer-b94c8c4fd-9pj2p\" (UID: \"4703a6d4-0761-4b4b-9bdb-2aa0e274aee8\") " pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p"
Jul 21 17:38:08.450941 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:08.450866    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4703a6d4-0761-4b4b-9bdb-2aa0e274aee8-proxy-tls\") pod \"model-chainer-b94c8c4fd-9pj2p\" (UID: \"4703a6d4-0761-4b4b-9bdb-2aa0e274aee8\") " pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p"
Jul 21 17:38:08.450941 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:08.450930    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4703a6d4-0761-4b4b-9bdb-2aa0e274aee8-openshift-service-ca-bundle\") pod \"model-chainer-b94c8c4fd-9pj2p\" (UID: \"4703a6d4-0761-4b4b-9bdb-2aa0e274aee8\") " pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p"
Jul 21 17:38:08.451514 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:08.451492    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4703a6d4-0761-4b4b-9bdb-2aa0e274aee8-openshift-service-ca-bundle\") pod \"model-chainer-b94c8c4fd-9pj2p\" (UID: \"4703a6d4-0761-4b4b-9bdb-2aa0e274aee8\") " pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p"
Jul 21 17:38:08.453423 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:08.453407    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4703a6d4-0761-4b4b-9bdb-2aa0e274aee8-proxy-tls\") pod \"model-chainer-b94c8c4fd-9pj2p\" (UID: \"4703a6d4-0761-4b4b-9bdb-2aa0e274aee8\") " pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p"
Jul 21 17:38:08.547548 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:08.547528    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p"
Jul 21 17:38:08.676902 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:08.676876    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p"]
Jul 21 17:38:08.679033 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:38:08.679009    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4703a6d4_0761_4b4b_9bdb_2aa0e274aee8.slice/crio-4496280f86255628de8895738142309c598ddfc62f5eb2de063581f46a1b4841 WatchSource:0}: Error finding container 4496280f86255628de8895738142309c598ddfc62f5eb2de063581f46a1b4841: Status 404 returned error can't find the container with id 4496280f86255628de8895738142309c598ddfc62f5eb2de063581f46a1b4841
Jul 21 17:38:09.299610 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:09.299576    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p" event={"ID":"4703a6d4-0761-4b4b-9bdb-2aa0e274aee8","Type":"ContainerStarted","Data":"9ef517c2bb1d72e476ebef74872d7a64cc7f9137bfa6a4596af774985c69a198"}
Jul 21 17:38:09.300132 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:09.299627    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p" event={"ID":"4703a6d4-0761-4b4b-9bdb-2aa0e274aee8","Type":"ContainerStarted","Data":"4496280f86255628de8895738142309c598ddfc62f5eb2de063581f46a1b4841"}
Jul 21 17:38:09.300132 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:09.299647    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p"
Jul 21 17:38:09.322085 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:09.322040    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p" podStartSLOduration=1.3220260050000001 podStartE2EDuration="1.322026005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:38:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:38:09.320938575 +0000 UTC m=+714.721502667" watchObservedRunningTime="2026-07-21 17:38:09.322026005 +0000 UTC m=+714.722590086"
Jul 21 17:38:13.184644 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:13.184608    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w" podUID="2b312ed3-829f-44a2-b234-94f65637c42d" containerName="switch-graph-4dfe2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:38:15.311344 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:15.311296    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p"
Jul 21 17:38:18.183864 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:18.183830    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w" podUID="2b312ed3-829f-44a2-b234-94f65637c42d" containerName="switch-graph-4dfe2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:38:18.353123 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:18.353094    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p"]
Jul 21 17:38:18.353344 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:18.353303    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p" podUID="4703a6d4-0761-4b4b-9bdb-2aa0e274aee8" containerName="model-chainer" containerID="cri-o://9ef517c2bb1d72e476ebef74872d7a64cc7f9137bfa6a4596af774985c69a198" gracePeriod=30
Jul 21 17:38:18.617905 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:18.617879    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w"
Jul 21 17:38:18.726369 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:18.726297    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2b312ed3-829f-44a2-b234-94f65637c42d-proxy-tls\") pod \"2b312ed3-829f-44a2-b234-94f65637c42d\" (UID: \"2b312ed3-829f-44a2-b234-94f65637c42d\") "
Jul 21 17:38:18.726516 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:18.726389    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b312ed3-829f-44a2-b234-94f65637c42d-openshift-service-ca-bundle\") pod \"2b312ed3-829f-44a2-b234-94f65637c42d\" (UID: \"2b312ed3-829f-44a2-b234-94f65637c42d\") "
Jul 21 17:38:18.726717 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:18.726696    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b312ed3-829f-44a2-b234-94f65637c42d-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "2b312ed3-829f-44a2-b234-94f65637c42d" (UID: "2b312ed3-829f-44a2-b234-94f65637c42d"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:38:18.728685 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:18.728666    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b312ed3-829f-44a2-b234-94f65637c42d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "2b312ed3-829f-44a2-b234-94f65637c42d" (UID: "2b312ed3-829f-44a2-b234-94f65637c42d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:38:18.827146 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:18.827118    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2b312ed3-829f-44a2-b234-94f65637c42d-openshift-service-ca-bundle\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:38:18.827146 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:18.827140    2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/2b312ed3-829f-44a2-b234-94f65637c42d-proxy-tls\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:38:19.348802 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:19.348766    2581 generic.go:356] "Generic (PLEG): container finished" podID="2b312ed3-829f-44a2-b234-94f65637c42d" containerID="8403b9cf247241a8ba22bd9301966fe61839390c44bb8ba618461f8207b9fdc8" exitCode=0
Jul 21 17:38:19.348802 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:19.348820    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w"
Jul 21 17:38:19.349322 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:19.348833    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w" event={"ID":"2b312ed3-829f-44a2-b234-94f65637c42d","Type":"ContainerDied","Data":"8403b9cf247241a8ba22bd9301966fe61839390c44bb8ba618461f8207b9fdc8"}
Jul 21 17:38:19.349322 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:19.348916    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w" event={"ID":"2b312ed3-829f-44a2-b234-94f65637c42d","Type":"ContainerDied","Data":"a0923c2752b41bcd7a6f66a52eb1c4f8e62f2ba325e8349075de88c1714b9e9c"}
Jul 21 17:38:19.349322 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:19.348945    2581 scope.go:117] "RemoveContainer" containerID="8403b9cf247241a8ba22bd9301966fe61839390c44bb8ba618461f8207b9fdc8"
Jul 21 17:38:19.357654 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:19.357460    2581 scope.go:117] "RemoveContainer" containerID="8403b9cf247241a8ba22bd9301966fe61839390c44bb8ba618461f8207b9fdc8"
Jul 21 17:38:19.357740 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:38:19.357712    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8403b9cf247241a8ba22bd9301966fe61839390c44bb8ba618461f8207b9fdc8\": container with ID starting with 8403b9cf247241a8ba22bd9301966fe61839390c44bb8ba618461f8207b9fdc8 not found: ID does not exist" containerID="8403b9cf247241a8ba22bd9301966fe61839390c44bb8ba618461f8207b9fdc8"
Jul 21 17:38:19.357781 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:19.357750    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8403b9cf247241a8ba22bd9301966fe61839390c44bb8ba618461f8207b9fdc8"} err="failed to get container status \"8403b9cf247241a8ba22bd9301966fe61839390c44bb8ba618461f8207b9fdc8\": rpc error: code = NotFound desc = could not find container \"8403b9cf247241a8ba22bd9301966fe61839390c44bb8ba618461f8207b9fdc8\": container with ID starting with 8403b9cf247241a8ba22bd9301966fe61839390c44bb8ba618461f8207b9fdc8 not found: ID does not exist"
Jul 21 17:38:19.364549 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:19.364532    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w"]
Jul 21 17:38:19.368721 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:19.368703    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-4dfe2-bb5dbc976-h6n8w"]
Jul 21 17:38:20.309486 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:20.309449    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p" podUID="4703a6d4-0761-4b4b-9bdb-2aa0e274aee8" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:38:21.125467 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:21.125433    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b312ed3-829f-44a2-b234-94f65637c42d" path="/var/lib/kubelet/pods/2b312ed3-829f-44a2-b234-94f65637c42d/volumes"
Jul 21 17:38:25.309685 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:25.309645    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p" podUID="4703a6d4-0761-4b4b-9bdb-2aa0e274aee8" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:38:30.309325 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:30.309286    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p" podUID="4703a6d4-0761-4b4b-9bdb-2aa0e274aee8" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:38:30.309734 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:30.309390    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p"
Jul 21 17:38:35.309863 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:35.309822    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p" podUID="4703a6d4-0761-4b4b-9bdb-2aa0e274aee8" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:38:40.309188 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:40.309141    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p" podUID="4703a6d4-0761-4b4b-9bdb-2aa0e274aee8" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:38:45.310108 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:45.310071    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p" podUID="4703a6d4-0761-4b4b-9bdb-2aa0e274aee8" containerName="model-chainer" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:38:48.478747 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.478690    2581 generic.go:356] "Generic (PLEG): container finished" podID="4703a6d4-0761-4b4b-9bdb-2aa0e274aee8" containerID="9ef517c2bb1d72e476ebef74872d7a64cc7f9137bfa6a4596af774985c69a198" exitCode=0
Jul 21 17:38:48.479138 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.478759    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p" event={"ID":"4703a6d4-0761-4b4b-9bdb-2aa0e274aee8","Type":"ContainerDied","Data":"9ef517c2bb1d72e476ebef74872d7a64cc7f9137bfa6a4596af774985c69a198"}
Jul 21 17:38:48.548139 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.548114    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p"
Jul 21 17:38:48.660767 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.660689    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4703a6d4-0761-4b4b-9bdb-2aa0e274aee8-proxy-tls\") pod \"4703a6d4-0761-4b4b-9bdb-2aa0e274aee8\" (UID: \"4703a6d4-0761-4b4b-9bdb-2aa0e274aee8\") "
Jul 21 17:38:48.660767 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.660727    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4703a6d4-0761-4b4b-9bdb-2aa0e274aee8-openshift-service-ca-bundle\") pod \"4703a6d4-0761-4b4b-9bdb-2aa0e274aee8\" (UID: \"4703a6d4-0761-4b4b-9bdb-2aa0e274aee8\") "
Jul 21 17:38:48.661087 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.661066    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4703a6d4-0761-4b4b-9bdb-2aa0e274aee8-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "4703a6d4-0761-4b4b-9bdb-2aa0e274aee8" (UID: "4703a6d4-0761-4b4b-9bdb-2aa0e274aee8"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:38:48.662799 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.662770    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4703a6d4-0761-4b4b-9bdb-2aa0e274aee8-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4703a6d4-0761-4b4b-9bdb-2aa0e274aee8" (UID: "4703a6d4-0761-4b4b-9bdb-2aa0e274aee8"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:38:48.695985 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.695956    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw"]
Jul 21 17:38:48.696323 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.696310    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b312ed3-829f-44a2-b234-94f65637c42d" containerName="switch-graph-4dfe2"
Jul 21 17:38:48.696378 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.696325    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b312ed3-829f-44a2-b234-94f65637c42d" containerName="switch-graph-4dfe2"
Jul 21 17:38:48.696378 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.696332    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4703a6d4-0761-4b4b-9bdb-2aa0e274aee8" containerName="model-chainer"
Jul 21 17:38:48.696378 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.696338    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4703a6d4-0761-4b4b-9bdb-2aa0e274aee8" containerName="model-chainer"
Jul 21 17:38:48.696534 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.696412    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b312ed3-829f-44a2-b234-94f65637c42d" containerName="switch-graph-4dfe2"
Jul 21 17:38:48.696534 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.696422    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4703a6d4-0761-4b4b-9bdb-2aa0e274aee8" containerName="model-chainer"
Jul 21 17:38:48.699276 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.699260    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw"
Jul 21 17:38:48.701460 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.701439    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-5bf12-kube-rbac-proxy-sar-config\""
Jul 21 17:38:48.701532 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.701491    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-5bf12-serving-cert\""
Jul 21 17:38:48.707294 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.707270    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw"]
Jul 21 17:38:48.762028 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.761999    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fdc05d56-33fd-4cb8-a9bd-4d40bfada364-proxy-tls\") pod \"switch-graph-5bf12-8c97ccc4-nrwbw\" (UID: \"fdc05d56-33fd-4cb8-a9bd-4d40bfada364\") " pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw"
Jul 21 17:38:48.762131 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.762060    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc05d56-33fd-4cb8-a9bd-4d40bfada364-openshift-service-ca-bundle\") pod \"switch-graph-5bf12-8c97ccc4-nrwbw\" (UID: \"fdc05d56-33fd-4cb8-a9bd-4d40bfada364\") " pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw"
Jul 21 17:38:48.762198 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.762137    2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4703a6d4-0761-4b4b-9bdb-2aa0e274aee8-proxy-tls\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:38:48.762198 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.762149    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4703a6d4-0761-4b4b-9bdb-2aa0e274aee8-openshift-service-ca-bundle\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:38:48.863351 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.863323    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc05d56-33fd-4cb8-a9bd-4d40bfada364-openshift-service-ca-bundle\") pod \"switch-graph-5bf12-8c97ccc4-nrwbw\" (UID: \"fdc05d56-33fd-4cb8-a9bd-4d40bfada364\") " pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw"
Jul 21 17:38:48.863463 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.863368    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fdc05d56-33fd-4cb8-a9bd-4d40bfada364-proxy-tls\") pod \"switch-graph-5bf12-8c97ccc4-nrwbw\" (UID: \"fdc05d56-33fd-4cb8-a9bd-4d40bfada364\") " pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw"
Jul 21 17:38:48.863515 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:38:48.863468    2581 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-5bf12-serving-cert: secret "switch-graph-5bf12-serving-cert" not found
Jul 21 17:38:48.863554 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:38:48.863527    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdc05d56-33fd-4cb8-a9bd-4d40bfada364-proxy-tls podName:fdc05d56-33fd-4cb8-a9bd-4d40bfada364 nodeName:}" failed. No retries permitted until 2026-07-21 17:38:49.363511049 +0000 UTC m=+754.764075100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/fdc05d56-33fd-4cb8-a9bd-4d40bfada364-proxy-tls") pod "switch-graph-5bf12-8c97ccc4-nrwbw" (UID: "fdc05d56-33fd-4cb8-a9bd-4d40bfada364") : secret "switch-graph-5bf12-serving-cert" not found
Jul 21 17:38:48.863968 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:48.863947    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc05d56-33fd-4cb8-a9bd-4d40bfada364-openshift-service-ca-bundle\") pod \"switch-graph-5bf12-8c97ccc4-nrwbw\" (UID: \"fdc05d56-33fd-4cb8-a9bd-4d40bfada364\") " pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw"
Jul 21 17:38:49.367294 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:49.367260    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fdc05d56-33fd-4cb8-a9bd-4d40bfada364-proxy-tls\") pod \"switch-graph-5bf12-8c97ccc4-nrwbw\" (UID: \"fdc05d56-33fd-4cb8-a9bd-4d40bfada364\") " pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw"
Jul 21 17:38:49.369903 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:49.369870    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fdc05d56-33fd-4cb8-a9bd-4d40bfada364-proxy-tls\") pod \"switch-graph-5bf12-8c97ccc4-nrwbw\" (UID: \"fdc05d56-33fd-4cb8-a9bd-4d40bfada364\") " pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw"
Jul 21 17:38:49.485598 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:49.485542    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p"
Jul 21 17:38:49.485948 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:49.485538    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p" event={"ID":"4703a6d4-0761-4b4b-9bdb-2aa0e274aee8","Type":"ContainerDied","Data":"4496280f86255628de8895738142309c598ddfc62f5eb2de063581f46a1b4841"}
Jul 21 17:38:49.485948 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:49.485686    2581 scope.go:117] "RemoveContainer" containerID="9ef517c2bb1d72e476ebef74872d7a64cc7f9137bfa6a4596af774985c69a198"
Jul 21 17:38:49.501839 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:49.501820    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p"]
Jul 21 17:38:49.505270 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:49.505250    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/model-chainer-b94c8c4fd-9pj2p"]
Jul 21 17:38:49.610351 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:49.610329    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw"
Jul 21 17:38:49.739385 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:49.739364    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw"]
Jul 21 17:38:49.741847 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:38:49.741819    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdc05d56_33fd_4cb8_a9bd_4d40bfada364.slice/crio-54162e80dcf0e8a5dc9582d47771402abac3c6d34623df7688e20b84f2a27410 WatchSource:0}: Error finding container 54162e80dcf0e8a5dc9582d47771402abac3c6d34623df7688e20b84f2a27410: Status 404 returned error can't find the container with id 54162e80dcf0e8a5dc9582d47771402abac3c6d34623df7688e20b84f2a27410
Jul 21 17:38:50.492512 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:50.492473    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw" event={"ID":"fdc05d56-33fd-4cb8-a9bd-4d40bfada364","Type":"ContainerStarted","Data":"f8c11ddf3d63942e4b50f3edda5d85242f705a6b2982d438498aec07713b7b64"}
Jul 21 17:38:50.497942 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:50.492926    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw" event={"ID":"fdc05d56-33fd-4cb8-a9bd-4d40bfada364","Type":"ContainerStarted","Data":"54162e80dcf0e8a5dc9582d47771402abac3c6d34623df7688e20b84f2a27410"}
Jul 21 17:38:50.497942 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:50.493061    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw"
Jul 21 17:38:50.512379 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:50.512340    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw" podStartSLOduration=2.512328002 podStartE2EDuration="2.512328002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:38:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:38:50.511581156 +0000 UTC m=+755.912145253" watchObservedRunningTime="2026-07-21 17:38:50.512328002 +0000 UTC m=+755.912892064"
Jul 21 17:38:51.125898 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:51.125865    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4703a6d4-0761-4b4b-9bdb-2aa0e274aee8" path="/var/lib/kubelet/pods/4703a6d4-0761-4b4b-9bdb-2aa0e274aee8/volumes"
Jul 21 17:38:56.502926 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:38:56.502892    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw"
Jul 21 17:39:18.571321 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:39:18.571288    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz"]
Jul 21 17:39:18.575897 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:39:18.575879    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz"
Jul 21 17:39:18.578002 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:39:18.577974    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-8558d-kube-rbac-proxy-sar-config\""
Jul 21 17:39:18.578113 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:39:18.577975    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-8558d-serving-cert\""
Jul 21 17:39:18.584286 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:39:18.584262    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz"]
Jul 21 17:39:18.702593 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:39:18.702565    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ef6ba6a-2f42-400f-9cb1-80300498c6b4-openshift-service-ca-bundle\") pod \"sequence-graph-8558d-55554bfd8c-dq7wz\" (UID: \"6ef6ba6a-2f42-400f-9cb1-80300498c6b4\") " pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz"
Jul 21 17:39:18.702809 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:39:18.702619    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6ef6ba6a-2f42-400f-9cb1-80300498c6b4-proxy-tls\") pod \"sequence-graph-8558d-55554bfd8c-dq7wz\" (UID: \"6ef6ba6a-2f42-400f-9cb1-80300498c6b4\") " pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz"
Jul 21 17:39:18.803498 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:39:18.803465    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6ef6ba6a-2f42-400f-9cb1-80300498c6b4-proxy-tls\") pod \"sequence-graph-8558d-55554bfd8c-dq7wz\" (UID: \"6ef6ba6a-2f42-400f-9cb1-80300498c6b4\") " pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz"
Jul 21 17:39:18.803648 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:39:18.803550    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ef6ba6a-2f42-400f-9cb1-80300498c6b4-openshift-service-ca-bundle\") pod \"sequence-graph-8558d-55554bfd8c-dq7wz\" (UID: \"6ef6ba6a-2f42-400f-9cb1-80300498c6b4\") " pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz"
Jul 21 17:39:18.804219 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:39:18.804133    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ef6ba6a-2f42-400f-9cb1-80300498c6b4-openshift-service-ca-bundle\") pod \"sequence-graph-8558d-55554bfd8c-dq7wz\" (UID: \"6ef6ba6a-2f42-400f-9cb1-80300498c6b4\") " pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz"
Jul 21 17:39:18.805941 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:39:18.805920    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6ef6ba6a-2f42-400f-9cb1-80300498c6b4-proxy-tls\") pod \"sequence-graph-8558d-55554bfd8c-dq7wz\" (UID: \"6ef6ba6a-2f42-400f-9cb1-80300498c6b4\") " pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz"
Jul 21 17:39:18.887679 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:39:18.887615    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz"
Jul 21 17:39:19.015482 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:39:19.015458    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz"]
Jul 21 17:39:19.017734 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:39:19.017708    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ef6ba6a_2f42_400f_9cb1_80300498c6b4.slice/crio-981c4badc9727b03d9253410af3aa27eff63ce86d4bfe7943d235a89dbfacd03 WatchSource:0}: Error finding container 981c4badc9727b03d9253410af3aa27eff63ce86d4bfe7943d235a89dbfacd03: Status 404 returned error can't find the container with id 981c4badc9727b03d9253410af3aa27eff63ce86d4bfe7943d235a89dbfacd03
Jul 21 17:39:19.624934 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:39:19.624894    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz" event={"ID":"6ef6ba6a-2f42-400f-9cb1-80300498c6b4","Type":"ContainerStarted","Data":"11c065310b300ebc17b11c33fd1cbcbdb6331ae564a9fe66a871090c51355e46"}
Jul 21 17:39:19.625347 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:39:19.624944    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz" event={"ID":"6ef6ba6a-2f42-400f-9cb1-80300498c6b4","Type":"ContainerStarted","Data":"981c4badc9727b03d9253410af3aa27eff63ce86d4bfe7943d235a89dbfacd03"}
Jul 21 17:39:19.625347 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:39:19.624969    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz"
Jul 21 17:39:19.646165 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:39:19.646117    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz" podStartSLOduration=1.646102297 podStartE2EDuration="1.646102297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:39:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:39:19.644733073 +0000 UTC m=+785.045297145" watchObservedRunningTime="2026-07-21 17:39:19.646102297 +0000 UTC m=+785.046666368"
Jul 21 17:39:25.635271 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:39:25.635245    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz"
Jul 21 17:41:15.041507 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:41:15.041479    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 17:41:15.042926 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:41:15.042907    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 17:46:15.069287 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:46:15.069258    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 17:46:15.071605 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:46:15.071583    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 17:47:03.284898 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:03.284867    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw"]
Jul 21 17:47:03.285465 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:03.285068    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw" podUID="fdc05d56-33fd-4cb8-a9bd-4d40bfada364" containerName="switch-graph-5bf12" containerID="cri-o://f8c11ddf3d63942e4b50f3edda5d85242f705a6b2982d438498aec07713b7b64" gracePeriod=30
Jul 21 17:47:06.501358 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:06.501270    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw" podUID="fdc05d56-33fd-4cb8-a9bd-4d40bfada364" containerName="switch-graph-5bf12" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:47:11.501009 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:11.500961    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw" podUID="fdc05d56-33fd-4cb8-a9bd-4d40bfada364" containerName="switch-graph-5bf12" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:47:16.500777 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:16.500734    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw" podUID="fdc05d56-33fd-4cb8-a9bd-4d40bfada364" containerName="switch-graph-5bf12" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:47:16.501214 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:16.500856    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw"
Jul 21 17:47:21.501002 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:21.500954    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw" podUID="fdc05d56-33fd-4cb8-a9bd-4d40bfada364" containerName="switch-graph-5bf12" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:47:26.500808 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:26.500761    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw" podUID="fdc05d56-33fd-4cb8-a9bd-4d40bfada364" containerName="switch-graph-5bf12" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:47:31.501716 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:31.501667    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw" podUID="fdc05d56-33fd-4cb8-a9bd-4d40bfada364" containerName="switch-graph-5bf12" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:47:33.356115 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:33.356081    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz"]
Jul 21 17:47:33.356620 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:33.356398    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz" podUID="6ef6ba6a-2f42-400f-9cb1-80300498c6b4" containerName="sequence-graph-8558d" containerID="cri-o://11c065310b300ebc17b11c33fd1cbcbdb6331ae564a9fe66a871090c51355e46" gracePeriod=30
Jul 21 17:47:33.449489 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:33.449465    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw"
Jul 21 17:47:33.532491 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:33.532462    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fdc05d56-33fd-4cb8-a9bd-4d40bfada364-proxy-tls\") pod \"fdc05d56-33fd-4cb8-a9bd-4d40bfada364\" (UID: \"fdc05d56-33fd-4cb8-a9bd-4d40bfada364\") "
Jul 21 17:47:33.532672 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:33.532520    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc05d56-33fd-4cb8-a9bd-4d40bfada364-openshift-service-ca-bundle\") pod \"fdc05d56-33fd-4cb8-a9bd-4d40bfada364\" (UID: \"fdc05d56-33fd-4cb8-a9bd-4d40bfada364\") "
Jul 21 17:47:33.532932 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:33.532904    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdc05d56-33fd-4cb8-a9bd-4d40bfada364-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "fdc05d56-33fd-4cb8-a9bd-4d40bfada364" (UID: "fdc05d56-33fd-4cb8-a9bd-4d40bfada364"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:47:33.534842 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:33.534809    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdc05d56-33fd-4cb8-a9bd-4d40bfada364-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "fdc05d56-33fd-4cb8-a9bd-4d40bfada364" (UID: "fdc05d56-33fd-4cb8-a9bd-4d40bfada364"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:47:33.634065 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:33.634030    2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/fdc05d56-33fd-4cb8-a9bd-4d40bfada364-proxy-tls\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:47:33.634065 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:33.634059    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdc05d56-33fd-4cb8-a9bd-4d40bfada364-openshift-service-ca-bundle\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:47:33.827253 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:33.827155    2581 generic.go:356] "Generic (PLEG): container finished" podID="fdc05d56-33fd-4cb8-a9bd-4d40bfada364" containerID="f8c11ddf3d63942e4b50f3edda5d85242f705a6b2982d438498aec07713b7b64" exitCode=0
Jul 21 17:47:33.827253 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:33.827215    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw"
Jul 21 17:47:33.827253 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:33.827241    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw" event={"ID":"fdc05d56-33fd-4cb8-a9bd-4d40bfada364","Type":"ContainerDied","Data":"f8c11ddf3d63942e4b50f3edda5d85242f705a6b2982d438498aec07713b7b64"}
Jul 21 17:47:33.827476 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:33.827291    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw" event={"ID":"fdc05d56-33fd-4cb8-a9bd-4d40bfada364","Type":"ContainerDied","Data":"54162e80dcf0e8a5dc9582d47771402abac3c6d34623df7688e20b84f2a27410"}
Jul 21 17:47:33.827476 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:33.827314    2581 scope.go:117] "RemoveContainer" containerID="f8c11ddf3d63942e4b50f3edda5d85242f705a6b2982d438498aec07713b7b64"
Jul 21 17:47:33.836358 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:33.836341    2581 scope.go:117] "RemoveContainer" containerID="f8c11ddf3d63942e4b50f3edda5d85242f705a6b2982d438498aec07713b7b64"
Jul 21 17:47:33.836573 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:47:33.836555    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8c11ddf3d63942e4b50f3edda5d85242f705a6b2982d438498aec07713b7b64\": container with ID starting with f8c11ddf3d63942e4b50f3edda5d85242f705a6b2982d438498aec07713b7b64 not found: ID does not exist" containerID="f8c11ddf3d63942e4b50f3edda5d85242f705a6b2982d438498aec07713b7b64"
Jul 21 17:47:33.836633 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:33.836585    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8c11ddf3d63942e4b50f3edda5d85242f705a6b2982d438498aec07713b7b64"} err="failed to get container status \"f8c11ddf3d63942e4b50f3edda5d85242f705a6b2982d438498aec07713b7b64\": rpc error: code = NotFound desc = could not find container \"f8c11ddf3d63942e4b50f3edda5d85242f705a6b2982d438498aec07713b7b64\": container with ID starting with f8c11ddf3d63942e4b50f3edda5d85242f705a6b2982d438498aec07713b7b64 not found: ID does not exist"
Jul 21 17:47:33.850349 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:33.850302    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw"]
Jul 21 17:47:33.851873 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:33.851855    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-5bf12-8c97ccc4-nrwbw"]
Jul 21 17:47:35.126006 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:35.125974    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdc05d56-33fd-4cb8-a9bd-4d40bfada364" path="/var/lib/kubelet/pods/fdc05d56-33fd-4cb8-a9bd-4d40bfada364/volumes"
Jul 21 17:47:35.633512 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:35.633477    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz" podUID="6ef6ba6a-2f42-400f-9cb1-80300498c6b4" containerName="sequence-graph-8558d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:47:40.633437 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:40.633401    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz" podUID="6ef6ba6a-2f42-400f-9cb1-80300498c6b4" containerName="sequence-graph-8558d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:47:45.633840 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:45.633801    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz" podUID="6ef6ba6a-2f42-400f-9cb1-80300498c6b4" containerName="sequence-graph-8558d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:47:45.634230 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:45.633903    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz"
Jul 21 17:47:50.633532 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:50.633496    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz" podUID="6ef6ba6a-2f42-400f-9cb1-80300498c6b4" containerName="sequence-graph-8558d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:47:55.634093 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:47:55.634043    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz" podUID="6ef6ba6a-2f42-400f-9cb1-80300498c6b4" containerName="sequence-graph-8558d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:48:00.633216 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:00.633155    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz" podUID="6ef6ba6a-2f42-400f-9cb1-80300498c6b4" containerName="sequence-graph-8558d" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:48:03.512596 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.512574    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz"
Jul 21 17:48:03.577380 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.577352    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl"]
Jul 21 17:48:03.577701 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.577689    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdc05d56-33fd-4cb8-a9bd-4d40bfada364" containerName="switch-graph-5bf12"
Jul 21 17:48:03.577701 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.577703    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdc05d56-33fd-4cb8-a9bd-4d40bfada364" containerName="switch-graph-5bf12"
Jul 21 17:48:03.577786 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.577729    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ef6ba6a-2f42-400f-9cb1-80300498c6b4" containerName="sequence-graph-8558d"
Jul 21 17:48:03.577786 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.577734    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ef6ba6a-2f42-400f-9cb1-80300498c6b4" containerName="sequence-graph-8558d"
Jul 21 17:48:03.577854 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.577790    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ef6ba6a-2f42-400f-9cb1-80300498c6b4" containerName="sequence-graph-8558d"
Jul 21 17:48:03.577854 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.577798    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdc05d56-33fd-4cb8-a9bd-4d40bfada364" containerName="switch-graph-5bf12"
Jul 21 17:48:03.580535 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.580519    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl"
Jul 21 17:48:03.583464 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.583438    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-f64bd-kube-rbac-proxy-sar-config\""
Jul 21 17:48:03.583464 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.583459    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-f64bd-serving-cert\""
Jul 21 17:48:03.591052 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.591030    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl"]
Jul 21 17:48:03.661657 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.661581    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ef6ba6a-2f42-400f-9cb1-80300498c6b4-openshift-service-ca-bundle\") pod \"6ef6ba6a-2f42-400f-9cb1-80300498c6b4\" (UID: \"6ef6ba6a-2f42-400f-9cb1-80300498c6b4\") "
Jul 21 17:48:03.661797 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.661678    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6ef6ba6a-2f42-400f-9cb1-80300498c6b4-proxy-tls\") pod \"6ef6ba6a-2f42-400f-9cb1-80300498c6b4\" (UID: \"6ef6ba6a-2f42-400f-9cb1-80300498c6b4\") "
Jul 21 17:48:03.661883 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.661863    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d51e87a-c1e1-4869-8874-c868f839747d-openshift-service-ca-bundle\") pod \"ensemble-graph-f64bd-7d86669d75-5pcrl\" (UID: \"3d51e87a-c1e1-4869-8874-c868f839747d\") " pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl"
Jul 21 17:48:03.661977 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.661943    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ef6ba6a-2f42-400f-9cb1-80300498c6b4-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "6ef6ba6a-2f42-400f-9cb1-80300498c6b4" (UID: "6ef6ba6a-2f42-400f-9cb1-80300498c6b4"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:48:03.661977 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.661963    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3d51e87a-c1e1-4869-8874-c868f839747d-proxy-tls\") pod \"ensemble-graph-f64bd-7d86669d75-5pcrl\" (UID: \"3d51e87a-c1e1-4869-8874-c868f839747d\") " pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl"
Jul 21 17:48:03.662161 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.662015    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6ef6ba6a-2f42-400f-9cb1-80300498c6b4-openshift-service-ca-bundle\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:48:03.663844 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.663819    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ef6ba6a-2f42-400f-9cb1-80300498c6b4-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "6ef6ba6a-2f42-400f-9cb1-80300498c6b4" (UID: "6ef6ba6a-2f42-400f-9cb1-80300498c6b4"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:48:03.762555 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.762519    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3d51e87a-c1e1-4869-8874-c868f839747d-proxy-tls\") pod \"ensemble-graph-f64bd-7d86669d75-5pcrl\" (UID: \"3d51e87a-c1e1-4869-8874-c868f839747d\") " pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl"
Jul 21 17:48:03.762710 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.762581    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d51e87a-c1e1-4869-8874-c868f839747d-openshift-service-ca-bundle\") pod \"ensemble-graph-f64bd-7d86669d75-5pcrl\" (UID: \"3d51e87a-c1e1-4869-8874-c868f839747d\") " pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl"
Jul 21 17:48:03.762710 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.762640    2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/6ef6ba6a-2f42-400f-9cb1-80300498c6b4-proxy-tls\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:48:03.762710 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:48:03.762670    2581 secret.go:189] Couldn't get secret kserve-ci-e2e-test/ensemble-graph-f64bd-serving-cert: secret "ensemble-graph-f64bd-serving-cert" not found
Jul 21 17:48:03.762805 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:48:03.762750    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d51e87a-c1e1-4869-8874-c868f839747d-proxy-tls podName:3d51e87a-c1e1-4869-8874-c868f839747d nodeName:}" failed. No retries permitted until 2026-07-21 17:48:04.262732629 +0000 UTC m=+1309.663296678 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/3d51e87a-c1e1-4869-8874-c868f839747d-proxy-tls") pod "ensemble-graph-f64bd-7d86669d75-5pcrl" (UID: "3d51e87a-c1e1-4869-8874-c868f839747d") : secret "ensemble-graph-f64bd-serving-cert" not found
Jul 21 17:48:03.763227 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.763208    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d51e87a-c1e1-4869-8874-c868f839747d-openshift-service-ca-bundle\") pod \"ensemble-graph-f64bd-7d86669d75-5pcrl\" (UID: \"3d51e87a-c1e1-4869-8874-c868f839747d\") " pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl"
Jul 21 17:48:03.962342 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.962249    2581 generic.go:356] "Generic (PLEG): container finished" podID="6ef6ba6a-2f42-400f-9cb1-80300498c6b4" containerID="11c065310b300ebc17b11c33fd1cbcbdb6331ae564a9fe66a871090c51355e46" exitCode=0
Jul 21 17:48:03.962342 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.962310    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz"
Jul 21 17:48:03.962540 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.962338    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz" event={"ID":"6ef6ba6a-2f42-400f-9cb1-80300498c6b4","Type":"ContainerDied","Data":"11c065310b300ebc17b11c33fd1cbcbdb6331ae564a9fe66a871090c51355e46"}
Jul 21 17:48:03.962540 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.962412    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz" event={"ID":"6ef6ba6a-2f42-400f-9cb1-80300498c6b4","Type":"ContainerDied","Data":"981c4badc9727b03d9253410af3aa27eff63ce86d4bfe7943d235a89dbfacd03"}
Jul 21 17:48:03.962540 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.962434    2581 scope.go:117] "RemoveContainer" containerID="11c065310b300ebc17b11c33fd1cbcbdb6331ae564a9fe66a871090c51355e46"
Jul 21 17:48:03.971295 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.971280    2581 scope.go:117] "RemoveContainer" containerID="11c065310b300ebc17b11c33fd1cbcbdb6331ae564a9fe66a871090c51355e46"
Jul 21 17:48:03.971557 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:48:03.971541    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11c065310b300ebc17b11c33fd1cbcbdb6331ae564a9fe66a871090c51355e46\": container with ID starting with 11c065310b300ebc17b11c33fd1cbcbdb6331ae564a9fe66a871090c51355e46 not found: ID does not exist" containerID="11c065310b300ebc17b11c33fd1cbcbdb6331ae564a9fe66a871090c51355e46"
Jul 21 17:48:03.971673 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.971564    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11c065310b300ebc17b11c33fd1cbcbdb6331ae564a9fe66a871090c51355e46"} err="failed to get container status \"11c065310b300ebc17b11c33fd1cbcbdb6331ae564a9fe66a871090c51355e46\": rpc error: code = NotFound desc = could not find container \"11c065310b300ebc17b11c33fd1cbcbdb6331ae564a9fe66a871090c51355e46\": container with ID starting with 11c065310b300ebc17b11c33fd1cbcbdb6331ae564a9fe66a871090c51355e46 not found: ID does not exist"
Jul 21 17:48:03.983118 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.983095    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz"]
Jul 21 17:48:03.987298 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:03.987278    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8558d-55554bfd8c-dq7wz"]
Jul 21 17:48:04.266595 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:04.266563    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3d51e87a-c1e1-4869-8874-c868f839747d-proxy-tls\") pod \"ensemble-graph-f64bd-7d86669d75-5pcrl\" (UID: \"3d51e87a-c1e1-4869-8874-c868f839747d\") " pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl"
Jul 21 17:48:04.269078 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:04.269054    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3d51e87a-c1e1-4869-8874-c868f839747d-proxy-tls\") pod \"ensemble-graph-f64bd-7d86669d75-5pcrl\" (UID: \"3d51e87a-c1e1-4869-8874-c868f839747d\") " pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl"
Jul 21 17:48:04.491532 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:04.491478    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl"
Jul 21 17:48:04.619084 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:04.619059    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl"]
Jul 21 17:48:04.621053 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:48:04.621025    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d51e87a_c1e1_4869_8874_c868f839747d.slice/crio-166937839aed00df4aa0840b4c514b2be5a5b688c3f08cfbc65ef7b17fe23c8b WatchSource:0}: Error finding container 166937839aed00df4aa0840b4c514b2be5a5b688c3f08cfbc65ef7b17fe23c8b: Status 404 returned error can't find the container with id 166937839aed00df4aa0840b4c514b2be5a5b688c3f08cfbc65ef7b17fe23c8b
Jul 21 17:48:04.968666 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:04.968570    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl" event={"ID":"3d51e87a-c1e1-4869-8874-c868f839747d","Type":"ContainerStarted","Data":"4cfdd5ab84e6a3c3f88a0f48e643469c96460c6adda3faa33c713bc6264fe203"}
Jul 21 17:48:04.968834 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:04.968726    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl"
Jul 21 17:48:04.968834 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:04.968793    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl" event={"ID":"3d51e87a-c1e1-4869-8874-c868f839747d","Type":"ContainerStarted","Data":"166937839aed00df4aa0840b4c514b2be5a5b688c3f08cfbc65ef7b17fe23c8b"}
Jul 21 17:48:04.985747 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:04.985705    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl" podStartSLOduration=1.985691821 podStartE2EDuration="1.985691821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:48:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:48:04.984075833 +0000 UTC m=+1310.384639917" watchObservedRunningTime="2026-07-21 17:48:04.985691821 +0000 UTC m=+1310.386255903"
Jul 21 17:48:05.125073 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:05.125042    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ef6ba6a-2f42-400f-9cb1-80300498c6b4" path="/var/lib/kubelet/pods/6ef6ba6a-2f42-400f-9cb1-80300498c6b4/volumes"
Jul 21 17:48:10.980192 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:10.980141    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl"
Jul 21 17:48:13.631913 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:13.631835    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl"]
Jul 21 17:48:13.632376 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:13.632009    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl" podUID="3d51e87a-c1e1-4869-8874-c868f839747d" containerName="ensemble-graph-f64bd" containerID="cri-o://4cfdd5ab84e6a3c3f88a0f48e643469c96460c6adda3faa33c713bc6264fe203" gracePeriod=30
Jul 21 17:48:15.978288 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:15.978250    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl" podUID="3d51e87a-c1e1-4869-8874-c868f839747d" containerName="ensemble-graph-f64bd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:48:20.978252 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:20.978216    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl" podUID="3d51e87a-c1e1-4869-8874-c868f839747d" containerName="ensemble-graph-f64bd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:48:25.977983 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:25.977948    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl" podUID="3d51e87a-c1e1-4869-8874-c868f839747d" containerName="ensemble-graph-f64bd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:48:25.978387 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:25.978061    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl"
Jul 21 17:48:30.977864 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:30.977824    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl" podUID="3d51e87a-c1e1-4869-8874-c868f839747d" containerName="ensemble-graph-f64bd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:48:33.562057 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:33.562020    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl"]
Jul 21 17:48:33.566800 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:33.566780    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl"
Jul 21 17:48:33.569256 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:33.569239    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-b64c9-serving-cert\""
Jul 21 17:48:33.569352 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:33.569261    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-b64c9-kube-rbac-proxy-sar-config\""
Jul 21 17:48:33.575898 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:33.575875    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl"]
Jul 21 17:48:33.597583 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:33.597553    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b9719340-89dd-48a3-adca-417eb7fe6c9f-proxy-tls\") pod \"sequence-graph-b64c9-cbbfb58f7-5whfl\" (UID: \"b9719340-89dd-48a3-adca-417eb7fe6c9f\") " pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl"
Jul 21 17:48:33.597717 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:33.597593    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9719340-89dd-48a3-adca-417eb7fe6c9f-openshift-service-ca-bundle\") pod \"sequence-graph-b64c9-cbbfb58f7-5whfl\" (UID: \"b9719340-89dd-48a3-adca-417eb7fe6c9f\") " pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl"
Jul 21 17:48:33.698531 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:33.698498    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9719340-89dd-48a3-adca-417eb7fe6c9f-openshift-service-ca-bundle\") pod \"sequence-graph-b64c9-cbbfb58f7-5whfl\" (UID: \"b9719340-89dd-48a3-adca-417eb7fe6c9f\") " pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl"
Jul 21 17:48:33.698707 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:33.698606    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b9719340-89dd-48a3-adca-417eb7fe6c9f-proxy-tls\") pod \"sequence-graph-b64c9-cbbfb58f7-5whfl\" (UID: \"b9719340-89dd-48a3-adca-417eb7fe6c9f\") " pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl"
Jul 21 17:48:33.699322 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:33.699300    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9719340-89dd-48a3-adca-417eb7fe6c9f-openshift-service-ca-bundle\") pod \"sequence-graph-b64c9-cbbfb58f7-5whfl\" (UID: \"b9719340-89dd-48a3-adca-417eb7fe6c9f\") " pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl"
Jul 21 17:48:33.701228 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:33.701207    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b9719340-89dd-48a3-adca-417eb7fe6c9f-proxy-tls\") pod \"sequence-graph-b64c9-cbbfb58f7-5whfl\" (UID: \"b9719340-89dd-48a3-adca-417eb7fe6c9f\") " pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl"
Jul 21 17:48:33.878247 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:33.878138    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl"
Jul 21 17:48:34.009977 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:34.009948    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl"]
Jul 21 17:48:34.012152 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:48:34.012125    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9719340_89dd_48a3_adca_417eb7fe6c9f.slice/crio-db461f9f0af7dff3601100d33c7dc975b061d484fe5b0f1982d06b3958213b79 WatchSource:0}: Error finding container db461f9f0af7dff3601100d33c7dc975b061d484fe5b0f1982d06b3958213b79: Status 404 returned error can't find the container with id db461f9f0af7dff3601100d33c7dc975b061d484fe5b0f1982d06b3958213b79
Jul 21 17:48:34.102512 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:34.102481    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl" event={"ID":"b9719340-89dd-48a3-adca-417eb7fe6c9f","Type":"ContainerStarted","Data":"ecf14af86cdde4d87d66127af0681be0e1d0fc50b9669c4861c29e54eac7b215"}
Jul 21 17:48:34.102684 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:34.102542    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl" event={"ID":"b9719340-89dd-48a3-adca-417eb7fe6c9f","Type":"ContainerStarted","Data":"db461f9f0af7dff3601100d33c7dc975b061d484fe5b0f1982d06b3958213b79"}
Jul 21 17:48:34.102684 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:34.102573    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl"
Jul 21 17:48:34.118952 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:34.118892    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl" podStartSLOduration=1.118876836 podStartE2EDuration="1.118876836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:48:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:48:34.116641464 +0000 UTC m=+1339.517205534" watchObservedRunningTime="2026-07-21 17:48:34.118876836 +0000 UTC m=+1339.519440906"
Jul 21 17:48:35.977709 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:35.977617    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl" podUID="3d51e87a-c1e1-4869-8874-c868f839747d" containerName="ensemble-graph-f64bd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:48:40.114190 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:40.114150    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl"
Jul 21 17:48:40.978307 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:40.978269    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl" podUID="3d51e87a-c1e1-4869-8874-c868f839747d" containerName="ensemble-graph-f64bd" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:48:43.664361 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:43.664328    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl"]
Jul 21 17:48:43.664767 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:43.664630    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl" podUID="b9719340-89dd-48a3-adca-417eb7fe6c9f" containerName="sequence-graph-b64c9" containerID="cri-o://ecf14af86cdde4d87d66127af0681be0e1d0fc50b9669c4861c29e54eac7b215" gracePeriod=30
Jul 21 17:48:43.795292 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:43.795264    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl"
Jul 21 17:48:43.886962 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:43.886896    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d51e87a-c1e1-4869-8874-c868f839747d-openshift-service-ca-bundle\") pod \"3d51e87a-c1e1-4869-8874-c868f839747d\" (UID: \"3d51e87a-c1e1-4869-8874-c868f839747d\") "
Jul 21 17:48:43.886962 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:43.886955    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3d51e87a-c1e1-4869-8874-c868f839747d-proxy-tls\") pod \"3d51e87a-c1e1-4869-8874-c868f839747d\" (UID: \"3d51e87a-c1e1-4869-8874-c868f839747d\") "
Jul 21 17:48:43.887389 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:43.887356    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d51e87a-c1e1-4869-8874-c868f839747d-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "3d51e87a-c1e1-4869-8874-c868f839747d" (UID: "3d51e87a-c1e1-4869-8874-c868f839747d"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:48:43.889379 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:43.889352    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d51e87a-c1e1-4869-8874-c868f839747d-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "3d51e87a-c1e1-4869-8874-c868f839747d" (UID: "3d51e87a-c1e1-4869-8874-c868f839747d"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:48:43.988395 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:43.988366    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d51e87a-c1e1-4869-8874-c868f839747d-openshift-service-ca-bundle\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:48:43.988395 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:43.988393    2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/3d51e87a-c1e1-4869-8874-c868f839747d-proxy-tls\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:48:44.147202 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:44.147096    2581 generic.go:356] "Generic (PLEG): container finished" podID="3d51e87a-c1e1-4869-8874-c868f839747d" containerID="4cfdd5ab84e6a3c3f88a0f48e643469c96460c6adda3faa33c713bc6264fe203" exitCode=0
Jul 21 17:48:44.147202 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:44.147138    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl"
Jul 21 17:48:44.147407 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:44.147211    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl" event={"ID":"3d51e87a-c1e1-4869-8874-c868f839747d","Type":"ContainerDied","Data":"4cfdd5ab84e6a3c3f88a0f48e643469c96460c6adda3faa33c713bc6264fe203"}
Jul 21 17:48:44.147407 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:44.147264    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl" event={"ID":"3d51e87a-c1e1-4869-8874-c868f839747d","Type":"ContainerDied","Data":"166937839aed00df4aa0840b4c514b2be5a5b688c3f08cfbc65ef7b17fe23c8b"}
Jul 21 17:48:44.147407 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:44.147289    2581 scope.go:117] "RemoveContainer" containerID="4cfdd5ab84e6a3c3f88a0f48e643469c96460c6adda3faa33c713bc6264fe203"
Jul 21 17:48:44.157968 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:44.157953    2581 scope.go:117] "RemoveContainer" containerID="4cfdd5ab84e6a3c3f88a0f48e643469c96460c6adda3faa33c713bc6264fe203"
Jul 21 17:48:44.158260 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:48:44.158240    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4cfdd5ab84e6a3c3f88a0f48e643469c96460c6adda3faa33c713bc6264fe203\": container with ID starting with 4cfdd5ab84e6a3c3f88a0f48e643469c96460c6adda3faa33c713bc6264fe203 not found: ID does not exist" containerID="4cfdd5ab84e6a3c3f88a0f48e643469c96460c6adda3faa33c713bc6264fe203"
Jul 21 17:48:44.158325 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:44.158266    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4cfdd5ab84e6a3c3f88a0f48e643469c96460c6adda3faa33c713bc6264fe203"} err="failed to get container status \"4cfdd5ab84e6a3c3f88a0f48e643469c96460c6adda3faa33c713bc6264fe203\": rpc error: code = NotFound desc = could not find container \"4cfdd5ab84e6a3c3f88a0f48e643469c96460c6adda3faa33c713bc6264fe203\": container with ID starting with 4cfdd5ab84e6a3c3f88a0f48e643469c96460c6adda3faa33c713bc6264fe203 not found: ID does not exist"
Jul 21 17:48:44.170859 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:44.170838    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl"]
Jul 21 17:48:44.173868 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:44.173849    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-f64bd-7d86669d75-5pcrl"]
Jul 21 17:48:45.111527 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:45.111493    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl" podUID="b9719340-89dd-48a3-adca-417eb7fe6c9f" containerName="sequence-graph-b64c9" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:48:45.125343 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:45.125317    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d51e87a-c1e1-4869-8874-c868f839747d" path="/var/lib/kubelet/pods/3d51e87a-c1e1-4869-8874-c868f839747d/volumes"
Jul 21 17:48:50.111270 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:50.111234    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl" podUID="b9719340-89dd-48a3-adca-417eb7fe6c9f" containerName="sequence-graph-b64c9" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:48:55.111682 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:55.111643    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl" podUID="b9719340-89dd-48a3-adca-417eb7fe6c9f" containerName="sequence-graph-b64c9" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:48:55.112138 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:48:55.111755    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl"
Jul 21 17:49:00.111345 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:00.111309    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl" podUID="b9719340-89dd-48a3-adca-417eb7fe6c9f" containerName="sequence-graph-b64c9" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:49:05.111591 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:05.111553    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl" podUID="b9719340-89dd-48a3-adca-417eb7fe6c9f" containerName="sequence-graph-b64c9" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:49:10.111114 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:10.111076    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl" podUID="b9719340-89dd-48a3-adca-417eb7fe6c9f" containerName="sequence-graph-b64c9" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:49:13.820490 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:13.820463    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl"
Jul 21 17:49:13.947497 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:13.947415    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b9719340-89dd-48a3-adca-417eb7fe6c9f-proxy-tls\") pod \"b9719340-89dd-48a3-adca-417eb7fe6c9f\" (UID: \"b9719340-89dd-48a3-adca-417eb7fe6c9f\") "
Jul 21 17:49:13.947497 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:13.947479    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9719340-89dd-48a3-adca-417eb7fe6c9f-openshift-service-ca-bundle\") pod \"b9719340-89dd-48a3-adca-417eb7fe6c9f\" (UID: \"b9719340-89dd-48a3-adca-417eb7fe6c9f\") "
Jul 21 17:49:13.947870 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:13.947844    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9719340-89dd-48a3-adca-417eb7fe6c9f-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "b9719340-89dd-48a3-adca-417eb7fe6c9f" (UID: "b9719340-89dd-48a3-adca-417eb7fe6c9f"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:49:13.949704 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:13.949675    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9719340-89dd-48a3-adca-417eb7fe6c9f-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "b9719340-89dd-48a3-adca-417eb7fe6c9f" (UID: "b9719340-89dd-48a3-adca-417eb7fe6c9f"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:49:14.049022 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:14.048978    2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/b9719340-89dd-48a3-adca-417eb7fe6c9f-proxy-tls\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:49:14.049022 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:14.049018    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b9719340-89dd-48a3-adca-417eb7fe6c9f-openshift-service-ca-bundle\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:49:14.283032 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:14.282992    2581 generic.go:356] "Generic (PLEG): container finished" podID="b9719340-89dd-48a3-adca-417eb7fe6c9f" containerID="ecf14af86cdde4d87d66127af0681be0e1d0fc50b9669c4861c29e54eac7b215" exitCode=0
Jul 21 17:49:14.283217 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:14.283038    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl"
Jul 21 17:49:14.283217 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:14.283074    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl" event={"ID":"b9719340-89dd-48a3-adca-417eb7fe6c9f","Type":"ContainerDied","Data":"ecf14af86cdde4d87d66127af0681be0e1d0fc50b9669c4861c29e54eac7b215"}
Jul 21 17:49:14.283217 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:14.283128    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl" event={"ID":"b9719340-89dd-48a3-adca-417eb7fe6c9f","Type":"ContainerDied","Data":"db461f9f0af7dff3601100d33c7dc975b061d484fe5b0f1982d06b3958213b79"}
Jul 21 17:49:14.283217 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:14.283151    2581 scope.go:117] "RemoveContainer" containerID="ecf14af86cdde4d87d66127af0681be0e1d0fc50b9669c4861c29e54eac7b215"
Jul 21 17:49:14.291591 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:14.291573    2581 scope.go:117] "RemoveContainer" containerID="ecf14af86cdde4d87d66127af0681be0e1d0fc50b9669c4861c29e54eac7b215"
Jul 21 17:49:14.291861 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:49:14.291842    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecf14af86cdde4d87d66127af0681be0e1d0fc50b9669c4861c29e54eac7b215\": container with ID starting with ecf14af86cdde4d87d66127af0681be0e1d0fc50b9669c4861c29e54eac7b215 not found: ID does not exist" containerID="ecf14af86cdde4d87d66127af0681be0e1d0fc50b9669c4861c29e54eac7b215"
Jul 21 17:49:14.291918 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:14.291874    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecf14af86cdde4d87d66127af0681be0e1d0fc50b9669c4861c29e54eac7b215"} err="failed to get container status \"ecf14af86cdde4d87d66127af0681be0e1d0fc50b9669c4861c29e54eac7b215\": rpc error: code = NotFound desc = could not find container \"ecf14af86cdde4d87d66127af0681be0e1d0fc50b9669c4861c29e54eac7b215\": container with ID starting with ecf14af86cdde4d87d66127af0681be0e1d0fc50b9669c4861c29e54eac7b215 not found: ID does not exist"
Jul 21 17:49:14.304299 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:14.304274    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl"]
Jul 21 17:49:14.307323 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:14.307303    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-b64c9-cbbfb58f7-5whfl"]
Jul 21 17:49:15.126532 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:15.126499    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9719340-89dd-48a3-adca-417eb7fe6c9f" path="/var/lib/kubelet/pods/b9719340-89dd-48a3-adca-417eb7fe6c9f/volumes"
Jul 21 17:49:23.883647 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:23.883614    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq"]
Jul 21 17:49:23.884065 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:23.883968    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d51e87a-c1e1-4869-8874-c868f839747d" containerName="ensemble-graph-f64bd"
Jul 21 17:49:23.884065 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:23.883981    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d51e87a-c1e1-4869-8874-c868f839747d" containerName="ensemble-graph-f64bd"
Jul 21 17:49:23.884065 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:23.883991    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9719340-89dd-48a3-adca-417eb7fe6c9f" containerName="sequence-graph-b64c9"
Jul 21 17:49:23.884065 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:23.883996    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9719340-89dd-48a3-adca-417eb7fe6c9f" containerName="sequence-graph-b64c9"
Jul 21 17:49:23.884224 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:23.884074    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d51e87a-c1e1-4869-8874-c868f839747d" containerName="ensemble-graph-f64bd"
Jul 21 17:49:23.884224 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:23.884085    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9719340-89dd-48a3-adca-417eb7fe6c9f" containerName="sequence-graph-b64c9"
Jul 21 17:49:23.888854 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:23.888834    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq"
Jul 21 17:49:23.891371 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:23.891342    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-4c9b0-serving-cert\""
Jul 21 17:49:23.891371 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:23.891361    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 21 17:49:23.891579 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:23.891389    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"ensemble-graph-4c9b0-kube-rbac-proxy-sar-config\""
Jul 21 17:49:23.891703 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:23.891689    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-wx68x\""
Jul 21 17:49:23.898108 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:23.898086    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq"]
Jul 21 17:49:23.919561 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:23.919536    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12d23a8f-707c-4ff1-8719-b1b33a5c134b-openshift-service-ca-bundle\") pod \"ensemble-graph-4c9b0-754cff594-62dgq\" (UID: \"12d23a8f-707c-4ff1-8719-b1b33a5c134b\") " pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq"
Jul 21 17:49:23.919671 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:23.919580    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/12d23a8f-707c-4ff1-8719-b1b33a5c134b-proxy-tls\") pod \"ensemble-graph-4c9b0-754cff594-62dgq\" (UID: \"12d23a8f-707c-4ff1-8719-b1b33a5c134b\") " pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq"
Jul 21 17:49:24.020853 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:24.020827    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/12d23a8f-707c-4ff1-8719-b1b33a5c134b-proxy-tls\") pod \"ensemble-graph-4c9b0-754cff594-62dgq\" (UID: \"12d23a8f-707c-4ff1-8719-b1b33a5c134b\") " pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq"
Jul 21 17:49:24.020973 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:24.020916    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12d23a8f-707c-4ff1-8719-b1b33a5c134b-openshift-service-ca-bundle\") pod \"ensemble-graph-4c9b0-754cff594-62dgq\" (UID: \"12d23a8f-707c-4ff1-8719-b1b33a5c134b\") " pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq"
Jul 21 17:49:24.021031 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:49:24.021003    2581 secret.go:189] Couldn't get secret kserve-ci-e2e-test/ensemble-graph-4c9b0-serving-cert: secret "ensemble-graph-4c9b0-serving-cert" not found
Jul 21 17:49:24.021082 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:49:24.021072    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12d23a8f-707c-4ff1-8719-b1b33a5c134b-proxy-tls podName:12d23a8f-707c-4ff1-8719-b1b33a5c134b nodeName:}" failed. No retries permitted until 2026-07-21 17:49:24.521055798 +0000 UTC m=+1389.921619851 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/12d23a8f-707c-4ff1-8719-b1b33a5c134b-proxy-tls") pod "ensemble-graph-4c9b0-754cff594-62dgq" (UID: "12d23a8f-707c-4ff1-8719-b1b33a5c134b") : secret "ensemble-graph-4c9b0-serving-cert" not found
Jul 21 17:49:24.021528 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:24.021512    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12d23a8f-707c-4ff1-8719-b1b33a5c134b-openshift-service-ca-bundle\") pod \"ensemble-graph-4c9b0-754cff594-62dgq\" (UID: \"12d23a8f-707c-4ff1-8719-b1b33a5c134b\") " pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq"
Jul 21 17:49:24.524152 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:24.524118    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/12d23a8f-707c-4ff1-8719-b1b33a5c134b-proxy-tls\") pod \"ensemble-graph-4c9b0-754cff594-62dgq\" (UID: \"12d23a8f-707c-4ff1-8719-b1b33a5c134b\") " pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq"
Jul 21 17:49:24.524335 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:49:24.524254    2581 secret.go:189] Couldn't get secret kserve-ci-e2e-test/ensemble-graph-4c9b0-serving-cert: secret "ensemble-graph-4c9b0-serving-cert" not found
Jul 21 17:49:24.524335 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:49:24.524314    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12d23a8f-707c-4ff1-8719-b1b33a5c134b-proxy-tls podName:12d23a8f-707c-4ff1-8719-b1b33a5c134b nodeName:}" failed. No retries permitted until 2026-07-21 17:49:25.524299804 +0000 UTC m=+1390.924863853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/12d23a8f-707c-4ff1-8719-b1b33a5c134b-proxy-tls") pod "ensemble-graph-4c9b0-754cff594-62dgq" (UID: "12d23a8f-707c-4ff1-8719-b1b33a5c134b") : secret "ensemble-graph-4c9b0-serving-cert" not found
Jul 21 17:49:25.531978 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:25.531941    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/12d23a8f-707c-4ff1-8719-b1b33a5c134b-proxy-tls\") pod \"ensemble-graph-4c9b0-754cff594-62dgq\" (UID: \"12d23a8f-707c-4ff1-8719-b1b33a5c134b\") " pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq"
Jul 21 17:49:25.534639 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:25.534615    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/12d23a8f-707c-4ff1-8719-b1b33a5c134b-proxy-tls\") pod \"ensemble-graph-4c9b0-754cff594-62dgq\" (UID: \"12d23a8f-707c-4ff1-8719-b1b33a5c134b\") " pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq"
Jul 21 17:49:25.699922 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:25.699892    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq"
Jul 21 17:49:25.825612 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:25.825584    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq"]
Jul 21 17:49:25.827242 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:49:25.827214    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12d23a8f_707c_4ff1_8719_b1b33a5c134b.slice/crio-e3bbf50eba51f2590893d4a677cb3dbc77fc1e110e6b7818585fb1b664e3a157 WatchSource:0}: Error finding container e3bbf50eba51f2590893d4a677cb3dbc77fc1e110e6b7818585fb1b664e3a157: Status 404 returned error can't find the container with id e3bbf50eba51f2590893d4a677cb3dbc77fc1e110e6b7818585fb1b664e3a157
Jul 21 17:49:26.338939 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:26.338891    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq" event={"ID":"12d23a8f-707c-4ff1-8719-b1b33a5c134b","Type":"ContainerStarted","Data":"0fd75f36b470f9717663a5c6b5d471ad81eb61be1d60c3d5adadd3320cca7028"}
Jul 21 17:49:26.339123 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:26.338975    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq"
Jul 21 17:49:26.339123 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:26.339001    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq" event={"ID":"12d23a8f-707c-4ff1-8719-b1b33a5c134b","Type":"ContainerStarted","Data":"e3bbf50eba51f2590893d4a677cb3dbc77fc1e110e6b7818585fb1b664e3a157"}
Jul 21 17:49:26.356407 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:26.356366    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq" podStartSLOduration=3.356353308 podStartE2EDuration="3.356353308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:49:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:49:26.354659038 +0000 UTC m=+1391.755223109" watchObservedRunningTime="2026-07-21 17:49:26.356353308 +0000 UTC m=+1391.756917380"
Jul 21 17:49:32.348752 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:32.348722    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq"
Jul 21 17:49:43.914107 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:43.914075    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9"]
Jul 21 17:49:43.917610 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:43.917594    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9"
Jul 21 17:49:43.919865 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:43.919845    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-8e991-kube-rbac-proxy-sar-config\""
Jul 21 17:49:43.920148 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:43.920131    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"sequence-graph-8e991-serving-cert\""
Jul 21 17:49:43.926812 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:43.926789    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9"]
Jul 21 17:49:43.981242 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:43.981211    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1fba3291-23ba-4393-8b98-54390aad47cc-proxy-tls\") pod \"sequence-graph-8e991-bb5b488f6-295l9\" (UID: \"1fba3291-23ba-4393-8b98-54390aad47cc\") " pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9"
Jul 21 17:49:43.981388 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:43.981269    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fba3291-23ba-4393-8b98-54390aad47cc-openshift-service-ca-bundle\") pod \"sequence-graph-8e991-bb5b488f6-295l9\" (UID: \"1fba3291-23ba-4393-8b98-54390aad47cc\") " pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9"
Jul 21 17:49:44.082788 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:44.082759    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1fba3291-23ba-4393-8b98-54390aad47cc-proxy-tls\") pod \"sequence-graph-8e991-bb5b488f6-295l9\" (UID: \"1fba3291-23ba-4393-8b98-54390aad47cc\") " pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9"
Jul 21 17:49:44.082903 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:44.082796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fba3291-23ba-4393-8b98-54390aad47cc-openshift-service-ca-bundle\") pod \"sequence-graph-8e991-bb5b488f6-295l9\" (UID: \"1fba3291-23ba-4393-8b98-54390aad47cc\") " pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9"
Jul 21 17:49:44.083539 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:44.083470    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fba3291-23ba-4393-8b98-54390aad47cc-openshift-service-ca-bundle\") pod \"sequence-graph-8e991-bb5b488f6-295l9\" (UID: \"1fba3291-23ba-4393-8b98-54390aad47cc\") " pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9"
Jul 21 17:49:44.085353 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:44.085330    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1fba3291-23ba-4393-8b98-54390aad47cc-proxy-tls\") pod \"sequence-graph-8e991-bb5b488f6-295l9\" (UID: \"1fba3291-23ba-4393-8b98-54390aad47cc\") " pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9"
Jul 21 17:49:44.228889 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:44.228812    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9"
Jul 21 17:49:44.357510 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:44.357489    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9"]
Jul 21 17:49:44.359818 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:49:44.359793    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fba3291_23ba_4393_8b98_54390aad47cc.slice/crio-45643bfa03610c0c3c591aacafd652419b138c972910e227e34c9329fc2b564a WatchSource:0}: Error finding container 45643bfa03610c0c3c591aacafd652419b138c972910e227e34c9329fc2b564a: Status 404 returned error can't find the container with id 45643bfa03610c0c3c591aacafd652419b138c972910e227e34c9329fc2b564a
Jul 21 17:49:44.426950 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:44.426920    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9" event={"ID":"1fba3291-23ba-4393-8b98-54390aad47cc","Type":"ContainerStarted","Data":"79b7c0d68d059f63e4b12924f094b4509e31aa4e794df94de14cfd986c26b113"}
Jul 21 17:49:44.427043 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:44.426979    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9" event={"ID":"1fba3291-23ba-4393-8b98-54390aad47cc","Type":"ContainerStarted","Data":"45643bfa03610c0c3c591aacafd652419b138c972910e227e34c9329fc2b564a"}
Jul 21 17:49:44.427088 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:44.427057    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9"
Jul 21 17:49:44.443361 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:44.443317    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9" podStartSLOduration=1.443295501 podStartE2EDuration="1.443295501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:49:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:49:44.442335561 +0000 UTC m=+1409.842899632" watchObservedRunningTime="2026-07-21 17:49:44.443295501 +0000 UTC m=+1409.843859572"
Jul 21 17:49:50.436641 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:49:50.436611    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9"
Jul 21 17:51:15.096704 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:51:15.096675    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 17:51:15.100184 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:51:15.100148    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 17:56:15.131789 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:56:15.131761    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 17:56:15.136430 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:56:15.136410    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 17:57:38.660739 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:57:38.660687    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq"]
Jul 21 17:57:38.661631 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:57:38.660996    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq" podUID="12d23a8f-707c-4ff1-8719-b1b33a5c134b" containerName="ensemble-graph-4c9b0" containerID="cri-o://0fd75f36b470f9717663a5c6b5d471ad81eb61be1d60c3d5adadd3320cca7028" gracePeriod=30
Jul 21 17:57:42.347128 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:57:42.347083    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq" podUID="12d23a8f-707c-4ff1-8719-b1b33a5c134b" containerName="ensemble-graph-4c9b0" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:57:47.347333 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:57:47.347292    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq" podUID="12d23a8f-707c-4ff1-8719-b1b33a5c134b" containerName="ensemble-graph-4c9b0" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:57:52.347259 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:57:52.347213    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq" podUID="12d23a8f-707c-4ff1-8719-b1b33a5c134b" containerName="ensemble-graph-4c9b0" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:57:52.347642 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:57:52.347322    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq"
Jul 21 17:57:57.346743 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:57:57.346700    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq" podUID="12d23a8f-707c-4ff1-8719-b1b33a5c134b" containerName="ensemble-graph-4c9b0" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:57:58.502137 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:57:58.502105    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9"]
Jul 21 17:57:58.502515 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:57:58.502315    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9" podUID="1fba3291-23ba-4393-8b98-54390aad47cc" containerName="sequence-graph-8e991" containerID="cri-o://79b7c0d68d059f63e4b12924f094b4509e31aa4e794df94de14cfd986c26b113" gracePeriod=30
Jul 21 17:58:00.435877 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:00.435838    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9" podUID="1fba3291-23ba-4393-8b98-54390aad47cc" containerName="sequence-graph-8e991" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:58:02.346626 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:02.346581    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq" podUID="12d23a8f-707c-4ff1-8719-b1b33a5c134b" containerName="ensemble-graph-4c9b0" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:58:05.436090 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:05.436042    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9" podUID="1fba3291-23ba-4393-8b98-54390aad47cc" containerName="sequence-graph-8e991" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:58:07.346368 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:07.346332    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq" podUID="12d23a8f-707c-4ff1-8719-b1b33a5c134b" containerName="ensemble-graph-4c9b0" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:58:08.810315 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:08.810293    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq"
Jul 21 17:58:08.948849 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:08.948774    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12d23a8f-707c-4ff1-8719-b1b33a5c134b-openshift-service-ca-bundle\") pod \"12d23a8f-707c-4ff1-8719-b1b33a5c134b\" (UID: \"12d23a8f-707c-4ff1-8719-b1b33a5c134b\") "
Jul 21 17:58:08.948990 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:08.948876    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/12d23a8f-707c-4ff1-8719-b1b33a5c134b-proxy-tls\") pod \"12d23a8f-707c-4ff1-8719-b1b33a5c134b\" (UID: \"12d23a8f-707c-4ff1-8719-b1b33a5c134b\") "
Jul 21 17:58:08.949098 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:08.949075    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12d23a8f-707c-4ff1-8719-b1b33a5c134b-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "12d23a8f-707c-4ff1-8719-b1b33a5c134b" (UID: "12d23a8f-707c-4ff1-8719-b1b33a5c134b"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:58:08.950968 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:08.950943    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/12d23a8f-707c-4ff1-8719-b1b33a5c134b-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "12d23a8f-707c-4ff1-8719-b1b33a5c134b" (UID: "12d23a8f-707c-4ff1-8719-b1b33a5c134b"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:58:09.049739 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:09.049709    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/12d23a8f-707c-4ff1-8719-b1b33a5c134b-openshift-service-ca-bundle\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:58:09.049739 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:09.049736    2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/12d23a8f-707c-4ff1-8719-b1b33a5c134b-proxy-tls\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:58:09.677085 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:09.677040    2581 generic.go:356] "Generic (PLEG): container finished" podID="12d23a8f-707c-4ff1-8719-b1b33a5c134b" containerID="0fd75f36b470f9717663a5c6b5d471ad81eb61be1d60c3d5adadd3320cca7028" exitCode=0
Jul 21 17:58:09.677085 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:09.677086    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq" event={"ID":"12d23a8f-707c-4ff1-8719-b1b33a5c134b","Type":"ContainerDied","Data":"0fd75f36b470f9717663a5c6b5d471ad81eb61be1d60c3d5adadd3320cca7028"}
Jul 21 17:58:09.677335 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:09.677097    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq"
Jul 21 17:58:09.677335 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:09.677157    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq" event={"ID":"12d23a8f-707c-4ff1-8719-b1b33a5c134b","Type":"ContainerDied","Data":"e3bbf50eba51f2590893d4a677cb3dbc77fc1e110e6b7818585fb1b664e3a157"}
Jul 21 17:58:09.677335 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:09.677202    2581 scope.go:117] "RemoveContainer" containerID="0fd75f36b470f9717663a5c6b5d471ad81eb61be1d60c3d5adadd3320cca7028"
Jul 21 17:58:09.685674 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:09.685656    2581 scope.go:117] "RemoveContainer" containerID="0fd75f36b470f9717663a5c6b5d471ad81eb61be1d60c3d5adadd3320cca7028"
Jul 21 17:58:09.685923 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:58:09.685904    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fd75f36b470f9717663a5c6b5d471ad81eb61be1d60c3d5adadd3320cca7028\": container with ID starting with 0fd75f36b470f9717663a5c6b5d471ad81eb61be1d60c3d5adadd3320cca7028 not found: ID does not exist" containerID="0fd75f36b470f9717663a5c6b5d471ad81eb61be1d60c3d5adadd3320cca7028"
Jul 21 17:58:09.685969 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:09.685931    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fd75f36b470f9717663a5c6b5d471ad81eb61be1d60c3d5adadd3320cca7028"} err="failed to get container status \"0fd75f36b470f9717663a5c6b5d471ad81eb61be1d60c3d5adadd3320cca7028\": rpc error: code = NotFound desc = could not find container \"0fd75f36b470f9717663a5c6b5d471ad81eb61be1d60c3d5adadd3320cca7028\": container with ID starting with 0fd75f36b470f9717663a5c6b5d471ad81eb61be1d60c3d5adadd3320cca7028 not found: ID does not exist"
Jul 21 17:58:09.692062 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:09.692040    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq"]
Jul 21 17:58:09.694253 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:09.694222    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/ensemble-graph-4c9b0-754cff594-62dgq"]
Jul 21 17:58:10.436096 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:10.436059    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9" podUID="1fba3291-23ba-4393-8b98-54390aad47cc" containerName="sequence-graph-8e991" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:58:10.436593 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:10.436157    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9"
Jul 21 17:58:11.125674 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:11.125626    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12d23a8f-707c-4ff1-8719-b1b33a5c134b" path="/var/lib/kubelet/pods/12d23a8f-707c-4ff1-8719-b1b33a5c134b/volumes"
Jul 21 17:58:15.435923 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:15.435888    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9" podUID="1fba3291-23ba-4393-8b98-54390aad47cc" containerName="sequence-graph-8e991" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:58:20.435793 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:20.435753    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9" podUID="1fba3291-23ba-4393-8b98-54390aad47cc" containerName="sequence-graph-8e991" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:58:25.435495 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:25.435454    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9" podUID="1fba3291-23ba-4393-8b98-54390aad47cc" containerName="sequence-graph-8e991" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:58:28.659713 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:28.659690    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9"
Jul 21 17:58:28.763089 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:28.763015    2581 generic.go:356] "Generic (PLEG): container finished" podID="1fba3291-23ba-4393-8b98-54390aad47cc" containerID="79b7c0d68d059f63e4b12924f094b4509e31aa4e794df94de14cfd986c26b113" exitCode=0
Jul 21 17:58:28.763089 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:28.763061    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9"
Jul 21 17:58:28.763287 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:28.763111    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9" event={"ID":"1fba3291-23ba-4393-8b98-54390aad47cc","Type":"ContainerDied","Data":"79b7c0d68d059f63e4b12924f094b4509e31aa4e794df94de14cfd986c26b113"}
Jul 21 17:58:28.763287 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:28.763196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9" event={"ID":"1fba3291-23ba-4393-8b98-54390aad47cc","Type":"ContainerDied","Data":"45643bfa03610c0c3c591aacafd652419b138c972910e227e34c9329fc2b564a"}
Jul 21 17:58:28.763287 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:28.763237    2581 scope.go:117] "RemoveContainer" containerID="79b7c0d68d059f63e4b12924f094b4509e31aa4e794df94de14cfd986c26b113"
Jul 21 17:58:28.773026 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:28.773003    2581 scope.go:117] "RemoveContainer" containerID="79b7c0d68d059f63e4b12924f094b4509e31aa4e794df94de14cfd986c26b113"
Jul 21 17:58:28.773417 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:58:28.773393    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79b7c0d68d059f63e4b12924f094b4509e31aa4e794df94de14cfd986c26b113\": container with ID starting with 79b7c0d68d059f63e4b12924f094b4509e31aa4e794df94de14cfd986c26b113 not found: ID does not exist" containerID="79b7c0d68d059f63e4b12924f094b4509e31aa4e794df94de14cfd986c26b113"
Jul 21 17:58:28.773494 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:28.773422    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79b7c0d68d059f63e4b12924f094b4509e31aa4e794df94de14cfd986c26b113"} err="failed to get container status \"79b7c0d68d059f63e4b12924f094b4509e31aa4e794df94de14cfd986c26b113\": rpc error: code = NotFound desc = could not find container \"79b7c0d68d059f63e4b12924f094b4509e31aa4e794df94de14cfd986c26b113\": container with ID starting with 79b7c0d68d059f63e4b12924f094b4509e31aa4e794df94de14cfd986c26b113 not found: ID does not exist"
Jul 21 17:58:28.809389 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:28.809371    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fba3291-23ba-4393-8b98-54390aad47cc-openshift-service-ca-bundle\") pod \"1fba3291-23ba-4393-8b98-54390aad47cc\" (UID: \"1fba3291-23ba-4393-8b98-54390aad47cc\") "
Jul 21 17:58:28.809518 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:28.809499    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1fba3291-23ba-4393-8b98-54390aad47cc-proxy-tls\") pod \"1fba3291-23ba-4393-8b98-54390aad47cc\" (UID: \"1fba3291-23ba-4393-8b98-54390aad47cc\") "
Jul 21 17:58:28.809694 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:28.809671    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fba3291-23ba-4393-8b98-54390aad47cc-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "1fba3291-23ba-4393-8b98-54390aad47cc" (UID: "1fba3291-23ba-4393-8b98-54390aad47cc"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:58:28.811506 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:28.811483    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fba3291-23ba-4393-8b98-54390aad47cc-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "1fba3291-23ba-4393-8b98-54390aad47cc" (UID: "1fba3291-23ba-4393-8b98-54390aad47cc"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:58:28.910192 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:28.910153    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fba3291-23ba-4393-8b98-54390aad47cc-openshift-service-ca-bundle\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:58:28.910192 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:28.910191    2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/1fba3291-23ba-4393-8b98-54390aad47cc-proxy-tls\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:58:29.084010 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:29.083984    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9"]
Jul 21 17:58:29.088515 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:29.088491    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/sequence-graph-8e991-bb5b488f6-295l9"]
Jul 21 17:58:29.124873 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:29.124844    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fba3291-23ba-4393-8b98-54390aad47cc" path="/var/lib/kubelet/pods/1fba3291-23ba-4393-8b98-54390aad47cc/volumes"
Jul 21 17:58:38.898057 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:38.898021    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7"]
Jul 21 17:58:38.898529 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:38.898395    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12d23a8f-707c-4ff1-8719-b1b33a5c134b" containerName="ensemble-graph-4c9b0"
Jul 21 17:58:38.898529 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:38.898409    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="12d23a8f-707c-4ff1-8719-b1b33a5c134b" containerName="ensemble-graph-4c9b0"
Jul 21 17:58:38.898529 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:38.898436    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fba3291-23ba-4393-8b98-54390aad47cc" containerName="sequence-graph-8e991"
Jul 21 17:58:38.898529 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:38.898441    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fba3291-23ba-4393-8b98-54390aad47cc" containerName="sequence-graph-8e991"
Jul 21 17:58:38.898529 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:38.898489    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="12d23a8f-707c-4ff1-8719-b1b33a5c134b" containerName="ensemble-graph-4c9b0"
Jul 21 17:58:38.898529 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:38.898499    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fba3291-23ba-4393-8b98-54390aad47cc" containerName="sequence-graph-8e991"
Jul 21 17:58:38.902791 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:38.902770    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7"
Jul 21 17:58:38.905285 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:38.905257    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\""
Jul 21 17:58:38.905285 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:38.905271    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-wx68x\""
Jul 21 17:58:38.905285 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:38.905272    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-edfd2-serving-cert\""
Jul 21 17:58:38.905497 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:38.905296    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-edfd2-kube-rbac-proxy-sar-config\""
Jul 21 17:58:38.911985 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:38.911962    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7"]
Jul 21 17:58:38.984218 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:38.984194    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/74fa48df-8884-40e9-96e9-6c56969c7f52-proxy-tls\") pod \"splitter-graph-edfd2-6d56bf75d9-cj6n7\" (UID: \"74fa48df-8884-40e9-96e9-6c56969c7f52\") " pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7"
Jul 21 17:58:38.984353 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:38.984258    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74fa48df-8884-40e9-96e9-6c56969c7f52-openshift-service-ca-bundle\") pod \"splitter-graph-edfd2-6d56bf75d9-cj6n7\" (UID: \"74fa48df-8884-40e9-96e9-6c56969c7f52\") " pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7"
Jul 21 17:58:39.085380 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:39.085339    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74fa48df-8884-40e9-96e9-6c56969c7f52-openshift-service-ca-bundle\") pod \"splitter-graph-edfd2-6d56bf75d9-cj6n7\" (UID: \"74fa48df-8884-40e9-96e9-6c56969c7f52\") " pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7"
Jul 21 17:58:39.085499 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:39.085396    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/74fa48df-8884-40e9-96e9-6c56969c7f52-proxy-tls\") pod \"splitter-graph-edfd2-6d56bf75d9-cj6n7\" (UID: \"74fa48df-8884-40e9-96e9-6c56969c7f52\") " pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7"
Jul 21 17:58:39.085554 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:58:39.085506    2581 secret.go:189] Couldn't get secret kserve-ci-e2e-test/splitter-graph-edfd2-serving-cert: secret "splitter-graph-edfd2-serving-cert" not found
Jul 21 17:58:39.085594 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:58:39.085559    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/74fa48df-8884-40e9-96e9-6c56969c7f52-proxy-tls podName:74fa48df-8884-40e9-96e9-6c56969c7f52 nodeName:}" failed. No retries permitted until 2026-07-21 17:58:39.585543214 +0000 UTC m=+1944.986107265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/74fa48df-8884-40e9-96e9-6c56969c7f52-proxy-tls") pod "splitter-graph-edfd2-6d56bf75d9-cj6n7" (UID: "74fa48df-8884-40e9-96e9-6c56969c7f52") : secret "splitter-graph-edfd2-serving-cert" not found
Jul 21 17:58:39.085933 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:39.085916    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74fa48df-8884-40e9-96e9-6c56969c7f52-openshift-service-ca-bundle\") pod \"splitter-graph-edfd2-6d56bf75d9-cj6n7\" (UID: \"74fa48df-8884-40e9-96e9-6c56969c7f52\") " pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7"
Jul 21 17:58:39.589301 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:39.589269    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/74fa48df-8884-40e9-96e9-6c56969c7f52-proxy-tls\") pod \"splitter-graph-edfd2-6d56bf75d9-cj6n7\" (UID: \"74fa48df-8884-40e9-96e9-6c56969c7f52\") " pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7"
Jul 21 17:58:39.591718 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:39.591699    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/74fa48df-8884-40e9-96e9-6c56969c7f52-proxy-tls\") pod \"splitter-graph-edfd2-6d56bf75d9-cj6n7\" (UID: \"74fa48df-8884-40e9-96e9-6c56969c7f52\") " pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7"
Jul 21 17:58:39.813565 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:39.813537    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7"
Jul 21 17:58:39.942713 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:39.942686    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7"]
Jul 21 17:58:39.945356 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:58:39.945319    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74fa48df_8884_40e9_96e9_6c56969c7f52.slice/crio-35f922218dcf737cd0276d0e2431cd4544fbe2ad6d1b1e62f6f0f5dc0974c957 WatchSource:0}: Error finding container 35f922218dcf737cd0276d0e2431cd4544fbe2ad6d1b1e62f6f0f5dc0974c957: Status 404 returned error can't find the container with id 35f922218dcf737cd0276d0e2431cd4544fbe2ad6d1b1e62f6f0f5dc0974c957
Jul 21 17:58:40.818260 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:40.818215    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7" event={"ID":"74fa48df-8884-40e9-96e9-6c56969c7f52","Type":"ContainerStarted","Data":"bb37d114832bc9b3ee142d3fa75808e9553c64f3101add2fde03d2159e06e10c"}
Jul 21 17:58:40.818442 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:40.818307    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7" event={"ID":"74fa48df-8884-40e9-96e9-6c56969c7f52","Type":"ContainerStarted","Data":"35f922218dcf737cd0276d0e2431cd4544fbe2ad6d1b1e62f6f0f5dc0974c957"}
Jul 21 17:58:40.818442 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:40.818333    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7"
Jul 21 17:58:40.834928 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:40.834879    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7" podStartSLOduration=2.834864654 podStartE2EDuration="2.834864654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:58:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:58:40.83446331 +0000 UTC m=+1946.235027397" watchObservedRunningTime="2026-07-21 17:58:40.834864654 +0000 UTC m=+1946.235428724"
Jul 21 17:58:46.829231 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:46.829195    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7"
Jul 21 17:58:48.974551 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:48.974468    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7"]
Jul 21 17:58:48.974918 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:48.974717    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7" podUID="74fa48df-8884-40e9-96e9-6c56969c7f52" containerName="splitter-graph-edfd2" containerID="cri-o://bb37d114832bc9b3ee142d3fa75808e9553c64f3101add2fde03d2159e06e10c" gracePeriod=30
Jul 21 17:58:51.827726 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:51.827680    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7" podUID="74fa48df-8884-40e9-96e9-6c56969c7f52" containerName="splitter-graph-edfd2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:58:56.826923 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:56.826884    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7" podUID="74fa48df-8884-40e9-96e9-6c56969c7f52" containerName="splitter-graph-edfd2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:58:58.753390 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:58.753352    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5"]
Jul 21 17:58:58.757074 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:58.757051    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5"
Jul 21 17:58:58.759400 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:58.759377    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-984cf-kube-rbac-proxy-sar-config\""
Jul 21 17:58:58.759499 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:58.759381    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"switch-graph-984cf-serving-cert\""
Jul 21 17:58:58.766209 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:58.766186    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5"]
Jul 21 17:58:58.848678 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:58.848655    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee9a7e45-62a3-498c-ae89-6e4232cd3b60-openshift-service-ca-bundle\") pod \"switch-graph-984cf-684f6d5564-4wqx5\" (UID: \"ee9a7e45-62a3-498c-ae89-6e4232cd3b60\") " pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5"
Jul 21 17:58:58.848782 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:58.848697    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee9a7e45-62a3-498c-ae89-6e4232cd3b60-proxy-tls\") pod \"switch-graph-984cf-684f6d5564-4wqx5\" (UID: \"ee9a7e45-62a3-498c-ae89-6e4232cd3b60\") " pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5"
Jul 21 17:58:58.949216 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:58.949156    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee9a7e45-62a3-498c-ae89-6e4232cd3b60-proxy-tls\") pod \"switch-graph-984cf-684f6d5564-4wqx5\" (UID: \"ee9a7e45-62a3-498c-ae89-6e4232cd3b60\") " pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5"
Jul 21 17:58:58.949344 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:58.949300    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee9a7e45-62a3-498c-ae89-6e4232cd3b60-openshift-service-ca-bundle\") pod \"switch-graph-984cf-684f6d5564-4wqx5\" (UID: \"ee9a7e45-62a3-498c-ae89-6e4232cd3b60\") " pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5"
Jul 21 17:58:58.949344 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:58:58.949316    2581 secret.go:189] Couldn't get secret kserve-ci-e2e-test/switch-graph-984cf-serving-cert: secret "switch-graph-984cf-serving-cert" not found
Jul 21 17:58:58.949461 ip-10-0-135-98 kubenswrapper[2581]: E0721 17:58:58.949383    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee9a7e45-62a3-498c-ae89-6e4232cd3b60-proxy-tls podName:ee9a7e45-62a3-498c-ae89-6e4232cd3b60 nodeName:}" failed. No retries permitted until 2026-07-21 17:58:59.449367118 +0000 UTC m=+1964.849931166 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/ee9a7e45-62a3-498c-ae89-6e4232cd3b60-proxy-tls") pod "switch-graph-984cf-684f6d5564-4wqx5" (UID: "ee9a7e45-62a3-498c-ae89-6e4232cd3b60") : secret "switch-graph-984cf-serving-cert" not found
Jul 21 17:58:58.949895 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:58.949874    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee9a7e45-62a3-498c-ae89-6e4232cd3b60-openshift-service-ca-bundle\") pod \"switch-graph-984cf-684f6d5564-4wqx5\" (UID: \"ee9a7e45-62a3-498c-ae89-6e4232cd3b60\") " pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5"
Jul 21 17:58:59.454148 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:59.454116    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee9a7e45-62a3-498c-ae89-6e4232cd3b60-proxy-tls\") pod \"switch-graph-984cf-684f6d5564-4wqx5\" (UID: \"ee9a7e45-62a3-498c-ae89-6e4232cd3b60\") " pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5"
Jul 21 17:58:59.456599 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:59.456572    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee9a7e45-62a3-498c-ae89-6e4232cd3b60-proxy-tls\") pod \"switch-graph-984cf-684f6d5564-4wqx5\" (UID: \"ee9a7e45-62a3-498c-ae89-6e4232cd3b60\") " pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5"
Jul 21 17:58:59.667850 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:59.667823    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5"
Jul 21 17:58:59.798211 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:59.798185    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5"]
Jul 21 17:58:59.800322 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:58:59.800291    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee9a7e45_62a3_498c_ae89_6e4232cd3b60.slice/crio-a1b866522b6f2fca70df34f9349538ee891af59c9b3d3b78ed074e8984c65880 WatchSource:0}: Error finding container a1b866522b6f2fca70df34f9349538ee891af59c9b3d3b78ed074e8984c65880: Status 404 returned error can't find the container with id a1b866522b6f2fca70df34f9349538ee891af59c9b3d3b78ed074e8984c65880
Jul 21 17:58:59.906911 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:59.906879    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5" event={"ID":"ee9a7e45-62a3-498c-ae89-6e4232cd3b60","Type":"ContainerStarted","Data":"5e1eecf5af79c37261f765c745bf48f5c9fa9fe202fc234f5368bae7ee3544e1"}
Jul 21 17:58:59.907068 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:59.906959    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5" event={"ID":"ee9a7e45-62a3-498c-ae89-6e4232cd3b60","Type":"ContainerStarted","Data":"a1b866522b6f2fca70df34f9349538ee891af59c9b3d3b78ed074e8984c65880"}
Jul 21 17:58:59.907068 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:59.906981    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5"
Jul 21 17:58:59.924505 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:58:59.924447    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5" podStartSLOduration=1.924433477 podStartE2EDuration="1.924433477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:58:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:58:59.924065653 +0000 UTC m=+1965.324629741" watchObservedRunningTime="2026-07-21 17:58:59.924433477 +0000 UTC m=+1965.324997547"
Jul 21 17:59:01.827581 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:01.827547    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7" podUID="74fa48df-8884-40e9-96e9-6c56969c7f52" containerName="splitter-graph-edfd2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:59:01.827957 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:01.827658    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7"
Jul 21 17:59:05.918595 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:05.918524    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5"
Jul 21 17:59:06.827007 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:06.826968    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7" podUID="74fa48df-8884-40e9-96e9-6c56969c7f52" containerName="splitter-graph-edfd2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:59:11.827366 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:11.827319    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7" podUID="74fa48df-8884-40e9-96e9-6c56969c7f52" containerName="splitter-graph-edfd2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:59:16.827942 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:16.827898    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7" podUID="74fa48df-8884-40e9-96e9-6c56969c7f52" containerName="splitter-graph-edfd2" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 17:59:18.995081 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:18.995049    2581 generic.go:356] "Generic (PLEG): container finished" podID="74fa48df-8884-40e9-96e9-6c56969c7f52" containerID="bb37d114832bc9b3ee142d3fa75808e9553c64f3101add2fde03d2159e06e10c" exitCode=0
Jul 21 17:59:18.995383 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:18.995116    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7" event={"ID":"74fa48df-8884-40e9-96e9-6c56969c7f52","Type":"ContainerDied","Data":"bb37d114832bc9b3ee142d3fa75808e9553c64f3101add2fde03d2159e06e10c"}
Jul 21 17:59:19.112978 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:19.112956    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7"
Jul 21 17:59:19.211387 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:19.211357    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74fa48df-8884-40e9-96e9-6c56969c7f52-openshift-service-ca-bundle\") pod \"74fa48df-8884-40e9-96e9-6c56969c7f52\" (UID: \"74fa48df-8884-40e9-96e9-6c56969c7f52\") "
Jul 21 17:59:19.211538 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:19.211404    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/74fa48df-8884-40e9-96e9-6c56969c7f52-proxy-tls\") pod \"74fa48df-8884-40e9-96e9-6c56969c7f52\" (UID: \"74fa48df-8884-40e9-96e9-6c56969c7f52\") "
Jul 21 17:59:19.211707 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:19.211687    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74fa48df-8884-40e9-96e9-6c56969c7f52-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "74fa48df-8884-40e9-96e9-6c56969c7f52" (UID: "74fa48df-8884-40e9-96e9-6c56969c7f52"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 17:59:19.213562 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:19.213544    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74fa48df-8884-40e9-96e9-6c56969c7f52-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "74fa48df-8884-40e9-96e9-6c56969c7f52" (UID: "74fa48df-8884-40e9-96e9-6c56969c7f52"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 17:59:19.312126 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:19.312105    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/74fa48df-8884-40e9-96e9-6c56969c7f52-openshift-service-ca-bundle\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:59:19.312126 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:19.312128    2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/74fa48df-8884-40e9-96e9-6c56969c7f52-proxy-tls\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 17:59:20.001151 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:20.001116    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7" event={"ID":"74fa48df-8884-40e9-96e9-6c56969c7f52","Type":"ContainerDied","Data":"35f922218dcf737cd0276d0e2431cd4544fbe2ad6d1b1e62f6f0f5dc0974c957"}
Jul 21 17:59:20.001629 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:20.001195    2581 scope.go:117] "RemoveContainer" containerID="bb37d114832bc9b3ee142d3fa75808e9553c64f3101add2fde03d2159e06e10c"
Jul 21 17:59:20.001629 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:20.001132    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7"
Jul 21 17:59:20.023087 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:20.023058    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7"]
Jul 21 17:59:20.026328 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:20.026307    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-edfd2-6d56bf75d9-cj6n7"]
Jul 21 17:59:21.125666 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:21.125631    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74fa48df-8884-40e9-96e9-6c56969c7f52" path="/var/lib/kubelet/pods/74fa48df-8884-40e9-96e9-6c56969c7f52/volumes"
Jul 21 17:59:49.229271 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:49.229234    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj"]
Jul 21 17:59:49.229677 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:49.229579    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74fa48df-8884-40e9-96e9-6c56969c7f52" containerName="splitter-graph-edfd2"
Jul 21 17:59:49.229677 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:49.229591    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="74fa48df-8884-40e9-96e9-6c56969c7f52" containerName="splitter-graph-edfd2"
Jul 21 17:59:49.229677 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:49.229650    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="74fa48df-8884-40e9-96e9-6c56969c7f52" containerName="splitter-graph-edfd2"
Jul 21 17:59:49.239116 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:49.239084    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj"
Jul 21 17:59:49.241913 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:49.241883    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-afaec-serving-cert\""
Jul 21 17:59:49.242049 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:49.241980    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"splitter-graph-afaec-kube-rbac-proxy-sar-config\""
Jul 21 17:59:49.244052 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:49.244029    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj"]
Jul 21 17:59:49.330320 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:49.330293    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/39988086-e8b6-43ed-bcac-947b2cf28d4e-proxy-tls\") pod \"splitter-graph-afaec-6f497d467-xk7jj\" (UID: \"39988086-e8b6-43ed-bcac-947b2cf28d4e\") " pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj"
Jul 21 17:59:49.330471 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:49.330357    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39988086-e8b6-43ed-bcac-947b2cf28d4e-openshift-service-ca-bundle\") pod \"splitter-graph-afaec-6f497d467-xk7jj\" (UID: \"39988086-e8b6-43ed-bcac-947b2cf28d4e\") " pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj"
Jul 21 17:59:49.431226 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:49.431190    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/39988086-e8b6-43ed-bcac-947b2cf28d4e-proxy-tls\") pod \"splitter-graph-afaec-6f497d467-xk7jj\" (UID: \"39988086-e8b6-43ed-bcac-947b2cf28d4e\") " pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj"
Jul 21 17:59:49.431383 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:49.431264    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39988086-e8b6-43ed-bcac-947b2cf28d4e-openshift-service-ca-bundle\") pod \"splitter-graph-afaec-6f497d467-xk7jj\" (UID: \"39988086-e8b6-43ed-bcac-947b2cf28d4e\") " pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj"
Jul 21 17:59:49.431895 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:49.431873    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39988086-e8b6-43ed-bcac-947b2cf28d4e-openshift-service-ca-bundle\") pod \"splitter-graph-afaec-6f497d467-xk7jj\" (UID: \"39988086-e8b6-43ed-bcac-947b2cf28d4e\") " pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj"
Jul 21 17:59:49.433693 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:49.433672    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/39988086-e8b6-43ed-bcac-947b2cf28d4e-proxy-tls\") pod \"splitter-graph-afaec-6f497d467-xk7jj\" (UID: \"39988086-e8b6-43ed-bcac-947b2cf28d4e\") " pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj"
Jul 21 17:59:49.550055 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:49.550026    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj"
Jul 21 17:59:49.680714 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:49.680635    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj"]
Jul 21 17:59:49.682845 ip-10-0-135-98 kubenswrapper[2581]: W0721 17:59:49.682821    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39988086_e8b6_43ed_bcac_947b2cf28d4e.slice/crio-3d2dbf3a92d5414047f1c81807436af8c47396182de31e8ef110bdb58cb38528 WatchSource:0}: Error finding container 3d2dbf3a92d5414047f1c81807436af8c47396182de31e8ef110bdb58cb38528: Status 404 returned error can't find the container with id 3d2dbf3a92d5414047f1c81807436af8c47396182de31e8ef110bdb58cb38528
Jul 21 17:59:50.139943 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:50.139910    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj" event={"ID":"39988086-e8b6-43ed-bcac-947b2cf28d4e","Type":"ContainerStarted","Data":"c48a3883717fcac683f0a540554a64f76d9b707287ac46810ecce1d9046984bb"}
Jul 21 17:59:50.140136 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:50.139960    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj" event={"ID":"39988086-e8b6-43ed-bcac-947b2cf28d4e","Type":"ContainerStarted","Data":"3d2dbf3a92d5414047f1c81807436af8c47396182de31e8ef110bdb58cb38528"}
Jul 21 17:59:50.140136 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:50.140072    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj"
Jul 21 17:59:50.159671 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:50.159625    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj" podStartSLOduration=1.159611017 podStartE2EDuration="1.159611017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 17:59:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:59:50.157981045 +0000 UTC m=+2015.558545115" watchObservedRunningTime="2026-07-21 17:59:50.159611017 +0000 UTC m=+2015.560175087"
Jul 21 17:59:56.149964 ip-10-0-135-98 kubenswrapper[2581]: I0721 17:59:56.149931    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj"
Jul 21 18:01:15.158436 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:01:15.158409    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 18:01:15.165063 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:01:15.165045    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 18:06:15.186551 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:06:15.186524    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 18:06:15.193879 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:06:15.193859    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 18:08:03.804622 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:03.804587    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj"]
Jul 21 18:08:03.805134 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:03.804785    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj" podUID="39988086-e8b6-43ed-bcac-947b2cf28d4e" containerName="splitter-graph-afaec" containerID="cri-o://c48a3883717fcac683f0a540554a64f76d9b707287ac46810ecce1d9046984bb" gracePeriod=30
Jul 21 18:08:06.147698 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:06.147611    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj" podUID="39988086-e8b6-43ed-bcac-947b2cf28d4e" containerName="splitter-graph-afaec" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 18:08:11.147648 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:11.147609    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj" podUID="39988086-e8b6-43ed-bcac-947b2cf28d4e" containerName="splitter-graph-afaec" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 18:08:16.147835 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:16.147801    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj" podUID="39988086-e8b6-43ed-bcac-947b2cf28d4e" containerName="splitter-graph-afaec" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 18:08:16.148305 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:16.147889    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj"
Jul 21 18:08:21.147906 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:21.147868    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj" podUID="39988086-e8b6-43ed-bcac-947b2cf28d4e" containerName="splitter-graph-afaec" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 18:08:26.148411 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:26.148368    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj" podUID="39988086-e8b6-43ed-bcac-947b2cf28d4e" containerName="splitter-graph-afaec" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 18:08:31.148039 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:31.147998    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj" podUID="39988086-e8b6-43ed-bcac-947b2cf28d4e" containerName="splitter-graph-afaec" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 18:08:33.992353 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:33.992333    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj"
Jul 21 18:08:34.048471 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:34.048437    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39988086-e8b6-43ed-bcac-947b2cf28d4e-openshift-service-ca-bundle\") pod \"39988086-e8b6-43ed-bcac-947b2cf28d4e\" (UID: \"39988086-e8b6-43ed-bcac-947b2cf28d4e\") "
Jul 21 18:08:34.048608 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:34.048505    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/39988086-e8b6-43ed-bcac-947b2cf28d4e-proxy-tls\") pod \"39988086-e8b6-43ed-bcac-947b2cf28d4e\" (UID: \"39988086-e8b6-43ed-bcac-947b2cf28d4e\") "
Jul 21 18:08:34.048842 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:34.048808    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39988086-e8b6-43ed-bcac-947b2cf28d4e-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "39988086-e8b6-43ed-bcac-947b2cf28d4e" (UID: "39988086-e8b6-43ed-bcac-947b2cf28d4e"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 18:08:34.050723 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:34.050703    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39988086-e8b6-43ed-bcac-947b2cf28d4e-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "39988086-e8b6-43ed-bcac-947b2cf28d4e" (UID: "39988086-e8b6-43ed-bcac-947b2cf28d4e"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 18:08:34.149872 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:34.149814    2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/39988086-e8b6-43ed-bcac-947b2cf28d4e-proxy-tls\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 18:08:34.149872 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:34.149835    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39988086-e8b6-43ed-bcac-947b2cf28d4e-openshift-service-ca-bundle\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 18:08:34.498322 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:34.498238    2581 generic.go:356] "Generic (PLEG): container finished" podID="39988086-e8b6-43ed-bcac-947b2cf28d4e" containerID="c48a3883717fcac683f0a540554a64f76d9b707287ac46810ecce1d9046984bb" exitCode=0
Jul 21 18:08:34.498322 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:34.498282    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj"
Jul 21 18:08:34.498540 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:34.498285    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj" event={"ID":"39988086-e8b6-43ed-bcac-947b2cf28d4e","Type":"ContainerDied","Data":"c48a3883717fcac683f0a540554a64f76d9b707287ac46810ecce1d9046984bb"}
Jul 21 18:08:34.498540 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:34.498437    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj" event={"ID":"39988086-e8b6-43ed-bcac-947b2cf28d4e","Type":"ContainerDied","Data":"3d2dbf3a92d5414047f1c81807436af8c47396182de31e8ef110bdb58cb38528"}
Jul 21 18:08:34.498540 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:34.498477    2581 scope.go:117] "RemoveContainer" containerID="c48a3883717fcac683f0a540554a64f76d9b707287ac46810ecce1d9046984bb"
Jul 21 18:08:34.507088 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:34.507072    2581 scope.go:117] "RemoveContainer" containerID="c48a3883717fcac683f0a540554a64f76d9b707287ac46810ecce1d9046984bb"
Jul 21 18:08:34.507338 ip-10-0-135-98 kubenswrapper[2581]: E0721 18:08:34.507322    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c48a3883717fcac683f0a540554a64f76d9b707287ac46810ecce1d9046984bb\": container with ID starting with c48a3883717fcac683f0a540554a64f76d9b707287ac46810ecce1d9046984bb not found: ID does not exist" containerID="c48a3883717fcac683f0a540554a64f76d9b707287ac46810ecce1d9046984bb"
Jul 21 18:08:34.507397 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:34.507344    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c48a3883717fcac683f0a540554a64f76d9b707287ac46810ecce1d9046984bb"} err="failed to get container status \"c48a3883717fcac683f0a540554a64f76d9b707287ac46810ecce1d9046984bb\": rpc error: code = NotFound desc = could not find container \"c48a3883717fcac683f0a540554a64f76d9b707287ac46810ecce1d9046984bb\": container with ID starting with c48a3883717fcac683f0a540554a64f76d9b707287ac46810ecce1d9046984bb not found: ID does not exist"
Jul 21 18:08:34.518920 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:34.518897    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj"]
Jul 21 18:08:34.522771 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:34.522752    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/splitter-graph-afaec-6f497d467-xk7jj"]
Jul 21 18:08:35.125445 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:08:35.125411    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39988086-e8b6-43ed-bcac-947b2cf28d4e" path="/var/lib/kubelet/pods/39988086-e8b6-43ed-bcac-947b2cf28d4e/volumes"
Jul 21 18:11:15.212676 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:11:15.212576    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 18:11:15.222364 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:11:15.222347    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 18:15:18.108920 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:18.108887    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5"]
Jul 21 18:15:18.109560 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:18.109129    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5" podUID="ee9a7e45-62a3-498c-ae89-6e4232cd3b60" containerName="switch-graph-984cf" containerID="cri-o://5e1eecf5af79c37261f765c745bf48f5c9fa9fe202fc234f5368bae7ee3544e1" gracePeriod=30
Jul 21 18:15:20.915301 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:20.915266    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5" podUID="ee9a7e45-62a3-498c-ae89-6e4232cd3b60" containerName="switch-graph-984cf" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 18:15:25.915868 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:25.915828    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5" podUID="ee9a7e45-62a3-498c-ae89-6e4232cd3b60" containerName="switch-graph-984cf" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 18:15:30.915504 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:30.915462    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5" podUID="ee9a7e45-62a3-498c-ae89-6e4232cd3b60" containerName="switch-graph-984cf" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 18:15:30.915920 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:30.915623    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5"
Jul 21 18:15:34.826811 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:34.826776    2581 ???:1] "http: TLS handshake error from 10.0.136.21:57774: EOF"
Jul 21 18:15:34.829725 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:34.829701    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-984cf-684f6d5564-4wqx5_ee9a7e45-62a3-498c-ae89-6e4232cd3b60/switch-graph-984cf/0.log"
Jul 21 18:15:35.647542 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:35.647456    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-984cf-684f6d5564-4wqx5_ee9a7e45-62a3-498c-ae89-6e4232cd3b60/switch-graph-984cf/0.log"
Jul 21 18:15:35.915562 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:35.915466    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5" podUID="ee9a7e45-62a3-498c-ae89-6e4232cd3b60" containerName="switch-graph-984cf" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 18:15:36.464864 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:36.464836    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-984cf-684f6d5564-4wqx5_ee9a7e45-62a3-498c-ae89-6e4232cd3b60/switch-graph-984cf/0.log"
Jul 21 18:15:37.269396 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:37.269369    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-984cf-684f6d5564-4wqx5_ee9a7e45-62a3-498c-ae89-6e4232cd3b60/switch-graph-984cf/0.log"
Jul 21 18:15:38.094314 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:38.094285    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-984cf-684f6d5564-4wqx5_ee9a7e45-62a3-498c-ae89-6e4232cd3b60/switch-graph-984cf/0.log"
Jul 21 18:15:38.904862 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:38.904836    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-984cf-684f6d5564-4wqx5_ee9a7e45-62a3-498c-ae89-6e4232cd3b60/switch-graph-984cf/0.log"
Jul 21 18:15:39.706121 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:39.706088    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-984cf-684f6d5564-4wqx5_ee9a7e45-62a3-498c-ae89-6e4232cd3b60/switch-graph-984cf/0.log"
Jul 21 18:15:40.516654 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:40.516633    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-984cf-684f6d5564-4wqx5_ee9a7e45-62a3-498c-ae89-6e4232cd3b60/switch-graph-984cf/0.log"
Jul 21 18:15:40.915312 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:40.915221    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5" podUID="ee9a7e45-62a3-498c-ae89-6e4232cd3b60" containerName="switch-graph-984cf" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 18:15:41.327316 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:41.327287    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-984cf-684f6d5564-4wqx5_ee9a7e45-62a3-498c-ae89-6e4232cd3b60/switch-graph-984cf/0.log"
Jul 21 18:15:42.140322 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:42.140290    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-984cf-684f6d5564-4wqx5_ee9a7e45-62a3-498c-ae89-6e4232cd3b60/switch-graph-984cf/0.log"
Jul 21 18:15:42.952582 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:42.952553    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-984cf-684f6d5564-4wqx5_ee9a7e45-62a3-498c-ae89-6e4232cd3b60/switch-graph-984cf/0.log"
Jul 21 18:15:43.735371 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:43.735341    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-984cf-684f6d5564-4wqx5_ee9a7e45-62a3-498c-ae89-6e4232cd3b60/switch-graph-984cf/0.log"
Jul 21 18:15:44.562627 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:44.562601    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-984cf-684f6d5564-4wqx5_ee9a7e45-62a3-498c-ae89-6e4232cd3b60/switch-graph-984cf/0.log"
Jul 21 18:15:45.543461 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:45.543436    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve-ci-e2e-test_switch-graph-984cf-684f6d5564-4wqx5_ee9a7e45-62a3-498c-ae89-6e4232cd3b60/switch-graph-984cf/0.log"
Jul 21 18:15:45.915229 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:45.915134    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5" podUID="ee9a7e45-62a3-498c-ae89-6e4232cd3b60" containerName="switch-graph-984cf" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 21 18:15:48.267102 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:48.267082    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5"
Jul 21 18:15:48.365766 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:48.365689    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee9a7e45-62a3-498c-ae89-6e4232cd3b60-proxy-tls\") pod \"ee9a7e45-62a3-498c-ae89-6e4232cd3b60\" (UID: \"ee9a7e45-62a3-498c-ae89-6e4232cd3b60\") "
Jul 21 18:15:48.365766 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:48.365736    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee9a7e45-62a3-498c-ae89-6e4232cd3b60-openshift-service-ca-bundle\") pod \"ee9a7e45-62a3-498c-ae89-6e4232cd3b60\" (UID: \"ee9a7e45-62a3-498c-ae89-6e4232cd3b60\") "
Jul 21 18:15:48.366120 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:48.366091    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee9a7e45-62a3-498c-ae89-6e4232cd3b60-openshift-service-ca-bundle" (OuterVolumeSpecName: "openshift-service-ca-bundle") pod "ee9a7e45-62a3-498c-ae89-6e4232cd3b60" (UID: "ee9a7e45-62a3-498c-ae89-6e4232cd3b60"). InnerVolumeSpecName "openshift-service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 21 18:15:48.367816 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:48.367789    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee9a7e45-62a3-498c-ae89-6e4232cd3b60-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "ee9a7e45-62a3-498c-ae89-6e4232cd3b60" (UID: "ee9a7e45-62a3-498c-ae89-6e4232cd3b60"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 21 18:15:48.415907 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:48.415873    2581 generic.go:356] "Generic (PLEG): container finished" podID="ee9a7e45-62a3-498c-ae89-6e4232cd3b60" containerID="5e1eecf5af79c37261f765c745bf48f5c9fa9fe202fc234f5368bae7ee3544e1" exitCode=0
Jul 21 18:15:48.416071 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:48.415936    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5"
Jul 21 18:15:48.416071 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:48.415960    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5" event={"ID":"ee9a7e45-62a3-498c-ae89-6e4232cd3b60","Type":"ContainerDied","Data":"5e1eecf5af79c37261f765c745bf48f5c9fa9fe202fc234f5368bae7ee3544e1"}
Jul 21 18:15:48.416071 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:48.416031    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5" event={"ID":"ee9a7e45-62a3-498c-ae89-6e4232cd3b60","Type":"ContainerDied","Data":"a1b866522b6f2fca70df34f9349538ee891af59c9b3d3b78ed074e8984c65880"}
Jul 21 18:15:48.416071 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:48.416053    2581 scope.go:117] "RemoveContainer" containerID="5e1eecf5af79c37261f765c745bf48f5c9fa9fe202fc234f5368bae7ee3544e1"
Jul 21 18:15:48.424693 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:48.424678    2581 scope.go:117] "RemoveContainer" containerID="5e1eecf5af79c37261f765c745bf48f5c9fa9fe202fc234f5368bae7ee3544e1"
Jul 21 18:15:48.424947 ip-10-0-135-98 kubenswrapper[2581]: E0721 18:15:48.424930    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e1eecf5af79c37261f765c745bf48f5c9fa9fe202fc234f5368bae7ee3544e1\": container with ID starting with 5e1eecf5af79c37261f765c745bf48f5c9fa9fe202fc234f5368bae7ee3544e1 not found: ID does not exist" containerID="5e1eecf5af79c37261f765c745bf48f5c9fa9fe202fc234f5368bae7ee3544e1"
Jul 21 18:15:48.424997 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:48.424953    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e1eecf5af79c37261f765c745bf48f5c9fa9fe202fc234f5368bae7ee3544e1"} err="failed to get container status \"5e1eecf5af79c37261f765c745bf48f5c9fa9fe202fc234f5368bae7ee3544e1\": rpc error: code = NotFound desc = could not find container \"5e1eecf5af79c37261f765c745bf48f5c9fa9fe202fc234f5368bae7ee3544e1\": container with ID starting with 5e1eecf5af79c37261f765c745bf48f5c9fa9fe202fc234f5368bae7ee3544e1 not found: ID does not exist"
Jul 21 18:15:48.436367 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:48.436349    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5"]
Jul 21 18:15:48.439789 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:48.439768    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/switch-graph-984cf-684f6d5564-4wqx5"]
Jul 21 18:15:48.466610 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:48.466595    2581 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ee9a7e45-62a3-498c-ae89-6e4232cd3b60-proxy-tls\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 18:15:48.466673 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:48.466614    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ee9a7e45-62a3-498c-ae89-6e4232cd3b60-openshift-service-ca-bundle\") on node \"ip-10-0-135-98.ec2.internal\" DevicePath \"\""
Jul 21 18:15:49.125378 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:49.125340    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee9a7e45-62a3-498c-ae89-6e4232cd3b60" path="/var/lib/kubelet/pods/ee9a7e45-62a3-498c-ae89-6e4232cd3b60/volumes"
Jul 21 18:15:52.089962 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:52.089921    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vrb68_75f2dec8-5c4a-4312-9743-0429cc8c0034/global-pull-secret-syncer/0.log"
Jul 21 18:15:52.208117 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:52.208088    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vrcpb_1fba69f3-8ad4-4823-b6fb-c3a93e5e5613/konnectivity-agent/0.log"
Jul 21 18:15:52.261067 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:52.261042    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-98.ec2.internal_52a2fdb785bd958c3f182967e497262f/haproxy/0.log"
Jul 21 18:15:55.788660 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:55.788629    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2abfa793-fe8b-474e-8854-0fed95ec1067/alertmanager/0.log"
Jul 21 18:15:55.830949 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:55.830925    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2abfa793-fe8b-474e-8854-0fed95ec1067/config-reloader/0.log"
Jul 21 18:15:55.871456 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:55.871431    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2abfa793-fe8b-474e-8854-0fed95ec1067/kube-rbac-proxy-web/0.log"
Jul 21 18:15:55.912614 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:55.912593    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2abfa793-fe8b-474e-8854-0fed95ec1067/kube-rbac-proxy/0.log"
Jul 21 18:15:55.943551 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:55.943531    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2abfa793-fe8b-474e-8854-0fed95ec1067/kube-rbac-proxy-metric/0.log"
Jul 21 18:15:55.984857 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:55.984836    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2abfa793-fe8b-474e-8854-0fed95ec1067/prom-label-proxy/0.log"
Jul 21 18:15:56.019871 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:56.019853    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2abfa793-fe8b-474e-8854-0fed95ec1067/init-config-reloader/0.log"
Jul 21 18:15:56.237208 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:56.237120    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-66cc4d8469-hqj9w_55280080-4cf6-4bd5-98ad-06a6750d129f/metrics-server/0.log"
Jul 21 18:15:56.334128 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:56.334098    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2hdb6_92d9c4b7-2010-4bfb-af9d-bb81ff1e716f/node-exporter/0.log"
Jul 21 18:15:56.368452 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:56.368408    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2hdb6_92d9c4b7-2010-4bfb-af9d-bb81ff1e716f/kube-rbac-proxy/0.log"
Jul 21 18:15:56.399420 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:56.399395    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2hdb6_92d9c4b7-2010-4bfb-af9d-bb81ff1e716f/init-textfile/0.log"
Jul 21 18:15:56.626324 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:56.626299    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-6m2w8_ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c/kube-rbac-proxy-main/0.log"
Jul 21 18:15:56.651300 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:56.651242    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-6m2w8_ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c/kube-rbac-proxy-self/0.log"
Jul 21 18:15:56.681634 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:56.681608    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-6m2w8_ccaa5a14-dc5f-4ed0-87d8-39bdcd72cc1c/openshift-state-metrics/0.log"
Jul 21 18:15:57.046321 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:57.046297    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bb7f8949b-dljg7_38212eff-a6d4-41ea-9c6b-696d31528057/telemeter-client/0.log"
Jul 21 18:15:57.070708 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:57.070682    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bb7f8949b-dljg7_38212eff-a6d4-41ea-9c6b-696d31528057/reload/0.log"
Jul 21 18:15:57.094081 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:57.094059    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-bb7f8949b-dljg7_38212eff-a6d4-41ea-9c6b-696d31528057/kube-rbac-proxy/0.log"
Jul 21 18:15:57.124566 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:57.124545    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7fb48895-fn8bb_96dfb480-8daf-42e2-8d3c-4c50eee2487a/thanos-query/0.log"
Jul 21 18:15:57.150160 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:57.150142    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7fb48895-fn8bb_96dfb480-8daf-42e2-8d3c-4c50eee2487a/kube-rbac-proxy-web/0.log"
Jul 21 18:15:57.171891 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:57.171873    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7fb48895-fn8bb_96dfb480-8daf-42e2-8d3c-4c50eee2487a/kube-rbac-proxy/0.log"
Jul 21 18:15:57.198935 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:57.198917    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7fb48895-fn8bb_96dfb480-8daf-42e2-8d3c-4c50eee2487a/prom-label-proxy/0.log"
Jul 21 18:15:57.229970 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:57.229946    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7fb48895-fn8bb_96dfb480-8daf-42e2-8d3c-4c50eee2487a/kube-rbac-proxy-rules/0.log"
Jul 21 18:15:57.256536 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:57.256506    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7fb48895-fn8bb_96dfb480-8daf-42e2-8d3c-4c50eee2487a/kube-rbac-proxy-metrics/0.log"
Jul 21 18:15:59.645748 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:59.645722    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5468bd6b95-9hmzp_d0cf3182-0923-4eb9-90db-0ffcb6ab132a/console/0.log"
Jul 21 18:15:59.675849 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:15:59.675812    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-kv94m_26d1f966-465f-4fad-adfd-4dd1bd702287/download-server/0.log"
Jul 21 18:16:00.942893 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:00.942860    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv"]
Jul 21 18:16:00.943284 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:00.943237    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee9a7e45-62a3-498c-ae89-6e4232cd3b60" containerName="switch-graph-984cf"
Jul 21 18:16:00.943284 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:00.943249    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee9a7e45-62a3-498c-ae89-6e4232cd3b60" containerName="switch-graph-984cf"
Jul 21 18:16:00.943284 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:00.943279    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39988086-e8b6-43ed-bcac-947b2cf28d4e" containerName="splitter-graph-afaec"
Jul 21 18:16:00.943284 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:00.943285    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="39988086-e8b6-43ed-bcac-947b2cf28d4e" containerName="splitter-graph-afaec"
Jul 21 18:16:00.943420 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:00.943337    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="39988086-e8b6-43ed-bcac-947b2cf28d4e" containerName="splitter-graph-afaec"
Jul 21 18:16:00.943420 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:00.943350    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee9a7e45-62a3-498c-ae89-6e4232cd3b60" containerName="switch-graph-984cf"
Jul 21 18:16:00.946434 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:00.946416    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv"
Jul 21 18:16:00.948518 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:00.948499    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p4dfr\"/\"openshift-service-ca.crt\""
Jul 21 18:16:00.949579 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:00.949549    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p4dfr\"/\"default-dockercfg-85wwv\""
Jul 21 18:16:00.949658 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:00.949568    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p4dfr\"/\"kube-root-ca.crt\""
Jul 21 18:16:00.954188 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:00.954150    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv"]
Jul 21 18:16:00.964431 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:00.964411    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746-lib-modules\") pod \"perf-node-gather-daemonset-4j7zv\" (UID: \"a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746\") " pod="openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv"
Jul 21 18:16:00.964522 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:00.964450    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746-podres\") pod \"perf-node-gather-daemonset-4j7zv\" (UID: \"a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746\") " pod="openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv"
Jul 21 18:16:00.964522 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:00.964479    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746-sys\") pod \"perf-node-gather-daemonset-4j7zv\" (UID: \"a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746\") " pod="openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv"
Jul 21 18:16:00.964522 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:00.964498    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvl24\" (UniqueName: \"kubernetes.io/projected/a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746-kube-api-access-vvl24\") pod \"perf-node-gather-daemonset-4j7zv\" (UID: \"a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746\") " pod="openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv"
Jul 21 18:16:00.964639 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:00.964530    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746-proc\") pod \"perf-node-gather-daemonset-4j7zv\" (UID: \"a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746\") " pod="openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv"
Jul 21 18:16:01.065189 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:01.065136    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746-podres\") pod \"perf-node-gather-daemonset-4j7zv\" (UID: \"a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746\") " pod="openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv"
Jul 21 18:16:01.065354 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:01.065211    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746-sys\") pod \"perf-node-gather-daemonset-4j7zv\" (UID: \"a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746\") " pod="openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv"
Jul 21 18:16:01.065354 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:01.065229    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvl24\" (UniqueName: \"kubernetes.io/projected/a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746-kube-api-access-vvl24\") pod \"perf-node-gather-daemonset-4j7zv\" (UID: \"a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746\") " pod="openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv"
Jul 21 18:16:01.065354 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:01.065258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746-proc\") pod \"perf-node-gather-daemonset-4j7zv\" (UID: \"a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746\") " pod="openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv"
Jul 21 18:16:01.065354 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:01.065298    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746-lib-modules\") pod \"perf-node-gather-daemonset-4j7zv\" (UID: \"a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746\") " pod="openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv"
Jul 21 18:16:01.065354 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:01.065308    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746-podres\") pod \"perf-node-gather-daemonset-4j7zv\" (UID: \"a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746\") " pod="openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv"
Jul 21 18:16:01.065354 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:01.065337    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746-sys\") pod \"perf-node-gather-daemonset-4j7zv\" (UID: \"a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746\") " pod="openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv"
Jul 21 18:16:01.065594 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:01.065359    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746-proc\") pod \"perf-node-gather-daemonset-4j7zv\" (UID: \"a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746\") " pod="openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv"
Jul 21 18:16:01.065594 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:01.065413    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746-lib-modules\") pod \"perf-node-gather-daemonset-4j7zv\" (UID: \"a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746\") " pod="openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv"
Jul 21 18:16:01.073310 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:01.073285    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvl24\" (UniqueName: \"kubernetes.io/projected/a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746-kube-api-access-vvl24\") pod \"perf-node-gather-daemonset-4j7zv\" (UID: \"a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746\") " pod="openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv"
Jul 21 18:16:01.202329 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:01.202257    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zkt82_8f77df7d-c68e-44b1-8810-4c61c52e2d27/dns/0.log"
Jul 21 18:16:01.222874 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:01.222848    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zkt82_8f77df7d-c68e-44b1-8810-4c61c52e2d27/kube-rbac-proxy/0.log"
Jul 21 18:16:01.257389 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:01.257365    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv"
Jul 21 18:16:01.271438 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:01.271417    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-58wgl_8a3829cd-c60c-49da-a862-9554ec6a0e2b/dns-node-resolver/0.log"
Jul 21 18:16:01.388470 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:01.388329    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv"]
Jul 21 18:16:01.391189 ip-10-0-135-98 kubenswrapper[2581]: W0721 18:16:01.391152    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda0e8341a_6a4e_46c8_9ba8_b5baeb3ad746.slice/crio-faeeca02f6ceda6b80a1841d1c7de3c963ab81549a6b0b683a416afec25b9654 WatchSource:0}: Error finding container faeeca02f6ceda6b80a1841d1c7de3c963ab81549a6b0b683a416afec25b9654: Status 404 returned error can't find the container with id faeeca02f6ceda6b80a1841d1c7de3c963ab81549a6b0b683a416afec25b9654
Jul 21 18:16:01.477232 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:01.477146    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv" event={"ID":"a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746","Type":"ContainerStarted","Data":"344dfa29f10640157a5ad5598b96a230b4b11f5ab8247866530334c4788f1195"}
Jul 21 18:16:01.477232 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:01.477211    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv" event={"ID":"a0e8341a-6a4e-46c8-9ba8-b5baeb3ad746","Type":"ContainerStarted","Data":"faeeca02f6ceda6b80a1841d1c7de3c963ab81549a6b0b683a416afec25b9654"}
Jul 21 18:16:01.477430 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:01.477253    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv"
Jul 21 18:16:01.492902 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:01.492854    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv" podStartSLOduration=1.492839674 podStartE2EDuration="1.492839674s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 18:16:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 18:16:01.492081322 +0000 UTC m=+2986.892645392" watchObservedRunningTime="2026-07-21 18:16:01.492839674 +0000 UTC m=+2986.893403745"
Jul 21 18:16:01.803863 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:01.803832    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7c4d88bd77-d6qpg_ee9b3577-15a4-4dee-adbc-68674593a081/registry/0.log"
Jul 21 18:16:01.822979 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:01.822955    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-j8hgf_ca9f4acd-b386-4d33-9a03-ac667529f253/node-ca/0.log"
Jul 21 18:16:02.982866 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:02.982839    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gbssj_5be7304d-47e3-4590-afed-b4f6b09be876/serve-healthcheck-canary/0.log"
Jul 21 18:16:03.525383 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:03.525352    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rrwdh_ac75fb55-b0c9-4893-8fa3-2b41003858a1/kube-rbac-proxy/0.log"
Jul 21 18:16:03.545524 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:03.545491    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rrwdh_ac75fb55-b0c9-4893-8fa3-2b41003858a1/exporter/0.log"
Jul 21 18:16:03.568516 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:03.568496    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rrwdh_ac75fb55-b0c9-4893-8fa3-2b41003858a1/extractor/0.log"
Jul 21 18:16:05.721472 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:05.721443    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-6b69bf598b-znmjs_ecc53b5a-be74-4b17-b450-ca1b76e46aa7/manager/0.log"
Jul 21 18:16:05.749127 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:05.749100    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-654c557856-2gcz7_5c83e437-c5c8-433a-9dc2-8472fc4e722b/manager/0.log"
Jul 21 18:16:06.031918 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:06.031896    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-sbcfr_b149c0e9-4bda-4d29-93bd-b8b74664dd6e/seaweedfs/0.log"
Jul 21 18:16:07.490755 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:07.490727    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p4dfr/perf-node-gather-daemonset-4j7zv"
Jul 21 18:16:11.722053 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:11.722029    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x9w4v_fbbfd717-a4bd-4a5d-88fe-11b8e16e5443/kube-multus-additional-cni-plugins/0.log"
Jul 21 18:16:11.743267 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:11.743241    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x9w4v_fbbfd717-a4bd-4a5d-88fe-11b8e16e5443/egress-router-binary-copy/0.log"
Jul 21 18:16:11.769814 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:11.769787    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x9w4v_fbbfd717-a4bd-4a5d-88fe-11b8e16e5443/cni-plugins/0.log"
Jul 21 18:16:11.792749 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:11.792696    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x9w4v_fbbfd717-a4bd-4a5d-88fe-11b8e16e5443/bond-cni-plugin/0.log"
Jul 21 18:16:11.815549 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:11.815532    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x9w4v_fbbfd717-a4bd-4a5d-88fe-11b8e16e5443/routeoverride-cni/0.log"
Jul 21 18:16:11.841614 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:11.841598    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x9w4v_fbbfd717-a4bd-4a5d-88fe-11b8e16e5443/whereabouts-cni-bincopy/0.log"
Jul 21 18:16:11.865575 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:11.865556    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x9w4v_fbbfd717-a4bd-4a5d-88fe-11b8e16e5443/whereabouts-cni/0.log"
Jul 21 18:16:11.895901 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:11.895884    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-r55px_93f882ed-dbcf-40a5-b763-8d11c45c2813/kube-multus/0.log"
Jul 21 18:16:11.997105 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:11.997085    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w77vz_4402c8fb-d8a6-4c10-ab0f-acfa04695301/network-metrics-daemon/0.log"
Jul 21 18:16:12.016683 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:12.016666    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w77vz_4402c8fb-d8a6-4c10-ab0f-acfa04695301/kube-rbac-proxy/0.log"
Jul 21 18:16:12.827382 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:12.827346    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-controller/0.log"
Jul 21 18:16:12.845144 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:12.845115    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/1.log"
Jul 21 18:16:12.845319 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:12.845310    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 18:16:12.861810 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:12.861789    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/kube-rbac-proxy-node/0.log"
Jul 21 18:16:12.884816 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:12.884785    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/kube-rbac-proxy-ovn-metrics/0.log"
Jul 21 18:16:12.905565 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:12.905543    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/northd/0.log"
Jul 21 18:16:12.928533 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:12.928514    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/nbdb/0.log"
Jul 21 18:16:12.948157 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:12.948139    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/sbdb/0.log"
Jul 21 18:16:12.992837 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:12.992813    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovnkube-controller/0.log"
Jul 21 18:16:14.517152 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:14.517128    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-jxfq5_94d13840-ec8d-446a-8212-c0daa4a94012/network-check-target-container/0.log"
Jul 21 18:16:15.240839 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:15.240741    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 18:16:15.263084 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:15.250271    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-65gzx_6b03e7f6-2d72-4e82-8d25-ab3a7043533b/ovn-acl-logging/0.log"
Jul 21 18:16:15.463951 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:15.463927    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-qf4cm_5adb8d35-0a04-4f54-af3a-fb4c2f8ef1c2/iptables-alerter/0.log"
Jul 21 18:16:16.127981 ip-10-0-135-98 kubenswrapper[2581]: I0721 18:16:16.127953    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-hxw2v_f667bf8a-c9cb-43ca-b207-3b42f3283f4b/tuned/0.log"